Lead AI Engineer (Gen AI Platform, Agentic AI & LLM Infrastructure & Orchestration)

Capital One is hiring a Lead AI Engineer for their Gen AI Platform team focusing on Agentic AI & LLM Infrastructure & Orchestration.

Job ID: R238534 Posted: March 19, 2026

You will design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. The team develops state-of-the-art LLM optimization techniques to improve the performance (scalability, cost, latency, throughput) of large scale production AI systems.

You will partner across teams to deliver AI-powered products and contribute to long-term foundational AI system strategy.

Required Skills

• Bachelor's degree in Computer Science/AI/Engineering + 4 years AI/ML experience, OR Master's + 2 years
• 4+ years programming in Python, Go, Scala, or Java
• Experience with AWS Ultraclusters, Hugging Face, PyTorch
• LLM inference, vector databases, guardrails technologies

Preferred Qualifications

• 6+ years deploying scalable AI solutions on cloud platforms (AWS, GCP, Azure)
• Experience with LLM inference, similarity search, VectorDBs, guardrails, and memory systems
• Optimization expertise for training/inference software
• Knowledge of state-of-the-art training/inference optimization techniques

Locations: San Jose, CA (primary). Also available: Cambridge MA, McLean VA, New York NY, San Francisco CA.

Salary: $215,200 - $245,600 (San Francisco/San Jose), plus performance-based incentives.

Capital One offers visa sponsorship consideration for qualified candidates.