Lead AI Engineer (Gen AI Platform, Agentic AI & LLM Infrastructure & Orchestration)
AI Tools
Tech Stack
Agent Workflow
Build foundational AI systems including agentic AI infrastructure, LLM orchestration, guardrails, and memory systems for production-scale enterprise applications.
About the Role
Capital One is hiring a Lead AI Engineer for their Gen AI Platform team focusing on Agentic AI & LLM Infrastructure & Orchestration.
Job ID: R238534 Posted: March 19, 2026
You will design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. The team develops state-of-the-art LLM optimization techniques to improve the performance (scalability, cost, latency, throughput) of large scale production AI systems.
You will partner across teams to deliver AI-powered products and contribute to long-term foundational AI system strategy.
Required Skills
- Bachelor's degree in Computer Science/AI/Engineering + 4 years AI/ML experience, OR Master's + 2 years
- 4+ years programming in Python, Go, Scala, or Java
- Experience with AWS Ultraclusters, Hugging Face, PyTorch
- LLM inference, vector databases, guardrails technologies
Preferred Qualifications
- 6+ years deploying scalable AI solutions on cloud platforms (AWS, GCP, Azure)
- Experience with LLM inference, similarity search, VectorDBs, guardrails, and memory systems
- Optimization expertise for training/inference software
- Knowledge of state-of-the-art training/inference optimization techniques
Locations: San Jose, CA (primary). Also available: Cambridge MA, McLean VA, New York NY, San Francisco CA.
Salary: $215,200 - $245,600 (San Francisco/San Jose), plus performance-based incentives.
Capital One offers visa sponsorship consideration for qualified candidates.
