Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Capital One is hiring a Lead AI Engineer on the AI Foundations team covering LLM Core and Agentic AI. You'll partner with cross-functional teams to deliver AI-powered products, designing and deploying AI software components including foundation model inference, similarity search, guardrails, and agentic AI.

What you'll do:

• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage LLM optimization techniques for production systems
• Work with VectorDBs, Nemo Guardrails, and AWS Ultraclusters
• Collaborate across teams on AI-powered products

What we're looking for:

• 4+ years AI/ML experience with Bachelor's, or 2+ years with Master's
• Proficiency in Python, Go, Scala, Java
• Experience with PyTorch, Hugging Face
• AWS experience required

Locations:

• New York, NY / San Francisco, CA / San Jose, CA: $215,200 - $245,600
• Cambridge, MA / McLean, VA: $197,300 - $225,100