Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Job ID: R229391 | Posted: 11/05/2025

Overview

Capital One seeks to build responsible and reliable AI systems, changing banking for good. Capital One is an industry leader in using machine learning to create real-time, personalized customer experiences.

Team Description

The Intelligent Foundations and Experiences (IFX) team works to advance the state of the art in science and AI engineering and deploys proprietary solutions across the company. Their AI models empower teams across Capital One to enhance their products with the transformative power of AI, in responsible and scalable ways.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
• Invent LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems
• Contribute to technical vision and long-term roadmap of foundational AI systems

Ideal Candidate Profile

• You love building systems and share our passion to do the right thing
• Passionate about staying current with latest research and applying novel techniques in production
• Adapt quickly and thrive on bringing clarity to big, undefined problems
• Deeply technical with strong foundation in engineering and mathematics
• Resilient problem-solver who can forge new paths to achieve business goals when the route is unknown

Basic Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus minimum 4 years developing AI/ML algorithms or technologies; OR Master's degree in related field plus minimum 2 years experience
• Minimum 4 years programming experience with Python, Go, Scala, or Java

Preferred Qualifications

• 6 years deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience designing, developing, delivering, and supporting AI services
• Experience developing AI/ML algorithms using Python, C++, C#, Java, or Golang
• Experience optimizing training and inference software for hardware utilization, latency, throughput, and cost
• Passion for latest AI research and applying novel techniques in production

Locations & Salary

• Cambridge, MA: $193,400 - $220,700
• McLean, VA: $193,400 - $220,700
• New York, NY: $211,000 - $240,800
• San Francisco, CA: $211,000 - $240,800
• San Jose, CA: $211,000 - $240,800

Role is eligible for performance-based incentive compensation including cash bonuses and/or long-term incentives.

Additional Information

• Category: Engineering
• Experience Level: Manager
• Sponsorship available for qualified applicants
• Comprehensive benefits package available
• Equal opportunity employer
• Application period: minimum 5 business days
• No agencies