Senior Lead AI Engineer, Gen AI Platform @ Capital One

Salary: $229,900 - 286,200 per year

Requirements:

• We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 6 years of experience developing AI and ML algorithms or technologies, or a masters degree in one of these fields plus at least 4 years of relevant experience.
• We require at least 6 years of programming experience with Python, Go, Scala, or Java.
• We prefer candidates with 7 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud environments.
• We value experience designing, building, integrating, delivering, and supporting complex AI systems.
• We look for proven ability to lead and mentor engineering teams and influence cross-functional stakeholders.
• We prefer experience developing AI and ML technologies such as LLM inference, similarity search and vector databases, guardrails, and memory using Python, C++, C#, Java, or Golang.
• We look for experience applying advanced optimization techniques to improve training and inference performance, hardware utilization, latency, throughput, and cost.
• We value a strong interest in current AI research and the judgment to apply new methods in production.
• We prefer excellent communication and presentation skills with the ability to explain complex AI concepts clearly to peers.

Responsibilities:

• We partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers engage with Capital One.
• We design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• We use open source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, vector databases, NeMo Guardrails, PyTorch, and similar tools.
• We create and apply state-of-the-art LLM optimization techniques to improve scalability, cost efficiency, latency, and throughput in large-scale production AI systems.
• We contribute to the technical strategy and long-term roadmap for foundational AI systems at Capital One.

Technologies:

• AI
• AWS
• Azure
• C#
• Cloud
• Golang
• Hardware
• Support
• Java
• LLM
• PyTorch
• Python
• Scala
• Machine Learning

More:

We are building responsible and reliable AI systems to transform banking for good. Our Intelligent Foundations and Experiences (IFX) team sits at the center of our AI vision, working across the company to advance applied science and AI engineering while building proprietary solutions that deliver value to millions of customers. This senior lead role is based in locations such as McLean, New York, and San Jose, and offers a competitive salary range that varies by location, performance-based incentives, and a comprehensive benefits package supporting overall well-being. We also support qualified applicants with employment authorization sponsorship where applicable.

last updated 24 week of 2026