Senior lead AI engineer, Gen AI platform

At Capital One, we are dedicated to developing responsible and reliable AI systems that aim to transform banking for the better. As a key player in leveraging machine learning for personalized customer experiences, we are investing in technology infrastructure and attracting top talent. Our Intelligent Foundations and Experiences (IFX) team is instrumental in realizing our AI vision, working closely with partners to advance AI engineering and build proprietary solutions that deliver value to millions. In this role, you will join us in harnessing the transformative potential of emerging AI capabilities. We offer a comprehensive benefits package that supports your overall well-being, and we welcome applicants from diverse backgrounds.

- Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus a minimum of 6 years of experience in AI and ML algorithms or technologies, or a Masters degree in the same fields plus at least 4 years of experience in AI and ML.
- At least 6 years of experience programming in Python, Go, Scala, or Java.
- 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (such as AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience in designing, developing, integrating, delivering, and supporting complex AI systems.
- Proven capability to lead and mentor an engineering team while influencing cross-functional stakeholders.
- Familiarity with developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang.
- Experience in enhancing training and inference software by applying advanced techniques to optimize hardware utilization, latency, throughput, and cost.
- Strong enthusiasm for keeping current with the latest AI research and effectively integrating novel techniques into production.
- Excellent communication and presentation skills, able to simplify and convey complex AI concepts to peers.

- Collaborate with a diverse team of engineers, research scientists, technical program managers, and product managers to create AI-driven products that transform how our associates work and our customers engage with Capital One.
- Design, develop, test, deploy, and maintain AI software components, including foundational model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Utilize a wide range of Open Source and SaaS AI technologies, such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and others.
- Innovate and implement cutting-edge LLM optimization techniques to enhance the performance of large-scale production AI systems in terms of scalability, cost-effectiveness, latency, and throughput.
- Contribute to the technical vision and long-term strategy of foundational AI systems within Capital One.