Senior AI Systems Engineer (Foundation Models & LLM Inference)

Join Capital One as a Senior AI Systems Engineer, where you'll play a vital role in transforming banking through innovative AI solutions. You will lead the design, development, and optimization of scalable AI and machine learning systems with a focus on foundation models and large language model inference. This is your chance to collaborate with a dynamic team to create cutting-edge AI-powered products that enhance customer experiences and improve internal processes.

Overview

At Capital One, we are committed to creating responsible and reliable AI systems that revolutionize banking. With a strong industry reputation for leveraging machine learning to create personalized customer experiences, we continue investing in advanced technologies and top talent to push the boundaries of AI in financial services.

Team Description

The Intelligent Foundations and Experiences (IFX) team is key to our AI vision at Capital One. Working closely with various business units, we advance the art of AI engineering and build proprietary solutions that deliver significant value to millions of customers worldwide. Our AI models power teams across the organization, offering transformative capabilities in a responsible and scalable manner.

In this role, you will

• Collaborate with a cross-functional team that includes engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that enhance associate operations and customer interactions.
• Design, develop, test, deploy, and support AI software components such as foundation model training and large language model inference.
• Utilize a wide array of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
• Introduce novel LLM optimization techniques to enhance the performance, scalability, and cost-effectiveness of large-scale production AI systems.
• Contribute to the long-term technical vision and roadmap for foundational AI systems at Capital One.

The Ideal Candidate

• You are dedicated to building high-quality systems and are passionate about making a positive change in banking.
• You stay informed about the latest AI research and can effectively apply new techniques in production environments.
• You thrive in ambiguous situations, uncovering and clarifying complex problems while clearly articulating your insights.
• You possess strong technical skills in engineering and mathematics, enabling you to identify optimization opportunities effectively.
• You are a resilient innovator who can navigate uncharted paths to achieve business objectives.

Basic Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience in AI and ML development, or a Master's degree in the same fields plus at least 2 years of relevant experience.
• At least 4 years of programming experience in Python, Go, Scala, or Java.

Preferred Qualifications

• 6 years of experience in deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, etc.).
• Experience designing, developing, delivering, and supporting AI services.
• Expertise in AI and ML technologies, including LLM Inference, Similarity Search and VectorDBs, and Guardrails using programming languages such as Python, C++, C#, Java, or Golang.
• Experience optimizing training and inference software for performance improvements.
• Strong interest in the latest AI research and technology.

Capital One is proud to be an equal opportunity employer, committed to diversity and inclusion in the workplace.

Location: Cambridge, MA; McLean, VA; New York, NY; San Francisco, CA; San Jose, CA.