About The Company

Capital One is a leading financial services organization committed to transforming banking through innovative technology and responsible AI systems. With a longstanding reputation for leveraging machine learning and data-driven insights, Capital One aims to enhance customer experiences by delivering personalized, real-time solutions. The company invests heavily in cutting-edge technology infrastructure and attracts world-class talent to maintain its industry leadership. Its focus on responsible AI development ensures that technological advancements align with ethical standards, fostering trust and reliability in its products and services. Capital One’s mission is to reimagine banking by integrating emerging AI capabilities, creating scalable, high-performance infrastructure, and delivering breakthrough product experiences that benefit both customers and the broader financial ecosystem.

About The Role

The Senior Distinguished Engineer, AI Compute role at Capital One is a strategic and hands-on technical leadership position focused on building and scaling foundational AI compute capabilities within the company's cloud-based enterprise platform. This role involves designing and implementing highly available, secure, multi-tenant systems that support a wide range of AI and machine learning workloads, including large language model training, inference, data processing, and generative AI applications. The ideal candidate will have extensive experience in distributed systems, cloud computing, and high-performance infrastructure, with a passion for developing scalable compute solutions on CPU and GPU substrates. As a key technical leader, you will collaborate across teams to optimize compute resources, automate workflows, and contribute to the evolution of Capital One’s AI platform, ensuring it remains at the forefront of technological innovation.

Qualifications

Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience in AI and ML technologies, or Master’s degree in the same fields plus at least 8 years of relevant experience
Minimum of 10 years programming experience with Python, Go, Scala, or Java
Experience in building large-scale, distributed systems and high-performance computing infrastructure
Deep understanding of cloud computing platforms, particularly AWS services such as EKS, EC2 UltraClusters, and Graviton
Proficiency with distributed compute frameworks like Spark, Dask, Ray, or Flink
Strong knowledge of containerization (Kubernetes) and serverless environments (AWS Lambda)
Experience with ML workload patterns, including model training, inference, and feature generation pipelines
Proven ability to lead complex technical projects and collaborate with cross-functional teams

Responsibilities

Architect and develop control and data plane implementations to support a highly available, secure, and multi-tenant AI platform
Design and implement distributed compute solutions using Ray and Spark to accelerate workloads such as LLM pre-training, reinforcement learning, and large-scale data processing
Optimize compute resource utilization and develop cost-effective strategies for high-throughput AI workloads
Automate operational workflows to ensure system reliability and efficiency, including routine maintenance and troubleshooting
Lead technical execution across multiple projects, collaborating with developers working on microservices, foundation models, and AI inference engines
Engage with product and program management teams to align technical solutions with business objectives
Stay current with emerging AI and cloud technologies, participating in internal and external tech communities
Mentor internal talent and contribute to the development of next-generation AI engineering capabilities within the organization
Promote best practices in system design, code review, and technical documentation

Benefits

Competitive salary packages aligned with experience and location
Performance-based incentives including bonuses and long-term incentives
Comprehensive health, dental, and vision insurance plans
Retirement savings plans with employer contributions
Generous paid time off and holiday leave
Flexible work arrangements, including remote work options
Opportunities for professional development and continuous learning
Inclusive and diverse workplace culture that values innovation and collaboration

Equal Opportunity

Capital One is an equal opportunity employer committed to fostering an inclusive environment. We do not discriminate based on race, color, religion, sex, national origin, age, disability, veteran status, or any other protected characteristic. We promote diversity and equal opportunity in all aspects of employment and are dedicated to creating a workplace where everyone can thrive. We comply with all applicable federal, state, and local laws regarding equal employment opportunity and non-discrimination. All qualified applicants will receive consideration for employment without regard to any protected status.