Sr. Machine Learning Engineer, Amazon General Intelligence (AGI)

Sr. Machine Learning Engineer, Amazon General Intelligence (AGI)

Job ID: | Amazon.com Services LLC - A57

Overview

Our Machine Learning training infrastructure (ML Infra) team designs, implements, and optimizes large-scale computing infrastructure that powers AI and machine learning initiatives. We leverage advanced hardware, software architectures, and distributed computing techniques to enable breakthrough research and product development across the company. We are seeking a Senior Machine Learning Engineer to lead the development of our next-generation ML training infrastructure. This is a high impact, high visibility role that shapes the future of our machine learning capabilities and advances AI technology across the industry.

Key responsibilities

• Lead the definition, design, architecture quality, implementation, and delivery of the most advanced, most difficult, most cross-cutting, and/or most ambiguous challenges spanning across our ML infrastructure.
• Align ML Infrastructure and related organizations to a coherent technical vision and deliver systems that fit well together.
• Influence multiple teams, increasing their productivity and effectiveness. Set a high bar for performance and efficiency, and guide teams with expert leadership.
• Act as an authority on technical issues, guiding difficult trade-off decisions and communicating the impact of technical choices on AI research and product development.
• Demonstrate innovation and judgement in solving AI/ML infrastructure problems. Identify future skills needed and advocate for their development or acquisition to senior leaders. Scout and recruit top talent.
• Mentor senior and Principal engineers and institutionalize best practices in AI/ML infrastructure and distributed computing across the organization.

A day in the life

• 8+ years of professional software development experience in distributed systems with emphasis on ML infrastructure.
• 8+ years of programming experience in languages such as Python, C++, or Rust.
• Hands-on experience with parallel computing platforms (e.g., CUDA, OpenMP).
• Deep understanding of AI frameworks (PyTorch, TensorFlow, JAX) and their demands on compute, memory, network, and storage at scale.
• Knowledge of emerging AI hardware accelerators and architectures.
• Experience with containerization and orchestration (Docker, Kubernetes).
• Experience with cloud platforms (AWS, Azure, GCP) and their offerings.

About the team

Join our AGI team and work at the forefront of AI. Collaborate with top minds in deep learning and reinforcement learning to accelerate your career. This is a unique opportunity to shape the future of artificial intelligence.
Mission: We leverage hyper-scalable, general-purpose large model training and inference systems to develop and deploy sensory AI foundational models that revolutionize machine perception and interaction with humans and the physical world.

BASIC QUALIFICATIONS

• 5+ years of non-internship professional software development experience
• 5+ years of programming experience in at least one software language
• 5+ years of leading design or architecture of new/existing systems
• Experience as a mentor, tech lead, or leading an engineering team

PREFERRED QUALIFICATIONS

• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations
• Bachelor’s degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $151,300/year to $261,500/year, with pay based on location and experience. Amazon is a total compensation company. Depending on the position offered, equity, sign-on, and other benefits may be provided. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

Posted: August 12, 2025 (Updated about 4 hours ago)

Posted: July 16, 2025 (Updated about 4 hours ago)

Posted: August 19, 2025 (Updated about 4 hours ago)

Posted: September 10, 2025 (Updated about 4 hours ago)

Posted: September 15, 2025 (Updated about 6 hours ago)

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.