ML Compiler Engineer , AWS Neuron, Annapurna Labs
Posted 7 hours 24 minutes ago by Amazon
At AWS our vision is to make deep learning pervasive for everyday developers and to democratize access to innovative infrastructure. In order to deliver on that vision, we've created innovative software and hardware solutions that make it possible.
AWS Neuron is the SDK that optimizes the performance of complex neural net models executed on AWS Inferentia and Trainium, our custom chips designed to accelerate deep-learning workloads. The Neuron SDK consists of a compiler, run-time, and debugger, integrated with Tensorflow, PyTorch, and MXNet. It's preinstalled in AWS Deep Learning AMIs and Deep Learning Containers for customers to quickly get started with running high performance and cost-effective inference.
The Neuron team is hiring senior compiler engineers in order to solve our customers toughest problems. This is an opportunity to work on innovative products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish innovative research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We’re inventing. We’re experimenting. It is a very unique learning culture.
As a senior deep learning compiler engineer on the Neuron team, you will be a thought leader supporting the development of a compiler targeting AWS Inferentia and Trainum. You will be developing and scaling the compiler to handle the world's largest ML workloads. You will need to be technically capable, credible and curious in your own right as a trusted AWS Neuron engineer, innovating on behalf of our customers. You will leverage your technical communications skill as a hands-on partner to AWS ML services teams and you will be involved in pre-silicon design, bringing new products/features to market, and many other exciting projects. A background in machine learning and AI accelerators is preferred, but not required.
Explore the product and our history!
About the team
BASIC QUALIFICATIONS- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor’s degree in computer science or equivalent
- Experience in compiler design for CPU/GPU/Vector engines/ML-accelerators
- Experience with System Level performance analysis and optimization
- Experience with LLVM and/or MLIR
- Experience with the following technologies: PyTorch, OpenXLA, StableHLO, JAX, TVM, deep learning models, and algorithms
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.