Sr. TPM Neuron Compiler, Annapurna Labs

Company: Amazon Development Center U.S., Inc.
Location: Seattle
Posted on: June 26, 2025

Job Description:

Job Description The AWS Neuron Compiler team is seeking an experienced and motivated Sr TPM to lead and increase efficiency and predictability of our LLM model enablement program. This is a unique opportunity for someone who is passionate about machine learning, compilers, chip design, and software development. Your mission is to enable software developers and leaders developing machine learning models on Inferentia and Trainium chips to more efficiently plan, develop, and deploy advanced machine learning models. You will work backward to understand the needs our our engineering teams and create a compelling vision and strategy to improve requirement gathering, execution, and disseminating roadmaps and results. You will turn that vision into actionable plans that are written as clear, compelling narratives that leaders at all levels can understand. You will break that plan into easy to understand tasks and deliverables and work with engineering leaders to quickly and efficiently prioritize and implement the most important compiler capabilities, and deliver them together with customers, inference, and training teams. This role is hands-on and requires a mix of individual delivery and scaling through others. To be successful in this role you must be customer obsessed, understand concepts of low-level computer hardware and large language models. You need to be able to quickly learn about and deeply understand the needs of developers. You will be expected to invent on behalf of our developers and create new and innovative ideas that accelerate the development of delivery of new model and model variants on the current and future Trainium/Inferentia hardware. You must care deeply about operations and the developer experience and should be comfortable working with senior engineers and leaders to establish new concepts and best practices. Inside Amazon you will be a recognized expert in your field and will be responsible for effectively and reliably communicating project status to senior leaders and stakeholders. In this role, you will also write monthly and weekly business reviews and participate in strategic planning documents such as 3 Year plans, OP1 and Yearly Goals and present them to senior leaders across Amazon. The right candidate will possess a strong operations background as well as program management experience. You must excel at written and verbal communications. You will have experience with developer tools and software development processes. You must be able to thrive and succeed in an entrepreneurial environment, and not be hindered by ambiguity or competing priorities. This means anticipating bottlenecks, making tradeoffs and balancing the needs of the business versus technical constraints. Cross-team coordination, project management and an ability to learn and understand new technology are essential. Mentor We have a formal mentor search application that lets you find a mentor that works best for you based on location, job family, job level etc. Your manager can also help you find a mentor or two, because two is better than one. In addition to formal mentors, we work and train together so that we are always learning from one another, and we celebrate and support the career progression of our team members. Inclusion Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and we host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. Work-Life Balance We offer flexibility in working hours and encourage you to find your own balance between your work and personal life. A day in the life * Work backward from the customer or partner to build a compelling vision and strategy * Take input from business and engineer leaders to prioritize plans * Develop frameworks, processes and practices with engineers, managers, and business leaders * Manage cross org delivery program and backlog helping teams make strategic trade-offs on how to prioritize work * Identify and prioritize investments in engineering excellence * Mentor other program managers and engineers * Communicate program updates through narratives and reports BASIC QUALIFICATIONS- * 7 years of experience working directly with engineering teams - * Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules - * 5 years of technical program management experience - * Knowledge of machine learning concepts and development tools (such as compilers, profilers, debuggers). - * Knowledge of developer tooling across the software development life cycle (task management, source code, building, deployment, operations, real-time communication) - * Experience planning and delivering of software components (such as compilers and debugging tools). PREFERRED QUALIFICATIONS- 5 years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience - Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules - Experience defining KPI's/SLA's used to drive multi-million dollar businesses and reporting to senior leadership - * Experience in delivering machine learning models, compilers, or chips. - * Working with a team across geographies, team cultures, and multiple time zones. - * Ability to excel in a fast-paced, startup-like environment Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $133,900/year in our lowest geographic market up to $231,400/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.

Keywords: Amazon Development Center U.S., Inc., Everett , Sr. TPM Neuron Compiler, Annapurna Labs, Engineering , Seattle, Washington