Ml Compiler Engineer Aws Neuron Annapurna Labs jobs at Amazon in Canada, Old Toronto

Key job responsibilities
• Design and develop a state-of-the-art Agentic service platform using Gen AI/ML technologies that provide consistent, well-reasoned outcomes for advertiser guidance in a secure & reusable architecture, delivering low latency and secure advertiser experiences
• Optimizing for operation costs at scale through efficient resource utilization, token consumption and memory footprint at scale.
• Collaborate with cross-functional teams to integrate AI-driven solutions across our advertising ecosystem
• Pioneer new approaches to conversational AI and natural language interactions in advertising
• Shape the future of how businesses connect with customers through AI-powered advertising
• Create scalable systems that process millions of data points to deliver hyper-personalized ad experiencesWhat we're looking for:
• Passionate about Generative AI, Large Language Models, and their real-world applications
• Strong software engineering skills with experience in distributed systems and cloud technologies
• Creative problem-solver who thrives in ambiguity and loves tackling complex challenges
• Track record of delivering innovative solutions that drive business impact
• Enthusiasm for staying current with the rapidly evolving AI landscape
A day in the life• Highly analytical: You solve problems in ways that can be backed up with verifiable data. You focus on driving processes, tools, and statistical methods which support rational decision-making.
• Team obsessed: You help the team achieve outstanding results. You foster the creative atmosphere to let engineers innovate, while holding them accountable for making smart decisions and delivering results.
• Humbitious: You’re ambitious, yet humble. You recognize that there’s always opportunity for improvement and use introspection and feedback from teammates and peers to raise the bar for your team.
• Engaged by ambiguity: You're able to explore new problem spaces with unique constraints and thus non-obvious solutions; you’re quick to identify any gaps in the team and the right person to fill them to best deliver value to customers
• Passionate for staying current with the latest developments in AI technologies and applying those insights to real-world product challengesWhy join us?
• Be part of a team that's defining the future of AI in advertising
• Work on projects with massive scale and impact, reaching millions of businesses and consumers
• Collaborate with world-class AI researchers and engineers
• Access to cutting-edge AI technologies and resources

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Proven experience shipping Gen AI-powered features at scale from pilot to production and a deep understanding of AI trust and safety considerations

Key job responsibilities
• Design and develop a state-of-the-art Agentic service platform using Gen AI/ML technologies that provide consistent, well-reasoned outcomes for advertiser guidance in a secure & reusable architecture, delivering low latency and secure advertiser experiences
• Optimizing for operation costs at scale through efficient resource utilization, token consumption and memory footprint at scale.
• Collaborate with cross-functional teams to integrate AI-driven solutions across our advertising ecosystem
• Pioneer new approaches to conversational AI and natural language interactions in advertising
• Shape the future of how businesses connect with customers through AI-powered advertising
• Create scalable systems that process millions of data points to deliver hyper-personalized ad experiencesWhat we're looking for:
• Passionate about Generative AI, Large Language Models, and their real-world applications
• Strong software engineering skills with experience in distributed systems and cloud technologies
• Creative problem-solver who thrives in ambiguity and loves tackling complex challenges
• Track record of delivering innovative solutions that drive business impact
• Enthusiasm for staying current with the rapidly evolving AI landscape
A day in the life• Highly analytical: You solve problems in ways that can be backed up with verifiable data. You focus on driving processes, tools, and statistical methods which support rational decision-making.
• Team obsessed: You help the team achieve outstanding results. You foster the creative atmosphere to let engineers innovate, while holding them accountable for making smart decisions and delivering results.
• Humbitious: You’re ambitious, yet humble. You recognize that there’s always opportunity for improvement and use introspection and feedback from teammates and peers to raise the bar for your team.
• Engaged by ambiguity: You're able to explore new problem spaces with unique constraints and thus non-obvious solutions; you’re quick to identify any gaps in the team and the right person to fill them to best deliver value to customers
• Passionate for staying current with the latest developments in AI technologies and applying those insights to real-world product challengesWhy join us?
• Be part of a team that's defining the future of AI in advertising
• Work on projects with massive scale and impact, reaching millions of businesses and consumers
• Collaborate with world-class AI researchers and engineers
• Access to cutting-edge AI technologies and resources

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Proven experience shipping Gen AI-powered features at scale from pilot to production and a deep understanding of AI trust and safety considerations

Key job responsibilities
As a Software Development Engineer,- You will solve technical challenges and act as a mentor to other junior engineers.
- Given that this is an early-stage initiative, you'll play an active role in translating business and functional requirements into concrete deliverables and build quick prototypes or proofs of concept in partnership with other technology leaders within the team.
- You will help invent new features, design, develop and deploy highly scalable and reliable distributed services.
- You will work with a variety of core languages (primarily Java and Python) and technologies (AWS).
- You will work closely with Product Managers, Engineers and Applied Scientists.

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques
A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:Participate in design discussions, code review, and communicate with internal and external stakeholders.Work in a startup-like development environment, where you’re always working on the most important stuff.About the team
#1. Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.

- 3+ years of non-internship professional software development experience
- 3+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures
- Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm
- Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA
- Experience developing high performance libraries for HPC applications
- Proficiency in low-level performance optimization for GPUs
- Experience with LLVM/MLIR backend development for GPUs
- Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends
- Experience with parallel programming and optimization techniques
- Understanding of GPU memory hierarchies and optimization strategies

Key job responsibilitiesDevelops and maintains code for .NET web based enterprise applications.Experiments with AI tools.Works with all departments to define and document business requirements.Prepares diagrams, design documentation, and project documents.Thoroughly test code and verify performance to requirements prior to UAT and launchWrites clear, concise and detailed solution design and technical documentation.Compiles, organizes, analyzes and uses technical data to solve problems.Delivers projects (design, coding, testing, implementation, and support) on time and within budget.
A day in the lifeAs a member of the team, you will be hands on with a wide array of software applications.You will use your skills and experience to participate in and deliver with all phases of the project lifecycle. End to end ownership is yours.You will review requirements, propose solution designs, set project timelines, and be responsible to delivered agreed upon functionality within scope and on time.Following and establishing new best practices are keys to providing the highly consistent and scalable solutions needed to meet the demands of this key role

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent

The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements and business objectives. You'll be a key player in driving customer success through their cloud journey, providing technical expertise and best practices throughout the project lifecycle.
Possessing a deep understanding of AWS products and services, as a Delivery Consultant you will be proficient in architecting complex, scalable, and secure solutions tailored to meet the specific needs of each customer. You’ll work closely with stakeholders to gather requirements, assess current infrastructure, and propose effective migration strategies to AWS. As trusted advisors to our customers, providing guidance on industry trends, emerging technologies, and innovative solutions, you will be responsible for leading the implementation process, ensuring adherence to best practices, optimizing performance, and managing risks throughout the project.
Key job responsibilities
As an experienced technology professional, you will be responsible for:
1. Designing and implementing complex, scalable, and secure AWS solutions tailored to customer needs
2. Providing technical guidance and troubleshooting support throughout project delivery
3. Collaborating with stakeholders to gather requirements and propose effective migration strategies
4. Acting as a trusted advisor to customers on industry trends and emerging technologies
5. Sharing knowledge within the organization through mentoring, training, and creating reusable artifacts
About the team
Diverse Experiences: AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job below, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.Mentorship & Career Growth - We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

• 2+ years implementing cloud architecture
• Bachelor's degree in Computer Science, Engineering, related field, or equivalent experience
• 2+ years experience with one of the following programming languages/technologies: Java, Python, Ruby, Node.js, C, or C++

• AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation)
• Strong communication skills with the ability to explain technical concepts to both technical and non-technical audiences
• 2+ years implementing Data platforms
• Hands on experience with building data or machine learning pipeline
• Experience with one or more relevant tools (SQL, PostgreSQL, Data lake, DynamoDB, Hadoop)

As a Software Development Engineer (SDE) intern, you'll take everything you've learned in the classroom and apply it to projects that impact millions of customers worldwide. Instead of theoretical assignments, you'll build real features that customers use every day. You'll work alongside experienced engineers who are invested in your success, sharing their knowledge and helping you grow. The code you write won't be graded and forgotten - it will run in production, serving real customers across the globe. This is your chance to learn how to scale applications beyond anything you've tackled in your coursework.
Key job responsibilities
• Collaborate and communicate effectively with experienced cross-disciplinary Amazonians to design, build, and operate innovative products and services that delight our customers, while participating in technical discussions to drive solutions forward.
• Design and develop scalable solutions using cloud-native architectures and microservices in a large distributed computing environment.
• Participate in code reviews and contribute to technical documentation.
• Build and maintain resilient distributed systems that are scalable, fault-tolerant, and cost-effective.
• Leverage and contribute to the development of GenAI and AI-powered tools to enhance development productivity while staying current with emerging technologies.
• Write clean, maintainable code following best practices and design patterns.
• Work in an agile environment practicing CI/CD principles while participating in operational responsibilities including on-call duties.
• Demonstrate operational excellence through monitoring, troubleshooting, and resolving production issues.
A day in the life
As an intern, you will be matched to a manager and a mentor and will have the opportunity to influence the evolution of Amazon technology and lead critical projects early in your career.

- Are 18 years of age or older
- Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design
- Experience with AI/ML technologies
- Are enrolled in a Bachelor's degree or above in Computer Science, Computer Engineering, Data Science, Electrical Engineering, or related STEM fields, with an expected graduation date after October 2026

- Experience communicating technical concepts and processes using clear, simple language and visuals
- Experience in GenAI and Agent service development using LLM/VLM.
- Previous technical internship(s) or demonstrated project experience
- Strong problem-solving and analytical skills
- Demonstrated ability to learn and adapt to new technologies quickly
- Basic understanding of software development lifecycle (SDLC)