Sr Software Development Manager - Compiler Aws Neuron Annapurna Labs jobs at Amazon in Canada, Old Toronto

Key job responsibilities
• Design and develop a state-of-the-art Agentic service platform using Gen AI/ML technologies that provide consistent, well-reasoned outcomes for advertiser guidance in a secure & reusable architecture, delivering low latency and secure advertiser experiences
• Optimizing for operation costs at scale through efficient resource utilization, token consumption and memory footprint at scale.
• Collaborate with cross-functional teams to integrate AI-driven solutions across our advertising ecosystem
• Pioneer new approaches to conversational AI and natural language interactions in advertising
• Shape the future of how businesses connect with customers through AI-powered advertising
• Create scalable systems that process millions of data points to deliver hyper-personalized ad experiencesWhat we're looking for:
• Passionate about Generative AI, Large Language Models, and their real-world applications
• Strong software engineering skills with experience in distributed systems and cloud technologies
• Creative problem-solver who thrives in ambiguity and loves tackling complex challenges
• Track record of delivering innovative solutions that drive business impact
• Enthusiasm for staying current with the rapidly evolving AI landscape
A day in the life• Highly analytical: You solve problems in ways that can be backed up with verifiable data. You focus on driving processes, tools, and statistical methods which support rational decision-making.
• Team obsessed: You help the team achieve outstanding results. You foster the creative atmosphere to let engineers innovate, while holding them accountable for making smart decisions and delivering results.
• Humbitious: You’re ambitious, yet humble. You recognize that there’s always opportunity for improvement and use introspection and feedback from teammates and peers to raise the bar for your team.
• Engaged by ambiguity: You're able to explore new problem spaces with unique constraints and thus non-obvious solutions; you’re quick to identify any gaps in the team and the right person to fill them to best deliver value to customers
• Passionate for staying current with the latest developments in AI technologies and applying those insights to real-world product challengesWhy join us?
• Be part of a team that's defining the future of AI in advertising
• Work on projects with massive scale and impact, reaching millions of businesses and consumers
• Collaborate with world-class AI researchers and engineers
• Access to cutting-edge AI technologies and resources

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Proven experience shipping Gen AI-powered features at scale from pilot to production and a deep understanding of AI trust and safety considerations

As a Sr. Delivery Consultant - Application Modernization, you will be proficient in leading the architecture of complex, scalable, and secure solutions tailored to meet the specific needs of each customer. You’ll work closely with stakeholders to gather requirements, assess current applications, and propose effective migration strategies to AWS. As trusted advisors to our customers, providing guidance on industry trends, emerging technologies, and innovative solutions, you will be responsible for leading the implementation process, ensuring adherence to best practices, optimizing performance, and managing risks throughout the project.Key job responsibilities
As an experienced technology professional, you will be responsible for:
1. Leading the design and implementation of complex, scalable, and secure AWS solutions tailored to customer needs
2. Provide technical guidance and troubleshooting support throughout project delivery
3. Collaborating with stakeholders to gather requirements and propose effective migration strategies
4. Acting as a trusted advisor to customers on industry trends and emerging technologies
5. Sharing knowledge within the organization through mentoring, training, and creating reusable artifacts
6. Experience as a tech lead or leading a high performing consulting teamDiverse Experiences
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.Mentorship & Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.Work/Life Balance

- 5+ years of experience in cloud architecture and implementation
- Bachelor’s degree in computer science, Engineering, related field, or equivalent experience
- Experience leading application architecture/design/modernization projects, including cloud-based solutioning (AWS or equivalent), with AI and automation
- Experience with Infrastructure as Code (IaC) tools and practices

- AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation)
- AWS Professional level certifications (e.g., Solutions Architect Professional, DevOps Engineer Professional) preferred
- Experience with automation and scripting (e.g., Terraform, Python)
- Knowledge of security and compliance standards (e.g., HIPAA, GDPR)
- Strong communication skills with the ability to explain technical concepts to both technical and non-technical audiences
- Experience leading large-scale software development and modernization initiatives, with deep expertise in multiple programming languages (e.g. Java, Python, C++, JavaScript, Microservices) and Generative AI tools/technologies
- Proven ability to lead software engineering best practices across testing, source control, code reviews, and deployment/release management processes

Key job responsibilities
• Design and develop a state-of-the-art Agentic service platform using advanced Gen AI/ML technologies that provide consistent, well-reasoned outcomes for advertiser guidance in a secure & reusable architecture, delivering low latency and secure advertiser experiences
• Lead business and science strategy and roadmap for the team
• Design and build agents to guide advertisers in conversational and non-conversational experience.
• Design and implement advanced model and agent optimization techniques, including supervised fine-tuning, instruction tuning and preference optimization (e.g., DPO/IPO).
• Curate datasets and tools for MCP.
• Build evaluation pipelines for agent workflows, including automated benchmarks, multi-step reasoning tests, and safety guardrails.
• Collaborate with peers across engineering and product to bring scientific innovations into production.
• Stay current with the latest research in LLMs, RL, and agent-based AI, and translate findings into practical applications.
A day in the life• Highly analytical: You solve problems in ways that can be backed up with verifiable data. You focus on driving processes, tools, and statistical methods which support rational decision-making.
• Team obsessed: You help the team achieve results. You foster the creative atmosphere to let engineers innovate, while holding them accountable for making smart decisions and delivering results.
• Humbitious: You’re ambitious, yet humble. You recognize that there’s always opportunity for improvement and use introspection and feedback from teammates and peers to raise the bar for your team.
• Engaged by ambiguity: You're able to explore new problem spaces with unique constraints and thus non-obvious solutions; you’re quick to identify any gaps in the team and the right person to fill them to best deliver value to customers
• Passionate for staying current with the latest developments in AI technologies and applying those insights to real-world product challenges

- 3+ years of building machine learning models for business application experience
- PhD, or Master's degree and 6+ years of applied research experience
- Experience programming in Java, C++, Python or related language
- Experience with neural deep learning methods and machine learning

- Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc.
- Experience with large scale distributed systems such as Hadoop, Spark etc.

Key job responsibilities
• Design and develop a state-of-the-art Agentic service platform using Gen AI/ML technologies that provide consistent, well-reasoned outcomes for advertiser guidance in a secure & reusable architecture, delivering low latency and secure advertiser experiences
• Optimizing for operation costs at scale through efficient resource utilization, token consumption and memory footprint at scale.
• Collaborate with cross-functional teams to integrate AI-driven solutions across our advertising ecosystem
• Pioneer new approaches to conversational AI and natural language interactions in advertising
• Shape the future of how businesses connect with customers through AI-powered advertising
• Create scalable systems that process millions of data points to deliver hyper-personalized ad experiencesWhat we're looking for:
• Passionate about Generative AI, Large Language Models, and their real-world applications
• Strong software engineering skills with experience in distributed systems and cloud technologies
• Creative problem-solver who thrives in ambiguity and loves tackling complex challenges
• Track record of delivering innovative solutions that drive business impact
• Enthusiasm for staying current with the rapidly evolving AI landscape
A day in the life• Highly analytical: You solve problems in ways that can be backed up with verifiable data. You focus on driving processes, tools, and statistical methods which support rational decision-making.
• Team obsessed: You help the team achieve outstanding results. You foster the creative atmosphere to let engineers innovate, while holding them accountable for making smart decisions and delivering results.
• Humbitious: You’re ambitious, yet humble. You recognize that there’s always opportunity for improvement and use introspection and feedback from teammates and peers to raise the bar for your team.
• Engaged by ambiguity: You're able to explore new problem spaces with unique constraints and thus non-obvious solutions; you’re quick to identify any gaps in the team and the right person to fill them to best deliver value to customers
• Passionate for staying current with the latest developments in AI technologies and applying those insights to real-world product challengesWhy join us?
• Be part of a team that's defining the future of AI in advertising
• Work on projects with massive scale and impact, reaching millions of businesses and consumers
• Collaborate with world-class AI researchers and engineers
• Access to cutting-edge AI technologies and resources

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Proven experience shipping Gen AI-powered features at scale from pilot to production and a deep understanding of AI trust and safety considerations

Key job responsibilities
As a Software Development Engineer,- You will solve technical challenges and act as a mentor to other junior engineers.
- Given that this is an early-stage initiative, you'll play an active role in translating business and functional requirements into concrete deliverables and build quick prototypes or proofs of concept in partnership with other technology leaders within the team.
- You will help invent new features, design, develop and deploy highly scalable and reliable distributed services.
- You will work with a variety of core languages (primarily Java and Python) and technologies (AWS).
- You will work closely with Product Managers, Engineers and Applied Scientists.

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques
A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:Participate in design discussions, code review, and communicate with internal and external stakeholders.Work in a startup-like development environment, where you’re always working on the most important stuff.About the team
#1. Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.

- 3+ years of non-internship professional software development experience
- 3+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures
- Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm
- Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA
- Experience developing high performance libraries for HPC applications
- Proficiency in low-level performance optimization for GPUs
- Experience with LLVM/MLIR backend development for GPUs
- Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends
- Experience with parallel programming and optimization techniques
- Understanding of GPU memory hierarchies and optimization strategies

Key job responsibilitiesDevelops and maintains code for .NET web based enterprise applications.Experiments with AI tools.Works with all departments to define and document business requirements.Prepares diagrams, design documentation, and project documents.Thoroughly test code and verify performance to requirements prior to UAT and launchWrites clear, concise and detailed solution design and technical documentation.Compiles, organizes, analyzes and uses technical data to solve problems.Delivers projects (design, coding, testing, implementation, and support) on time and within budget.
A day in the lifeAs a member of the team, you will be hands on with a wide array of software applications.You will use your skills and experience to participate in and deliver with all phases of the project lifecycle. End to end ownership is yours.You will review requirements, propose solution designs, set project timelines, and be responsible to delivered agreed upon functionality within scope and on time.Following and establishing new best practices are keys to providing the highly consistent and scalable solutions needed to meet the demands of this key role

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent