Nvidia Senior Performance Compiler Engineer - Triton 

United States, Texas 

945409270

What you'll be doing:

• Investigating the latest and future NVIDIA GPU hardware architecture and programming models.

• Working on the frontier of AI by understanding advanced algorithms (like attention sinks and MoEs) and numerics (like block-scaled floating point) to identify new opportunities for optimization.

• Designing and implementing compiler technology using MLIR to optimize high-level kernel descriptions (written in Triton's Python DSL), with a focus on generating efficient, low-level GPU code. When vital, you'll also be able to use inline PTX to hand-tune critical code paths and extract peak performance from the hardware.

• Engaging in a dynamic, iterative process ofoptimization—sometimesstarting with the kernel, sometimes with the compiler—to find the most efficient path to peak performance.

• Collaborating with teams across NVIDIA, including hardware architects and the CUDA compiler team, to influence future products and ensure we are always operating at maximum efficiency.

What we need to see:

• Bachelor, Masters or Ph.D. degree or equivalent experience in Computer Science, Computer Engineering, Applied Math, or a related field.

• 6+ years of relevant industry experience in software development.

• Demonstrated strong C++ programming and software design skills, with an emphasis on performance analysis and debugging.

• Experienced in parallel programming, including CUDA/OpenCL GPU programming or other parallel models such as OpenMP.

• Solid understanding of computer architecture and hands-on experience with assembly-level programming.

Ways to stand out from the crowd:

• Experience in tuning BLAS or deep learning library kernels.

• Background in numerics and linear algebra.

• Experience with machine learning compilers like TVM or MLIR.

• Contributions to open-source projects, especially in the AI/ML or compiler space.

• Familiarity with the latest research in AI algorithms and numerics as well as a strong track record of contributions to open-source projects, particularly in the AI/ML, compiler, or high-performance computing domains.