Nvidia Compute Architecture Software Engineer 

China, Shanghai 

926618716

Join NVIDIA, a leader in advancing computer graphics, PC gaming, and accelerated computing for over 25 years. As an LLM Inference Software Engineer, you will be at the forefront of innovative AI technology, working on the ground-breaking TRTLLM project. This role offers you the exceptional opportunity to accelerate LLM inference using GPU technology, influencing everything from single PCs to clusters with thousands of powerful GPUs. Be part of a team that values creativity, cooperation, and the pursuit of excellence.

What you'll be doing:

• You will develop and optimize software solutions to accelerate LLM inference using GPU technology.

• Collaborate closely with a world-class team of engineers to implement and refine GPU-based algorithms.

• Analyze and determine the most effective methods to improve performance, ensuring seamless execution across diverse computing environments.

• Engage in both individual and team projects, contributing to NVIDIA's mission of leading the AI revolution.

• Work in an empowering and inclusive environment to successfully implement groundbreaking AI solutions.

What we need to see:

• 5+ working years' experience in software engineering, particularly in GPU programming and LLM inference.

• Strong proficiency in programming languages such as Python, C++, and CUDA.

• A solid understanding of deep learning frameworks and techniques.

• Outstanding problem-solving skills and the ability to work collaboratively in a team setting.

• Ambitious approach with a proven track record of taking initiative and delivering results.

• BS or above degree in Computer Science, Engineering, or a related field, or equivalent experience.