Deep Learning Performance Architect - Intern jobs at Nvidia in China, Shanghai

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people.

• Design and implement the DSL and the core compiler of tile-aware GPU programming model for emerging GPU architectures

• Continuously innovate and iterate on the core architecture of the compiler to consistently optimize performance

• Investigation of next-generation GPU architectures and provide solutions in the DSL and compiler stack

• Performance analysis on emerging AI/LLM workloads and integrate with AI/ML frameworks

• Masters or PhD or equivalent experience in relevant discipline (CE, CS&E, CS, AI)

• 4 + years of relevant work experience

• Excellent C/C++ programming and software engineering skills, ACM background is a plus

• Good fundamental knowledges on computer architecture

• Strong ability in abstracting problems and the methodology in resolving problems

• Strong compiler backgrounds including MLIR/TVM/Triton/LLVM is desired

• Good knowledge of GPU architecture and fast kernel programming skills is a plus

• Knowledge of LLM algorithms or a certain HPC domain is a plus

• Knowledge of multi-GPU distributed communication is a plus

• Excellent oral communication in English is a plus

for an exciting and fun role in our, which covers the areas over runtime, compiler optimization, code generation, CPU pipeline analysis and etc.

What you'll be doing:

• Work on feature enablement and optimization of open source Java virtual machine projects.

• Partner with both internal and communities to develop, valid and upstream patches.

• Work with global compiler, hardware and application teams to oversee improvements and problem resolutions.

• Drive and push architecture neutral and NV friendly solutions in the communities.

• Be flexible, with a variety of software development skills and extend the breadth and depth of knowledge.

What we need to see:

• Pursuing B.S. or higher degree in Computer Science/Engineering

• Excellent hands-on C++ programming skills

• Strong background in software engineering principles with a focus on crafting robust andmaintainable solutions to challenging problems

• Good communication and documentation skills and self-motivated

Ways to stand out from the crowd:

• Masters or PhD preferred, with compiler or language virtual machine experiences

• Background with Java and understand the key language features

• Familiar with Linux and shell programming

• Knowledge on computer architecture, ISA, assembly, and Arm64 is preferred

• Exposure to various ML techniques

What you’ll be doing:

• Develop algorithms to exercise various parts of the GPU pipeline to verify our performance metrics.

• Deeply dive into NVIDIA GPU architecture and software stack, develop new feature for NVIDIA GPU performance profiling tools.

• Write unit and integration tests to verify the functionality, performance, stability, resource usage of our products.

What we need to see:

• Pursuing a Master's degree major in CS/SE.

• Proficiency in C/C++, object oriented programming.

• Proficiency in written and spoken English.

Ways to stand out from the crowd:

• OpenGL, GLES, Direct3D, Vulkan, CUDA, OpenCL, console graphics APIs.

• Experience of driver development.

• Background with software development for embedded systems.

What you'll be doing:

• Developing and introducing groundbreaking reinforcement learning algorithms tailored for LLM applications.

• Collaborating with a world-class team of engineers and researchers to integrate these algorithms into applied scenarios.

• Using your extensive expertise in math and AI to improve the reasoning capabilities of our models.

• Engaging in rigorous testing and refinement processes to ensure flawless performance and reliability.

• Contributing to our collective goal of delivering industry-leading AI solutions, strictly adhering to NVIDIA's high standards.

What we need to see:

• Proficient in C++/Python programming.

• 3+ years working experience.

• BS or MS (or equivalent experience) in CS, CE, EE, or a related field.

• Proven experience in reinforcement learning and its application to large language models.

• Strong background in mathematics and AI algorithms, with a focus on reinforcement learning.

• Demonstrated history of applying reinforcement learning algorithms in practical scenarios.

• Understanding of GPU architecture is a huge plus.

• Excellent problem-solving skills and the ability to work collaboratively in a dynamic team environment.

• A passion for innovation and a dedication to achieving outstanding results.

What you’ll be doing:

• Apply Machine Learning, Deep Learning techniques to overcome QA and Automation challenges for different NVIDIA Product lines

• Maintain and optimize new and existing automated tests with AI solution

• Design, implement and augment existing test frameworks with AI automation tools to reduce manual development efforts and make the current automation framework more productive and smart

• Work closely and collaboratively with other development and QA teams to gather automation requirements and review automation design

What we need to see:

• Pursuing Master or higher degree in computer science or electrical engineering with strong academics

• Good programming skills in python, proficient in applying OOP concepts and Data structures

• Good experience with using AI development tools for test plan creation, automation framework and test case development

• Have experience on using Cursor, MCP, Coderabbit for script generation/review

• Hands on experience in solving complex problems using AI technology or tools such as RAG, LLM/vLLM and AIGC

• Experience with large or complex applications and knowledge of code optimization and manipulation

• Demonstrates excellent communication skills, maintains a strong sense of initiative and motivation, and consistently upholds high standards for software quality

• Ability to work closely & collaboratively with other Development & QA teams especially across geographies

Ways to stand out from the crowd:

• Programming skills in C# is a plus

• Knowledge of Linux, Mac and Android is a plus

• Experience on Machine Learning Frameworks like Pytorch, Keras with TensorFlow, ONNX , and TensorRT is a plus

• Background of RL(Reinforce learning), or Meta-learning, or Life-long learning is a plus.

• Knowledge of SQL/NoSQL Database is plus

What you will be doing:

• Develop and optimize the control stack, including locomotion, manipulation, and whole-body control algorithms;

• Deploy and evaluate neural network models in physics simulation and on real humanoid hardware;

• Design and maintain teleoperation software for controlling humanoid robots with low latency and high precision;

• Implement tools and processes for regular robot maintenance, diagnostics, and troubleshooting to ensure system reliability;

• Monitor teleoperators at the lab and develop quality assurance workflows to ensure high-quality data collection;

• Collaborate with researchers on model training, data processing, and MLOps lifecycle.

What we need to see:

• Bachelor’s degree in Computer Science, Robotics, Engineering, or a related field;

• 3+ years of full-time industry experience in robotics hardware or software full-stack;

• Hands-on experience with deploying and debugging neural network models on robotic hardware;

• Ability to implement real-time control algorithms, teleoperation stack, and sensor fusion;

• Proficiency in languages such as Python, C++, and experience with robotics frames (ROS) and physics simulation (Gazebo, Mujoco, Isaac, etc.).

• Experience in maintaining and troubleshooting robotic systems, including mechanical, electrical, and software components.

• Physically work on-site on all business days.

Ways to stand out from the crowd:

• Master’s or PhD’s degree in Computer Science, Robotics, Engineering, or a related field;

• Experience at humanoid robotics companies on real hardware deployment;

• Experience in robot hardware design;

• Demonstrated Tech Lead experience, coordinating a team of robotics engineers and driving projects from conception to deployment.