Nvidia HPC AI Software Architecture Intern - 

Israel, North District 

939189062

What you will be doing:

• Creating prototypes to evaluate and motivate extensions in programming models (CUDA, NCCL, MPI, OpenSHMEM), new designs in runtimes, and new features in the network hardware.
• Research, design and implement features for HPC communication middleware and Deep Learning frameworks such as TensorFlow and PyTorch.
• Work with hardware architects to define the future hardware relevant for scientific applications, Deep learning, and data-intensive workloads.

What we need to see:

• Pursuing a PhD in computer science, computer engineering, or a closely related field.
• Background in parallel programming models, and/or network architecture.
• Background in algorithm design, system programming, and computer architecture
• Strong programming and software development skills
• Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment

Ways to stand out from the crowd:

• Deep understanding of technology and passionate about what you do
• Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic environment
• Previous experience in designing communication middleware for high-performance computing systems, including InfiniBand, DPUs, Ethernet, NVLINK and Shared Memory;
• Experience in implementing communications libraries, particularly MPI, OpenSHMEM, or NCCL;
• Previous experience in programming models for emerging architectures including hierarchical heterogeneous memory systems and accelerators;