Expoint - all jobs in one place

The point where experts and best companies meet

Limitless High-tech career opportunities - Expoint

Nvidia Senior Software Engineer Deep Learning Inference 
Israel, Tel-Aviv District 
250868027

01.09.2024

What you’ll be doing:

  • Cooperate with research teams to onboard new LLMs and VLMs into Nvidia's opensource AI runtimes

  • Optimize inference workloads using sophisticated profiling and simulation tools

  • Build SOLID, extendable inference software systems, and refine robust APIs

  • Implement and debug low-level GPU code to harness the latest HW features

  • Own end-to-end inference acceleration features and work with teams around the world to deliver production-grade products

What we need to see:

  • B.Sc., M.Sc. or equivalent experience in Computer Science or Computer Engineering

  • 5+ years of relevant hands-on software engineering experience

  • Profound knowledge of software design principles

  • Strong proficiency in at least one system and one scripting language

  • Strong grasp of machine learning concepts

  • People person with excellent communication skills that enjoys collaboration and teamwork.

Ways to stand out from the crowd:

  • Familiarity with Nvidia's DL software stack, e.g. , , and

  • Proven track record of performance modeling, profiling, debugging, and development in a performance-critical setting with Nvidia's accelerators.

  • Familiarity with LLM quantization, fine-tunning, and caching algorithms

  • Proficiency in GPU kernel programming (CUDA or OpenCL)

  • Prior experience working on a large software project with 50+ contributors