Nvidia Director Engineering – Software AI Inferencing Platforms 

Vietnam, Thái Nguyên Province, Thái Nguyên 

464525268

What You’ll Be Doing:

• Build, lead and scale world-class engineering teams in Vietnam, collaborating with global counterparts across system software, data science, and AI platforms.

• Drive the design, architecture, and delivery of high-performance system software platforms that power NVIDIA’s AI products and services.

• Partner with global teams across Machine Learning, Inference Services, and Hardware/Software integration to ensure performance, reliability, and scalability.

• Oversee the development and optimization of AI delivery platforms in Vietnam, including NIMs, Blueprints, and other flagship NVIDIA services.

• Engage with open-source and enterprise data and workflow ecosystems (e.g., Temporal, Gitlab DevOps Platform, RAPIDS, NeMo Curator, Morpheus) to advance accelerated AI factory, data science and data engineering workloads.

• Champion continuous integration, continuous delivery, and engineering best practices across multi-site R&D Centers.

• Collaborate with product management and cross-functional stakeholders to ensure enterprise readiness and customer impact.

• Develop and deploy standard processes for large-scale, distributed system testing, encompassing stress, scale, failover, and resiliency testing.

• Ensure security and compliance testing aligns with industry standards for cloud and data center products.

• Mentor and develop talent within the organization, fostering a culture of quality and continuous improvement.

What We Need to See:

• Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, or related field.

• 15+ overall years of software engineering experience with 6+ years in senior leadership roles.

• Proven record of managing large, high-performing software teams and delivering complex AI/ML or data-driven products.

• Expertise in cloud, data, and accelerated computing technologies (e.g., Spark, Kubernetes, Dask, Python ecosystem, CUDA).

• Experience collaborating with open-source communities and enterprise partners.

• Strong leadership, communication, and cross-functional coordination skills.

• Strategic mindset with hands-on technical depth in AI, system software, or large-scale data platforms.

Ways to Stand Out from the Crowd:

• Experience building and scaling AI/ML Inferencing platforms from concept to production.

• Background in GPU programming, CUDA optimization, or system performance engineering.

• Deep understanding of microservices, distributed systems, and high-performance data architectures.

• Contributions to open-source projects or developer ecosystems.

• Knowledge of deep learning, RAG, embeddings, or modern text search frameworks.