Nvidia Software Architect Enterprise AI 

China, Shanghai 

410093682

What you'll be doing:

• Define the end-to-end technical architecture for the NIM Factory, from container build systems and CI/CD to Kubernetes deployment patterns and runtime optimization.

• Drive technical strategy and roadmap, making high-impact decisions on frameworks, technologies, and standards that empower dozens of engineering teams.

• Architect and influence the design of workflow orchestration systems that underpin the NIM factory.

• Coach and mentor senior engineers across the organization, fostering a culture of technical excellence, innovation, and knowledge sharing.

• Champion best practices in software development, including API design, automation, observability, and secure supply chain management.

• Collaborate with leadership across research, backend, SRE, and product to align technical vision with product goals and influence technical roadmaps.

What we need to see:

• 12+ years of experience designing and building large-scale, production distributed systems.

• Proven track record in a technical leadership or architect role, setting technical direction while staying hands-on with implementation.

• Deep architectural expertise in cloud-native technologies, including Kubernetes, containers, and microservices.

• Exceptional ability to coach, teach, and influence senior engineers; a passion for raising the technical bar of the entire organization.

• Strong foundation in modern software development practices, with proficiency in languages like Python for building tooling and services.

• Experience architecting solutions for GPU-accelerated or other high-performance computing workloads.

• Excellent communication and collaboration skills, with the ability to articulate complex technical concepts to diverse audiences and drive consensus.

• A degree in Computer Science, Computer Engineering, or a related field (BS or MS) or equivalent experience.

Ways to stand out from the crowd:

• Hands-on with LLM inference stacks (Triton Inference Server, TensorRT-LLM, vLLM, FasterTransformer, KServe).

• Experience optimizing large-model serving (KV cache sharding/paging, tensor/sequence parallelism, speculative decoding, dynamic batching).

• Experience architecting next-generation container build systems or CI/CD platforms at scale.

• Background with workflow orchestration engines (e.g., Temporal, Airflow) for complex, distributed processes.

• Expertise in designing multi-tenant, multi-cluster, or edge/air-gapped deployment architectures.