Nvidia Senior LLM Agents Architect 

Israel, North District 

460487326

What you'll be doing:

• Develop innovative AI flows to improve hardware and software through collaboration with various engineering roles.

• Facilitate co-creation workshops to transform SME rules of thumb into specific assignments, resources, cues, and guidelines. Define success measures, evaluation data, and feedback loops for agents to make a measurable difference in NVIDIA's HW simulation analysis and GPU-kernel optimization workflows.

• Rapidly prototype and thoughtfully productize; integrate with internal services, utilize GPU capabilities, remove bottlenecks, and deliver fitting solutions.

• Set up evaluation backbone using offline golden sets and online telemetry for confident iterations, cost control, and safe improvements.

• Mentor and improve teams through insights in agent orchestration, prompting, RAG, observability, crafting documentation and playbooks for NVIDIA's teams.

What we need to see:

• 7+ years in applied ML/AI or large-scale systems, with 3+ years crafting agentic or LLM-powered applications in production environments.

• B.Sc in Computer Science/ Electrical Engineering

• Proven ownership of at least one end-to-end agentic system or LLM application: requirements, architecture, implementation, evaluation, and incremental hardening in production.

• Strong software engineering skills in Python and one systems language (C++ or Rust preferred); experience integrating with GPUs, CUDA, or performance-critical services.

• Proficient in PyTorch or TensorFlow; skilled in tool use, RAG pipelines, and model adaptation.

• Demonstrated ability to collaborate with HW/SW domain experts and translate their heuristics into deterministic tools, constraints, and evaluation metrics.

• Excellence in communication and facilitation: aligning diverse collaborators, documentingdecisions/assumptions,and influencing without authority.

• Track record of building observability for AI systems: dataset/version management, offline test suites, online telemetry, guardrails/safety checks, and rollback plans.

• Proactive, independent, possessing strong analytical and problem-solving abilities; adept at handling uncertainty to provide practical, gradual benefits.