Broadcom AI/ML Model Runtime Engineer 

United States, California, Palo Alto 

503865069

This role will be a member of the Private AI Services’ Model Runtime team, which is a Kubernetes based control plane that operates ML inferencing services. The successful candidate must have experience contributing to Open Source projects, and experience participating in upstream Kubernetes and related CNCF projects as a contributor is a major plus.

Responsibilities

• Collaborate with cross-functional teams to design and deliver expanded capabilities of Kubernetes-based platform services for AI

• Troubleshoot and resolve complex issues related to Private AI inference services and their performance

• Augment the AI services platform to support diverse inferencing and embedding engines (e.g,. vLLM or HuggingFace Transformers library)

• Develop enhancements to the AI services platform to support a large set of ML models

• Participate in code reviews and ensure that the code is aligned with VMware's coding standards and best practices

• Develop and maintain automated tests to ensure the quality and reliability of the Private AI feature set

Requirements

• Ability to succeed on an take-home homework assignment and in-person technical interview including coding and debugging

• 5+ years experience in production quality Python code

• 5+ years of hands on experience with Container technologies (Docker and Kubernetes)

• Experience with CUDA or other numeric computing libraries and their Python bindings is a plus

• Strong analytical and diagnostic skills with ability to independently solve complex problems

• Excellent communication and collaboration skills, with the ability to work with cross-functional teams

• Experience with agile development methodologies and version control systems, such as Git

• BS in Computer Science or related technical fields and 12+ years of related experience in the software industry or MS in Computer Science or related technical fields and 10+ years of related experience in the software industry

• Candidate should not require work visa / sponsorship

What We Offer:

• Competitive salary and benefits package

• Opportunities for career growth and professional development

• Collaborative and dynamic work environment

• Access to cutting-edge technologies and tools