In this role, you’ll build cutting-edge AI infrastructure, design and develop core components such as model serving, prompt management, guardrails, gateways, and evaluation frameworks. You’ll help provide organizations with the precise tools to integrate and maintain GenAI into their workflows, ensuring scalability, compliance, and an excellent developer experience.
- Design and develop the infrastructure of our new GenAI solution.
- Develop and manage components such as prompts, guardrails, and model gateways, tracing and evaluation frameworks.
- Collaborate with cross-functional teams on shaping how AI applications are structured and managed.
- Stay up to date with the latest advancements in GenAI infrastructure, tooling, and frameworks, integrating industry best practices.
To be a GenAI Infrastructure Engineer at JFrog ML you need...- 5+ years of experience as a Software Engineer
- Experienced in designing, developing, and debugging complex, distributed systems (microservices, event-driven)
- Proven hands-on experience in containerized environments, microservices and Kubernetes
- Experienced with at least one of the main cloud provider platforms (e.g. AWS, GCP)
- Experience with designing, structuring, and maintaining Python SDKs
- Familiarity with AI application development frameworks and tools (e.g. LangChain, OpenAI, Hugging Face, MLflow)
- Experienced in Java and Python
Bonus Points- Experience working with AI Agents and LLM-based application frameworks
- Background in data engineering, feature stores, or vector databases for AI workloads