MongoDB Staff Engineer 

United States, California, Palo Alto 

994659966

As a Staff Engineer, you’ll be hands-on with design and implementation, while working with engineers across experience levels to build a robust, scalable system. The focus is on latency, availability, observability, and scalability in a multi-tenant, cloud-native environment.

• Partner with Search Platform and Voyage.ai AI engineers and researchers to productionize state-of-the-art embedding models and rerankers, supporting both batch and real-time inference
• Lead key projects around performance optimization, GPU utilization, autoscaling, and observability for the inference platform
• Design and build components of a multi-tenant inference service that integrates with Atlas Vector Search, driving capabilities for semantic search and hybrid retrieval
• Contribute to platform features like model versioning, safe deployment pipelines, latency-aware routing, and model health monitoring
• Collaborate with peers across ML, infra, and product teams to define architectural patterns and operational practices that support high availability and low latency at scale
• Guide decisions on model serving architecture using tools like vLLM, ONNX Runtime, and container orchestration in Kubernetes

• 8+ years of engineering experience in backend systems, ML infrastructure, or scalable platform development
• Expertise in serving embedding models in production environments
• Strong systems skills in languages like Go, Rust, C++, or Python, and experience profiling and optimizing performance
• Comfortable working on cloud-native distributed systems, with a focus on latency, availability, and observability
• Familiarity with inference runtimes and vector search systems (e.g., Faiss, HNSW, ScaNN)
• Proven ability to collaborate across disciplines and experience levels, from ML researchers to junior engineers
• Experience with high-scale SaaS infrastructure, particularly in multi-tenant environments

• Prior experience working with model teams on inference-optimized architectures
  Background in hybrid retrieval, prompt-based pipelines, or retrieval-augmented generation (RAG)
  Contributions to relevant open-source ML serving or vector search infrastructure

• Be part of shaping the future of AI-native developer experiences on the world’s most popular developer data platform
• Collaborate with ML experts from Voyage.ai to bring cutting-edge research into production at scale
• Solve hard problems in real-time inference, model serving, and semantic retrieval — in a system used by thousands of customers worldwide
• Work in a culture that values mentorship, autonomy, and strong technical craft
• Competitive compensation, equity, and career growth in a hands-on technical leadership role