המקום בו המומחים והחברות הטובות ביותר נפגשים
Apple Machine Learning Ops Applied United States, California, Sunnyvale 296646045
01.06.2024
Description
The main responsibilities for this position include:Build LLM Applications using open source LLM App Frameworks, AWS BedRock/GCP Vertex AIEvaluate and port Language Models onto optimized infrastructure to reduce cost and increase performanceBuild tools to benchmark and compare various embedding databases, LLMsBuild & Support CI/CD tools to port & manage applications on AWS/GCP & KubernetesBuild automation to enable self-healing systemsAbility to troubleshoot application specific, core network, system & performance issues.Build a multi-tenancy system by enforcing data protection between different use cases.
Key Qualifications
- 4+ years of experience in Python Programming
- Extensive experience in deploying and managing the applications on AWS/GCP & Kubernetes
- Deep understanding on RAG based pipelines for Model inferencing, GuardRails
- Experience in open source LLM App frameworks like LangChain/LlamaIndex
- Exposure to Cloud managed services like AWS BedRock/GCP Vertex AI
- Good Understanding of Agents in GenAI
- Strong Experience in Infrastructure templating tools like CloudFormation, Terraform
- Experience in GitOps based deployment tools like Spinnaker/Flux/ArgoCD
- Strong proficiency with Helm and Kustomize for managing Kubernetes applications and configurations.
- Experience in managing Embeddings using Vector databases
- Exposure to Promot engineering
- Experience in observability & traceability for Large Language Models.
- Experience in Performance tuning on operating systems like Linux
- Excellent analytical & problem solving skills
Education & Experience
BS in computer science with 4+ years or MS plus 2+ years experience or related experience.
Additional Requirements
- Exposure to various LLM infrastructure like GPUs, TPUs & Inferentia is preferred
- Exposure to LLM runtime like Triton, Frameworks like TensorRT, vLLM is an added advantage.
- Exposure to general Java troubleshooting skills
Pay & Benefits
- At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $138,900 and $256,500, and your base pay will depend on your skills, qualifications, experience, and location.Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.
משרות נוספות שיכולות לעניין אותך
