Information Analyst jobs in United States, California, Sunnyvale

What will you do?: You will lead a multidisciplinary team to develop solutions across multiple programs (text search, image search, local information, etc.) to: (i) own web search evaluation: You will own the systems that support fast and reliable evaluation of the quality of our web search service. (ii) build and automate training data generation: You will own the development of high-quality training data sets for our web information retrieval and ranking models, having direct and significant impact on our search quality. You will help improve the data quality, including mining for hard negatives, incorporating several dimensions of quality (e.g. relevance, content freshness, page trustworthiness, etc.), as well as scale the pipeline to billions of examples. You will work with stakeholders to address their specific modeling needs and develop and own metrics to communicate your progress on data quality and scale. (iii) accelerate experimental velocity: You will be responsible for improving the team’s ability to experiment quickly. This includes measuring the entire lifecycle of an experiment (from ideation, acquiring data, setting up infra to train, debugging model, running evaluations, deploying into production), identifying painpoints and developing solutions to address them. (iv) improve system understandability: You will develop advanced analytics and automate failure space analysis processes to help the team debug and understand search quality issues. You will partner with the broader AGI analytics team to coordinate metrics for our information retrieval engine with user signals or downstream dependencies to debug across systems as well. (v) streamline deployment and optimize model performance: You will develop expertise, systems, and processes to streamline model deployments and improve model inference efficiency, enabling the team to reduce latency, cut costs, or run larger models in production.
Key job responsibilities
As the SDM for the WIS Machine Learning Infrastructure team, you will:* Hire and develop the best. You will help grow and develop a team of scientists and engineers, growing their careers and empowering them to achieve amazing things.
* Set a vision for your team and create product roadmaps. Help your team identify technical and product requirements and opportunities. Use project management and prioritization skills to balance long and short-term goals and deliver on your product roadmap.
* Keep your technical skills current to contribute to architecture and design discussions. Lead your team to evolve and scale our service architecture.
* Drive continual improvements: Set and iteratively improve team processes and mechanisms to make sure the right things get prioritized and work gets done efficiently.
* Drive operational excellence: Implement operational best practices to improve the team’sA day in the life

- 3+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- 8+ years of leading the definition and development of multi tier web services experience
- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
- Experience partnering with product or program management teams

- Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
- Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers
- Experience designing or architecting (design patterns, reliability and scaling) of new and existing systems
- Experience managing MLEs and scientists
- Experience building software systems to support model training, deployment, and optimization