As a Technical Product Manager, you will work at the nexus of product and research. Your products are the language models that power Microsoft Copilot. You will be responsible for bringing our vision to life by supporting support a fast-paced organization to track, coordinate and manage flighting and launching of our latest model and prompt iterations. You will complete these launches by analyzing data and making thoughtful recommendations to assist in making ship decisions.
We are looking for candidates who:
- Are passionate about managing high stakes time-sensitive programs.
- Are keenly aware and able to manage timelines and schedules of mission critical launches.
- Take the initiative and enjoy building world-class consumer experiences and products in a highly collaborative, fast-paced environment.
- Savvy with data and deriving insights from pre-flight evaluations, post-flight scorecards and assist in determining launch decisions.
- Bring an abundance of positive energy, empathy, and kindness, in addition to being highly effective.
- Effectively manage multiple responsibilities and can adjust to shifting priorities.
By applying to this U.S. Mountain View, CA OR Redmond, WA position, you are required to be local to the San Francisco area OR Seattle area and in office 3 days a week.
Responsibilities
- Identifying and prioritizing language model issues that impact quality, factuality and safety and working with engineers and researchers to find a path to resolution.
- Identifying and executing on strategies to improve grounding of language models with information retrieval.
- Engineering prompts to teach language models how to behave across a wide range of scenarios.
- Defining measurable evaluations that use technical and product metrics to demonstrate quality improvements.
- Creating novel data collection tasks for taskers to evaluate language models.
- Working closely with researchers and engineers to define and manage engineering and research projects.
- Deploying and tracking AB model experiments in production.
- Accountable to own the status of key projects, proactively identifying risks and proposing solutions to ensure timely delivery.
- Embody our
Required Qualifications
- Bachelor's Degree AND 4 years experience in product/technical program management or software development OR equivalent experience.
- 2 years of experience leading multi-disciplinary projects, defining requirements, developing project plans and working with multi-disciplinary teams to execute them.
- Experience in coordinating ML-powered products.
Preferred Qualifications
- 3 years of experience in managing experiments and launches of language model and prompt experiments.
- Technical depth in software development, data science and machine learning. While you are not expected to write code on the critical path, you’re able to execute on prototypes, reason over large amounts of data, and speak the language of the engineers and researchers you work with.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: