Microsoft Research Intern - STAC Sociotechnical Alignment Center 

United States, New York, New York 

448900340

STAC is looking to hire several Research Interns in Redmond and NYC to conduct research on measuring risks, capabilities, performance, and other properties of AI systems, with a focus on “generative” or “general purpose” systems. STAC’s approach to evaluation is grounded in measurement theory from the social sciences and in statistics. All STAC internships will involve collaborations and/or co-mentorship with one or more .

STAC is especially interested in candidates with expertise in theoretical and methodological approaches that can be applied to help advance and mature the field of AI system evaluation. Prior experience with AI system evaluation specifically is not required. We especially encourage applications from candidates interested in topics including but not limited to: applications of methodologies from psychometrics and educational testing to the design and validation of evaluations (including methods such as item response theory, factor analysis, and other latent variable models); measurement theory from the social sciences; reliability of generative AI systems and generative AI system evaluation; validity of generative AI system evaluation; improving human and automated annotation methods for use in evaluation; participatory methods in measurement (including how different stakeholders interpret/work with/set goals for AI system measurement).

Applicants should have a demonstrated interest and established expertise in methods applicable to AI system evaluation, and a desire to work in a highly interdisciplinary environment. We welcome applicants with backgrounds in technical fields (e.g., machine learning, artificial intelligence, natural language processing, computer vision, statistics) and applicants with backgrounds in sociotechnical fields (e.g., economics, human-computer interaction, information science, educational testing, psychometrics).

Applicants to the STAC internship may also be interested in applying for the separate FATE NYC internship. Applicants interested in multiple internship opportunities

• Currently enrolled in a relevant PhD program.

Other Requirements

• Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
• In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.
• Applications (including reference letters) should be submitted by December 18 for full consideration, but will be accepted until all positions are filled. Applicants who do not submit a cover letter may not be considered. Your cover letter should be no more than 2 pages long. Please address the following points:
  • Include your name, email address, and website URL.
  • Briefly describe your current and past research.
  • What kinds of theoretical and methodological approaches do you have expertise in? How do you believe those approaches can be applied to help advance and mature the field of AI system evaluation? If applicable, please make reference to specific topics of interest described in the overview, or other topics in AI system evaluation.

• Demonstrated ability to conduct original research.
• Ability to collaborate effectively with other researchers and product development teams.
• Proficient interpersonal skills, cross-group, and cross-culture collaboration.
• Ability to think unconventionally to derive creative and innovative solutions.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: