Facebook Research Scientist Systems ML HPC - SW/HW Co-Design 

United States, Washington, Bellevue 

586753159

Apply High-Performance Computing (HPC) algorithms and techniques to optimize large-scale AI workloads

Analyze, benchmark, and optimize large-scale workloads on next-generation training superclusters

Apply relevant AI infrastructure and software/hardware acceleration techniques to build and optimize our intelligent ML systems that improve Meta’s products and experiences

Influence next-generation model and hardware architecture choices by projecting training performance and model efficiency

Goal-setting related to project impact, AI system design, and infrastructure/developer efficiency

Directly or influencing partners to deliver impact through deep, thorough data-driven analysis

Drive large projects across multiple teams

Define use cases and develop methodology and benchmarks to evaluate different approaches

Apply in depth knowledge of how ML infra interacts with the other systems around it

Experience in systems software development such as collective Communications

Currently has, or is in the process of obtaining, a Master's/PhD degree in Computer Science, Computer Vision, Generative AI, NLP, relevant technical field, or equivalent practical experience. Degree requirements must be completed prior to joining Meta

Currently has, or is in the process of obtaining, a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta

Specialized experience in one or more of the following machine learning/deep learning domains: high-performance computing, performance optimizations, SW/HW co-design, hardware accelerators architecture, GPU architecture, machine learning compilers, ML systems, AI infrastructure, or machine learning frameworks (e.g. PyTorch), numerics, Collective Communication libraries (NCCL or RCCL), and model compression

Experience developing AI system infrastructure or AI algorithms in C/C++ or Python

Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.

Experience or knowledge of training/inference of large-scale AI models

Experience or knowledge of distributed and cloud systems

Experience or knowledge in one or more of: recommendation and ranking models, LLM and/or LDM, or Collective Communication libraries (NCCL or RCCL)