Expoint - all jobs in one place

Finding the best job has never been easier

Limitless High-tech career opportunities - Expoint

Red hat Software Engineer 
United States, Massachusetts, Boston 
38065025

Today

What you will do:

  • Formulate test plans, and execute performance and evaluation benchmarks against various instructlab workloads and models to characterize performance, drive performance improvements, and detect performance regressions through data analysis and visualization

  • Develop tools and automation to aid the performance benchmarking work

  • Collaborate with other engineering teams to resolve performance issues

  • Triage, debug, and solve customer cases related to instructlab performance

  • Submit performance benchmarking results to industry consortia

  • Publish results, conclusions, recommendations and best practices via internal test reports, presentations, external blogs and official documentation to support our partners and customers

  • Participate in internal and external conferences about your work and results

What you will bring:

  • Performance benchmarking, data capture, data analysis, and data

  • Experience with performance data collection and analysis tools

  • Knowledge of popular AI technologies, and frameworks

  • Knowledge of large language model inference and finetuning internals

  • Programming experience in Python

  • Experience working with the Linux operating system

  • Excellent written and verbal language skills in English

The following will be considered a plus:

  • Masters degree or Phd in Computer Science or related fields

  • Knowledge of AI performance benchmarking suites such as MLperf

  • Direct experience working with AI performance profiling tools

The salary range for this position is $104,080.00 - $166,320.00. Actual offer will be based on your qualifications.

Pay Transparency

● Comprehensive medical, dental, and vision coverage

● Flexible Spending Account - healthcare and dependent care

● Health Savings Account - high deductible medical plan

● Retirement 401(k) with employer match

● Paid time off and holidays

● Paid parental leave plans for all new parents

● Leave benefits including disability, paid family medical leave, and paid military leave