Finding the best job has never been easier
Share
What you will do:
Formulate test plans, and execute performance and evaluation benchmarks against various instructlab workloads and models to characterize performance, drive performance improvements, and detect performance regressions through data analysis and visualization
Develop tools and automation to aid the performance benchmarking work
Collaborate with other engineering teams to resolve performance issues
Triage, debug, and solve customer cases related to instructlab performance
Submit performance benchmarking results to industry consortia
Publish results, conclusions, recommendations and best practices via internal test reports, presentations, external blogs and official documentation to support our partners and customers
Participate in internal and external conferences about your work and results
What you will bring:
Performance benchmarking, data capture, data analysis, and data
Experience with performance data collection and analysis tools
Knowledge of popular AI technologies, and frameworks
Knowledge of large language model inference and finetuning internals
Programming experience in Python
Experience working with the Linux operating system
Excellent written and verbal language skills in English
The following will be considered a plus:
Masters degree or Phd in Computer Science or related fields
Knowledge of AI performance benchmarking suites such as MLperf
Direct experience working with AI performance profiling tools
The salary range for this position is $104,080.00 - $166,320.00. Actual offer will be based on your qualifications.
Pay Transparency
● Comprehensive medical, dental, and vision coverage
● Flexible Spending Account - healthcare and dependent care
● Health Savings Account - high deductible medical plan
● Retirement 401(k) with employer match
● Paid time off and holidays
● Paid parental leave plans for all new parents
● Leave benefits including disability, paid family medical leave, and paid military leave
These jobs might be a good fit