Senior Machine Learning Research Engineer jobs at Red Hat in United States, Boston

What you will do

• Testing the performance and accuracy of LLMs for vLLM and llama.cpp inference on different accelerators.

• Making awesome test plans and cases to hit product requirements.

• Doing all sorts of testing: functional, performance, regression, you name it, to make sure the product is solid.

• Writing test code and frameworks to automate testing.

• Monitoring, analyzing, and reporting test results and failures.

• Sharing your knowledge and recommendations to help the team keep getting better.

• Keeping everyone in the loop about quality efforts.

• Giving good and quick code reviews.

What you will bring

• At least 3 years of software testing experience.

• Solid experience evaluating LLMs for performance on accelerators and accuracy (think HellaSwag, MMLU, Chatbot Arena, TruthfulQA, etc.).

• Being super comfortable with Python and PyTest is a must.

• Familiarity with Git, GitHub, or GitLab.

• Strong experience with API and performance testing, especially for C++ and Python.

• You should be a pro with Docker, Podman, and Kubernetes or Openshift.

• Highly experienced in setting up CI/CD processes like Jenkins and GitHub Actions.

• Understanding of core Machine Learning algorithms and basics

Bonus points if you have:

• A Bachelor’s degree (or higher) in computer science, math, or a related field is cool, but practical experience and technical skills are what really matter.

• Knowing how to excel in Open Source communities.

• Understanding how application build pipelines work (like how code becomes binaries or Python wheels).

• A track record of contributing to the vLLM community is ahugeplus!

The salary range for this position is $133,650.00 - $220,680.00. Actual offer will be based on your qualifications.

Pay Transparency

● Comprehensive medical, dental, and vision coverage

● Flexible Spending Account - healthcare and dependent care

● Health Savings Account - high deductible medical plan

● Retirement 401(k) with employer match

● Paid time off and holidays

● Paid parental leave plans for all new parents

● Leave benefits including disability, paid family medical leave, and paid military leave

Job Summary

You’ll help accelerate the development of AI prototypes by ensuring seamless platform integration, CI/CD pipelines, and other critical infrastructure to enable high-speed experimentation and iteration.

What you’ll do

• Platform Support and Optimization: Design and maintain scalable, secure, and efficient platforms to support AI Catalyst team initiatives, ensuring smooth integration of AI models and workflows.

• Infrastructure Management: Provide expertise in Kubernetes and cloud platforms (GCP, AWS, Azure) for container orchestration, scalable deployments, and real-time operations.

• Partner with the AI Catalyst team to identify bottlenecks, remove blockers, and optimize workflows for faster delivery of AI prototypes.

• Technical Leadership: Lead the implementation of critical systems (APIs, orchestration, observability, deployment) to ensure speed, reliability, and maintainability.

• Cross-Functional Collaboration: Work closely with engineering, product, and design teams to align technical priorities and drive impactful AI initiatives.

• Mentorship: Guide and mentor engineers, fostering a culture of technical excellence, collaboration, and rapid execution.

• Demonstrate proficiency in Kubernetes for container orchestration and scalable deployments.

• Mentor senior engineers and contribute to a culture of technical excellence, velocity, and pragmatic decision-making

• Proactively utilize AI-assisted development tools (e.g., GitHub Copilot, Cursor, Claude Code) for code generation, auto-completion, and intelligent suggestions to accelerate development cycles and enhance code quality.

• Explore and experiment with emerging AI technologies relevant to software development, proactively identifying opportunities to incorporate new AI capabilities into existing workflows and tooling.

What you’ll bring

• 10+ years of software engineering experience

• Strong background in Python and background in C, C++, Go or Rust.

• Proficiency in RHEL or other Linux distributions.

• Communication Skills: Strong ability to communicate technical tradeoffs and bring clarity to ambiguous situations

• Passion for AI Innovation: Enthusiasm for enabling AI initiatives that drive real-world impact and accelerate prototyping efforts.

• Ability to move fast without compromising quality, thriving in environments where rapid iteration and high ownership are the norm

• PoC Experience: Proven ability to work on and deliver successful Proof of Concepts or initiatives, showcasing the ability to rapidly prototype and validate ideas.

Nice to have

• Experience with cloud platforms such as GCP, AWS, or Azure.

• experience with building and packaging Python projects, package managers (dnf, pip), and build systems (cmake, meson)

• experience in working with upstream projects and Open Source communities.

• Experience in early-stage product incubation or 0→1 product delivery

• Contributions to internal AI platforms, model evaluation frameworks, or observability for AI systems

This is a rare opportunity to help shape how our company brings AI innovation to life - bridging research and real-world usage at a moment when speed, safety, and product quality matter most. If you're energized by rapid iteration, high autonomy, and making AI tangible for millions, we’d love to talk.

• Previous experience with hardware acceleration, either generic GPU experience or specific ones, such as CUDA and ROCm

• Knowledge of AI frameworks, such as PyTorch and/or TensorFlow

• Familiarity with containerization and orchestration

• Understanding of Open Source development models

• Experience with test-base development and agile/scrum methodologies

What you will do:

• Examine new project opportunities, identify the right approach to meeting or exceeding the requirements for these projects and develop solutions with an eye toward quality, security, maintainability, supportability, performance and resilience

• Work closely with Engineering, Product Management and Support stakeholders to prioritize features and bugs during all phases of development

• Participate in the interaction with relevant hardware partners with a focus on getting key functionality included in their roadmap

• Communicate architectural concepts and decisions to various audiences

• Be a leader and mentor for more junior members of the team and help expand their skill sets

• Participate in upstream AI/ML communities with a focus on learning more about the various technologies and how they might be used within our offerings

What you will bring:

• Strong experience with RHEL or other Linux distributions

• Strong experience with software development with programming languages such as Python, Go or similar

• Problem solving and troubleshooting skills with a focus on root cause analysis

• Experience with container technologies, such as Kubernetes/OpenShift and Podman

• Hands-on learning and demonstrable experience with implementing and owning complex features individually and in collaboration with others

Nice to have:

• Previous experience with hardware acceleration, either generic GPU experience or specific ones, such as CUDA and ROCm

• Knowledge of AI frameworks, such as PyTorch and/or TensorFlow

• Familiarity with containerization and orchestration

• Understanding of Open Source development models

• Experience with test-base development and agile/scrum methodologies

What you will do:

• Serve as the direct support for IBM customer inquiries about the Red Hat OpenShift Container Platform handed over from IBM product support teams.

• Use IBM and Red Hat ticketing systems and support tools to assist customers directly.

• Analyze issues to identify problems and communicate corrective actions and resolutions to customers.

• Collaborate with support engineers, technical account managers, internal teams, and external parties during problem resolution.

• Deliver exceptional customer experience by troubleshooting various issues and recommending solutions professionally and courteously.

• Document diagnostic steps and create reusable solutions for future incidents

• Perform weekend and holiday shift duties on a rotational schedule when needed.

What you will bring:

• 3+ years of experience working as a support or development engineer for a Platform-as-a-Service (PaaS) provider or hosting service

• 3+ years of experience working with Linux or Unix operating systems, including system installation, configuration, and maintenance; Red Hat Certified Engineer (RHCE) qualification is a big plus

• Familiarity with technologies like Red Hat OpenShift Container Platform, Kubernetes, containers, IT automation, and cloud management

• Experience working with hosted applications or large-scale application deployments

• Good understanding of Linux tools with an emphasis on cURL, Git, Strace, and Wireshark

• Troubleshooting skills and a passion for problem-solving and investigation

• Outstanding communication skills in English with the ability to communicate courteously and effectively with customers, colleagues, and third-party vendors

• Ability to handle multiple priorities and work under pressure

• Commitment to providing the best experience possible for Red Hat’s customers

The following are considered a plus:

• Bachelor's degree in a technical field, preferably engineering or computer science

• Experience with technologies like Open vSwitch, JBoss, Apache Tomcat, Go, Angular.js, Node.js, Ruby, Python web frameworks, and .NET framework

• Experience with source code management tools

• Knowledge of technical support systems and tools

• Familiarity with Red Hat’s solutions portfolio and open-source software development

• Participation in open-source projects, including patches submitted for upstream inclusion

This team focuses on a few key project areas:

• Developing & enhancing Backstage plugins

• Improving product security

• Deployment targets & installation methods

• Contributing to the Backstage communities by delivering features and fixes to the upstream projects

• Creating Software Templates & Actions

What you will do

• Develop a deep understanding of the technologies and frameworks used within the Red Hat Developer Hub and related projects

• Understand the product security concepts

• Create and maintain technical documentation for new and existing functionality

• Design and implement automation frameworks, including automated tests and quality checks, to support robust CI/CD pipelines

• Operate effectively in a fast-paced, agile environment where both timely delivery and long-term vision are valued

• Coordinate with team leads, architects, and other engineers to design and implement scalable, maintainable solutions

• Perform code reviews and provide constructive feedback to peers

• Actively participate in Scrum ceremonies and contribute to an agile development process

• Contribute to upstream projects by submitting and reviewing patches for bug fixes and feature requests to and from the community

• Coordinate and communicate effectively with engineering and leadership teams across global time zones

• Help establish and refine processes that enhance release quality, consistency, and automation

• Advocate for the team’s work through blog posts, community updates, and conference presentations

What will you bring

• Strong understanding of software development processes and methodologies (Agile, DevOps)

• Knowledge of cloud security principles and securing cloud environments

• Experience with programming languages relevant to the products (e.g., typescript, Python, Go, Node.js)

• Strong analytical, problem-solving, and critical thinking skills

• Bachelor's degree in computer science or a related field, or equivalent working experience

• Effective English Communication: Experience communicating effectively with other teams and departments across a broad organization

The following are considered a plus:

• Good understanding of common security vulnerabilities, (e.g. OWASP Top Ten) including how to detect, demonstrate, mitigate and resolve them.Knowledge of Security tools (SAST, DAST, SCA, vulnerability scanners, penetration testing)

• Experience in parsing and rendering YAML/JSON using tools such as jq and yq

• A passion for open source technologies, especially around data solutions

• Familiarity with design-thinking concepts and implementations

Job Summary:

The OS Platform team is looking for a Software Engineer to work on the integration of RHEL AI into a RHEL based operating system appliance. You will be responsible for bringing all the pieces of RHEL AI together into the end product our customers will consume. The team is also responsible for the administrator experience of installing, updating and monitoring the RHEL AI operating system. Previous experience with Fedora-based operating systems are highly desirable, and experience with bootc or Image Mode RHEL would be a big plus.

What you will do:

• Contribute to the development and implementation of software to deliver RHEL AI as an Operating System Appliance.

• Work closely with teams within AI Engineering, where collaboration opportunities present themselves

• Adhere to architectural and design principles that help improve overall development within the group

• Learn the architectural concepts that are key to the development of our product set

What you will bring:

• Experience with RHEL or other Linux distributions

• Experience with software development with programming languages such as Python, Go or similar

• Problem solving and troubleshooting skills with a focus on root cause analysis

• Experience with Docker or Podman

The following are considered a plus:

• Experience or knowledge of bootc and Image Mode RHEL

• Experience with technology for deploying and administering RHEL

• Familiarity with containerization and orchestration

• Understanding of Open Source development models

• Experience with test-base development and agile

• Experience with Kubernetes

• Experience using AI Coding tools

The salary range for this position is $108,760.00 - $173,800.00. Actual offer will be based on your qualifications.

Pay Transparency

● Comprehensive medical, dental, and vision coverage

● Flexible Spending Account - healthcare and dependent care

● Health Savings Account - high deductible medical plan

● Retirement 401(k) with employer match

● Paid time off and holidays

● Paid parental leave plans for all new parents

● Leave benefits including disability, paid family medical leave, and paid military leave

What You Will Do

• Work closely with management, product owners, developers, and quality engineers to understand product requirements and build suitable test plans to verify the performance and scale of OpenShift features and solutions for running AI workloads, such as Kubernetes Dynamic Resource Allocation (DRA), autoscaling, and operators for detection, configuration, and management of AI accelerators.

• Develop sophisticated tests that simulate user workloads through comprehensive end-to-end automation, leveraging custom-built and state-of-the-art open-source tools and frameworks.

• Deep dive into performance issues with the intent of discovering their root causes in complex distributed systems.

• Design and develop monitoring and reporting tools for performance and scale tests and analysis.

• Document your research and results clearly and concisely, and communicate findings both internally and externally.

• Engage in upstream communities to help test performance and scale early and influence design and development decisions.

• Triage, debug, and root cause customer issues related to OpenShift performance and scale.

• Present your work and findings at internal and external conferences.

What You Will Bring

• Master’s Degree in Computer Science or a related field with 1-2 years of relevant experience, or a Bachelor’s Degree in Computer Science or a related field with 3+ years of relevant experience.

• Demonstrable experience, understanding, and passion for performance engineering.

• Working knowledge of Kubernetes or OpenShift.

• Strong programming, debugging, and profiling skills in Python and/or Golang.

• Hands-on experience with performance measurement, analysis, and optimization.

• Experience with distributed systems.

• Very strong Linux system administration and system engineering skills.

• Solid scripting skills, particularly with Bash, Python, or Ansible.

• Experience working with public clouds like AWS, Azure, GCP, or IBM Cloud, as well as bare metal environments.

• Experience analyzing and interpreting large volumes of test results and succinctly communicating findings through easy-to-understand graphs/charts.

• Experience with collaborative software development methodologies, tools, and version control.

• Knowledge of statistical analysis and experimental design techniques.

• Excellent communication and interpersonal skills.

• Ability to work independently and proactively seek collaboration.

The Following Are Considered a Plus:

• Experience with container technologies like Podman or Docker, and familiarity with building container images.

• Experience with system performance engineering and metrics collection tools like iostat, vmstat, sar, perf, and Prometheus.

• Experience with monitoring and dashboarding tools like Prometheus and Grafana.

• Experience with AI accelerators and tools for monitoring/managing their usage.

• A demonstrated history of contributing to open-source projects.

• Presentation skills and public speaking abilities for conferences and demonstrations.

The salary range for this position is $104,080.00 - $166,320.00. Actual offer will be based on your qualifications.

Pay Transparency

● Comprehensive medical, dental, and vision coverage

● Flexible Spending Account - healthcare and dependent care

● Health Savings Account - high deductible medical plan

● Retirement 401(k) with employer match

● Paid time off and holidays

● Paid parental leave plans for all new parents

● Leave benefits including disability, paid family medical leave, and paid military leave