Boston Scientific Software Engineer SQA - AI/ML Products 

India, Haryana, Gurugram 

89555662

India-Haryana, Gurgaon

Your responsibilities will include:

• Develop and execute comprehensive test plans for AI/ML features including chatbots, recommendation engines, RAG search, and copilots.
• Design and maintain automation frameworks (Selenium, Cypress, Playwright, PyTest) for UI, API, and model‑level testing.
• Implement evaluation harnesses using LangSmith, RAGAS, LangTest, and custom scripts to score relevance, hallucination, fairness, and toxicity.
• Validate RAG pipelines end‑to‑end: embeddings, retrieval quality, prompt integrity, and response grounding.
• Monitor post‑deployment AI performance for drift, regression, and latency; partner with MLOps teams to triage incidents.
• Collaborate with product managers, data scientists, and engineers to define expected outcomes and edge‑case scenarios.
• Document test results, file defects, and drive root‑cause analysis to closure.

Required Qualifications:

• 6+ years of software quality assurance or test‑automation experience, including AI/ML products.
• Proficiency in Python or JavaScript and experience with RESTful API testing (Postman, Swagger).
• Hands‑on with automation tools such as Selenium, Cypress, Playwright, or PyTest.
• Knowledge of LLM evaluation frameworks (LangSmith, RAGAS) and vector database APIs.
• Strong foundation in QA processes: test planning, regression testing, CI/CD integration, and defect lifecycle management.

Preferred Qualifications:

• Experience testing RAG or agentic AI workflows at scale.
• Familiarity with monitoring solutions for model drift and data drift (Vertex AI, Azure Monitor, Fiddler).
• Exposure to ethical‑AI or bias‑testing methodologies.
• Background in healthcare or other regulated domains.