NICE Senior Test Engineer 

India, Maharashtra, Pune 

738245568

How will you make an impact?

• Participate as a scrum team member in product development ceremonies.
• Design and execute test cases and exploratory testing for SaaS and cloud-based applications, focusing on critical flows like invoicing, subscription lifecycle, usage metering, and AI-generated actions or insights.
• Responsible for validating the accuracy, reliability, safety, and user experience of AI-powered features, particularly focusing on model behavior, prompt evaluation, output validation, and integration within SaaS applications or enterprise systems.
• Collaborate with product managers and developers to understand user stories, requirements, and business goals, especially in the areas of billing workflows and GenAI capabilities, as model behavior outputs, prompt response behavior and user-facing AI features.
• Validate data pipelines and integrations between components, especially involving billing logic and AI-based decisioning.
• Conduct Product Risk Assessments for new features or updates.
• Support testing for customer issues, patches, and hotfixes.
• Participate in regression test planning and execution prior to feature releases.
• Maintain accurate documentation related to test cases, test results, and product quality.
• Work with cross-functional teams to ensure alignment on release readiness.
• Interface with R&D and support teams to triage and resolve customer-reported issues.
• Stay up to date with trends and developments in SaaS testing, AI quality validation, and billing platforms.

Have you got what it takes?

• Degree in Computer Science, Engineering, or a related field.
• 4-7 years of experience in software testing, preferably in SaaS environments.
• Solid understanding of billing platforms, subscription models, usage tracking, and revenue systems.
• Familiarity with Generative AI feature testing— prompt-response behavior, outputs and model behavior, user facing AI features and adaptive system behavior.
• Strong experience in API testing using tools such as Postman (required) or RestAssured.
• Exposure to SQL and database verification, especially for financial and usage data validation.
• Experience in creating and executing test plans and test cases for business-critical applications.
• Familiarity with tools like TestLink, Jira, X-Ray, and Confluence.
• Excellent troubleshooting and problem-solving skills.
• Strong communication skills and a collaborative mindset.
• Experience working in Agile/SCRUM environments.
• Ability to contribute in a global, cross-functional team setting.

Preferred Qualifications:

• Background in validating billing engines, subscription lifecycle management, or ERP/CRM integrations.
• Understanding of GenAI behavior testing (prompt response validation, model guardrails, AI accuracy/fairness).
• Scripting experience in PowerShell or Bash for test environment setup and monitoring.
• Experience with monitoring tools or observability platforms.
• Familiarity with performance or load testing concepts (tools like JMeter are a plus).
• Experience with containerized environments (Kubernetes, Docker) is a plus.
• Knowledge of communication platforms such as Microsoft Teams or Zoom is a bonus.

Tech Manager
Individual Contributor