Test case design:
- Good understanding about the various testing touch points in a model development lifecycle
- Participate in discussions with team members to understand testing needs.
- Support the development of test cases based on project requirements.
- Ability to define test cases to validate input data, Model functional performance, Model response etc
Test Execution:
- Execute manual tests for AI models and document results.
- Prior experience in performing AI specific testing methods like Pairwise testing, Metamorphic testing, Back-to-Back testing, Bias Testing, Drift testing etc
- Knowledge on responsible AI testing
- Knowledge on explainability testing tools (e.g., LIME, SHAP etc.)
- Assist in running automated tests and analysing their outcomes.
Model Validation Support:
- Help validate AI models against performance metrics such as accuracy and recall.
- Learn to conduct exploratory testing to identify potential issues.
- Exposure to testing LLM models
Data Quality Checks:
- Collaborate with data teams to ensure the quality of datasets used in testing.
- Participate in data validation activities to maintain data integrity.
- Prior experience in performing various data validation activities like data collection/generation, data augmentation, Exploratory data analysis, data bias and privacy etc
Documentation:
- Document test results and maintain clear records of defects found during testing.
- Prepare summary reports of testing activities for review.
Learning and Development:
- Stay informed about AI testing best practices and tools.
- Seek guidance from senior engineers to improve testing skills and knowledge.
Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
Experience:
- 1-4 years of experience in software testing / development with exposure to Python
- 1+ years in testing on AI/ML applications.
Technical Skills:
- Basic understanding of AI/ML concepts and algorithms.
- Familiarity with programming languages such as Python or Java is a plus.
- Exposure to software testing principles and practices.
- Strong analytical and problem-solving skills.
- Attention to detail and a commitment to quality.
- Experience with testing tools (e.g., Selenium, PyTest) through coursework or internships.
- Knowledge of version control systems (e.g., Git) is a plus.
- Experience with Agile methodologies is a bonus.