Finding the best job has never been easier
Apple QA Engineer - Generative AI Support Apps United States, Texas, Austin 970783377
02.02.2025
Share
Description
As a QA Engineer focused on Generative AI Product operations, we design and implement robust testing strategies for Generative AI solutions. Testing will include functionality, performance, accuracy and production sampling. Using the latest emerging AI technology, we test feature quality and assess customer experience. We will also collaborate with data scientists, ML engineers, and product teams to define testing requirements and identify potential risks. We develop and maintain automated test suites for AI/ML pipelines and APIs. Test data preprocessing pipelines and ensure data quality for AI model training. We validate AI generative solutions for bias, fairness, and ethical compliance. Perform load, stress, and security testing on solutions to ensure reliability.In this role, you will be the SME for auditing Generative AI quality across the AppleCare Digital platform. Collaboration, detailed troubleshooting, effective communication of issues, and timely resolution are critical skills required to succeed.
Minimum Qualifications
- Bachelor's in Computer Science, Software Engineering or similar field of study
- 3+ years of experience in QA engineering, with a focus on AI/ML systems.
- Strong programming skills in Python, Java, or another relevant language.
- Hands-on experience with testing frameworks like PyTest, Selenium, or JUnit.
- Familiarity with ML frameworks such as TensorFlow, PyTorch, or Hugging Face.
- Understanding of RESTful APIs and tools like Postman for API testing.
- Knowledge of CI/CD tools like Jenkins, GitHub Actions, or GitLab.
- Experience in validating Generative AI models (e.g., GPT, DALL-E)
- Knowledge of NLP, computer vision, or multimodal models.
- Familiarity with synthetic data testing techniques.
- Experience in verifying training data integrity and bias detection.
- Familiarity with data annotation tools and quality control processes.
- Experience with prompt engineering and LLMs in a hands-on capacity
Preferred Qualifications
- Master's or equivalent experience in Computer Science, Software Engineering, or an MBA is a plus
- Understanding of LLM fine-tuning and evaluation metrics (e.g., BLEU, ROUGE, F1-score).
- Knowledge of XAI (explainable AI) tools (e.g., SHAP, LIME).
- Familiarity with regulations like GDPR and AI ethics frameworks.
- Experience with cloud platforms (AWS, Azure, Google Cloud) and MLOps tools (e.g., Kubeflow, MLflow).
- Proficiency in load testing tools like JMeter or Locust.
- Experience with security best practices in AI systems
- Expert in the use of industry-standard data analysis and reporting tools including Tableau
Additional Requirements
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.
These jobs might be a good fit
