Fortinet Senior Software QA Specialist 

Canada, British Columbia, Burnaby 

86948001

Job Responsibilities:

• Design and execute system-level and module-level test cases to ensure the correctness and performance of AI security firewall features, including prompt filtering, content moderation, and response policy enforcement.
• Build and manage test datasets to simulate normal, abnormal, and adversarial prompts; evaluate the model’s ability to detect and defend against potential attacks such as prompt injection or misuse.
• Validate the overall effectiveness of model integration, including key metrics such as detection accuracy, false positive rate (FPR), and false negative rate (FNR), while continuously improving test coverage.
• Collaborate closely with R&D, security, and product teams to translate AI security requirements into verifiable test scenarios; participate in bug reproduction and root cause analysis.
• Set up test environments and conduct ongoing regression and performance/stress testing.
• Contribute to building hybrid local/cloud-based testing platforms; be proficient in containerized deployment (Docker/Kubernetes) to support flexible testing across multiple model versions and security policy configurations.
• Stay up to date with industry standards and best practices related to LLM/Generative AI security (e.g., OWASP Top 10 for LLMs), and incorporate relevant threat simulations and validations into test plans.

Job Requirements:

• Familiarity with common AI security threats such as prompt injection, output manipulation, data poisoning, and hallucination; hands-on testing experience in these areas is preferred.
• Proficiency in Python programming, with experience using testing frameworks such as pytest, unittest, or others for automated testing.
• Strong knowledge of RESTful API testing methodologies, and an understanding of model inference interfaces, vector databases, and embedding workflows.
• Experience with containerization and cloud platforms (e.g., Docker, Kubernetes, AWS, GCP, Azure), with the ability to build and manage test environments and perform resource-level debugging.
• Excellent analytical and communication skills, with the ability to drive issue resolution and quality improvement across cross-functional teams.
• Prior experience in testing AI/ML systems, model deployments, or security-related products is highly desirable.

The Canada base salary range for this full-time position is expected to be between $80,000 - $110,000 annually. Wage ranges are based on various factors including the labour market, job type, and job level. Exact salary offers will be determined by factors such as the candidate’s subject knowledge, skill level, qualifications, and experience.