Salesforce Senior Principal Data Scientist - Technical AI Ethicist 

United States, California, San Francisco 

343132083

Job Category

Job Details

Responsibilities:

• Adversarial Testing

  • Provide technical leadership in designing, prototyping, and implementing comprehensive adversarial testing strategies, including both automated and manual adversarial testing approaches

  • Mentor and guide collaborator teams on adversarial testing standard processes, helping them develop the skills to conduct their own testing effectively

  • Collaborate with cross-functional teams to integrate OEHU adversarial testing frameworks into the AI development lifecycle
    

• Safety and Robustness

  • Contribute to the development of detection models, safety guardrails, and other proactive measures to prevent and mitigate risks posed by bad actors

  • Research and implement innovative techniques for enhancing AI safety and robustness, drawing from both open-source and internal tools

  • Collaborate with Salesforce’s AI Research team on novel approaches to model safety
    

• Technical Research and Implementation

  • Write clean, efficient, and well-documented code (primarily in Python) to support research efforts and facilitate the evaluation of AI systems

  • Develop and maintain a repository of reusable code modules and libraries to streamline adversarial testing processes
    

• Testing Execution and Collaboration

  • Participate in scoping, documenting, and implementing tests with partner teams, including the implementation of mitigations identified during testing

  • Test for technical vulnerabilities, model vulnerabilities, and harm/abuse including but not limited to bias, toxicity, and inaccuracy

  • Participate in labeling test data in partnership with OEHU and partner teams
    

• Reporting, Documentation, and Continuous Learning

  • Write reports covering the goals and outcomes of testing operations, including significant observations and recommendations

  • Continuously monitor and analyze emerging threats and vulnerabilities to inform the development of adaptive safety measures

  • Continue to grow expertise in model safety by keeping up with research in socio-technical systems, privacy,interpretability/explainability,robustness, alignment, and responsible AI

Qualifications:

• A related technical degree required

• 7+ years of proven experience in Software Engineering, AI ethics, AI research, or similar roles

• Experience creating heuristic-based detection logic and rules for identifying anomalous or suspicious activity in systems and networks (e.g. log analysis, user behavior analytics)

• Experience using SQL and relational databases. Ability to use Python, R, or other scripting languages to perform data analysis at scale

• Experience with problem-solving and troubleshooting sophisticated issues with an emphasis on root-cause analysis

• Experience in analyzing sophisticated, large-scale data sets and communicating findings to technical and non-technical audiences

• Proven organizational and execution skills within a fast-paced, multi-stakeholder environment

• Experience working in a technical environment with a broad, cross-functional team to get results, define requirements, coordinate assets from other groups (design, legal, etc.), and deliver key achievements

• Excellent written and oral communication skills, as well as social skills, including the ability to articulate technical concepts to both technical and non-technical audiences.

• Works well under pressure, and is comfortable working in a fast-paced, ever-changing environment

If you require assistance due to a disability applying for open positions please submit a request via this.

Posting Statement

does not accept unsolicited headhunter and agency resumes.