Accelerate generative AI feature development by preparing comprehensive and automated trust and safety evaluations set across all relevant data types/languages and that cover all critical generative AI user journeys (e.g., edits, search, etc.).
Conduct research, identify emerging risk areas, abuse vectors, and edge cases, and build internal and external partnerships for generative AI safety.
Partner with product, engineering, policy, research, central trust and safety, etc. to develop tailored testing approaches, tools, and solutions (e.g., test accounts etc.), test execution, and model output analysis to inform improvement areas and safety mechanisms.
Establish testing to discover residual and emergent risks.
Define program metrics and communication, and establish health metrics and feedback loops with stakeholders to evolve the program and report on key insights.
Minimum qualifications:
Bachelor's degree or equivalent practical experience.
5 years of experience managing projects and defining project scope, goals, and deliverables.
5 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
Preferred qualifications:
Experience working with Google's products and services (e.g., generative AI products).
Experience in SQL, building dashboards, data collection/transformation, or visualization/dashboards or experience in a scripting/programming language (e.g., Python).
Knowledge of content moderation policies and best practices.
Excellent problem-solving skills with attention to detail in an ever-changing environment.
