Protection Scientist Engineer, Integrity
Company: OpenAI
Job description
About the Team
The Integrity team is responsible for the scaled systems that help identify and respond to bad actors and harm on OpenAI’s platforms. We protect users and the wider world by developing responses to complex harms and building the harm protections needed for new product and model launches. Integrity’s work spans not only across frontier harms like biological weapons and cybersecurity, but also high severity abuses such as child safety, nation-state misuse, and violence.
About the Role
Protection Scientists within Integrity design, orchestrate, and mature systems of defence against usage harms enabled by OpenAI's products. We are systems thinkers that combine deep harm domain expertise with breadth across investigation, data science, machine learning, policy and operations. Our distinctive strength is understanding how these disciplines fit together and translating between them to design and build effective systems of defence.
In San Francisco, we are hiring for protection work focused on sextortion, trafficking, national security (including nation-state misuse), and jailbreaks. Depending on your domain expertise, your work could include identifying AI-enabled coercion and exploitation, detecting misuse that supports trafficking, uncovering coordinated activity by state-linked actors, or investigating attempts to circumvent model safeguards. You will translate these evolving threats into detection systems and interventions that reduce harm.
Your core hands-on technical responsibility is harm detection. You will design, build, evaluate and maintain production detection systems, drawing on investigative expertise, data and shared engineering platforms. You will develop signals and classifiers that identify abusive behaviour and patterns across accounts and activity, and adapt them as adversaries change tactics.