Protection Scientist Engineer, Integrity
Company: OpenAI
Job description
About the Team
The Integrity team is responsible for the scaled systems that help identify and respond to bad actors and harm on OpenAI’s platforms. We protect users and the wider world by developing responses to complex harms and building the harm protections needed for new product and model launches. Integrity’s work spans not only across frontier harms like biological weapons and cybersecurity, but also high severity abuses such as child safety, nation-state misuse, and violence.
About the Role
Protection Scientists within Integrity design, orchestrate, and mature systems of defence against usage harms enabled by OpenAI's products. We are systems thinkers that combine deep harm domain expertise with breadth across investigation, data science, machine learning, policy and operations. Our distinctive strength is understanding how these disciplines fit together and translating between them to design and build effective systems of defence.
In London, we are hiring for protection work focused on scams, suicide and self-harm, or jailbreaks. Depending on your domain expertise, you could build systems that detect AI-enabled fraud and deceptive activity, identify interactions that may facilitate or encourage suicide and self-harm, or investigate attempts to circumvent model safeguards. These areas require different approaches, from understanding adversarial tactics and victim targeting to applying careful contextual judgement to sensitive conversations and emerging patterns of model misuse.
Your core hands-on technical responsibility is harm detection. You will design, build, evaluate and maintain production detection systems, drawing on investigative expertise, data and shared engineering platforms. You will develop signals and classifiers that identify harmful activity and interactions accurately, and improve them as products, behaviour and patterns of use evolve.