Frontier threat and preparedness
To attenuate these dangers as AI fashions proceed to enhance, we’re constructing a brand new group referred to as Preparedness. Led by Aleksander Madry, the Preparedness group will tightly join functionality evaluation, evaluations, and inside pink teaming for frontier fashions, from the fashions we develop within the close to future to these with AGI-level capabilities. The group will assist observe, consider, forecast and defend towards catastrophic dangers spanning a number of classes together with:
- Individualized persuasion
- Cybersecurity
- Chemical, organic, radiological, and nuclear (CBRN) threats
- Autonomous replication and adaptation (ARA)
The Preparedness group mission additionally consists of growing and sustaining a Danger-Knowledgeable Improvement Coverage (RDP). Our RDP will element our method to growing rigorous frontier mannequin functionality evaluations and monitoring, making a spectrum of protecting actions, and establishing a governance construction for accountability and oversight throughout that growth course of. The RDP is supposed to enrich and prolong our present threat mitigation work, which contributes to the security and alignment of latest, extremely succesful methods, each earlier than and after deployment.
