Frontier Mannequin Discussion board updates
Over the previous yr, trade has pushed vital advances within the capabilities of AI. As these advances have accelerated, new educational analysis into AI security is required. To handle this hole, the Discussion board and philanthropic companions are creating a brand new AI Security Fund, which is able to assist impartial researchers from all over the world affiliated with educational establishments, analysis establishments, and startups. The preliminary funding dedication for the AI Security Fund comes from Anthropic, Google, Microsoft, and OpenAI, and the generosity of our philanthropic companions, the Patrick J. McGovern Basis, the David and Lucile Packard Basis[^footnote-1], Eric Schmidt, and Jaan Tallinn. Collectively this quantities to over $10 million in preliminary funding. We expect extra contributions from different companions.
Earlier this yr, the members of the Discussion board signed on to voluntary AI commitments on the White Home, which included a pledge to facilitate third-party discovery and reporting of vulnerabilities in our AI programs. The Discussion board views the AI Security Fund as an essential a part of fulfilling this dedication by offering the exterior group with funding to raised consider and perceive frontier programs. The worldwide dialogue on AI security and the overall AI information base will profit from a wider vary of voices and views.
The first focus of the Fund can be supporting the event of latest mannequin evaluations and strategies for pink teaming AI fashions to assist develop and take a look at analysis strategies for doubtlessly harmful capabilities of frontier programs. We imagine that elevated funding on this space will assist elevate security and safety requirements and supply insights into the mitigations and controls trade, governments, and civil society want to reply to the challenges introduced by AI programs.
The Fund will put out a name for proposals inside the subsequent few months. Meridian Institute will administer the Fund—their work can be supported by an advisory committee comprised of impartial exterior specialists, specialists from AI corporations, and people with expertise in grantmaking.
