
OpenAI Embedded Safety Assessments Bring Outside Researchers Inside
OpenAI is letting outside safety researchers work inside the company. On Monday, November 16, it announced agreements with four independent groups, Apollo Research, METR, Transluce and Goodfire, for the first phase of what it calls embedded safety assessments. The researchers will get sustained access to internal models and systems, including model checkpoints, source code, training data and monitoring tools. Apollo Research published the most detailed terms. Six of its researchers will spend four months inside OpenAI, on OpenAI hardware, testing whether models try to subvert their own alignment or control systems. Apollo will publish two public reports; unredacted versions go to OpenAI’s board Safety and Security Committee. ...
