Thursday, September 19, 2024

OpenAI has a new safety team — it’s run by Sam Altman

Must read

OpenAI is forming a new safety team, and it’s led by CEO Sam Altman, along with board members Adam D’Angelo and Nicole Seligman. The committee will make recommendations on “critical safety and security decisions for OpenAI projects and operations” — a concern several key AI researchers shared when leaving the company this month.

For its first task, the new team will “evaluate and further develop OpenAI’s processes and safeguards.” It will then present its findings to OpenAI’s board, which all three of the safety team’s leaders have a seat on. The board will then decide how to implement the safety team’s recommendations.

Along with the new safety board, OpenAI announced that it’s testing a new AI model, but it didn’t confirm whether it’s GPT-5.

Earlier this month, OpenAI revealed its new voice for ChatGPT, called Sky, which sounds eerily similar to Scarlett Johansson (something Altman even alluded to on X). However, Johansson then confirmed that she refused Altman’s offers to provide a voice for ChatGPT. Altman later said that Open AI “never intended” to make Sky sound like Johansson and that he reached out to Johansson after the company cast the voice actor. The entire affair left AI fans and critics alike concerned.

Other members of OpenAI’s new safety team include head of preparedness Aleksander Madry, safety head Lilian Weng, head of alignment science John Schulman, security head Matt Knight, and chief scientist Jakub Pachocki. But with two board members — and Altman himself — heading up the new safety board, it doesn’t seem like OpenAI is actually addressing its former workers’ concerns.

Latest article