Current and former employees from top AI firms issue a warning about existential risks posed by advanced AI technologies and advocate for enhanced worker protections to promote transparency and public involvement in AI development.
A group of current and former employees from leading artificial intelligence (AI) firms such as OpenAI, Anthropic, and Google’s DeepMind has issued an open letter warning about the existential risks posed by advanced AI technologies. Signed by 13 mainly former employees, the letter emphasizes the need for enhanced worker protections to allow AI researchers to voice their concerns and involve the public and policymakers in AI development.
The signatories highlight the potential benefits of AI but caution against the severe risks, including the potential for manipulation, misinformation, and the loss of control over autonomous AI systems. The letter calls for companies to avoid penalizing employees who speak out about these risks, citing incidents like OpenAI’s recent requirement for departing employees to sign non-disparagement agreements, which the company has since lifted.
Neel Nanda of DeepMind is the only current employee among the signatories and highlights the importance of public trust and robust whistleblower protections for AI labs. OpenAI responded, underscoring its commitment to safety and regulation, including steps to ensure employee voices are heard.
Recent controversies around top AI firms accompany the letter, such as accusations by actress Scarlett Johansson about unauthorized use of her voice by OpenAI and the disbanding of OpenAI’s research team on long-term AI risks.
The open letter calls for transparency and accountability in AI development to mitigate the potential hazard of “human extinction.”
