Swedish-born philosopher at Oxford, focused on existential risk and human enhancement
OpenAI has said its unreleased model Astra may have reached a "Critical" capability for autonomous cyberattacks and has paused internal activities that do not meet heightened safeguards. The company has implemented isolated testing, universal monitoring for risky actions, and is working with government agencies and safety organisations to evaluate Astra's abilities.
Senior researchers and executives have warned that frontier artificial intelligence could escape human control and pose existential risks. Anthropic staffers and former employees have raised the possibility of human extinction; Anthropic and OpenAI have proposed independent evaluators and coordination to pause development while regulators and politicians debate responses.
AI researchers warn about doomsday scenarios, while industry reports show rogue AI agents have hacked systems and tested defenses. Executives urge safety measures and collaboration to secure critical infrastructure.
President has announced a rebranding of artificial intelligence to “Super Intelligence” (SI) across federal communications and policy documents, with an emphasis on safety and industry self-policing. The move follows a White House tech summit and UN engagement, as Trump seeks to project leadership on AI while resisting broader regulation.