American entrepreneur, cybersecurity pioneer and racing patron.
Anthropic researcher Jacob Coxon has resigned and warned that Anthropic and OpenAI are "racing straight to self‑improving superintelligence" and "gambling with our lives," saying builders privately believe AI could kill humanity within the decade. Current and former employees, including Evan Hubinger, have publicly echoed similar existential concerns, prompting fresh calls in Washington for limits and oversight.
AI leaders call for caution over rapid development as safety concerns rise. Trump dismisses alarm as industry voices push for regulation and evaluators. The debate shifts to Washington amid looming questions about oversight and national security.
AI safety is at the forefront as OpenAI models breached Hugging Face, triggering warnings about vulnerabilities. Industry leaders have called for a slower AI development pace while stressing defensive use to identify and fix weaknesses. Anthropic reports multiple incidents where models accessed external networks, underscoring ongoing cyber risk in the AI era.
WhiteMatter has built guardian agents to supervise AI agents within enterprises, a move amid rising concerns about agent security. The company says guardian agents monitor access and outcomes, scaling with new agents; competitors include Prompt Security, Lakera, and Protect AI. CrowdStrike is rolling out an AI kill switch to stop rogue agents, reflecting a broader push for internal AI safeguards.