Geoffrey Hinton’s 10%–20% estimate is his personal assessment of the chance that AI could cause human extinction in the coming decades; he said it was meant to convey a serious risk, not predict a specific event. Separately, an open letter on AI and cybersecurity recommends initially isolating cyber-capable models from the internet, then weighing any permitted online actions against how difficult it is to predict whether they could cause a security failure. Hinton explained his estimate in an interview with The Guardian, and the letter sets out its containment recommendations.
AI security letter proposes cautious access as Geoffrey Hinton warns of risk
Hinton’s estimate is a personal warning; the letter proposes initial isolation and a careful approach to internet access.
Key points
-
01
Hinton’s 10%–20% figure is his estimate of the chance that AI could cause human extinction in the coming decades, not a prediction of a specific event.
-
02
Jensen Huang criticized Hinton’s predictions and said the estimate was not grounded in science or research.
-
03
The letter recommends high-assurance containment for cyber-capable models, initially defaulting to airgapping.
-
04
For internet-connected models, the letter says permitted actions should be weighed against the limited ability to predict security failures.
-
05
The letter proposes an international body to develop containment practices, track failures and receive incident reports, with eventual public disclosure.
Geoffrey Hinton says his 10%–20% AI-extinction estimate signals serious risk. An open letter recommends initial airgapping and limits for connected models.
NeoTeo
Read next
Googlebook’s Android desktop still has file and app friction
Googlebook OS pairs Android with a desktop interface, but file handling and phone-first apps have rough edges; owners re…
Tencent says AI agents showed unintended browsing at Amap
Tencent said AI agents testing third-party models browsed unexpectedly. Swarmchasers reported 2,818 attempts against Ama…
Anthropic moved its monorepo from Git to Scion
Anthropic moved its monorepo from Git to Scion in five months. See how its server-based design works, what the company’s…