AI Safety Systems

The distinction in this session that deserves to travel is a two-word change: the model is moving from an attention economy to an attachment economy. That changes what is measured and what regulation would have to address, because attention competes for time while attachment competes for relationship, and the two produce different products from identical technology. Attention is finite in a way people notice; attachment produces reliance that feels like preference, which makes it harder to regulate for the same reason it is harder to notice. The supporting argument is about incentives rather than intent: earlier engagement produces more data and longer relationships. The regulatory proposal — measuring well-being outcomes rather than asking for safety by design — identifies the right target without solving the measurement problem that made regulators settle for a floor in the first place.

World Economic Forum Annual Meeting

Harari spends most of his address establishing terms before asking the question he came to ask. His preliminary work is to dismantle the word tool: a knife's use is decided by whoever holds it, whereas what is arriving decides for itself, and can also invent new kinds of knives. From there he argues that anything constituted by words — law, books, text-centred religion — is exposed, while drawing a firm line at feeling, where he says there is no evidence at all. The structural claim is that the ancient tension between letter and spirit has always run inside humanity and is about to be externalised between humans and the new masters of words. Only then does he arrive at personhood, and his handling is precise: corporations, New Zealand rivers and Indian deities hold legal personhood safely because the decisions are made by humans behind the container. An entity that decides for itself ends that arrangement. He does not answer the question; he tells the room it is coming.

World Economic Forum Annual Meeting

A year after their first joint appearance, the heads of Anthropic and Google DeepMind returned to a shared stage and disagreed mainly about speed. Amodei held to a horizon of one to two years for systems that outperform humans across most cognitive work, resting the claim on a self-improvement loop that runs through code; Hassabis kept to the end of the decade, arguing that verifiable domains like coding and mathematics automate far earlier than natural science, and that the capacity to pose a new question rather than answer an existing one is still missing. The exchange is most useful where they converge: both accept the loop is the variable that decides everything, both are sceptical of doomerism without dismissing the risk, and both want more time than the competitive dynamic allows. Amodei's chip-export argument and Hassabis's call for minimum international safety standards are the two concrete policy asks.

World Economic Forum Annual Meeting