Français English
Artificial Intelligence 4 min read

Demis Hassabis has a plan to harness AI safely

Author: user avatar Editors Desk Source: The Economist
Photograph: Getty Images
Photograph: Getty Images

The Google Deepmind co-founder sets out his vision in an exclusive interview

THE WORLD’S artificial-intelligence superpowers are beginning to throw their weight around. The American government’s short-lived decision to withhold foreigners’ access to Fable, a whizzy AI model from Anthropic, reflected not just a desire for control over the technology but also fear of the dangers it could pose in the wrong hands. Now China is said to be considering also curbing overseas access to its most advanced models. Yet for AI to be harnessed safely, the industry needs a plan that is coherent and predictable. Sir Demis Hassabis, the co-founder of Google DeepMind, thinks he has one.

Sir Demis has sketched out proposals for AI regulation in the past. His latest attempt—published online on July 14th and elaborated in an exclusive interview with The Economist—is more concrete. The American government, he says, should develop a system for testing the safety of new AI models before they are released. “It’s important that it’s not just an industry body,” he adds. But a regular government agency wouldn’t do either. “It would not be able to move fast enough, or have the right resources.” Instead, Sir Demis suggests taking inspiration from FINRA, the Financial Industry Regulatory Authority, a private agency in America that regulates brokers and stock markets.

It is a pragmatic proposal. Gone are the optimistic hopes, still held by some of his peers, of first establishing international consensus: America, he says, must lead the way. Agreement is not required because other countries will fall in line in order to maintain access to American technology and the American market. One day that could even include China, helping to defuse a race to the bottom on safety. Although he thinks the scheme should initially be voluntary for model-makers, his expectation is that it will end up mandatory. FINRA, by way of example, has hard enforcement powers delegated to it by the state.

Sir Demis’s approach differs from that suggested by Sam Altman, the boss of OpenAI, who penned an op-ed in the Financial Times earlier this month. Both men agree that the work of the new oversight body would be to establish standards, analyse risks and ensure that only countries that have joined the cause gain access to cutting-edge AI. Mr Altman, however, has called for an international effort, albeit one co-ordinated by America. Both proposals were presented to world leaders at a recent G7 summit in France.

Sir Demis’s proposal is the most detailed to have arrived from an AI bigwig. The industry’s senior figures tend to be more comfortable calling for rules in the abstract than designing regulatory agencies from scratch. Sir Demis, by contrast, has considered the practical details. He says the new agency should be funded by the industry, and that much of its immediate attention would be directed towards recruiting a talented team (existing AI-safety bodies could offer support in the short term).

Sir Demis suggests that the new agency focus on the labs making the most capable AI models. Earlier proposals from America and the European Union looked to the amount of computing power used to train a model as a rough guide for when oversight was required. Sir Demis instead suggests designating AI models as “frontier” if they meet certain thresholds on a selected set of benchmarks. The creators of those models would then be designated as “frontier labs” with extra responsibilities. Sir Demis is proud of the “elegant” way that approach sidesteps the question of whether academic or open-source models should be included or not. What matters is their capabilities.

Selecting the right benchmarks would be an important job for the new agency. Existing tests of AI models focus largely on commercial capabilities, like coding and general knowledge. Some organisations have gone further: Britain’s AI Security Institute, for example, has a well-regarded test for hacking capabilities which simulates breaking into a power station. But other characteristics, like how willing a model is to ignore instructions or pretend to be less capable than it is, are rarely examined in a systematic way that can be used to set a safety threshold.

Securing support from within the increasingly fractious AI community will not be easy, though the commonalities with Mr Altman’s proposal suggest it is not impossible. The American government also appears to have been listening, and is said to be close to unveiling its preferred approach.

Then will come the hard part. “No proposal would be immune to being executed poorly,” Sir Demis admits. “There are obviously versions of this that could be not very useful.”

Yet he argues that action is urgently required. “Time is short, the hour is late. We’ve seen the cyber threat; there’s much more serious threats coming down the line. Something has to be done: this is the time.” 

To track the trends shaping commerce, industry and technology, sign up to “The Bottom Line”, our weekly subscriber-only newsletter on global business.

Advertisement
You did not use the site, Click here to remain logged. Timeout: 60 second