Key takeaways from the AI Safety Summit

The UK’s AI Safety Summit has achieved as much as was realistically possible. Here, we look at the aftermath of the Summit and where it leaves the global AI governance agenda.
Forefront Advisers writing up the AI Summit, with AI machines

In the already narrow space for influencing the international AI agenda, the UK’s AI Safety Summit achieved as much as it could.

Although scaled down from Sunak’s initial ambitions, the AI Safety Summit achieved commitments from both the US and China to share AI threats, a national (more so than international) initiative on AI safety testing, and the continuation of the Summit in 2024.

The Summit consolidated the narrative of the catastrophic and security risks of frontier AI. This narrative is set to develop, for example, with a focus on the use of AI in dual-use goods.

Developments in the run-up to and during the Summit demonstrate that the AI governance space is only becoming more competitive. The rise of the US’s influence will squeeze the ability of the UK and other smaller nations to shape the agenda.

The Summit has now been established as yet another piece in the jigsaw of AI governance. Its purpose going forward may be to maintain a US-China dialogue as it serves tech-ambitious nations. However, the bigger debates on areas such as trade, intellectual property, and privacy will likely continue to contribute to an East-West rift.

As we wrote in the lead-up to the Summit, the UK’s definition of “success” was getting consensus from a broader group of countries on the risks associated with frontier AI, as well as a commitment to mitigate them.

In this context, the UK had a good Summit. The so-called “Bletchley Declaration” was signed on Wednesday by 28 nations, including one vote for the EU. This is the first time that China and the US have agreed in the area of AI governance and creates a narrow avenue for trust in the otherwise strained US-China trade relationship. If the entente cordiale lasts, it will be a British diplomatic victory.

The communiqué sets out three commitments: first, to share information on the risks of frontier AI (in a similar way to the existing threat-sharing mechanisms in cybersecurity); second, to develop national as well as international AI governance mechanisms; and third, to support “an internationally inclusive network of scientific research on frontier AI safety”.

Of these, the threat-sharing commitment is likely to become the most tangible. It was also a focus on Commission President Ursula von der Leyen’s address at the Summit. Regulatory coordination, on the other hand, is much further off, given many of the signatories – including the UK and EU – already have divergent approaches to regulating AI.

The second tangible deliverable of the Summit is the UK Safety Institute. Sunak announced last week that the UK’s Frontier Model Taskforce will evolve to become a permanent Institute, with Ian Hogarth – the current head of the Taskforce – continuing in post. The aim is to create public sector capability for testing foundation models before they are placed on the market and once they are operational.

In terms of computing power, the UK’s commitment to the Institute is sizeable – a new AI Research Resource. This £300 million network includes some of Europe’s supercomputers and priority access to two new supercomputers in Bristol and Cambridge. However, the international appeal of the Institute has been lukewarm so far.

The initiative was also overshadowed by the White House’s announcement of a US AI Safety Institute on the morning of the first day of the Summit. Although the two Institutes have committed to work together, this is a largely symbolic gesture. It is far more likely that they will focus on servicing domestic foundation model providers and those of the countries’ geopolitical spheres of influence – which will give the US Institute a more prominent role.

The Summit outcomes are a scaled-down version of Sunak’s ambition to establish an international research body modelled on the Intergovernmental Panel on Climate Change (IPCC). Still, they create a parallel model for US-China engagement.

The Summit debates were wide-ranging, covering issues from AI impact on labour to the treatment of open source. Underpinning them was the agreement that AI could create catastrophic risks and national security issues. This is a distinctive US and UK-driven narrative and one that is set to expand on the international agenda.

To that end, a top priority of the Safety Institute will be to assess the dual-use capabilities of complex AI systems.

We are likely to see other international structures pick up this narrative.

The Bletchley Park 100 (attendees of the Summit) also committed to the longevity of the format. As early as the opening speech, it was announced that it would be continued biannually, with South Korea as the next host in six months, followed by France in a year.

Like the UK, these are moderate-sized countries with an outsized tech sector. As such, the Summit format is likely to be used as a way for tech-focused countries to assert their voice more strongly than they would otherwise be able to in bigger, more established US-influenced multilateral fora such as the G7 or UN.

No formal mandate was given to the next AI Safety Summits. Therefore, the tension between this cooperation format and other international initiatives will continue, driven by the ambition of the participating nations to set themselves apart as AI leaders. The number of US announcements this week only fuels that competitive ambition.

In parallel, the UN High-level AI Advisory Board will also deliver a leadership meeting in November next year, and the G7 Hiroshima Process is set to evolve to further work under Italy’s presidency in 2024. The UN process, in particular, will also seek to ensure that China’s participation in the international debate is secured, at least on the baseline level of scientific knowledge exchange.

Whether via the Safety Summits, the UN process, or otherwise, China plans to pivot towards a more open foreign policy engagement with the West. This will be met with US suspicion.

In this context, the Summit in South Korea will be successful if it can extend the parallel track of truly international cooperation. What it likely will not discuss is the much more sensitive issue of trade in AI and related hardware, such as semiconductors. For this reason, its overall impact on the international stage will be restricted.

This has been a fraught few months for the UK and an incredibly busy week for AI governance. In the end, the Summit has achieved about as much as the UK could have hoped for, with China’s participation and a commitment to future international collaboration secured.

The Summit has also triggered a flurry of AI initiatives from individual countries, indicating that competition for leading international AI governance is only increasing.

Looking ahead, the most important issue to watch in the global governance space will be the rise of the US’s influence in the AI agenda and the implications this could have for China’s nascent participation in the debate.

Forefront Advisers’ Emerging Tech service assesses and anticipates how governments and policymakers in the EU and UK are adapting to drastic technological change, including AI and quantum computing. See how it can support you.

Share Post:

Stay Connected

More Updates

More Posts

Starmer’s UK-EU reset: rhetoric rises, reality lags 

Managing Director James Nation outlines how Starmer and Reeves are advancing a more openly pro-EU stance to reset UK–EU relations, while highlighting the persistent gap between political rhetoric and practical constraints, and what this means for domestic politics, negotiations with Brussels, and the risks facing Labour ahead of the next election.

Forefront Advisers Limited, 20 St Thomas St, London SE1 9RS, registered in England and Wales, no. 13248974

Scroll to Top

Discover more from Forefront

Subscribe now to keep reading and get access to the full archive.

Continue reading

Joseph Steward

Director

Joseph works across Forefront’s digital assets and UK political teams. He joined Forefront from the FCA, where he worked on developing the UK’s crypto policy, with a particular focus on stablecoins. During his time at the FCA he also covered UK strategy and engagement in the Asia-Pacific region and was seconded to HM Treasury ahead of the 2024 general election to support the government transition and cover US and Canada financial services policy. He holds a degree in politics from University College London, which included a year at the Higher School of Economics in Saint Petersburg.

Jessica Hazel

Senior Analyst

Jess works on coverage of Energy and Sustainability policy, typically focusing on activities in the UK market.

She previously worked as a Hydrogen Policy Official for the Scottish Government, covering a range of different policy areas in her time there. 

Jess completed her MSc in Environment and Development at the University of Edinburgh.

Manon Quénel

Associate Director

Manon works on the coverage of the EU sustainability policy focusing on the sustainable finance agenda and corporate accountability rules.

Before joining Forefront, Manon worked for a Brussels-based public affairs consultancy where she was supporting corporate clients navigate the EU political and regulatory landscape, focusing on the Green Deal and the financial services’ agenda. Previously, she worked in the policy department of the French Economic and Social Council in Paris and interned in the European Parliament in Brussels.

Manon holds a dual degree of master’s in public administration from SciencesPo Strabourg and York University and a specialized master in EU studies from Universite Libre de Bruxelles.

James Nation

Managing Director

James is a Managing Director of UK Politics. He previously worked as the Deputy Head of the Number 10 Policy Unit from 2022 until May 2024 and before that was a Special Adviser to the Chancellor of the Exchequer. Recently, he led the team responsible for the Conservative Party Manifesto in the 2024 General Election campaign. Earlier in his career, James worked as a civil servant in MHCLG and the Treasury, following on from a role in tax and fiscal policy at the CBI. 

Ksenia Duxfield-Karyakina

Managing Director

Ksenia is the Managing Director of Emerging Technology at Forefront. She has spent most of her career in technology policy, working across the UK, Europe, Asia-Pacific, and Emerging Markets. Her expertise spans AI, data governance, cloud, content, and fintech policy areas.

Before joining Forefront, Ksenia led public policy and regulatory affairs for Google Cloud in Europe, and was responsible for YouTube Policy in APAC and Eurasia, based out of Hong Kong. Prior to entering the big tech industry, Ksenia worked in financial services, focusing on anti-fraud and policies addressing financial crime within the OECD ecosystem. She is a journalist by training and holds a PhD in new media economics. Ksenia is a parent to two daughters, an art lover, and an avid reader (of paper books).

Dustin Benton

Managing Director

Dustin is the MD of sustainability at Forefront. Previously, he was policy director at Green Alliance, leading its work across energy, resources, and the natural environment. He previously worked at Defra, where he was chief analytical advisor to Henry Dimbleby’s National Food Strategy and led the department’s analysis of food vulnerability. Earlier in his career, Dustin led on climate and renewables at the Campaign to Protect Rural England. He holds an MA in Political Thought and Theory from the University of Birmingham and an MA in International Relations and French from the University of St Andrews.

Max Kemp

Associate Director

Max works in the EU team on energy & net zero, with a focus on industrial policy. He joins Forefront with several years’ experience in industry associations, first advising local energy companies on EU policy and then representing the glass sector on energy issues. He has also worked in legal and policy consulting for the EU institutions. 

Joseph Steward

Director

Joseph works across Forefront’s digital assets and UK political teams. He joined Forefront from the FCA, where he worked on developing the UK’s crypto policy, with a particular focus on stablecoins. During his time at the FCA he also covered UK strategy and engagement in the Asia-Pacific region and was seconded to HM Treasury ahead of the 2024 general election to support the government transition and cover US and Canada financial services policy. He holds a degree in politics from University College London, which included a year at the Higher School of Economics in Saint Petersburg.

Ramona Visenescu

Associate Director

Ramona is an Associate Director focusing on sustainable finance and circular economy. Ramona previously worked in Brussels at Teneo, where she also covered ESG legislative priorities and interned at the European Commission in DG Economy and Finance. She earned her Bachelor degree in International Relations and European Studies from the University of Bucharest and completed an Advanced Master in Financial Markets at the Solvay Brussels School of Economics & Management.

Pietro Candia

Associate Director

Pietro works across EU Politics and is based in Brussels. Before joining Forefront, he interned in other political risk advisory firms and worked in the government relations division of a major oil corporation. He holds a Bachelor’s degree in International Politics from Georgetown University and a Master’s degree in European and International Public Policy from LSE.

Imogen Stead

Senior Analyst

Imogen works across the Emerging Tech service, covering EU, UK and multilateral policy and regulatory developments in AI and critical technologies. She previously worked on Forefront’s UK Politics note, with a focus on post-Brexit trading relations and foreign policy, and has prior experience of policy and stakeholder management in two UK Civil Service departments. She holds a BA, MPhil and DPhil in Classics from the University of Oxford. 

Michele Grassi

Analyst

Michele works on EU digital assets policy and Italian politics. He previously interned as MEP assistant at the European Parliament and as a Policy analyst at the Lombardy Regional Council. Michele holds a double degree MSc in European Public Policy from LSE and Bocconi University.

Pascal LeTendre-Hanns

Director

Pascal leads on Forefront’s Energy & Net Zero and Sustainability insights. Pascal previously worked in the Paris-based pro-European think tank, EuropaNova. He is leading sustainability policy coverage and following political developments in France and Spain. He graduated from UCL with a First Class Honours degree in European Social and Political Studies, specialising in international relations and French, which included a year at Sciences Po Paris. 

Charles d’Arcy-Irvine

Director

Charles works on political and policy insight advising businesses across different industries. He previously worked in investment banking at Goldman Sachs and Deutsche Bank, as an official at HM Treasury, as a political adviser to George Osborne, and in real estate. He holds a master’s degree in public administration from the John F. Kennedy School of Government at Harvard University and is a Trustee of the Epping Forest Schools Partnership Trust. 

Christopher Glück

Managing Director

Chris leads Forefront’s EU political analysis and insights team. He previously led Hanbury’s EU Public Affairs work. Previously, Chris worked on EU financial services policy in HM Treasury and as policy advisor for Jakob von Weizsäcker in the European Parliament. Chris holds a master’s degree from the College of Europe and read history at the University of Munich. 

Matt Gravelle

Managing Director

Matt leads on the Financial Services and Digital Assets team.  He joined in late 2024 from Kraken, a leading cryptoasset exchange, where he was Head of Policy and Government Relations for the UK and APAC.

Matt has worked in financial services policy since moving to London in 2013. Before his time at Kraken, he spent more than 5 years as a Director in Standard Chartered’s regulatory affairs team, where he focused on crypto and broader markets regulation across the bank’s global footprint. He previously held policy roles at Deutsche Bank and CME Group.  

Matt is originally from Ottawa, Canada, where he worked for the Canadian government and a policy think tank before moving to the UK. Matt studied at Queen’s University (BA) and McMaster (MA) in Ontario and the University of British Columbia (PhD) in Vancouver.

Gergely Polner

Managing Director

Gergely heads Forefront’s EU team. He was previously Head of EU Affairs at Standard Chartered Bank and at the British Bankers Association. Before his City career, he spent eight years at the EU institutions, including as a spokesperson for the EU Council Presidency and Head of UK Public Affairs for the European Parliament. While at the EU Institutions, Gergely worked on the EU’s sanctions regime and the regulatory reform in financial services. He started his career as a lawyer and built a successful legal translation business.

Get in touch

Fill out the form below, and we will be in touch shortly.

James Bergeron

Senior Adviser

James Bergeron leads Forefront’s defence analysis and advice. He is a former US Navy submarine officer and law professor, he has served as the political advisor to ten senior US and NATO commanders.