A long way off a Science and Technology Superpower

This is an  extended version of a speech I made in a recent debate held in the Lords on a Report from the Science and Technology Committee "Science and technology superpower”: more than a slogan?  which extensively discussed government policy in science and technology 

The Committee's comprehensive report despite being nearly a year old still has great currency and relevance. Its conclusions are as valid as they were a year ago

Sir James Dyson has described the government’s science superpower ambition as a political slogan. Grandiose language about Global Britain from the Integrated review-and stated ambition to be a Science Superpower by 2030 -or is it a Science and Technology Superpower, is clearly overblown and detracts from what needs to be done. . 

UCL research has demonstrated that if measured by authorship, the UK accounts for about only about 13 per cent of the top 1 per cent of the most highly cited work across all research fields

We have had a proliferation of strategies as the Committee noted. 

  • R&D Roadmap, 
  • the Innovation Strategy,
  • the Life Sciences Vision 
  • the People and Culture Strategy,
  • and the National Space Strategy
  • National Quantum strategy.
  • National semi conductor strategy
  • A taskforce on foundation models is being set up

We have had a whole series of attempts at creating a strategy in various areas but with what follow up and delivery?

As well as the strategies I have mentioned we  have had a series of reviews

  • Professor  Dame Angela McLean’s Pro-innovation Regulation of Technologies Review Life Sciences
  • The Vallance Review of Pro-innovation Regulation of Digital Technologies 
  • Independent Review of Research Bureaucracy the  Review by Professor Adam Tickell 
  • The independent review of UKRI by Sir David Grant
  • We now have the Independent Review of The Future of Compute announced 
  • And now the Chancellors recent Life Sciences package

Where’s the result. What will the KPI’s be ? What is the shelf life of these reviews and where is the practical implementation?

 

T

Take for example the Life Sciences Vision launched back in 2021 

Dame Kate Bingham is quoted as believing the Vaccine scheme legacy has been  ‘squandered’.

Professor Adrian Hill, director of the Jenner Institute, which was responsible for the Oxford Covid vaccine, has said that the recent loss of the Vaccines Manufacturing and Innovation Centre (VMIC) in Oxfordshire, which had been created to respond to outbreaks, showed that the UK had been going backwards since the coronavirus pandemic.

Business investment is crucial. And no where more than in the life sciences sector. 

Lord Hunt of Kings Heath highlighted issues relating to investment in the sector  two weeks ago in his regret motion on the Branded Health Service Medicines (Costs) (Amendment) Regulations 2023. All the levers to create incentives for the development of new medicines are under government control.

As his motion noted the UK’s share of global pharmaceutical R&D has fallen by over one-third between 2012 and 2020. He   argued rightly that both the voluntary and statutory pricing schemes for new medicines schemes are becoming a major impediment to future investment in the UK. We seem to be treating the pharma industry as some kind of golden goose

Despite the government’s Life  Sciences  Vision we see Eli lilley pulling investment on laboratory space in London  because the UK “does not invite inward investment at this time and Astra Zeneca has decided to build its next plant in Ireland  because of the U.K.’s “discouraging” tax rate. 

Eli Lilly, the American multinational, had been looking to investing laboratory space in the UK, but it has put its plans for London on hold because, it said,”

The excellent O’Shaunessy report on clinical trials is all very well but if there is no commercial incentive to develop and launch. new medicines here why should pharma companies want to engage in clinical trials here? The Chancellor’s growth package for life Sciences announced on the 25th May fails to tackle this crucial aspect. 

In other sectors 

  • The CEO  OF Johnson Matthey, a chemicals company with a leading position in green hydrogen,has  said the UK is at risk of losing its lead thanks to a policy vacuum. 
  • The co founder  of ARM, Britain’s biggest semiconductor company, blames our “technologically illiterate political elite” and “Brexit idiocy” for the country’s paltry share of the chips market. 

On these benches however we do welcome the creation of the new department and I welcome  the launch of the Framework for Science and Technology to inform the work of the department to 2030. 

There are 10 key objectives:

  • identifying, pursuing and achieving strategic advantage in the technologies that are most critical to achieving UK objectives
  • showcasing the UK’s S&T strengths and ambitions at home and abroad to attract talent, investment and boost our global influence
  • boosting private and public investment in research and development for economic growth and better productivity building on the UK’s already enviable talent and skills base 
  • financing innovative science and technology start-ups and companies
  • capitalising on the UK government’s buying power to boost innovation and growth through public sector procurement
  • shaping the global science and tech landscape through strategic international engagement, diplomacy and partnerships
  • ensuring researchers have access to the best physical and digital infrastructure for R&D that attracts talent, investment and discoveries
  • leveraging post-Brexit freedoms to create world-leading pro-innovation regulation and influence global technical standards
  • creating a pro-innovation culture throughout the UK’s public sector to improve the way our public services run

What are the key priority outcomes? What concrete plans for delivery lie behind this? And does this explicitly supersede all of the visions and strategies that have gone before? 

As the Committee said in its report

“The government should set out what it wants to achieve in each of the broad areas of science and technology it has identified, with a clear implementation plan including measurable targets and key outcomes in priority areas, and an explanation of how they will be delivered. 

And - The government should consolidate existing sector-specific strategies into that implementation plan”

Also in terms of vital cross departmental working, joining up government on Science and Technology policy what is the role of the eNational Science and Technology Council and what are its key priorities?

This applies especially with Home office on visas for researchers if the UK wants to be a world leader in science and technology, it needs to be world leading in its approach to researcher mobility.

The UK’s upfront costs for work and study visas are up to 6 times higher than the average fees of other leading science nations. The application process for UK visitor visas is also bureaucratic and unwieldy, and the UK has one of the highest visitor visa refusal rates.

There are really important systemic issues which should be a top priority for resolution by the new Department. 

Published at the same time as the DSIT framework was the independent review of the UK’s research, development and innovation  landscape by Sir Paul Nurse,

Sir Paul calculated our spending around 2.5% of GDP. But he still concluded that funding, particularly  provided by government, was limited, and below that of other competitive nations such as  the Germans, South Koreans and US. 

There is the particular and urgent problem of Horizon and the uncertainty around our membership. The absolute top priority for UK R&D should  be rejoining Horizon.We need access to collaboration across the EU  where pre Brexit  we disproportionately benefited from Horizon’s 95 billion euro budget. We need a clear commitment to negotiate re entry. What is the position now nearly two months after the Prime Minister’s  letter to Sir Adrian Smith of 14th April assuring him about our intentions on Horizon?

Iceland and Israel, Norway and New  Zealand, and Turkey and Tunisia, are all already part of Horizon, as is Ukraine. Why not us?

The two universities of Oxford and Cambridge once received more than £130m a year from European research programmes but are now  getting only £1m annually between them.

Meanwhile Britain has fallen behind Russia, Italy and Finland in the world league table for computing power., Britain has slipped from third in the rankings in 2005 to seventh now, according to the Independent Review of The Future of Compute. 

The way the UK delivers and supports research is also “not optimal,” the Nurse review said said. Of course research academics here will know the frustrations of the bureaucracy associated with applying for U.K. research grants. As the Tickell review  found there are issues with bureaucracy around research and development funding. 

EPSRC is according to researchers admirable in how it oversees the research grants. Innovate UK with its  Knowledge Transfer Partnerships however has a far more risk averse and bureaucratic approach just at the point where a bit of commercial risk taking is needed. We need to benchmark to ensure the least bureaucratic processes. I am told that the European Innovation Council is a model

ARIA was specifically designed to avoid bureaucracy as we said during the passage of the bill but why weren't all of UKRI processes remodelled rather than creating a new entity? Incidentally do we have any more information now about their key research and development projects?

The government doesn’t really have a clear idea of the role of university research either. The Research Excellence Framework has the perverse incentive of discouraging cooperation. We should be encouraging strategic partnerships in research especially internationally as the Committee concludes 

Commercialisation is a crucial aspect linking R&D to economic growth.  This in turn means the need for a consistent industrial strategy with the right commercial incentives and an understanding of the value of intangible assets such as IP and data. In this context Catapults are performing a brilliant job but need a bigger role and more resource as the Committee have recommended in a previous report.

Of course we are all much relieved for the tech sector by the rescue of Silicon Valley bank by HSBC. But the popularity of a US bank in a way demonstrates that we  may have a growing start up culture but scale up is still a problem as Sir Patrick Vallance said in his evidence to the Commons Science Innovation and Technology Committee  last month. 

The US is still preferred for listing by tech companies over London as we’ve seen with U.K. based ARM  seeking a listing in the US. 

There are aspects of wider government policy where there is no perceived benefit to U.K. science and technology

  • Reduction of of R & D  tax credits for SME’s
  • Raising corporation tax to 25% 

One of the long outstanding issues is reform to assist with derisking so that pension funds can play their part in helping grow tech companies also mentioned by Sir Patrick as an important  aspiration and I see that finally something is stirring from the British Business Bank with the LIFTS initiative.  

There are many other elements that need to be covered for a viable Science and technology strategy.

Regulatory Divergence 

Even where the government thinks it is being innovation friendly it is clouded by the desire to be divergent from the EU to get some kind of Brexit dividend.. It talks about  pro innovation regulation but Contrary to the advice of virtually every prominent technologist  the AI governance white paper only concerns itself with voluntary sectoral regulation and leaves it to the regulators in particular sectors not proposing a broader risk based regulatory regime like that proposed under the EU’s AIA or indeed by the US Administration’s Blue Print for AI. Maybe that will change after the  Prime Minister’s ’s visit to the US this week. 

Changes to our Data Protection regime proposed by the Data Protection and Digital Information bill no 2 which go further than just clarifying the retained GDPR and of course make changes to the ICO’s structure could leads to a lack of EU data adequacy and new compliance costs.. 

We have waited forever for competition law in the digital space to be reformed through a Digital Markets Act and Digital Markets Unit to be put on a statutory basis and now we have a bill which gives inadequate powers to the CMA to act swiftly to ensure competition.  In the meantime the so called hyperscalers gain greater and greater influence over the development of new technologies such as AI. 

Diversity

 In the the wise words of the British Science Association we must ensure the opportunities and benefits are equitable in any future science strategy, not only to shape a world-leading science industry, but to sustain progress and successfully bring out the potential of people from all communities, backgrounds and regions. Britain cannot be a superpower if parts of society are not welcomed and able to contribute to science research and innovation. Making science inclusive – from classroom to career – is essential to establishing a globally competitive workforce.

Mathematics

As regards mathematics, where is the £300m promised additional funding for mathematical science research as announced in January 2020 or the National Academy for the Mathematical Sciences or a National Strategy for Mathematics.

So much to do for the new Department. I hope that the Minister and his colleagues in DSIT will rise to the challenge 

 


The long-awaited AI Governance White Paper falls far short of what is needed

The long-awaited AI Governance White Paper falls far short of what is needed

The Government's AI Governance White Paper : A Pro Innovation to AI Regulation came out in late March . This is my take on it published by Politics Home. 

Lord Clement-Jones

Lord Clement-Jones

@whiterhino1949

Last week over a thousand leading technologists wrote an open letter pointing out the “profound risks to society and humanity” of artificial intelligence (AI) systems with human-competitive intelligence.

They called inter alia for AI developers to “work with policymakers to dramatically accelerate development of robust AI governance systems”. So, it is ironic that our government published proposals for AI governance barely worthy of the name.

This at a time when there is huge interest and apprehension of the capabilities of new AI, such as ChatGPT and GPT-4, has never been higher.

Business needs a clear central oversight and compliance mechanism, not a patchwork of regulation

A long gestation period of national AI policy making, which started so well back in 2017 with the Hall-Pesenti Review and the creation of the Centre for Data Ethics and Innovation, the Office for AI and the AI Council, has ended up producing a minimal  proposal for “a pro-innovation approach to AI regulation”. In substance this amounts to toothless exhortation by sectoral regulators to follow ethical principles and a complete failure to oversee AI development with no new regulator.

Much of the white paper’s diagnosis is correct in terms of the risks and opportunities of AI. It emphasizes the need for public trust and sets out the attendant risks and adopts a realistic approach to the definition of AI. It makes the case for central coordination and even admits that this is what business has asked for, but the actual governance prescription falls far short.

The suggested form of governance of AI is a set of principles and exhortations which various regulators – with no lead regulator – are being asked to interpret in a range of sectors under the expectation that they will somehow join the dots between them. They will have no new enforcement powers. There may be standards for developers and adopters but no obligation to adopt them.

There is no recognition that the different forms of AI are technologies that need a comprehensive cross-sectoral approach to ensure that they are transparent, explainable, accurate and free from bias whether they are in an existing regulated or unregulated sector. Business needs a clear central oversight and compliance mechanism, not a patchwork of regulation. The government’s proposals will not meet its objective of ensuring public trust in AI technology.

The government seems intent on going forward entirely without regard to what any other country is doing in the belief that somehow this is pro innovation. It does not recognise the need for our developers to be confident they can exploit their technology internationally.

Far from being world leading or turbocharging growth in practice, our developers and adopters will be forced to look over their shoulder at other more rigorous jurisdictions. If they have any international ambitions they will have to conform to European Union requirements under the forthcoming AI Act and ensure they avoid liability in the United States by adopting the AI risk management standards being set by the National Institute for Standards and Technology. Once again government ideology is militating against the interests of our business and science and technology communities.

What is needed – which I sincerely hope the Science and Technology Committee will recommend in its inquiry into AI governance – is a combination of risk-based, cross-sectoral regulation combined with specific regulation in sectors, such as financial services, underpinned by common trustworthy international standards of risk assessment, audit and monitoring.

We have world beating AI researchers and developers. We need to support their international contribution, not fool them they can operate in isolation.

Lord Clement-Jones, Liberal Democrat peer and spokesperson for Science Innovation and Technology in the Lords and co-founder of the All Party Parliamentary Group on AI.  

 


Common Ethics and Standards and Compatible Regulation will let responsible AI Flourish

This is the talk I gave at the opening of the excellent Portraits of AI Leadership Conference organized by Ramsay Brown of the The AI Responsibility Lab  based in LA and  Dr Julian Huppert Director of the Intellectul Forum at Jesus College Cambridge  

It’s a pleasure to help kick off proceedings today.

Now you may well ask why a lawyer like myself fell among tech experts like yourselves  

In 2016 as a digital spokesperson at an industry and Parliament trust breakfast I realized that the level of parliamentary understanding was incredibly low so with Stephen Metcalfe MP then the chair of Science and Technology Select Committee I founded the All Party Parliamentary Group on Artificial Intelligence.The APPG is dedicated to informing parliamentarians about developments and creating a community of interest around future policy regarding AI,  its adoption use and regulation.

As a result I was asked to chair the House of Lords Special Enquiry Select Committee on AI with the remit  to consider the economic, ethical and social implications of advances in artificial intelligence. This produced its report “AI in the UK: Ready Willing and Able?”  in April 2018.  It took a close look at government policy towards AI and its ambitions including those contained in the Hall/ Pesenti Review of October 2017 and those set out by former prime Minister Teresa May in her Davos World Economic Forum Speech including her goal for “ the UK to lead the world in deciding how AI can be deployed in a safe and ethical manner.”  

Since then, as well as co-chairing the All Party AI Group, I have maintained a close interest in the development of UK policy in AI, chaired a follow-up to the Select Committee’s report, “AI in the UK: No Room for Complacency”, acted as an adviser to the Council of Europe’s working party on AI (CAHAI) and helped establish the OECD Global Parliamentary Network on AI. 

I am now the Science Innovation and Technology  Spokesperson for the Liberal Democrats in the House of Lords for my sins.

Accross the world COVID-19  has emphasized and accelerated the dependence of virtually every business and sector on the successful adoption of the latest relevant technologies for their survival. Barely a day goes by without some reference to AI in the news. Both today and yesterday GPT 4 was one of the lead stories. 

Artificial Intelligence presents opportunities in a whole variety of sectors.  Variously we know what it can do,.

  • Detect financial crime/fraud/anti competitive behaviour.
  • Deliver personalised Education-of the learning experience
  • Energy Conservation 
  • In Healthcare: Diagnostics. Drug Discovery and distribution, administration too 
  • Delivery of the UN Sustainable development goals in terms of more productive agriculture, alleviation of hunger and poverty
  • Smart or connected cities
  • In terms of  technology used by regulators or Reg tech

The  opportunities for AI are incredibly varied indeed many people find it unhelpful to have such a variety of different types of machine learning labelled AI as it is. But I think we are stuck with it! There are common factors such as deep neural networks and machine learning. Increasingly the benefits are not just seen around not just about increasing efficiency, speed etc in terms of analysis, pattern detection and ability to predict but more about what creatively AI can add to human endeavour

We’ve seen the excitement over ChatGPT from Open AI and other large language models and AI text to image applications such as DALL E and now we have GPT 4. . The combination of these systems will give every appearance of AGI. 

The anticipated economic benefits over this decade are significant with estimates predicting that the UK’s GDP will be up to 10% higher in 2030 from the development and adoption of AI

But things can go wrong.This isn’t just any old technology-The degree of autonomy, lack of human intervention, the Black box nature  of some systems makes it different from other tech.

This is well illustrated by Brian Christian’s book ; the Alignment Problem and Stuart Russell’s  Human Compatible. The challenge is to ensure that AI is our servant not our master. Stuart Russell says we have to build in uncertainty into the delivery of objectives of AI systems so that a human in loop is not just desirable but necessary.

Furthermore failure to tackle issues such as bias/discrimination and lack of transparency could lead to a lack of public/consumer trust, reputational damage and inability to deploy new technology. Public trust and trustworthy AI is fundamental to continued advances in technology.

Just take for instance 

  • Consumer Financial Services decisions such as on Credit rating
  • Cybersecurity issues
  • Deployment in the workplace 

This is particularly true in government and public sector use of AI.

  • Public sector decisions such as on social security matters
  • Live Facial recognition by the police-The dangers of the surveillance state
  • And of course deployment of Lethal AutonomousWeapons

The need to ensure responsible or ethical AI in its business and public adoption could and should however lead to a positive appraisal of governance more broadly both in the private and public sector

It is clear that AI even in its narrow form will and should have a profound impact on and implications for corporate governance. Trade organisations such as techUK and specific AI organisations such as the Partnership on AI recognize that corporate responsibility and governance on AI is increasingly important.

This means a much more value driven approach to the adoption of new technology. Engagement from boards through governance right through to policy implementation is crucial. This not purely a matter for the CTO/CIO.

Key areas that need tackling 

  • Raising senior management awareness of issues posed by AI 
  • Definition/classification  of AI systems being developed, procured and deployed,
  • Employment issues : will it augment human skills or substitute them?
  • Oversight including Accountability through Boards and Audit and Risk Committees, 
  • Risk assessment that is undertaken with the identification of high risk uses
  • Procurement rules
  • Whistleblowing 

But it also importantly means assessing the ethics of adoption of AI  and the ethical principles to be applied: It may involve the establishment of an ethics advisory committee.

We have a pretty good common set of principles -OECD or G20- which are generally regarded as the gold standard which can be adopted which can help us ensure 

  • Quality of training data
  • Freedom from Bias 
  • The impact on Individual civil and human rights
  • Accuracy and robustness
  • Transparency and Explainability which of course include the need for open communication where these technologies are deployed. 

Generally in business and in the tech research and development world I think there  there is an appetite for regulatory certainty and adoption of common standards  particularly on standards for tools such as 

  • Conformity/risk and impact assessment 
  • AI audit
  • Continuous Monitoring 
  • Scoreboxes
  • And Sandboxing 

I am optimistic too that common standards

can be achieved internationally in all these areas. Work on common standards is bearing fruit.  In particular We have seen the launch last October of the interactive AI Standards Hub by the Alan Turing institute with the support of the British Standards Institution and National Physical Laboratory  which will provide users across industry, academia and regulators with practical tools and educational materials to effectively use and shape AI technical standards. 

This in turn could lead to agreement on ISO standards with the EU and the US where NIST is actively engaged in developing such standards

Agreement on the actual regulation of AI ie what elements of governance and application of standards is obligatory, however, is more difficult. 

There are already some elements of a legal framework in place. Even without specific legislation, AI deployment in the UK will interface with existing legislation and regulation in particular relating to 

  •  personal data under the GDPR  
  •  discrimination and fair treatment under the Human Rights Act and Equality Act
  • product safety and public safety
  • And various sector-specific regulatory regimes requiring oversight and control by persons undertaking regulated functions, the FCA for financial services, Ofcom in the future for social media for example.

But when it comes to legislation and regulation that is specific to AI that’s where some of the difficulties and disagreements start emerging especially from the UK’s divergent approach. 

The UK has stated that it wishes its regulation to be innovation friendly and context specific. We do need however to be clear that regulation is not necessarily the enemy of innovation, it can in fact be the stimulus and be the key to gaining and retaining public trust around digital technology and its adoption so we can realise the benefits and minimise the returns.

Then we have the policy that regulation will be context specific. As regards categorising AI rather than working to a broad definition of AI and determining what falls within scope, which is the approach taken by the EU AI Act, the UK looks like electing to follow an approach that instead sets out the core principles of AI which the government says “allows regulators to develop their own sector-specific definitions to meet the evolving nature of AI as technology advances.”

 This approach which potentially adopts different regulatory requirements across sectors in my view runs the risk of creating barriers for developers and adopters having to navigate through the regulators of multiple sectors even given the new levels of cooperation currently being put in place.  Where a  cross-compatible AI system is concerned for example in finance and telecoms for example they would have to potentially understand and comply with different regimes administered by the FCA, Prudential Reg Authority, and Ofcom at the same time. 

In its  AI policy paper published last July there is a surprising admission by the government that a context-driven approach may lead to less uniformity between regulators and may cause confusion and apprehension for stakeholders who will potentially need to consider a regime of multiple regulators as well as the measures required to be taken to deal with extra- territorial regimes, such as the EU Regulation.

Also the the more we diverge when it comes to regulation from other jurisdictions the more difficult it gets for developers and those who want to develop AI systems internationally

One example is the proposals to water down data protection under the GDPR which could mean difficulty in transferring data between the UK and Europe. The more I look at the new Data Protection and Digital Identity bill introduced into Parliament last week the more problematic it appears. 

In my view without a broad definition and some overarching duty to carry out a risk and impact assessment and subsequent regular audit to assess whether an AI system is conforming to Al principles the governance of AI systems will be deficient, on the grounds alone that not every sector is regulated. 

For example, except for certain specific products such as driverless cars  or say in financial services and as proposed for social media platforms there is no accountability or liability regime established for the operation of  AI systems more broadly..

Regulation could and should take the form of an overarching regulatory regime designed to  ensure public transparency in the use of AI technologies and the recourse available across sectors for non ethical use.This should set out clear common duties to assess risk and impact and adhere to common standards. Depending on the extent of the risk and impact assessed further regulatory requirements  would arise. 

This includes the public sector. Although The UK Government has recognized the need for guidance for public sector organizations in the procurement and use of AI there is no central and local government compliance mechanism and no transparency yet in the form of a public register of use of automated decision making. It is is interesting that many US cities-and indeed big tech companies- have been much more proactive

Also, despite the efforts of Parliamentarians and organisations such as the Ada Lovelace Institute, there is no no recognition at all by Government that explicit legislation and/‘or regulation for intrusive AI technology such as live facial recognition is needed to prevent the arrival of the surveillance state

But International harmonization is in my view essential if we are to see developers able to commercialize their products on a global basis assured that they are adhering to common standards of regulation and I believe would help provide the certainty businesses would need to develop and invest in the UK more readily 

I would go further when it comes to dealing with our nearest trading partner. When the White Paper does emerge I believe that it is important that there is recognition that we need a considerable degree of convergence between ourselves and the EU and that a risk based form of horizontal rather than purely sectoral regulation is required otherwise we face potentially another trade barrier -AI Adequacy -to add to the need for data adequacy.

That in my view is the way to get real traction to realise the full benefits of  the global development of responsible AI, AI for good which we all to see flourish !  


We Can't Let this Disastrous Retained EU Law Bill go through in its current form

In the Lords we recently saw the arrival of the Retained EU (Law Revocation and Reform ) Bill. With its sunset clause threatening to phase out up to 4000 pieces of vital IP, environmental, consumer protection and product safety legislation on 31st December 2023 we need to drastically change or block it. This is what I said on second reading

 I hosted a meeting with Zsuzsanna Szelényi, the brave Hungarian former MP, a member of Fidesz and the author of Tainted Democracy: Viktor Orbán and the Subversion of Hungary. I reflected that this Bill, especially in the light of the reports from the DPRRC and the SLSC, is a government land grab of powers over Parliament, fully worthy of Viktor Orbán himself and his cronies. This is no less than an attempt to achieve a tawdry version of Singapore-on-Thames in the UK without proper democratic scrutiny, to the vast detriment of consumers, workers and creatives. It is no surprise that the Regulatory Policy Committee has stated that the Bill’s impact assessment is not fit for purpose.

It is not only important regulations that are being potentially swept away, but principles of interpretation and case law, built up over nearly 50 years of membership of the EU. This Government are knocking down the pillars of certainty of application of our laws. Lord Fox rightly quoted the Bar Council in this respect. Clause 5 would rip out the fundamental right to the protection of personal data from the UK GDPR and the Data Protection Act 2018. This is a direct threat to the UK’s data adequacy, with all the consequences that that entails. Is that really the Government’s intention?

As regards consumers, Which? has demonstrated the threat to basic food hygiene requirements for all types of food businesses: controls over meat safety, maximum pesticide levels, food additive regulations, controls over allergens in foods and requirements for baby foods. Product safety rights at risk include those affecting child safety and regulations surrounding transport safety. Civil aviation services could be sunsetted, along with airlines’ liability requirements in the event of airline accidents. Consumer rights on cancellation and information, protection against aggressive selling practices and redress for consumer law breaches across many sectors could all be impacted. Are any of these rights dispensable—mere parking tickets?

The TUC and many others have pointed out the employment rights that could be lost, and health and safety requirements too. Without so much as a by-your-leave, the Government could damage the employment conditions of every single employee in this country.

For creative workers in particular, the outlook as a result of this Bill is bleak. The impact of any change on the protection of part-time and fixed-term workers is particularly important for freelance workers in the creative industries. Fixed-term workers currently have the right to be treated no less favourably than a comparable permanent employee unless the employer can justify the different treatment. Are these rights dispensable? Are they mere parking tickets?

Then there is potentially the massive change to intellectual property rights, including CJEU case law on which rights holders rely. If these fall away, it creates huge uncertainty and incentive for litigation. The IP regulations and case law on the dashboard which could be sunsetted encompass a whole range, from databases, computer programs and performing rights to protections for medicines. At particular risk are artists’ resale rights, which give visual artists and their heirs a right to a royalty on secondary sales of the artist’s original works when sold on the art market. Visual artists are some of the lowest-earning creators, earning between £5,000 and £10,000 a year. Are these rights dispensable? Have the Government formed any view at all yet?

This Bill has created a fog of uncertainty over all these areas—a blank sheet of paper, per  Lord Beith; a giant question mark, per Lord Heseltine—and the impact could be disastrous. I hope this House ensures it does not see the light of day in its current form.


Crossparty work yet to do on the Online Safety Bill

Finally the Online Safety Bill has arrived in the House of Lords. This is what I said on winding up at the end of the debate which had 66 speakers in total, many of them making passionate and moving  speeches. We all want to see this go through, in particular to ensure that children and vulnerable adults are properly protected on social media, but there are still changes we want to see before it comes into law.

 

My Lords, I thank the Minister for his detailed introduction and his considerable engagement on the Bill to date. This has been a comprehensive, heartfelt and moving debate, with a great deal of cross-party agreement about how we must regulate social media going forward. With 66 speakers, however, I sadly will not be able to mention many significant contributors by name.

It has been a long and winding road to get to this point, as noble Lords have pointed out. As the Minister pointed out, along with a number of other noble Lords today, I sat on the Joint Committee which reported as far back as December 2021. I share the disappointment of many that we are not further along with the Bill. It is still a huge matter of regret that the Government chose not to implement Part 3 of the DEA in 2019. Not only, as mentioned by many, have we had a cavalcade of five Culture Secretaries, we have diverged a long way from the 2019 White Paper with its concept of the overarching duty of care. I share the regret that the Government have chosen to inflict last-minute radical surgery on the Bill to satisfy the, in my view, unjustified concerns of a very small number in their own party.

Ian Russell—I pay tribute to him, like other noble Lords—and the Samaritans are right that this is a major watering down of the Bill. Mr Russell showed us just this week how Molly had received thousands and thousands of posts, driven at her by the tech firms’ algorithms, which were harmful but would still be classed as legal. The noble Lord, Lord Russell, graphically described some of that material. As he said, if the regulator does not have powers around that content, there will be more tragedies like Molly’s.

The case for proper regulation of harms on social media was made eloquently to us in the Joint Committee by Ian and by witnesses such Edleen John of the FA and Frances Haugen, the Facebook whistleblower. The introduction to our report makes it clear that the key issue is the business model of the platforms, as described by the noble Lords, Lord Knight and Lord Mitchell, and the behaviour of their algorithms, which personalise and can amplify harmful content. A long line of reports by Select Committees and all-party groups have rightly concluded that regulation is absolutely necessary given the failure of the platforms even today to address these systemic issues. I am afraid I do not agree with the noble Baroness, Lady Bennett; being a digital native is absolutely no protection—if indeed there is such a thing as a digital native.

We will be examining the Bill and amendments proposed to it in a cross-party spirit of constructive criticism on these Benches. I hope the Government will respond likewise. The tests we will apply include: effective protections for children and vulnerable adults; transparency of systems and power for Ofcom to get to grips with the algorithms underlying them; that regulation is practical and privacy protecting; that online behaviour is treated on all fours with offline; and that there is a limitation of powers of the Secretary of State. We recognise the theme which has come through very strongly today: the importance of media literacy.

Given that there is, as a result of the changes to the Bill, increased emphasis on illegal content, we welcome the new offences, recommended in the main by the Law Commission, such as hate and communication crimes. We welcome Zach’s law, against sending flashing images or “epilepsy trolling”, as it is called, campaigned for by the Epilepsy Society, which is now in Clause 164 of the Bill. We welcome too the proposal to make an offence of encouraging self-harm. I hope that more is to come along the lines requested by my noble friend Lady Parminter.

There are many other forms of behaviour which are not and will not be illegal, and which may, according to terms of service, be entirely legal, but are in fact harmful. The terms of service of a platform acquire great importance as a result of these changes. Without “legal but harmful” regulation, platforms’ terms of service may not reflect the risks to adults on that service, and I was delighted to hear what the noble Baroness, Lady Stowell, had to say on this. That is why there must be a duty on platforms to undertake and publish risk and impact assessments on the outcomes of their terms of service and the use of their user empowerment tools, so that Ofcom can clearly evaluate the impact of their design and insist on changes or adherence to terms of service, issue revised codes or argue for more powers as necessary, for all the reasons set out by the noble Baroness, Lady Gohir, and my noble friend Lady Parminter.

The provisions around user empowerment tools have now become of the utmost importance as a result of these changes. However, as Carnegie, the Antisemitism Policy Trust, and many noble Lords today have said, these should be on by default to protect those suffering from poor mental health or who might lack faculty to turn them on.

Time is short today, so I can give only a snapshot of where else we on these Benches—and those on others, I hope—will be focusing in Committee. The current wording around “content of democratic importance” and “journalistic content” creates a lack of clarity for moderation processes. As recommended by the Joint Committee, these definitions should be replaced with a single statutory requirement to protect content where there are reasonable grounds to believe it will be in the public interest, as supported by the Equality and Human Rights Commission.

There has been a considerable amount of focus on children today, and there are a number of amendments that have clearly gained a huge amount of support around the House, and from the Children’s Charities’ Coalition on Internet Safety. They were so well articulated by the noble Baroness, Lady Kidron. I will not adumbrate them, but they include that children’s harms should be specified in the Bill, that we should include reference to the UN convention, and that there should be provisions to prevent online grooming. Particularly in the light of what we heard this week, we absolutely support those campaigning to ensure that the Bill provides for coroners to have access to children’s social media accounts after their deaths. We want to see Minister Scully’s promise to look at this translate into a firm government amendment.

We also need to expressly future-proof the Bill. It is not at all clear whether the Bill will be adequate to regulate and keep safe children in the metaverse. One has only to read the recent Institution of Engineering and Technology report, Safeguarding the Metaverse, and the report of the online CSA covert intelligence team, to realise that it is a real problem. We really need to make sure that we get the Bill right from this point of view.

As far as pornography is concerned, if we needed any more convincing of the issues surrounding children’s access to pornography, the recent research by the Children’s Commissioner, mentioned by several noble Lords, is the absolute clincher. It underlines the importance of the concerns of the coalition of charities, the noble Lord, Lord Bethell, and many other speakers today, who believe that the Online Safety Bill does not go far enough to prevent children accessing harmful pornographic content. We look forward to debating those amendments when they are put forward by the noble Lord, Lord Bethell.

We need to move swiftly on Part 5 in particular. The call to have a clear time limit to bring it in within six months of the Bill becoming law is an absolutely reasonable and essential demand.

We need to enshrine age-assurance principles in the Bill. The Minister is very well aware of issues relating to the Secretary of State’s powers. They have been mentioned by a number of noble Lords, and we need to get them right. Some can be mitigated by further and better parliamentary scrutiny, but many should simply be omitted from the Bill.

As has been mentioned by a number of noble Lords, there is huge regret around media literacy. We need to ensure that there is a whole-of-government approach to media literacy, with specific objectives set for not only Ofcom but the Government itself. I am sure that the noble Lord, Lord Stevenson, will be talking about an independent ombudsman.

End-to-end encryption has also come up; of course, that needs protecting. Clause 110 on the requirement by Ofcom to use accredited technology could lead to a requirement for continual surveillance. We need to correct that as well.

There is a lot in the Bill. We need to debate and tackle the issue of misinformation in due course, but this may not be the Bill for it. There are issues around what we know about the solutions to misinformation and disinformation and the operation of algorithmic amplification.

The code for violence against women and girls has been mentioned. I look forward to debating that and making sure that Ofcom has the power and the duty to produce a code which will protect women and girls against that kind of abuse online. We will no doubt consider criminal sanctions against senior managers as well. A Joint Committee, modelled on the Joint Committee on Human Rights, to ensure that the Bill is future-proofed along the lines that the noble Lords, Lord Inglewood and Lord Balfe, talked about is highly desirable.

The Minister was very clear in his opening remarks about what amendments he intends to table in Committee. I hope that he has others under consideration and that he will be in listening mode with regard to the changes that the House has said it wants to see today. Subject to getting the Bill in the right shape, these Benches are very keen to see early implementation of its provisions.

I hope that the Ofcom implementation road map will be revised, and that the Minister can say something about that. It is clearly the desire of noble Lords all around the House to improve the Bill, but we also want to see it safely through the House so that the long-delayed implementation can start.

This Bill is almost certainly not going to be the last word on the subject, as the noble Baroness, Lady Merron, very clearly said at the beginning of this debate, but it is a vital start. I am glad to say that today we have started in a very effective way.


Tackling the Harms in the Metaverse

I recentlty took part in a session entitled Regulation and Policing of Harm in the Metaverse as part of a Society for Computers and the Law and Queen Mary University of London policy forum on the metaverse alongside Benson Egwuonwu from DAC Beechcroft and Professor Julia Hornle Chair of Internet Law at the Centre for Commercial Law Studies at Queen Mary 

This is what i said in my introduction.

This is what two recent adverts from Meta said:

  • “In the metaverse farmers will optimize crop yields with real time data”
  • “In the metaverse students will learn astronomy by orbiting Saturn’s rings”

Both end with the message “The metaverse may be virtual but the impact is real”.

This is an important message but the first advert is a rather baffling use of the metaverse, the second could be quite exciting. Both adverts are designed to make us think about the opportunities presented by it.

But as we all know, alongside the opportunities there are always risks. It is very true of Artificial Intelligence, a subject I speak on regularly, but particularly as regards the metaverse.

The metaverse opens new forms and means of visualisation and communication but I don’t believe that there is yet a proper recognition that the metaverse in the form of immersive games which use avatars and metaverse chat rooms can cause harm or of  the potential extent of that harm.

I suspect this could be because although we now recognize that there are harms in the Online world,  the virtual world is even further away from reality and we again have a pattern repeating itself. At first we don’t recognize the potential harms that a new and developing technology such as this presents until confronted with the stark consequences.

The example of the tragic death of Molly Russell in relation to the understanding of harm on social media springs to mind

So in the face of that lack of recognition it’s really important to understand the nature of this potential harm, how can it be addressed and  prevent what might  become the normalisation of harm in the metaverse

 

The Sunday Times in a piece earlier this year on Metaverse Harms rather luridly headlined “My journey into the metaverse — already a home to sex predators”  asserted:   “....academics, VR experts and children’s charities say it is already a poorly regulated “Wild West” and “a tragedy waiting to happen” with legislation and safeguards woefully behind the technology. It is a place where adults and children, using their real voices, are able to mingle freely and chat, their headsets obscuring their activities from those around them.”

It went on: “Its immersive nature makes children particularly vulnerable, according to the National Society for the Prevention of Cruelty to Children (NSPCC) charity.”

This is supported by the Center for Countering Digital Hate’s  investigation last year into Facebook’s VR metaverse which  found children exposed to sexual content, bullying and threats of violence.

And there are other potential and actual harms too not involving children. Women and girls report being harassed and sexually assaulted, there is also fraudulent activity and racial abuse.

It is clear that because of the very nature of the metaverse- the impact of its hyper-realistic environment -there are specific and distinct harms the metaverse can cause that are different from other online platforms.

These include harms that may as yet be unquantified – which makes regulation difficult. There is insufficient knowledge and understanding about harms such as  the potentially addictive impact of the metaverse & other behavioural and cognitive effects it may have.

Policy and enforcement are made more difficult by fact that the metaverse is intended to allow real-time conversations. Inadequate data storage of activity on the metaverse could mean a lack of evidence to prove harm and the track of perpetrators but in turn this also raises conflicting privacy questions.

So What does the Online Safety Bill do?

It is important that metaverse is included within the platform responsibilities proposed by the bill. The Focus of the bill is about systems and risk assessment relating to  published content but metaverse platforms are about activity happening in real-time and we need to appreciate and deal with this difference. It also shows the importance of having a future proofing mechanism within the  bill but one that is not reliant on the decision of the Secretary of State for Culture Media and Sport.

There is the question whether the metaverse definition of regulated services currently falls within scope. This was raised by my colleagues in the Commons and ministerial reassurance was  given in relation to childrten but we have had two Ministerial changes since then!

Architects of the Bill such as CarnegieUK are optimistic that the metaverse – and the tech companies who create it  will not escape regulation in the UK because of the way that user generated content is defined in clause 50 and the reference there to “encountered”.

It is very likely that harms to children in the metaverse on these services will be caught.

As regards adults however  the OSB now very much focuses on harmful illegal content. Query whether it will or should capture analogous crimes within the metaverse so for instance is ‘virtual rape and sexual assault’ considered criminal in  the metaverse?

As regards content outside this, the current changes which have been announced to the bill which focus on Terms of Service rather than ‘legal but harmful’ create uncertainty.

It seems the idea is to give power to users to exclude other participants who are causing or threantening but how is this practical in the context of the virtual reality of the metaverse?

A better approach might be to clearly regulate to drive Safety by Design. Given the difficulties which will be encountered in policing and enforcement I believe  the emphasis needs to be placed on design of metaverse platforms and consider at the very outset how platform design contributes to harm or delivers safety.

Furthermore at present there is no proper independent complaints or redress mechanism such as an Ombudsman proposed for any of these platforms which in the view of many is a gaping hole in the governance of social media which includes the metaverse.

In a recent report The Center for Countering Digital Hate recorded 100 potential violations of Meta’s policies in 11 hours on Facebook’s VR chat . CCDH researchers found that users, including minors, are exposed to abusive behaviour every seven minutes. Yet the evidence is also that Meta is already unresponsive to reports of abuse. It seems that of those 100 potential violations, only 51 met Facebook’s criteria for reporting offending content, as the platform rejects reports if it cannot match them to a username in its database.

Well we are expecting the Bill in the Lords in the early New Year . We’ll see what we can do to improve it!

 

 


Lord C-J at the Piccaso Data Privacy Awards

I recently attended and spoke at the inaugural Piccaso Data Privacy awards celebrating the contribution of businessers and organisations innovating in data privacy . 

Piccaso is an acronym (Privacy, InfoSec, Culture, Change , Awareness, Societal Organisation) for an organisation which aims to harness "the knowledge and experience of experts both from the privacy, data protection, and information security domains to inspire, challenge, and educate our community to elevate the practice of privacy and data protection maturity within their firms and sectors."

This is what I said. 

I’m delighted to have been asked to make a few remarks at this evening’s terrific inaugural Piccasso event… and it’s a privilege to follow the avatar of John Edwards the Information Commissioner, especially his sales pitch for the ICO!  It is a great example of his positive approach to regulation which we know needs to be principled, proportionate and communicative. 

Continuing the wise approach of his predecessor, Elizabeth Denham who I am delighted to see is one of our judges.

We of course have new data protection legislation coming down the track which may or may not prove positive, which we are going to have to grapple with inside and outside Parliament fairly soon 

I hope that whatever changes are made to the GDPR its broad approach will continue, and any changes to the GDPR structure and oversight of the regulator, mean we not only remain data adequate for EU purposes but keep public trust in the use and sharing of their data in the UK!

And the need for public trust in the use and sharing of our data and the preservation of individual privacy is crucial if we are to get the full benefit of the adoption of new technologies such as AI and Machine learning.  We have seen how when trust fails, such as with the poorly handled GP data saga last year, when over three million NHS patients opted out of sharing their health data. 

This is a unique and very special event gathering together the full width of community, public and private and third sector, who really get this and each of whom is supporting privacy compliant innovation, by developing privacy enabling solutions, ensuring organisations use their data in a privacy by design and trusted way, and enabling individuals to exercise their privacy rights.  

The 15 award categories tonight and those people and  organisations nominated give a real sense of the breadth of the skills and talent present – all of you focussed on making our organisations, economy and society a trusted and safe place to live and operate.  

Tonight’s event is a celebration of your incredible contributions, which are all too often overlooked and under-appreciated. 

 

Given that a culture of privacy protection is not always the rule, I want us to commend and celebrate the good work that is being done by so many in this room tonight - including those engaged in thought leadership, testing and setting boundaries and devising creative policy approaches which address new developments such as blockchain, Web 3.0 and the Metaverse. 

You all know, live with and understand the importance of data protection and privacy, and your leadership is helping to enable a safer future, and one where innovation is encouraged.  

So whether you win or not tonight, thank you - and congratulations for playing a really important role in a privacy protecting future!

 

 

 


It's time to have a moratorium on Live Facial Recognition use

We recently debated the recommendations of the  Lords Justice and Home Affairs Committee Report Technology rules? The advent of new technologies in the justice system 

This is what I said on welcoming the $eport.

I entirely understand and welcome the width of the report but today I shall focus on live facial recognition technology, a subject that I have raised many times in this House and elsewhere in Questions and debates, and even in a Private Member’s Bill, over the last five years. The previous debate involving a Home Office Minister—the predecessor of the noble Lord, Lord Sharpe, the noble Baroness, Lady Williams—was in April, on the new College of Policing guidance on live facial recognition.

On each occasion, I drew attention to why guidance or codes are regarded as insufficient by myself and many other organisations such as Liberty, Big Brother Watch, the Ada Lovelace Institute, the former Information Commissioner, current and former Biometrics and Surveillance Camera Commissioners and the Home Office’s own Biometrics and Forensics Ethics Group, not to mention the Commons Science and Technology Committee. On each occasion, I have raised the lack of a legal basis for the use of this technology—and on each occasion, government Ministers have denied that new explicit legislation or regulation is needed, as they have in the wholly inadequate response to this report.

In the successful appeal of Liberal Democrat Councillor Ed Bridges, the Court of Appeal case on the police use of live facial recognition issued in August 2020, the court ruled that South Wales Police’s use of such technology had not been in accordance with the

law on several grounds, including in relation to certain human rights convention rights, data protection legislation and the public sector equality duty. So it was with considerable pleasure that I read the Justice and Home Affairs Committee report, which noted the complicated institutional landscape around the adoption of this kind of technology, emphasised the need for public trust and recommended a stronger legal framework with primary legislation embodying general principles supported by detailed regulation, a single national regulatory body, minimum scientific standards, and local or regional ethics committees put on a statutory basis.

Despite what paragraph 4 of the response says, neither House of Parliament has ever adequately considered or rigorously scrutinised automated facial recognition technology. We remain in the precarious position of police forces dictating the debate, taking it firmly out of the hands of elected parliamentarians and instead—as with the recent College of Policing guidance—marking their own homework. A range of studies have shown that facial recognition technology disproportionately misidentifies women and BAME people, meaning that people from those groups are more likely to be wrongly stopped and questioned by police, and to have their images retained as the result of a false match.

The response urges us to be more positive about the use of new technology, but the UK is now the most camera-surveilled country in the Western world. London remains the third most surveilled city in the world, with 73 surveillance cameras for every 1,000 people. The last Surveillance Camera Commissioner did a survey, shortly before stepping down, and found that there are over 6,000 systems and 80,000 cameras in operation in England and Wales across 183 local authorities. The ubiquity of surveillance cameras, which can be retrofitted with facial recognition software and fed into police databases, means that there is already an apparatus in place for large-scale intrusive surveillance, which could easily be augmented by the widespread adoption of facial recognition technology. Indeed, many surveillance cameras in the UK already have advanced capabilities such as biometric identification, behavioural analysis, anomaly detection, item/clothing recognition, vehicle recognition and profiling.

The breadth of public concern around this issue is growing clearer by the day. Many cities in the US have banned the use of facial recognition, while the European Parliament has called for a ban on the police use of facial recognition technology in public places and predictive policing. In 2020 Microsoft, IBM and Amazon announced that they would cease selling facial recognition technology to US law enforcement bodies.

Public trust is crucial. Sadly, the new Data Protection and Digital Information Bill does not help. As the Surveillance Camera Commissioner said last year, in a blog about the consultation leading up to it:

“This consultation ought to have provided a rare opportunity to pause and consider the real issues that we talk about when we talk about accountable police use of biometrics and surveillance, a chance to design a legal framework that is a planned response to identified requirements rather than a retrospective reaction to highlighted shortcomings, but it is an opportunity missed.”

Now we see that the role of Surveillance Camera Commissioner is to be abolished in the new data protection Bill—talk about shooting the messenger. The much-respected Ada Lovelace Institute has called, in its report Countermeasures and the associated Ryder review in June this year, for new primary legislation to govern the use of biometric technologies by both public and private actors, for a new oversight body and for a moratorium until comprehensive legislation is passed.

The Justice and Home Affairs Committee stopped short of recommending a moratorium on the use of LFR, but I agree with the institute that a moratorium is a vital first step. We need to put a stop to this unregulated invasion of our privacy and have a careful review, so that its use can be paused while a proper regulatory framework is put in place. Rather than update and use toothless codes of practice, as we are urged to do by the Government, to legitimise the use of new technologies such as live facial recognition, the UK should have a root-and-branch surveillance camera and biometrics review, which seeks to increase accountability and protect fundamental rights. The committee’s report is extremely authoritative in this respect. I hope today that the Government will listen but, so far, I am not filled with optimism about their approach to AI governance.


AI Governance: Science and Technology Committee launches enquiry

The House of Commons Science and Technology Committee has launched an inquiry into the governance of artificial intelligence (AI).

This is what they said on launching it:

In July, the UK Government set out its emerging thinking on how it would regulate the use of AI. It is expected to publish proposals in a White Paper later this year, which the Committee would examine in its inquiry.

Used to spot patterns in large datasets, make predictions, and automate processes, AI’s role in the UK economy and society is growing. However, there are concerns around its use. MPs will examine the potential impacts of biased algorithms in the public and private sectors. A lack of transparency on how AI is applied and how automated decisions can be challenged will also be investigated.

In the inquiry, MPs will explore how risks posed to the public by the improper use of AI should be addressed, and how the Government can ensure AI is used in an ethical and responsible way. The Committee seeks evidence on the current governance of AI, whether the Government’s proposed approach is the right one, and how their plans compare with other countries.

Rt Hon Greg Clark MP, Chair of Science and Technology Committee, said:

“AI is already transforming almost every area of research and business. It has extraordinary potential but there are concerns about how the existing regulatory system is suited to a world of AI.

With machines making more and more decisions that impact people’s lives, it is crucial we have effective regulation in place. In our inquiry we look forward to examining the Government’s proposals in detail.”

These are these key questions they are asking

  • How effective is current governance of AI in the UK?
  • What are the current strengths and weaknesses of current arrangements, including for research?
  • What measures could make the use of AI more transparent and explainable to the public?
  • How should decisions involving AI be reviewed and scrutinised in both public and private sectors?
  • Are current options for challenging the use of AI adequate and, if not, how can they be improved?
  • How should the use of AI be regulated, and which body or bodies should provide regulatory oversight?
  • To what extent is the legal framework for the use of AI, especially in making decisions, fit for purpose?
  • Is more legislation or better guidance required?
  • What lessons, if any, can the UK learn from other countries on AI governance?

This is the written evidence to the Committee from myself and Coran Darling,  a Trainee Solicitor and member of the global tech and life sciences sectors at DLA Piper 

Introduction

I, alongside Stephen Metcalfe MP, co-founded the All Party Parliamentary Group on Artificial Intelligence (“APPG”) in late 2016. The APPG is dedicated to informing parliamentarians of contextual developments and creating a community of interest around future policy regarding AI, its adoption, use, and regulation.

I was fortunate to then be asked to chair the House of Lords Special Enquiry Select Committee on AI with the remit: “to consider the economic, ethical, and social implications of advances in artificial intelligence”. As part of our work, the Select Committee produced its first report “AI in the UK: Ready Willing and Able?” in April 2018. The report looked closely at the current landscape of governmental policy towards the subject of AI and its ambitions for future development. This included, for example, those future plans contained in the Hall/Pesenti Review of October 2017, and those set out by former prime Minister Teresa May in her Davos World Economic Forum Speech, including her aim for the UK to “lead the world in deciding how AI can be deployed in a safe and ethical manner.”

Since then, as well as continuing to co-chair the APPG, I have maintained a close interest in the development of UK policy in AI, chaired a follow-up to the Select Committee’s report, “AI in the UK: No Room for Complacency”, acted as an adviser to the Council of Europe’s working party on AI (“CAHAI”) and helped establish the OECD Global Parliamentary Network on AI.

Lord Clement-Jones

25th November 2022

Background

The Hall Pesenti Review (“Review”) was an independent review commissioned in March 2017 tasked with reporting on the potential impact of AI on the UK economy. While it did not tackle the question of ethics or regulation of AI, the Review made several key recommendations designed to set a clear course for UK AI strategy including that:

  • Data Trusts should be developed to provide proven and trusted frameworks to facilitate the sharing of data between organisations holding data and organisations looking to use data to develop AI;
  • the Alan Turing Institute should become the national institute for AI and data science with the creation of an International Turing AI fellowship programme for AI in the UK; and
  • the establishment of an UK AI Council to help coordinate and grow AI in the UK should occur.

The Government's subsequent “Industrial Strategy: building a Britain fit for the future” published in November 2017 (“Industrial Strategy”), identified putting AI “at the forefront of the UK’s AI and data revolution” as one of four 'Grand Challenges' identified as key to Britain's future. At the same time, the Industrial Strategy recognised that ethics would be key to the successful adoption of AI in the UK. This led to the establishment of the Centre for Data Ethics and Innovation in late 2018 with the remit to “make sure that data and AI deliver the best possible outcomes for society, in support of their ethical and innovative use”. In early 2018, the Industrial Strategy would go on to produce a £950m ‘AI Sector Deal’, which incorporated nearly all the recommendations of the Review and established a new Government Office for AI designed to coordinate their implementation.

Building on the work of the Review and the Industrial Strategy, the original Select Committee report enquiry concluded that the UK was in a strong position to be among the world leaders in the development of AI. Our recommendations were designed to support the Government and the UK in realising the potential of AI for our society and our economy and to protect from future potential threats and risks. It was concluded that the UK had a unique opportunity to forge a distinctive role for itself as a pioneer in ethical AI. We did, however, emphasise that if poorly handled, public confidence in AI could be undermined significantly.

In anticipation of the OECD’s subsequent digital AI principles, which were adopted in 2019, the Select Committee proposed five principles that could form the basis of a cross-sector AI code, and which could be adopted both nationally and internationally.

We did not at that point recommend a new regulatory body for AI-specific regulation, but instead noted that such a framework of principles could underpin regulation, should it prove to be necessary, in the future and that existing regulators would be best placed to regulate AI in their respective sectors. The Government in its response accepted the need to retain and develop public trust through an ethical approach both nationally and internationally.

In December 2020, the Select Committee’s follow up report “AI in the UK: No Room for Complacency” we examined the progress made by the Government to date since our earlier work. After interviews with government ministers, regulators, and other key players, the new report made several key recommendations. In particular, that:

  • greater public understanding was essential for the wider adoption of AI and active steps should be taken by the Government to explain to the general public the use of their personal data by AI;
  • the development of policy and mechanisms to safeguard the use of data, such as data trusts, needed to pick up pace, otherwise it risked being left behind by technological developments;
  • the time had come for the Government to move from deciding what the ethics are to how to instil them in the development and deployment of AI systems. We called for the CDEI to establish and publish national standards for the ethical development and deployment of AI;
  • users and policymakers needed to develop a better understanding of risk and how it can be assessed and mitigated, in terms of the context in which it is applied; and
  • that coordination between the various bodies involved in the development of AI, including the various regulators, was essential. The Government therefore needed to better coordinate its AI policy and the use of data and technology by national and local government. 

Despite the passage of time since the Industrial Strategy, the current governance of AI remains incomplete and unsatisfactory in several respects.

With respect to the use of data for training and inputs, such as for decision making and prediction, the UK General Data Protection Regulation (“GDPR”) and the Data Protection Act 2018 are important forms of governance. The Government’s “Data A New Direction” consultation however has led to a new Data Protection bill (“DP Bill”) which, while currently in development, proposes major changes to the GDPR post Brexit. These include significant amendments, such as no longer requiring firms to have a designated Data Protection Officer. The proposed DP Bill also waters down several provisions relating to data impact assessments. This holds the potential to create a divergence from the established data protection position in the UK and is likely to impact on the important EU Adequacy Decision in June 2021, leading to uncertainty for those wishing to use data for training and processing. The Government’s apparent intention to amend Article 22 of the GDPR giving the citizen the right not to be subjected to automated decision making also creates further uncertainty and runs the risk of a lower level of governance over decision made by AI systems.

A further area currently without a satisfactory approach is that of data and the issue of bias in decision making as a result of inherent bias caused by the improper use of data sets during the process of training algorithms. While it is likely that the Government’s own gap analysis will show that equalities legislation covers bias in acquired data which leads to discriminatory decisions made by AI, further consideration is needed on whether specific legal obligations in relation to the use of AI should be implemented in this context to actively mitigate its risk, rather than state that a discriminatory outcome is prohibited.

It is also the case that in many other areas of data and AI, there is no proper current governance in terms of binding legal duties that ensure that key internationally accepted ethical principles, such as those set out in the OECD AI Principles, are observed. These include:

  • Inclusive growth, sustainable development and well-being;
  • Human-centred values and fairness;
  • Transparency and explainability;
  • Robustness, security and safety; and

Despite the overall acceptance that the UK would need to consider developing policy or regulations in order to remain ahead of the curve, the UK’s National AI Strategy, published in September 2021, contained no discussion of ethics or regulation. Instead, an AI Governance whitepaper was promised to be published at some point in 2022.

Subsequent publication of an AI policy paper and AI Action Plan in July 2022 did however indicate that the Government was committed to developing “a pro-innovation national position on governing and regulating AI.” It is expected that this will be used to develop the AI Governance White paper.

Their approach is as follows:

“Establishing clear, innovation-friendly and flexible approaches to regulating AI will be core to achieving our ambition to unleash growth and innovation while safeguarding our fundamental values and keeping people safe and secure […] drive business confidence, promote investment, boost public trust and ultimately drive productivity across the economy.”

To facilitate its ‘pro-innovation’ approach, the Government has proposed several early cross-sectoral and overarching principles which build on the OECD AI Principles. These principles will, it seems, be interpreted and implemented by regulators within the context of the environment they oversee and will therefore be flexible to interpretation.

In terms of classification of AI within this ‘pro-innovation’ approach, rather than working to a clear definition of AI and determining what falls within scope, as chosen by the EU with their proposed AI Act, the UK has elected to follow an approach that instead sets out the core principles of AI which allows regulators to develop their own sector-specific definitions to meet the evolving nature of AI as technology advances.

In my view however, without a broad definition and some overarching duty to carry out a risk and impact assessment and subsequent regular audit to assess whether an AI system is conforming to Al principles, the governance of AI systems will be deficient, on the grounds alone that not every sector is regulated as is likely to be required. For example, except for certain specific products such as driverless cars there is no accountability or liability regime established for liability for the operation of AI systems at present.

This is the case for the public sector, as well as those in the private sector. While The Government has recognised the need for guidance for public sector organisations in the procurement and use of AI, it remains that there is no central and local government compliance mechanism to put this into practice. There are therefore insufficient measures of transparency, such as in the form of a public register of use of automated decision making, that require oversight and assessment of the decisions being carried out by AI in the context of public organisations. Furthermore, despite the efforts of parliamentarians, and organisations such as the Ada Lovelace Institute, there is no material recognition by the Government that explicit legislation, and/or regulation for intrusive AI technology such as live facial recognition, is needed to prevent the arrival of the surveillance state.

In light of the recognition by the National AI Strategy of the need to gain public trust, and for the wider use of trustworthy AI, the Government’s current proposals for a context specific approach are inadequate. In the face of this need to retain public trust, it must be clear, above all however, that regulation is not necessarily the enemy of innovation. In fact, it can in be the stimulus and key to gaining and retaining public trust around digital technology and its adoption. An approach by the Government could and should take the form of an overarching regulatory regime designed to ensure public transparency in the use of AI technologies and the recourse available across sectors for non-ethical use.

As is currently proposed, an approach which adopts divergent regulatory requirements across sectors would run the risk of creating barriers for developers and adopters through the requirement of having to navigate the regulatory obligations of multiple sectors. Where a cross-compatible AI system is concerned, for example in finance and telecoms, an organisation would have to potentially understand and comply with different regimes administered by the FCA, Prudential Regulation Authority, and Ofcom at the same time.

So, for these reasons, a much more horizontal cross sectoral approach than the Government is proposing is needed for the development and adoption of AI systems. This should set out clear common duties to assess risk and impact and adhere to common standards. Depending on the extent of the risk and impact assessed further legal duties would arise.

The question (What lessons, if any, can the UK learn from other countries on AI governance?) in my view should extend wider and ask not just about the lessons but the degree of harmonisation needed to ensure the most beneficial context for UK AI development, adoption, and assurance of ethical AI standards.

In its recent AI policy paper, a surprising admission is made by the Government that a context-driven approach may lead to less uniformity between regulators and may cause confusion and apprehension for stakeholders who will potentially need to consider multiple regimes, as well as the measures required to be taken to deal with extra-territorial obligations, such as those of the proposed EU AI Act.

International harmonisation is, in my view, essential if we wish to see developers and suppliers able to commercialise their products on a global basis assured that they are adhering to common standards of regulation without lengthy verification on entry of each individual jurisdiction in which they interact.

This could come in the form of a national version of the EU’s approach, where we have regulation that harmonises the landscape across sectors and industries, or in the form of international agreement on the standards of risk and impact assessment to be adopted. Work on common standards (i.e. the tools which would be deployed if regulation were out in place) is bearing fruit and may also assist organsiations in ensuring they are in conformity without navigating every subsector or jurisdiction with which they interact.

Most recently, we have seen the launch of the interactive AI Standards Hub by the Alan Turing institute with the support of the British Standards Institution and National Physical Laboratory which will provide users across industry, academia, and regulators with practical tools and educational materials to effectively use and shape AI technical standard. This in turn could lead to agreement on ISO standards with the EU and the US where NIST is actively engaged in developing similar protocols.

Having a harmonised approach would help provide the certainty businesses would need to develop and invest in the UK more readily.

When it comes to dealing with our nearest trading partner, it may be favourable to go one step further. When the White Paper does emerge, I believe that it is important that there is recognition that a considerable degree of convergence between us and EU is required practically, and that a risk-based form of horizontal, rather than purely sectoral, regulation is needed.

The Government is engaged in a great deal of activity. The question, therefore, is whether it is fast or focused enough and whether its objectives (such as achieving trustworthy AI and harmonised international standards) are going to be achieved through the actions being taken so far. As it stands currently, this does not look to be the case.

 

Lord Clement-Jones,

Coran Darling

 

 

 

 

 

 

 

 


Lord C-J at OECD : Mixed evidence on UK AI Governance

I recently attended a meeting of the OECD Global Parliamentary Network Group on Artificial Intelligence and spoke on UK developments during a session on Innovating in AI Legislation

It seems a long time since we all got together in person-what a pleasure! And such a pleasure to follow Eva. I am a huge admirer of what the EU have done in the AI space. I think we are all now beginning to be aware of the importance of digital media and the importance of AI and algorithms in our lives both positive and negative.Inevitably what I say is mainly focused on what we are doing in the UK but I hope it will have relevance in other jurisdictions. 

The good news is that despite ( just a few!) changes in government or the pandemic UK government action on  AI governance has been moving forward.

The UK’s National AI strategy - A ten-year plan for UK investment in and support of AI-was published in September 2021. It promised an AI Governance White Paper this year. In an AI policy paper and Action Plan published this July the Government then set out its emerging proposals for regulating AI in a policy consultation paper in which it committed to develop “a pro-innovation national position on governing and regulating AI.”  This will be used to develop the White paper which may yet emerge this year.

Their approach would be “Establishing clear, innovation-friendly and flexible approaches to regulating AI will be core to achieving our ambition to unleash growth and innovation while safeguarding our fundamental values and keeping people safe and secure. …….drive business confidence,promote investment, boost public trust and ultimately drive productivity across the economy.” Fine words but we now have some more detailed clues as to the future of regulation of AI in the UK.

As regards categorising AI rather than working to a clear definition of AI determining what falls within scope, which is the approach taken by the EU Regulation, the UK has elected to follow an approach that instead sets out the core principles of AI which allows regulators to develop their own sector-specific definitions to meet the evolving nature of AI as technology advances. 

In a surprising admission the policy paper does acknowledge that a context-driven approach may lead to less uniformity between regulators and may cause confusion and apprehension for stakeholders who will potentially need to consider the regime of multiple regulators as well as the measures required to be taken to deal with extra-territorial regimes, such as the EU Regulation. 

To facilitate its ‘pro-innovation’ approach, the UK Government however has proposed several early cross-sectoral and overarching principles which build on the OECD ‘Principles on Artificial Intelligence’ . These principles will be interpreted and implemented by regulators within the context of the environment they oversee and would therefore be flexible to interpretation. This call for views and evidence closed on 26 September so we shall see what emerges in the White paper probably not this year!!

As a result of this context-driven approach  the regulators in different sectors are going to take centre stage. So it is timely that  4 of our key regulators the ICO OFCOM  CMA FCA  have got together under a new Digital Regulators Cooperation Forum to pool expertise in this field. This includes sandboxing and  input from a variety of expert institutes such as the Alan Turing Institute on areas such as risk assessment, AI, audit, digital design frameworks and standards digital advertising and horizon scanning

The policy paper in turn has led to the launch this October of the interactive hub platform AI Standards Hub led  by the Alan Turing institute with the support of the British Standards Institution and National Physical Laboratory which will provide users across industry, academia and regulators with practical tools and educational materials to effectively use and shape AI technical standards. 

All this represents action but while the National AI strategy paper of last September does talk about public trust and the need for trustworthy AI,my view is that it needs to be reflected in how we regulate. In the face of the need to retain public trust we need to be clear, above all, that regulation is not necessarily the enemy of innovation, it can in fact be the stimulus and be the key to gaining and retaining public trust around digital technology and its adoption so we can realise the benefits and minimise the risks.

International harmonization is in my view essential if we are to see developers able to commercialize their products on a global basis assured that they are adhering to common standards of regulation. One of my regrets is that the UK government unlike our technical experts doesn’t devote enough attention to positive collaboration in a number of international AI fora such as the Council of Europe, UNESCO And the OECD 

But the UK IS playing an active part in GPAI serviced by the OECD  which is beginning to deliver some interesting output particularly in respect of the workplace. I hope too that when the White Paper does emerge that there is recognition that we need a considerable degree of convergence between ourselves the EU, members of the COE and the OECD in particular, for the benefit of our developers and cross border business  that recognizes that a risk based form of horizontal rather than purely sectoral regulation is required.

Above all this means agreeing on standards for risk and impact assessments alongside tools for audit and continuous monitoring for higher risk applications..That way I believe we can draw the US into the fold as well.

Other aspects of policy where I  do NOT believe we are heading in the right direction however are 

Data :The government’s “Data A New Direction”  consultation has led to a new Data Protection bill. Despite little appetite in the business or the research communities they are proposing major changes to the GDPR post Brexit including not requiring firms to have a DPO or DPIA.  All this is likely to impact on the precious EU Adequacy Decision which was made in June 21 and is meant to last for 4 years. 

IP:  Our Intellectual Property Office too is currently grappling with issues relating to IP created by AI .  Artificial Intelligence and Intellectual Property: copyright and patents consultation closed January 2022 and now has recommended changes to text and data mining exemption which has been very widely criticised by the creative industries, publishers etc. 

In addition although the UK Government has recognized the need for any amount of guidance for public sector organizations there is no central and local government compliance mechanism and  little transparency in the form of a public register of use of automated decision making. 

We also, despite the efforts of Parliamentarians and organisations such as the Ada Lovelace Institute, have no recognition at all that regulation for intrusive AI technology such as live facial recognition is needed. 

We are still having a major debate on the deployment over live facial recognition technology -the use of biometrics and AI - in policing, schools and in criminal justice recently. Many of us have real concern that we are approaching the surveillance state. 

In addition there is little appetite in government to ensure that our employment laws protect the increasing number of workers in the gig economy whose lives can be ruled by algorithm without redress.

So our government is engaged in a great deal of activity, the question as ever is whether it is fast or focused enough and whether the objectives such as achieving trustworthy AI and harmonized international standards are going to be achieved through the actions being taken so far. As you’ve heard today, I believe the evidence of success is still mixed! I still have quite a political shopping list!