A long way off a Science and Technology Superpower

This is an  extended version of a speech I made in a recent debate held in the Lords on a Report from the Science and Technology Committee "Science and technology superpower”: more than a slogan?  which extensively discussed government policy in science and technology 

The Committee's comprehensive report despite being nearly a year old still has great currency and relevance. Its conclusions are as valid as they were a year ago

Sir James Dyson has described the government’s science superpower ambition as a political slogan. Grandiose language about Global Britain from the Integrated review-and stated ambition to be a Science Superpower by 2030 -or is it a Science and Technology Superpower, is clearly overblown and detracts from what needs to be done. . 

UCL research has demonstrated that if measured by authorship, the UK accounts for about only about 13 per cent of the top 1 per cent of the most highly cited work across all research fields

We have had a proliferation of strategies as the Committee noted. 

  • R&D Roadmap, 
  • the Innovation Strategy,
  • the Life Sciences Vision 
  • the People and Culture Strategy,
  • and the National Space Strategy
  • National Quantum strategy.
  • National semi conductor strategy
  • A taskforce on foundation models is being set up

We have had a whole series of attempts at creating a strategy in various areas but with what follow up and delivery?

As well as the strategies I have mentioned we  have had a series of reviews

  • Professor  Dame Angela McLean’s Pro-innovation Regulation of Technologies Review Life Sciences
  • The Vallance Review of Pro-innovation Regulation of Digital Technologies 
  • Independent Review of Research Bureaucracy the  Review by Professor Adam Tickell 
  • The independent review of UKRI by Sir David Grant
  • We now have the Independent Review of The Future of Compute announced 
  • And now the Chancellors recent Life Sciences package

Where’s the result. What will the KPI’s be ? What is the shelf life of these reviews and where is the practical implementation?

 

T

Take for example the Life Sciences Vision launched back in 2021 

Dame Kate Bingham is quoted as believing the Vaccine scheme legacy has been  ‘squandered’.

Professor Adrian Hill, director of the Jenner Institute, which was responsible for the Oxford Covid vaccine, has said that the recent loss of the Vaccines Manufacturing and Innovation Centre (VMIC) in Oxfordshire, which had been created to respond to outbreaks, showed that the UK had been going backwards since the coronavirus pandemic.

Business investment is crucial. And no where more than in the life sciences sector. 

Lord Hunt of Kings Heath highlighted issues relating to investment in the sector  two weeks ago in his regret motion on the Branded Health Service Medicines (Costs) (Amendment) Regulations 2023. All the levers to create incentives for the development of new medicines are under government control.

As his motion noted the UK’s share of global pharmaceutical R&D has fallen by over one-third between 2012 and 2020. He   argued rightly that both the voluntary and statutory pricing schemes for new medicines schemes are becoming a major impediment to future investment in the UK. We seem to be treating the pharma industry as some kind of golden goose

Despite the government’s Life  Sciences  Vision we see Eli lilley pulling investment on laboratory space in London  because the UK “does not invite inward investment at this time and Astra Zeneca has decided to build its next plant in Ireland  because of the U.K.’s “discouraging” tax rate. 

Eli Lilly, the American multinational, had been looking to investing laboratory space in the UK, but it has put its plans for London on hold because, it said,”

The excellent O’Shaunessy report on clinical trials is all very well but if there is no commercial incentive to develop and launch. new medicines here why should pharma companies want to engage in clinical trials here? The Chancellor’s growth package for life Sciences announced on the 25th May fails to tackle this crucial aspect. 

In other sectors 

  • The CEO  OF Johnson Matthey, a chemicals company with a leading position in green hydrogen,has  said the UK is at risk of losing its lead thanks to a policy vacuum. 
  • The co founder  of ARM, Britain’s biggest semiconductor company, blames our “technologically illiterate political elite” and “Brexit idiocy” for the country’s paltry share of the chips market. 

On these benches however we do welcome the creation of the new department and I welcome  the launch of the Framework for Science and Technology to inform the work of the department to 2030. 

There are 10 key objectives:

  • identifying, pursuing and achieving strategic advantage in the technologies that are most critical to achieving UK objectives
  • showcasing the UK’s S&T strengths and ambitions at home and abroad to attract talent, investment and boost our global influence
  • boosting private and public investment in research and development for economic growth and better productivity building on the UK’s already enviable talent and skills base 
  • financing innovative science and technology start-ups and companies
  • capitalising on the UK government’s buying power to boost innovation and growth through public sector procurement
  • shaping the global science and tech landscape through strategic international engagement, diplomacy and partnerships
  • ensuring researchers have access to the best physical and digital infrastructure for R&D that attracts talent, investment and discoveries
  • leveraging post-Brexit freedoms to create world-leading pro-innovation regulation and influence global technical standards
  • creating a pro-innovation culture throughout the UK’s public sector to improve the way our public services run

What are the key priority outcomes? What concrete plans for delivery lie behind this? And does this explicitly supersede all of the visions and strategies that have gone before? 

As the Committee said in its report

“The government should set out what it wants to achieve in each of the broad areas of science and technology it has identified, with a clear implementation plan including measurable targets and key outcomes in priority areas, and an explanation of how they will be delivered. 

And - The government should consolidate existing sector-specific strategies into that implementation plan”

Also in terms of vital cross departmental working, joining up government on Science and Technology policy what is the role of the eNational Science and Technology Council and what are its key priorities?

This applies especially with Home office on visas for researchers if the UK wants to be a world leader in science and technology, it needs to be world leading in its approach to researcher mobility.

The UK’s upfront costs for work and study visas are up to 6 times higher than the average fees of other leading science nations. The application process for UK visitor visas is also bureaucratic and unwieldy, and the UK has one of the highest visitor visa refusal rates.

There are really important systemic issues which should be a top priority for resolution by the new Department. 

Published at the same time as the DSIT framework was the independent review of the UK’s research, development and innovation  landscape by Sir Paul Nurse,

Sir Paul calculated our spending around 2.5% of GDP. But he still concluded that funding, particularly  provided by government, was limited, and below that of other competitive nations such as  the Germans, South Koreans and US. 

There is the particular and urgent problem of Horizon and the uncertainty around our membership. The absolute top priority for UK R&D should  be rejoining Horizon.We need access to collaboration across the EU  where pre Brexit  we disproportionately benefited from Horizon’s 95 billion euro budget. We need a clear commitment to negotiate re entry. What is the position now nearly two months after the Prime Minister’s  letter to Sir Adrian Smith of 14th April assuring him about our intentions on Horizon?

Iceland and Israel, Norway and New  Zealand, and Turkey and Tunisia, are all already part of Horizon, as is Ukraine. Why not us?

The two universities of Oxford and Cambridge once received more than £130m a year from European research programmes but are now  getting only £1m annually between them.

Meanwhile Britain has fallen behind Russia, Italy and Finland in the world league table for computing power., Britain has slipped from third in the rankings in 2005 to seventh now, according to the Independent Review of The Future of Compute. 

The way the UK delivers and supports research is also “not optimal,” the Nurse review said said. Of course research academics here will know the frustrations of the bureaucracy associated with applying for U.K. research grants. As the Tickell review  found there are issues with bureaucracy around research and development funding. 

EPSRC is according to researchers admirable in how it oversees the research grants. Innovate UK with its  Knowledge Transfer Partnerships however has a far more risk averse and bureaucratic approach just at the point where a bit of commercial risk taking is needed. We need to benchmark to ensure the least bureaucratic processes. I am told that the European Innovation Council is a model

ARIA was specifically designed to avoid bureaucracy as we said during the passage of the bill but why weren't all of UKRI processes remodelled rather than creating a new entity? Incidentally do we have any more information now about their key research and development projects?

The government doesn’t really have a clear idea of the role of university research either. The Research Excellence Framework has the perverse incentive of discouraging cooperation. We should be encouraging strategic partnerships in research especially internationally as the Committee concludes 

Commercialisation is a crucial aspect linking R&D to economic growth.  This in turn means the need for a consistent industrial strategy with the right commercial incentives and an understanding of the value of intangible assets such as IP and data. In this context Catapults are performing a brilliant job but need a bigger role and more resource as the Committee have recommended in a previous report.

Of course we are all much relieved for the tech sector by the rescue of Silicon Valley bank by HSBC. But the popularity of a US bank in a way demonstrates that we  may have a growing start up culture but scale up is still a problem as Sir Patrick Vallance said in his evidence to the Commons Science Innovation and Technology Committee  last month. 

The US is still preferred for listing by tech companies over London as we’ve seen with U.K. based ARM  seeking a listing in the US. 

There are aspects of wider government policy where there is no perceived benefit to U.K. science and technology

  • Reduction of of R & D  tax credits for SME’s
  • Raising corporation tax to 25% 

One of the long outstanding issues is reform to assist with derisking so that pension funds can play their part in helping grow tech companies also mentioned by Sir Patrick as an important  aspiration and I see that finally something is stirring from the British Business Bank with the LIFTS initiative.  

There are many other elements that need to be covered for a viable Science and technology strategy.

Regulatory Divergence 

Even where the government thinks it is being innovation friendly it is clouded by the desire to be divergent from the EU to get some kind of Brexit dividend.. It talks about  pro innovation regulation but Contrary to the advice of virtually every prominent technologist  the AI governance white paper only concerns itself with voluntary sectoral regulation and leaves it to the regulators in particular sectors not proposing a broader risk based regulatory regime like that proposed under the EU’s AIA or indeed by the US Administration’s Blue Print for AI. Maybe that will change after the  Prime Minister’s ’s visit to the US this week. 

Changes to our Data Protection regime proposed by the Data Protection and Digital Information bill no 2 which go further than just clarifying the retained GDPR and of course make changes to the ICO’s structure could leads to a lack of EU data adequacy and new compliance costs.. 

We have waited forever for competition law in the digital space to be reformed through a Digital Markets Act and Digital Markets Unit to be put on a statutory basis and now we have a bill which gives inadequate powers to the CMA to act swiftly to ensure competition.  In the meantime the so called hyperscalers gain greater and greater influence over the development of new technologies such as AI. 

Diversity

 In the the wise words of the British Science Association we must ensure the opportunities and benefits are equitable in any future science strategy, not only to shape a world-leading science industry, but to sustain progress and successfully bring out the potential of people from all communities, backgrounds and regions. Britain cannot be a superpower if parts of society are not welcomed and able to contribute to science research and innovation. Making science inclusive – from classroom to career – is essential to establishing a globally competitive workforce.

Mathematics

As regards mathematics, where is the £300m promised additional funding for mathematical science research as announced in January 2020 or the National Academy for the Mathematical Sciences or a National Strategy for Mathematics.

So much to do for the new Department. I hope that the Minister and his colleagues in DSIT will rise to the challenge 

 


The long-awaited AI Governance White Paper falls far short of what is needed

The long-awaited AI Governance White Paper falls far short of what is needed

The Government's AI Governance White Paper : A Pro Innovation to AI Regulation came out in late March . This is my take on it published by Politics Home. 

Lord Clement-Jones

Lord Clement-Jones

@whiterhino1949

Last week over a thousand leading technologists wrote an open letter pointing out the “profound risks to society and humanity” of artificial intelligence (AI) systems with human-competitive intelligence.

They called inter alia for AI developers to “work with policymakers to dramatically accelerate development of robust AI governance systems”. So, it is ironic that our government published proposals for AI governance barely worthy of the name.

This at a time when there is huge interest and apprehension of the capabilities of new AI, such as ChatGPT and GPT-4, has never been higher.

Business needs a clear central oversight and compliance mechanism, not a patchwork of regulation

A long gestation period of national AI policy making, which started so well back in 2017 with the Hall-Pesenti Review and the creation of the Centre for Data Ethics and Innovation, the Office for AI and the AI Council, has ended up producing a minimal  proposal for “a pro-innovation approach to AI regulation”. In substance this amounts to toothless exhortation by sectoral regulators to follow ethical principles and a complete failure to oversee AI development with no new regulator.

Much of the white paper’s diagnosis is correct in terms of the risks and opportunities of AI. It emphasizes the need for public trust and sets out the attendant risks and adopts a realistic approach to the definition of AI. It makes the case for central coordination and even admits that this is what business has asked for, but the actual governance prescription falls far short.

The suggested form of governance of AI is a set of principles and exhortations which various regulators – with no lead regulator – are being asked to interpret in a range of sectors under the expectation that they will somehow join the dots between them. They will have no new enforcement powers. There may be standards for developers and adopters but no obligation to adopt them.

There is no recognition that the different forms of AI are technologies that need a comprehensive cross-sectoral approach to ensure that they are transparent, explainable, accurate and free from bias whether they are in an existing regulated or unregulated sector. Business needs a clear central oversight and compliance mechanism, not a patchwork of regulation. The government’s proposals will not meet its objective of ensuring public trust in AI technology.

The government seems intent on going forward entirely without regard to what any other country is doing in the belief that somehow this is pro innovation. It does not recognise the need for our developers to be confident they can exploit their technology internationally.

Far from being world leading or turbocharging growth in practice, our developers and adopters will be forced to look over their shoulder at other more rigorous jurisdictions. If they have any international ambitions they will have to conform to European Union requirements under the forthcoming AI Act and ensure they avoid liability in the United States by adopting the AI risk management standards being set by the National Institute for Standards and Technology. Once again government ideology is militating against the interests of our business and science and technology communities.

What is needed – which I sincerely hope the Science and Technology Committee will recommend in its inquiry into AI governance – is a combination of risk-based, cross-sectoral regulation combined with specific regulation in sectors, such as financial services, underpinned by common trustworthy international standards of risk assessment, audit and monitoring.

We have world beating AI researchers and developers. We need to support their international contribution, not fool them they can operate in isolation.

Lord Clement-Jones, Liberal Democrat peer and spokesperson for Science Innovation and Technology in the Lords and co-founder of the All Party Parliamentary Group on AI.  

 


Common Ethics and Standards and Compatible Regulation will let responsible AI Flourish

This is the talk I gave at the opening of the excellent Portraits of AI Leadership Conference organized by Ramsay Brown of the The AI Responsibility Lab  based in LA and  Dr Julian Huppert Director of the Intellectul Forum at Jesus College Cambridge  

It’s a pleasure to help kick off proceedings today.

Now you may well ask why a lawyer like myself fell among tech experts like yourselves  

In 2016 as a digital spokesperson at an industry and Parliament trust breakfast I realized that the level of parliamentary understanding was incredibly low so with Stephen Metcalfe MP then the chair of Science and Technology Select Committee I founded the All Party Parliamentary Group on Artificial Intelligence.The APPG is dedicated to informing parliamentarians about developments and creating a community of interest around future policy regarding AI,  its adoption use and regulation.

As a result I was asked to chair the House of Lords Special Enquiry Select Committee on AI with the remit  to consider the economic, ethical and social implications of advances in artificial intelligence. This produced its report “AI in the UK: Ready Willing and Able?”  in April 2018.  It took a close look at government policy towards AI and its ambitions including those contained in the Hall/ Pesenti Review of October 2017 and those set out by former prime Minister Teresa May in her Davos World Economic Forum Speech including her goal for “ the UK to lead the world in deciding how AI can be deployed in a safe and ethical manner.”  

Since then, as well as co-chairing the All Party AI Group, I have maintained a close interest in the development of UK policy in AI, chaired a follow-up to the Select Committee’s report, “AI in the UK: No Room for Complacency”, acted as an adviser to the Council of Europe’s working party on AI (CAHAI) and helped establish the OECD Global Parliamentary Network on AI. 

I am now the Science Innovation and Technology  Spokesperson for the Liberal Democrats in the House of Lords for my sins.

Accross the world COVID-19  has emphasized and accelerated the dependence of virtually every business and sector on the successful adoption of the latest relevant technologies for their survival. Barely a day goes by without some reference to AI in the news. Both today and yesterday GPT 4 was one of the lead stories. 

Artificial Intelligence presents opportunities in a whole variety of sectors.  Variously we know what it can do,.

  • Detect financial crime/fraud/anti competitive behaviour.
  • Deliver personalised Education-of the learning experience
  • Energy Conservation 
  • In Healthcare: Diagnostics. Drug Discovery and distribution, administration too 
  • Delivery of the UN Sustainable development goals in terms of more productive agriculture, alleviation of hunger and poverty
  • Smart or connected cities
  • In terms of  technology used by regulators or Reg tech

The  opportunities for AI are incredibly varied indeed many people find it unhelpful to have such a variety of different types of machine learning labelled AI as it is. But I think we are stuck with it! There are common factors such as deep neural networks and machine learning. Increasingly the benefits are not just seen around not just about increasing efficiency, speed etc in terms of analysis, pattern detection and ability to predict but more about what creatively AI can add to human endeavour

We’ve seen the excitement over ChatGPT from Open AI and other large language models and AI text to image applications such as DALL E and now we have GPT 4. . The combination of these systems will give every appearance of AGI. 

The anticipated economic benefits over this decade are significant with estimates predicting that the UK’s GDP will be up to 10% higher in 2030 from the development and adoption of AI

But things can go wrong.This isn’t just any old technology-The degree of autonomy, lack of human intervention, the Black box nature  of some systems makes it different from other tech.

This is well illustrated by Brian Christian’s book ; the Alignment Problem and Stuart Russell’s  Human Compatible. The challenge is to ensure that AI is our servant not our master. Stuart Russell says we have to build in uncertainty into the delivery of objectives of AI systems so that a human in loop is not just desirable but necessary.

Furthermore failure to tackle issues such as bias/discrimination and lack of transparency could lead to a lack of public/consumer trust, reputational damage and inability to deploy new technology. Public trust and trustworthy AI is fundamental to continued advances in technology.

Just take for instance 

  • Consumer Financial Services decisions such as on Credit rating
  • Cybersecurity issues
  • Deployment in the workplace 

This is particularly true in government and public sector use of AI.

  • Public sector decisions such as on social security matters
  • Live Facial recognition by the police-The dangers of the surveillance state
  • And of course deployment of Lethal AutonomousWeapons

The need to ensure responsible or ethical AI in its business and public adoption could and should however lead to a positive appraisal of governance more broadly both in the private and public sector

It is clear that AI even in its narrow form will and should have a profound impact on and implications for corporate governance. Trade organisations such as techUK and specific AI organisations such as the Partnership on AI recognize that corporate responsibility and governance on AI is increasingly important.

This means a much more value driven approach to the adoption of new technology. Engagement from boards through governance right through to policy implementation is crucial. This not purely a matter for the CTO/CIO.

Key areas that need tackling 

  • Raising senior management awareness of issues posed by AI 
  • Definition/classification  of AI systems being developed, procured and deployed,
  • Employment issues : will it augment human skills or substitute them?
  • Oversight including Accountability through Boards and Audit and Risk Committees, 
  • Risk assessment that is undertaken with the identification of high risk uses
  • Procurement rules
  • Whistleblowing 

But it also importantly means assessing the ethics of adoption of AI  and the ethical principles to be applied: It may involve the establishment of an ethics advisory committee.

We have a pretty good common set of principles -OECD or G20- which are generally regarded as the gold standard which can be adopted which can help us ensure 

  • Quality of training data
  • Freedom from Bias 
  • The impact on Individual civil and human rights
  • Accuracy and robustness
  • Transparency and Explainability which of course include the need for open communication where these technologies are deployed. 

Generally in business and in the tech research and development world I think there  there is an appetite for regulatory certainty and adoption of common standards  particularly on standards for tools such as 

  • Conformity/risk and impact assessment 
  • AI audit
  • Continuous Monitoring 
  • Scoreboxes
  • And Sandboxing 

I am optimistic too that common standards

can be achieved internationally in all these areas. Work on common standards is bearing fruit.  In particular We have seen the launch last October of the interactive AI Standards Hub by the Alan Turing institute with the support of the British Standards Institution and National Physical Laboratory  which will provide users across industry, academia and regulators with practical tools and educational materials to effectively use and shape AI technical standards. 

This in turn could lead to agreement on ISO standards with the EU and the US where NIST is actively engaged in developing such standards

Agreement on the actual regulation of AI ie what elements of governance and application of standards is obligatory, however, is more difficult. 

There are already some elements of a legal framework in place. Even without specific legislation, AI deployment in the UK will interface with existing legislation and regulation in particular relating to 

  •  personal data under the GDPR  
  •  discrimination and fair treatment under the Human Rights Act and Equality Act
  • product safety and public safety
  • And various sector-specific regulatory regimes requiring oversight and control by persons undertaking regulated functions, the FCA for financial services, Ofcom in the future for social media for example.

But when it comes to legislation and regulation that is specific to AI that’s where some of the difficulties and disagreements start emerging especially from the UK’s divergent approach. 

The UK has stated that it wishes its regulation to be innovation friendly and context specific. We do need however to be clear that regulation is not necessarily the enemy of innovation, it can in fact be the stimulus and be the key to gaining and retaining public trust around digital technology and its adoption so we can realise the benefits and minimise the returns.

Then we have the policy that regulation will be context specific. As regards categorising AI rather than working to a broad definition of AI and determining what falls within scope, which is the approach taken by the EU AI Act, the UK looks like electing to follow an approach that instead sets out the core principles of AI which the government says “allows regulators to develop their own sector-specific definitions to meet the evolving nature of AI as technology advances.”

 This approach which potentially adopts different regulatory requirements across sectors in my view runs the risk of creating barriers for developers and adopters having to navigate through the regulators of multiple sectors even given the new levels of cooperation currently being put in place.  Where a  cross-compatible AI system is concerned for example in finance and telecoms for example they would have to potentially understand and comply with different regimes administered by the FCA, Prudential Reg Authority, and Ofcom at the same time. 

In its  AI policy paper published last July there is a surprising admission by the government that a context-driven approach may lead to less uniformity between regulators and may cause confusion and apprehension for stakeholders who will potentially need to consider a regime of multiple regulators as well as the measures required to be taken to deal with extra- territorial regimes, such as the EU Regulation.

Also the the more we diverge when it comes to regulation from other jurisdictions the more difficult it gets for developers and those who want to develop AI systems internationally

One example is the proposals to water down data protection under the GDPR which could mean difficulty in transferring data between the UK and Europe. The more I look at the new Data Protection and Digital Identity bill introduced into Parliament last week the more problematic it appears. 

In my view without a broad definition and some overarching duty to carry out a risk and impact assessment and subsequent regular audit to assess whether an AI system is conforming to Al principles the governance of AI systems will be deficient, on the grounds alone that not every sector is regulated. 

For example, except for certain specific products such as driverless cars  or say in financial services and as proposed for social media platforms there is no accountability or liability regime established for the operation of  AI systems more broadly..

Regulation could and should take the form of an overarching regulatory regime designed to  ensure public transparency in the use of AI technologies and the recourse available across sectors for non ethical use.This should set out clear common duties to assess risk and impact and adhere to common standards. Depending on the extent of the risk and impact assessed further regulatory requirements  would arise. 

This includes the public sector. Although The UK Government has recognized the need for guidance for public sector organizations in the procurement and use of AI there is no central and local government compliance mechanism and no transparency yet in the form of a public register of use of automated decision making. It is is interesting that many US cities-and indeed big tech companies- have been much more proactive

Also, despite the efforts of Parliamentarians and organisations such as the Ada Lovelace Institute, there is no no recognition at all by Government that explicit legislation and/‘or regulation for intrusive AI technology such as live facial recognition is needed to prevent the arrival of the surveillance state

But International harmonization is in my view essential if we are to see developers able to commercialize their products on a global basis assured that they are adhering to common standards of regulation and I believe would help provide the certainty businesses would need to develop and invest in the UK more readily 

I would go further when it comes to dealing with our nearest trading partner. When the White Paper does emerge I believe that it is important that there is recognition that we need a considerable degree of convergence between ourselves and the EU and that a risk based form of horizontal rather than purely sectoral regulation is required otherwise we face potentially another trade barrier -AI Adequacy -to add to the need for data adequacy.

That in my view is the way to get real traction to realise the full benefits of  the global development of responsible AI, AI for good which we all to see flourish !  


Lord C-J at the Piccaso Data Privacy Awards

I recently attended and spoke at the inaugural Piccaso Data Privacy awards celebrating the contribution of businessers and organisations innovating in data privacy . 

Piccaso is an acronym (Privacy, InfoSec, Culture, Change , Awareness, Societal Organisation) for an organisation which aims to harness "the knowledge and experience of experts both from the privacy, data protection, and information security domains to inspire, challenge, and educate our community to elevate the practice of privacy and data protection maturity within their firms and sectors."

This is what I said. 

I’m delighted to have been asked to make a few remarks at this evening’s terrific inaugural Piccasso event… and it’s a privilege to follow the avatar of John Edwards the Information Commissioner, especially his sales pitch for the ICO!  It is a great example of his positive approach to regulation which we know needs to be principled, proportionate and communicative. 

Continuing the wise approach of his predecessor, Elizabeth Denham who I am delighted to see is one of our judges.

We of course have new data protection legislation coming down the track which may or may not prove positive, which we are going to have to grapple with inside and outside Parliament fairly soon 

I hope that whatever changes are made to the GDPR its broad approach will continue, and any changes to the GDPR structure and oversight of the regulator, mean we not only remain data adequate for EU purposes but keep public trust in the use and sharing of their data in the UK!

And the need for public trust in the use and sharing of our data and the preservation of individual privacy is crucial if we are to get the full benefit of the adoption of new technologies such as AI and Machine learning.  We have seen how when trust fails, such as with the poorly handled GP data saga last year, when over three million NHS patients opted out of sharing their health data. 

This is a unique and very special event gathering together the full width of community, public and private and third sector, who really get this and each of whom is supporting privacy compliant innovation, by developing privacy enabling solutions, ensuring organisations use their data in a privacy by design and trusted way, and enabling individuals to exercise their privacy rights.  

The 15 award categories tonight and those people and  organisations nominated give a real sense of the breadth of the skills and talent present – all of you focussed on making our organisations, economy and society a trusted and safe place to live and operate.  

Tonight’s event is a celebration of your incredible contributions, which are all too often overlooked and under-appreciated. 

 

Given that a culture of privacy protection is not always the rule, I want us to commend and celebrate the good work that is being done by so many in this room tonight - including those engaged in thought leadership, testing and setting boundaries and devising creative policy approaches which address new developments such as blockchain, Web 3.0 and the Metaverse. 

You all know, live with and understand the importance of data protection and privacy, and your leadership is helping to enable a safer future, and one where innovation is encouraged.  

So whether you win or not tonight, thank you - and congratulations for playing a really important role in a privacy protecting future!

 

 

 


It's time to have a moratorium on Live Facial Recognition use

We recently debated the recommendations of the  Lords Justice and Home Affairs Committee Report Technology rules? The advent of new technologies in the justice system 

This is what I said on welcoming the $eport.

I entirely understand and welcome the width of the report but today I shall focus on live facial recognition technology, a subject that I have raised many times in this House and elsewhere in Questions and debates, and even in a Private Member’s Bill, over the last five years. The previous debate involving a Home Office Minister—the predecessor of the noble Lord, Lord Sharpe, the noble Baroness, Lady Williams—was in April, on the new College of Policing guidance on live facial recognition.

On each occasion, I drew attention to why guidance or codes are regarded as insufficient by myself and many other organisations such as Liberty, Big Brother Watch, the Ada Lovelace Institute, the former Information Commissioner, current and former Biometrics and Surveillance Camera Commissioners and the Home Office’s own Biometrics and Forensics Ethics Group, not to mention the Commons Science and Technology Committee. On each occasion, I have raised the lack of a legal basis for the use of this technology—and on each occasion, government Ministers have denied that new explicit legislation or regulation is needed, as they have in the wholly inadequate response to this report.

In the successful appeal of Liberal Democrat Councillor Ed Bridges, the Court of Appeal case on the police use of live facial recognition issued in August 2020, the court ruled that South Wales Police’s use of such technology had not been in accordance with the

law on several grounds, including in relation to certain human rights convention rights, data protection legislation and the public sector equality duty. So it was with considerable pleasure that I read the Justice and Home Affairs Committee report, which noted the complicated institutional landscape around the adoption of this kind of technology, emphasised the need for public trust and recommended a stronger legal framework with primary legislation embodying general principles supported by detailed regulation, a single national regulatory body, minimum scientific standards, and local or regional ethics committees put on a statutory basis.

Despite what paragraph 4 of the response says, neither House of Parliament has ever adequately considered or rigorously scrutinised automated facial recognition technology. We remain in the precarious position of police forces dictating the debate, taking it firmly out of the hands of elected parliamentarians and instead—as with the recent College of Policing guidance—marking their own homework. A range of studies have shown that facial recognition technology disproportionately misidentifies women and BAME people, meaning that people from those groups are more likely to be wrongly stopped and questioned by police, and to have their images retained as the result of a false match.

The response urges us to be more positive about the use of new technology, but the UK is now the most camera-surveilled country in the Western world. London remains the third most surveilled city in the world, with 73 surveillance cameras for every 1,000 people. The last Surveillance Camera Commissioner did a survey, shortly before stepping down, and found that there are over 6,000 systems and 80,000 cameras in operation in England and Wales across 183 local authorities. The ubiquity of surveillance cameras, which can be retrofitted with facial recognition software and fed into police databases, means that there is already an apparatus in place for large-scale intrusive surveillance, which could easily be augmented by the widespread adoption of facial recognition technology. Indeed, many surveillance cameras in the UK already have advanced capabilities such as biometric identification, behavioural analysis, anomaly detection, item/clothing recognition, vehicle recognition and profiling.

The breadth of public concern around this issue is growing clearer by the day. Many cities in the US have banned the use of facial recognition, while the European Parliament has called for a ban on the police use of facial recognition technology in public places and predictive policing. In 2020 Microsoft, IBM and Amazon announced that they would cease selling facial recognition technology to US law enforcement bodies.

Public trust is crucial. Sadly, the new Data Protection and Digital Information Bill does not help. As the Surveillance Camera Commissioner said last year, in a blog about the consultation leading up to it:

“This consultation ought to have provided a rare opportunity to pause and consider the real issues that we talk about when we talk about accountable police use of biometrics and surveillance, a chance to design a legal framework that is a planned response to identified requirements rather than a retrospective reaction to highlighted shortcomings, but it is an opportunity missed.”

Now we see that the role of Surveillance Camera Commissioner is to be abolished in the new data protection Bill—talk about shooting the messenger. The much-respected Ada Lovelace Institute has called, in its report Countermeasures and the associated Ryder review in June this year, for new primary legislation to govern the use of biometric technologies by both public and private actors, for a new oversight body and for a moratorium until comprehensive legislation is passed.

The Justice and Home Affairs Committee stopped short of recommending a moratorium on the use of LFR, but I agree with the institute that a moratorium is a vital first step. We need to put a stop to this unregulated invasion of our privacy and have a careful review, so that its use can be paused while a proper regulatory framework is put in place. Rather than update and use toothless codes of practice, as we are urged to do by the Government, to legitimise the use of new technologies such as live facial recognition, the UK should have a root-and-branch surveillance camera and biometrics review, which seeks to increase accountability and protect fundamental rights. The committee’s report is extremely authoritative in this respect. I hope today that the Government will listen but, so far, I am not filled with optimism about their approach to AI governance.


AI Governance: Science and Technology Committee launches enquiry

The House of Commons Science and Technology Committee has launched an inquiry into the governance of artificial intelligence (AI).

This is what they said on launching it:

In July, the UK Government set out its emerging thinking on how it would regulate the use of AI. It is expected to publish proposals in a White Paper later this year, which the Committee would examine in its inquiry.

Used to spot patterns in large datasets, make predictions, and automate processes, AI’s role in the UK economy and society is growing. However, there are concerns around its use. MPs will examine the potential impacts of biased algorithms in the public and private sectors. A lack of transparency on how AI is applied and how automated decisions can be challenged will also be investigated.

In the inquiry, MPs will explore how risks posed to the public by the improper use of AI should be addressed, and how the Government can ensure AI is used in an ethical and responsible way. The Committee seeks evidence on the current governance of AI, whether the Government’s proposed approach is the right one, and how their plans compare with other countries.

Rt Hon Greg Clark MP, Chair of Science and Technology Committee, said:

“AI is already transforming almost every area of research and business. It has extraordinary potential but there are concerns about how the existing regulatory system is suited to a world of AI.

With machines making more and more decisions that impact people’s lives, it is crucial we have effective regulation in place. In our inquiry we look forward to examining the Government’s proposals in detail.”

These are these key questions they are asking

  • How effective is current governance of AI in the UK?
  • What are the current strengths and weaknesses of current arrangements, including for research?
  • What measures could make the use of AI more transparent and explainable to the public?
  • How should decisions involving AI be reviewed and scrutinised in both public and private sectors?
  • Are current options for challenging the use of AI adequate and, if not, how can they be improved?
  • How should the use of AI be regulated, and which body or bodies should provide regulatory oversight?
  • To what extent is the legal framework for the use of AI, especially in making decisions, fit for purpose?
  • Is more legislation or better guidance required?
  • What lessons, if any, can the UK learn from other countries on AI governance?

This is the written evidence to the Committee from myself and Coran Darling,  a Trainee Solicitor and member of the global tech and life sciences sectors at DLA Piper 

Introduction

I, alongside Stephen Metcalfe MP, co-founded the All Party Parliamentary Group on Artificial Intelligence (“APPG”) in late 2016. The APPG is dedicated to informing parliamentarians of contextual developments and creating a community of interest around future policy regarding AI, its adoption, use, and regulation.

I was fortunate to then be asked to chair the House of Lords Special Enquiry Select Committee on AI with the remit: “to consider the economic, ethical, and social implications of advances in artificial intelligence”. As part of our work, the Select Committee produced its first report “AI in the UK: Ready Willing and Able?” in April 2018. The report looked closely at the current landscape of governmental policy towards the subject of AI and its ambitions for future development. This included, for example, those future plans contained in the Hall/Pesenti Review of October 2017, and those set out by former prime Minister Teresa May in her Davos World Economic Forum Speech, including her aim for the UK to “lead the world in deciding how AI can be deployed in a safe and ethical manner.”

Since then, as well as continuing to co-chair the APPG, I have maintained a close interest in the development of UK policy in AI, chaired a follow-up to the Select Committee’s report, “AI in the UK: No Room for Complacency”, acted as an adviser to the Council of Europe’s working party on AI (“CAHAI”) and helped establish the OECD Global Parliamentary Network on AI.

Lord Clement-Jones

25th November 2022

Background

The Hall Pesenti Review (“Review”) was an independent review commissioned in March 2017 tasked with reporting on the potential impact of AI on the UK economy. While it did not tackle the question of ethics or regulation of AI, the Review made several key recommendations designed to set a clear course for UK AI strategy including that:

  • Data Trusts should be developed to provide proven and trusted frameworks to facilitate the sharing of data between organisations holding data and organisations looking to use data to develop AI;
  • the Alan Turing Institute should become the national institute for AI and data science with the creation of an International Turing AI fellowship programme for AI in the UK; and
  • the establishment of an UK AI Council to help coordinate and grow AI in the UK should occur.

The Government's subsequent “Industrial Strategy: building a Britain fit for the future” published in November 2017 (“Industrial Strategy”), identified putting AI “at the forefront of the UK’s AI and data revolution” as one of four 'Grand Challenges' identified as key to Britain's future. At the same time, the Industrial Strategy recognised that ethics would be key to the successful adoption of AI in the UK. This led to the establishment of the Centre for Data Ethics and Innovation in late 2018 with the remit to “make sure that data and AI deliver the best possible outcomes for society, in support of their ethical and innovative use”. In early 2018, the Industrial Strategy would go on to produce a £950m ‘AI Sector Deal’, which incorporated nearly all the recommendations of the Review and established a new Government Office for AI designed to coordinate their implementation.

Building on the work of the Review and the Industrial Strategy, the original Select Committee report enquiry concluded that the UK was in a strong position to be among the world leaders in the development of AI. Our recommendations were designed to support the Government and the UK in realising the potential of AI for our society and our economy and to protect from future potential threats and risks. It was concluded that the UK had a unique opportunity to forge a distinctive role for itself as a pioneer in ethical AI. We did, however, emphasise that if poorly handled, public confidence in AI could be undermined significantly.

In anticipation of the OECD’s subsequent digital AI principles, which were adopted in 2019, the Select Committee proposed five principles that could form the basis of a cross-sector AI code, and which could be adopted both nationally and internationally.

We did not at that point recommend a new regulatory body for AI-specific regulation, but instead noted that such a framework of principles could underpin regulation, should it prove to be necessary, in the future and that existing regulators would be best placed to regulate AI in their respective sectors. The Government in its response accepted the need to retain and develop public trust through an ethical approach both nationally and internationally.

In December 2020, the Select Committee’s follow up report “AI in the UK: No Room for Complacency” we examined the progress made by the Government to date since our earlier work. After interviews with government ministers, regulators, and other key players, the new report made several key recommendations. In particular, that:

  • greater public understanding was essential for the wider adoption of AI and active steps should be taken by the Government to explain to the general public the use of their personal data by AI;
  • the development of policy and mechanisms to safeguard the use of data, such as data trusts, needed to pick up pace, otherwise it risked being left behind by technological developments;
  • the time had come for the Government to move from deciding what the ethics are to how to instil them in the development and deployment of AI systems. We called for the CDEI to establish and publish national standards for the ethical development and deployment of AI;
  • users and policymakers needed to develop a better understanding of risk and how it can be assessed and mitigated, in terms of the context in which it is applied; and
  • that coordination between the various bodies involved in the development of AI, including the various regulators, was essential. The Government therefore needed to better coordinate its AI policy and the use of data and technology by national and local government. 

Despite the passage of time since the Industrial Strategy, the current governance of AI remains incomplete and unsatisfactory in several respects.

With respect to the use of data for training and inputs, such as for decision making and prediction, the UK General Data Protection Regulation (“GDPR”) and the Data Protection Act 2018 are important forms of governance. The Government’s “Data A New Direction” consultation however has led to a new Data Protection bill (“DP Bill”) which, while currently in development, proposes major changes to the GDPR post Brexit. These include significant amendments, such as no longer requiring firms to have a designated Data Protection Officer. The proposed DP Bill also waters down several provisions relating to data impact assessments. This holds the potential to create a divergence from the established data protection position in the UK and is likely to impact on the important EU Adequacy Decision in June 2021, leading to uncertainty for those wishing to use data for training and processing. The Government’s apparent intention to amend Article 22 of the GDPR giving the citizen the right not to be subjected to automated decision making also creates further uncertainty and runs the risk of a lower level of governance over decision made by AI systems.

A further area currently without a satisfactory approach is that of data and the issue of bias in decision making as a result of inherent bias caused by the improper use of data sets during the process of training algorithms. While it is likely that the Government’s own gap analysis will show that equalities legislation covers bias in acquired data which leads to discriminatory decisions made by AI, further consideration is needed on whether specific legal obligations in relation to the use of AI should be implemented in this context to actively mitigate its risk, rather than state that a discriminatory outcome is prohibited.

It is also the case that in many other areas of data and AI, there is no proper current governance in terms of binding legal duties that ensure that key internationally accepted ethical principles, such as those set out in the OECD AI Principles, are observed. These include:

  • Inclusive growth, sustainable development and well-being;
  • Human-centred values and fairness;
  • Transparency and explainability;
  • Robustness, security and safety; and

Despite the overall acceptance that the UK would need to consider developing policy or regulations in order to remain ahead of the curve, the UK’s National AI Strategy, published in September 2021, contained no discussion of ethics or regulation. Instead, an AI Governance whitepaper was promised to be published at some point in 2022.

Subsequent publication of an AI policy paper and AI Action Plan in July 2022 did however indicate that the Government was committed to developing “a pro-innovation national position on governing and regulating AI.” It is expected that this will be used to develop the AI Governance White paper.

Their approach is as follows:

“Establishing clear, innovation-friendly and flexible approaches to regulating AI will be core to achieving our ambition to unleash growth and innovation while safeguarding our fundamental values and keeping people safe and secure […] drive business confidence, promote investment, boost public trust and ultimately drive productivity across the economy.”

To facilitate its ‘pro-innovation’ approach, the Government has proposed several early cross-sectoral and overarching principles which build on the OECD AI Principles. These principles will, it seems, be interpreted and implemented by regulators within the context of the environment they oversee and will therefore be flexible to interpretation.

In terms of classification of AI within this ‘pro-innovation’ approach, rather than working to a clear definition of AI and determining what falls within scope, as chosen by the EU with their proposed AI Act, the UK has elected to follow an approach that instead sets out the core principles of AI which allows regulators to develop their own sector-specific definitions to meet the evolving nature of AI as technology advances.

In my view however, without a broad definition and some overarching duty to carry out a risk and impact assessment and subsequent regular audit to assess whether an AI system is conforming to Al principles, the governance of AI systems will be deficient, on the grounds alone that not every sector is regulated as is likely to be required. For example, except for certain specific products such as driverless cars there is no accountability or liability regime established for liability for the operation of AI systems at present.

This is the case for the public sector, as well as those in the private sector. While The Government has recognised the need for guidance for public sector organisations in the procurement and use of AI, it remains that there is no central and local government compliance mechanism to put this into practice. There are therefore insufficient measures of transparency, such as in the form of a public register of use of automated decision making, that require oversight and assessment of the decisions being carried out by AI in the context of public organisations. Furthermore, despite the efforts of parliamentarians, and organisations such as the Ada Lovelace Institute, there is no material recognition by the Government that explicit legislation, and/or regulation for intrusive AI technology such as live facial recognition, is needed to prevent the arrival of the surveillance state.

In light of the recognition by the National AI Strategy of the need to gain public trust, and for the wider use of trustworthy AI, the Government’s current proposals for a context specific approach are inadequate. In the face of this need to retain public trust, it must be clear, above all however, that regulation is not necessarily the enemy of innovation. In fact, it can in be the stimulus and key to gaining and retaining public trust around digital technology and its adoption. An approach by the Government could and should take the form of an overarching regulatory regime designed to ensure public transparency in the use of AI technologies and the recourse available across sectors for non-ethical use.

As is currently proposed, an approach which adopts divergent regulatory requirements across sectors would run the risk of creating barriers for developers and adopters through the requirement of having to navigate the regulatory obligations of multiple sectors. Where a cross-compatible AI system is concerned, for example in finance and telecoms, an organisation would have to potentially understand and comply with different regimes administered by the FCA, Prudential Regulation Authority, and Ofcom at the same time.

So, for these reasons, a much more horizontal cross sectoral approach than the Government is proposing is needed for the development and adoption of AI systems. This should set out clear common duties to assess risk and impact and adhere to common standards. Depending on the extent of the risk and impact assessed further legal duties would arise.

The question (What lessons, if any, can the UK learn from other countries on AI governance?) in my view should extend wider and ask not just about the lessons but the degree of harmonisation needed to ensure the most beneficial context for UK AI development, adoption, and assurance of ethical AI standards.

In its recent AI policy paper, a surprising admission is made by the Government that a context-driven approach may lead to less uniformity between regulators and may cause confusion and apprehension for stakeholders who will potentially need to consider multiple regimes, as well as the measures required to be taken to deal with extra-territorial obligations, such as those of the proposed EU AI Act.

International harmonisation is, in my view, essential if we wish to see developers and suppliers able to commercialise their products on a global basis assured that they are adhering to common standards of regulation without lengthy verification on entry of each individual jurisdiction in which they interact.

This could come in the form of a national version of the EU’s approach, where we have regulation that harmonises the landscape across sectors and industries, or in the form of international agreement on the standards of risk and impact assessment to be adopted. Work on common standards (i.e. the tools which would be deployed if regulation were out in place) is bearing fruit and may also assist organsiations in ensuring they are in conformity without navigating every subsector or jurisdiction with which they interact.

Most recently, we have seen the launch of the interactive AI Standards Hub by the Alan Turing institute with the support of the British Standards Institution and National Physical Laboratory which will provide users across industry, academia, and regulators with practical tools and educational materials to effectively use and shape AI technical standard. This in turn could lead to agreement on ISO standards with the EU and the US where NIST is actively engaged in developing similar protocols.

Having a harmonised approach would help provide the certainty businesses would need to develop and invest in the UK more readily.

When it comes to dealing with our nearest trading partner, it may be favourable to go one step further. When the White Paper does emerge, I believe that it is important that there is recognition that a considerable degree of convergence between us and EU is required practically, and that a risk-based form of horizontal, rather than purely sectoral, regulation is needed.

The Government is engaged in a great deal of activity. The question, therefore, is whether it is fast or focused enough and whether its objectives (such as achieving trustworthy AI and harmonised international standards) are going to be achieved through the actions being taken so far. As it stands currently, this does not look to be the case.

 

Lord Clement-Jones,

Coran Darling

 

 

 

 

 

 

 

 


Lord C-J at OECD : Mixed evidence on UK AI Governance

I recently attended a meeting of the OECD Global Parliamentary Network Group on Artificial Intelligence and spoke on UK developments during a session on Innovating in AI Legislation

It seems a long time since we all got together in person-what a pleasure! And such a pleasure to follow Eva. I am a huge admirer of what the EU have done in the AI space. I think we are all now beginning to be aware of the importance of digital media and the importance of AI and algorithms in our lives both positive and negative.Inevitably what I say is mainly focused on what we are doing in the UK but I hope it will have relevance in other jurisdictions. 

The good news is that despite ( just a few!) changes in government or the pandemic UK government action on  AI governance has been moving forward.

The UK’s National AI strategy - A ten-year plan for UK investment in and support of AI-was published in September 2021. It promised an AI Governance White Paper this year. In an AI policy paper and Action Plan published this July the Government then set out its emerging proposals for regulating AI in a policy consultation paper in which it committed to develop “a pro-innovation national position on governing and regulating AI.”  This will be used to develop the White paper which may yet emerge this year.

Their approach would be “Establishing clear, innovation-friendly and flexible approaches to regulating AI will be core to achieving our ambition to unleash growth and innovation while safeguarding our fundamental values and keeping people safe and secure. …….drive business confidence,promote investment, boost public trust and ultimately drive productivity across the economy.” Fine words but we now have some more detailed clues as to the future of regulation of AI in the UK.

As regards categorising AI rather than working to a clear definition of AI determining what falls within scope, which is the approach taken by the EU Regulation, the UK has elected to follow an approach that instead sets out the core principles of AI which allows regulators to develop their own sector-specific definitions to meet the evolving nature of AI as technology advances. 

In a surprising admission the policy paper does acknowledge that a context-driven approach may lead to less uniformity between regulators and may cause confusion and apprehension for stakeholders who will potentially need to consider the regime of multiple regulators as well as the measures required to be taken to deal with extra-territorial regimes, such as the EU Regulation. 

To facilitate its ‘pro-innovation’ approach, the UK Government however has proposed several early cross-sectoral and overarching principles which build on the OECD ‘Principles on Artificial Intelligence’ . These principles will be interpreted and implemented by regulators within the context of the environment they oversee and would therefore be flexible to interpretation. This call for views and evidence closed on 26 September so we shall see what emerges in the White paper probably not this year!!

As a result of this context-driven approach  the regulators in different sectors are going to take centre stage. So it is timely that  4 of our key regulators the ICO OFCOM  CMA FCA  have got together under a new Digital Regulators Cooperation Forum to pool expertise in this field. This includes sandboxing and  input from a variety of expert institutes such as the Alan Turing Institute on areas such as risk assessment, AI, audit, digital design frameworks and standards digital advertising and horizon scanning

The policy paper in turn has led to the launch this October of the interactive hub platform AI Standards Hub led  by the Alan Turing institute with the support of the British Standards Institution and National Physical Laboratory which will provide users across industry, academia and regulators with practical tools and educational materials to effectively use and shape AI technical standards. 

All this represents action but while the National AI strategy paper of last September does talk about public trust and the need for trustworthy AI,my view is that it needs to be reflected in how we regulate. In the face of the need to retain public trust we need to be clear, above all, that regulation is not necessarily the enemy of innovation, it can in fact be the stimulus and be the key to gaining and retaining public trust around digital technology and its adoption so we can realise the benefits and minimise the risks.

International harmonization is in my view essential if we are to see developers able to commercialize their products on a global basis assured that they are adhering to common standards of regulation. One of my regrets is that the UK government unlike our technical experts doesn’t devote enough attention to positive collaboration in a number of international AI fora such as the Council of Europe, UNESCO And the OECD 

But the UK IS playing an active part in GPAI serviced by the OECD  which is beginning to deliver some interesting output particularly in respect of the workplace. I hope too that when the White Paper does emerge that there is recognition that we need a considerable degree of convergence between ourselves the EU, members of the COE and the OECD in particular, for the benefit of our developers and cross border business  that recognizes that a risk based form of horizontal rather than purely sectoral regulation is required.

Above all this means agreeing on standards for risk and impact assessments alongside tools for audit and continuous monitoring for higher risk applications..That way I believe we can draw the US into the fold as well.

Other aspects of policy where I  do NOT believe we are heading in the right direction however are 

Data :The government’s “Data A New Direction”  consultation has led to a new Data Protection bill. Despite little appetite in the business or the research communities they are proposing major changes to the GDPR post Brexit including not requiring firms to have a DPO or DPIA.  All this is likely to impact on the precious EU Adequacy Decision which was made in June 21 and is meant to last for 4 years. 

IP:  Our Intellectual Property Office too is currently grappling with issues relating to IP created by AI .  Artificial Intelligence and Intellectual Property: copyright and patents consultation closed January 2022 and now has recommended changes to text and data mining exemption which has been very widely criticised by the creative industries, publishers etc. 

In addition although the UK Government has recognized the need for any amount of guidance for public sector organizations there is no central and local government compliance mechanism and  little transparency in the form of a public register of use of automated decision making. 

We also, despite the efforts of Parliamentarians and organisations such as the Ada Lovelace Institute, have no recognition at all that regulation for intrusive AI technology such as live facial recognition is needed. 

We are still having a major debate on the deployment over live facial recognition technology -the use of biometrics and AI - in policing, schools and in criminal justice recently. Many of us have real concern that we are approaching the surveillance state. 

In addition there is little appetite in government to ensure that our employment laws protect the increasing number of workers in the gig economy whose lives can be ruled by algorithm without redress.

So our government is engaged in a great deal of activity, the question as ever is whether it is fast or focused enough and whether the objectives such as achieving trustworthy AI and harmonized international standards are going to be achieved through the actions being taken so far. As you’ve heard today, I believe the evidence of success is still mixed! I still have quite a political shopping list! 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


How to Make the UK the Best Place in the World for Artificial Intelligence.

I recently gave a talk at a meeting of members of The Entrepreneurs Network. This is slightly expanded version.

It's pleasure to be in Entrepreneurial company tonight 

The Truss/Kwarteng paradise of  Britannia Unchained to unleash growth, growth growth has been showed up for what it it was. It didn’t outlast a lettuce.  I hope that with Rishi Sunak as PM we are at the end of the magical thinking era. 

I am always an optimist but I look forward to hearing whether you agree with Guy Hands who thinks we’re going to be the sick man of Europe. 

So I’m not going to talk at you too long and I’m certainly not going to get into detailed expenditure or taxation proposals!  That would be bound to get me into trouble.

And the first thing to remember is that policy is all very well but its results that matter and government can be the graveyard for good ideas, innovation and enterprise. You only have to read Kate Bingham’s recent book Long Shot  to understand how bureaucratic process can so easily be a killer of good intentions and effective outcomes.

The second is that we are in my view fighting a combination of factors including the effects of COVID Brexit, Austerity, and political instability to put it mildly. Mathew Syed in his Sunday Times column headlined that an “Irrational faith in the providence of Brexit has trapped adherents in cognitive dissonance and denial” . We need a frank appraisal of the impact of Brexit and fix the consequences where we can.

So our economic circumstances really do require prioritisation and clear thinking. 

What I would like to do is throw out a few thoughts for discussion on where the focus of government policy should be in order to grow our tech sector in general and AI development and adoption in particular.

The challenges include.

  • how can we convert academic success into entrepreneurship?
  • How can we increase the speed of business adoption of AI tech in the UK?
  • How can we best guard against future harms that AI could bring?

I am saying all this of course in the light of the Government’s grand 10 year plan “Make Britain a global AI superpower” published a year ago. 

Let’s briefly consider a number of key priority areas : 

  • The need for quality data 
  • Good regulation and standards which gain public trust
  • Jobs and Skills
  • International cooperation especially in R&D eg Horizon
  • Investment incentives
  • Infrastructure 

TechUk reported earlier this year at London Tech Week that UK start-up investment saw the biggest annual opening on record in 2022, with $11.3B raised by UKstart-ups in Q1, compared to $7.9b in Q1 2021.The UK is home to 122 unicorns, behind only the USand China for the creation of billion dollar tech companies, and first in Europe..

This is undoubtedly positive, especially considering the wider economic challenges the UK and the world face. However, with the UK economy forecasted to face a recession and an economic slowdown forecasted for 2023-2026, we cannot be complacent, 

Moreover as the Entrepreneurs Network point out in your recent paper making Britain the best place for AI Innovation, while the UK is a global leader in research, development and talent, the Tortoise Index ranks Government strategy - defined as financial and procedural investment into AI - only 13th internationally, which puts it behind Belgium. 

First of all if we are to have an AI growth Strategy there is  need for a quality data 

We need independent measures of platform business, their economic activity, growth rates, national and regional figures that can reveal hotspots of growth as well as cold spots for future investment and development.It seems that organisations such as the ONS don’t gather relevant data. It is difficult to develop a growth strategy for AI when the baseline from which to compare the growth isn't available. 

We also need data that cover different dimensions of growth –there need to be quality measures – quality of jobs, income, service, work/life balance etc.

Good regulation and standards

Then we have the importance of certainty for business of clear regulation.progress on AI governance and regulation is important as well to restore  and retain Public Trust.. 

Regulation is not necessarily the enemy of innovation, it can in fact be the stimulus and be the key to gaining and retaining public trust around AI and its adoption 

One of the main areas of focus of our original AI Select Committee was the need to develop an appropriate ethical framework for the development and application of AI and we were early advocates for international agreement on the principles to be adopted. It has become clear that voluntary ethical guidelines however much they are widely shared, are not enough to guarantee ethical AI and gain trust. 

Some of the institutions envisaged as the core of AI development really are working well. The Turing for example is coordinating effectively such as through the new AI Standards Hub But CDEI has lost its way and not been given enough independence and the Office for AI has lost impetus. The Digital Catapult has considerable expertise and great potential but is underresourced.

A key development in the last two years has been the work done at international level in the Council of Europe, OECD,  UNESCO and EU towards putting these principles into practice . The only international forum where the government seem to want to make a real contribution however is the global partnership on AI GPAI

 If at minimum  we could agree international standards for AI Risk Assessment and Audit that would represent realm progress and give our developers real certainty. 

The UK’s National AI strategy accepts the fact that we need to prepare for AGI 

On the other hand despite little appetite in the business or the research communities they have now introduced a new a really unhelpful Bill  on major changes to the GDPR post Brexit and as a result we may have a less independent ICO which will put at risk the precious Data Adequacy ruling by the EU.

And above all despite their commitment to trustworthy AI, we still await the Government’s proposals on AI Governance in the forthcoming White Paper but there is a strong prediction that it will be mainly sectoral;/contextual and not in line with our EU partners or even extraordinarily the US.

At the very least we also need to be mindful that the extraterritoriality of the EU AI Act means a level of regulatory conformity will be required for the benefit of our developers and cross border business  

Jobs and Skills

Then of course we have the potential impact of AI on jobs and employment . A  report by Microsoft quoted  by TEN found that the UK is facing an AI skills shortage: only 17% of UK employees are being re-skilled for AI

We need to ensure that people have the opportunity to reskill and retrain to be able to adapt to the evolving labour market caused by AI. Every child should leave school with a basic sense of how AI works.

But the pace, scale and ambition of government action does not match the challenge facing many people working in the UK. The Skills and post 16  Education Act with its introduction of a Lifelong Loan Entitlement is a step in the right direction.I  welcome the renewed emphasis on Further Education and the new institutes of Technology.. but this isn’t ambitious enough.

The government refer to AI apprenticeships but Apprentice Levy reform is long overdue. The work of Local Digital Skills Partnerships and Digital Boot camps  is welcome but they are greatly under-resourced and only a patchwork. Careers advice and Adult education need a total revamp

We also need to attract foreign talent. Immigration has a positive impact on innovation.The new Global Talent visa seeks to attract leaders or potential leaders in various fields including digital technology.   This and changes the changes to the Innovator visa are welcome.

Broader digital literacy is crucial. We need to learn how to live and work alongside AI and a specific training scheme should be designed to support people to work alongside AI and automation, and to be able to maximise its potential

Given the current and imminently greater disruption in the job market we need to modernise employment rights to make them fit for the age of the AI driven ‘gig economy’, in particular by establishing a new ‘dependent contractor’ employment status in between employment and self-employment, with entitlements to basic rights such as minimum earnings levels, sick pay and holiday entitlement. 

Alongside this we shared the priority of the AI Council Roadmap for more diversity and inclusion in the AI workforce and we still need to see more progress in this area.

R & D support including International cooperation eg Horizon

Any industrial policy for AI needs to discuss the R & D and innovation context in which it is designed to sit.

The UK has/had a long-term target for UK R&D to reach 2.4% of GDP by 2027. In 2020 we had the very well-intentioned R & D Roadmap. Since then we have had the UK Innovation Strategy with its Vision 2035, the AI Strategy, the Lifesciences Vision, the Fintech Strategic Review, all it seems informed by the Integrated Review’s determination that we will have secured our status as a science and tech superpower by 2030.

So there is no shortage of roadmaps, reviews and strategies which lay out government policy in this landscape!

Lord Hague wrote a wise piece in the Times a little time ago. he said

“But the officials working on so many new strategies should be running down the corridors by now and told to come back only when they have some detailed plans that go far beyond expressing our ambitions”

When we wrote our AI reports in 2018 and 2020 it was clear to us that the UK remained attractive to international research talent. I am still very enthusiastic about the future of UK research & development, innovation and their commercial translation in the UK and want them to thrive for all our benefit

University R&  D remains important.There are strong concerns about the availability of research visas available for  entrance to universities research programmes and the failure to agree and the lack of access to EU Horizon research Council funding could have a huge impact. Plan B by the sound of it won’t give us anything like the same benefits. A number of Russell group universities such as imperial UCL and my own Queen Mary are now with finance partners building spin out funds. 

Additional funding could be provided to leading research universities to fund postgraduate scholarships in AI-related fields. .We should be seeking to make universities regional powerhouses tied in with the economic future of our city regions through university enterprise zones

We do nevertheless rank highly in the world of early-stage research and some late stage not least in AI, but it is in commercialisation- translational research and industrial R&D-where we continue to fall down.

The UK is a top nation in the global impact of its R&D, but not so effective at innovation, where it ranks 11th in the world in terms of knowledge diffusion and 27th for knowledge absorption, according to an October 2021 report by BEIS.

As Lord Willets is quoted as saying in a recent excellent HEPI paper (see how i quote tory peers!)  “Catching the wave: harnessing regional research and development to level up ‘We all know the problem– we have great universities and win Nobel Prizes, but we don’t do so well at commercialisation’.

Our research sponsoring bodies could be more generous in their funding, with less micromanagement, less keen digging up projects by the roots to see if they are growing. The creation of ARIA was an admission of the bureaucratic nature the current UKRI research funding system

 I welcome moves to extend R&D tax credits to investment in cloud computing infrastructure and data cost, but We need to bring in capital expenditure costs, such as those on plant and machinery for facilities engaging in R&D within scope as Tech UK have called for.I think we should now consider for AI investment something akin to the dedicated film tax credit for AI investment which has been so successful to date.

There needs to be more support for Catapults which have crucial roles as technology and innovation centre as the House of Lords Science and Technology Committee Report this year recommended

We could also emulate America’s seed fund- the SBIR and STTR programs which are at much great scale than our albeit successful UK Innovation and Science Seed Fund (UKI2S). And we need to expand the role of our low profile British Business bank 

Infrastructure

There has been so much government bravado in this area but is clear that the much trumpeted £5 billion announced last year  for Project Gigabit bringing gigabit coverage to the hardest to reach areas has not even been fully allocated and barely a penny has been spent. 

But the Government is still not achieving its objectives.

The latest Ofcom figures show it seems  that 90% of houses are covered by superfast broadband but the urban rural gap is still wide.

While some parts of the country are benefiting from high internet speeds, others have been left behind, The UK has nearly 5mn houses with more than three choices of ultrafast fibre optic broadband, while 10mn homes do not have a single option. According to the latest government data, in January 2022, 70 per cent of urban premises across the UK had access to gigabit-capable broadband, compared with 30 per cent of rural ones.

In fact urban areas now risk being overbuilt with fibre. In many towns and cities, at least three companies are digging to lay broadband fibre cables all targeting the same households, with some areas predicted to have six or seven such lines by the end of the decade. 

So are we now into a wild west for the laying of fibre optic cable Is this going to be like the Energy market with great numbers of companies going bust. 

So sadly even our infrastructure rollout is not very coherent! 

 

 

 

 

 


Creating the best framework for AI in the UK

This is a short piece I wrote earlier in the year for the Foundation of Science & Technology about the future of AI regulation in the UK which has now appeared in the FST Journal 

 

Summary

  • AI is becoming embedded in everything we do
  • We should be clear about the purpose and implications of new technologies
  • There is a general acceptance of the need for a risk-based ethics regulatory framework
  • The Humanities will be as important as STEM in the development of AI
  • Every child leaving school should have an understanding of the basics of AI.

 

A little over five years ago, the Lord's AI select committee began its first inquiry.  The resulting report was titled: AI in the UK: ready, willing and able?  About the same time, the independent review Growing the Artificial Intelligence Industry in the UK set a baseline from which to work.

There will always be something of a debate about the definition of artificial intelligence.  It is clear though that the availability of quality data is at the heart of AI applications.  In the overall AI policy ecosystem, some of the institutions were newly established by Government, some of them recommended by the Hall review.  There is the Centre for Data Ethics and Innovation, the AI Council and the Office for AI.  Standards development has been led by the Alan Turing Institute, the Open Data Institute, the Ada Lovelace Institute, the British Standards Institution and the Oxford Internet Institute, to name just a few.

Regulators include the Information Commissioner’s Office, Ofcom, the Financial Conduct Authority and the Competition & Markets Authority, which have come together under a new digital regulators’ cooperation forum to pool expertise.  The Court of Appeal has also been grappling with issues relating to IP created by AI.  Now regulation is not necessarily the enemy of innovation.  In fact, it can be a stimulus and is the key to gaining and retaining public trust around AI, so that we can realise the benefits and minimise the risks.  Algorithms have got a bad name over the past few years.

I believe that AI will actually lead to greater productivity and more efficient use of resources generally.  However, technology is not neutral.  We should be clear about the purpose and implications of new technology when we adopt it. Inevitably, there are major societal issues about the potential benefit from new technologies.  Will AI better connect and empower our citizens improve working life?

In the UK, there is general recognition of the need for an ethics-based regulatory framework: this is what the forthcoming AI Governance white paper is expected to contain.  The National Strategy also highlights the importance of public trust and the need for trustworthy AI.

We should be clear about the purpose and implications of new technology when we adopt it. Will AI better connect and empower our citizens?

The legal situation

The Government has produced a set of transparency standards for AI in the public sector (and, notably, GCHQ has produced a set of AI ethics for its operations).  On the other hand, it has also been consulting on major changes to the GDPR post-Brexit, in particular a proposal to get rid of Article 22, the so-called ‘right to explanation’ where there is automated decision making (if anything, we need to extend this to decisions where there is already a human involved).  There are no proposals to clarify data protection for behavioural or so-called inferred data, which are the bedrock of current social media business models, and will be even more important in what has been described as the metaverse.  There is also a suggestion that firms may no longer be required to have a Data Protection Officer or undertake data protection impact assessments.

We have in fact no settled regulation, or legal framework, for intrusive AI technologies such as live facial recognition.  This continues to be deployed by the police, despite the best efforts of a number of campaigning organisations and even successive biometrics and surveillance camera commissioners who have argued for a full legal framework.  There are no robust compliance or redress mechanisms for ensuring ethical, transparent, automated decision-making in our public sector either.

It is not yet even clear whether the Government is still wedded to sectoral (rather than horizontal) regulation. The case is now irrefutable for a risk-based form of horizontal regulation, which puts into practice common ethical values, such as the OECD principles.

There has been a great deal of work internationally by the Council of Europe, OECD, UNESCO, the global partnership on AI, and especially the EU.  The UK, therefore, needs a considerable degree of convergence between ourselves, the EU and members of the Council of Europe, for the benefit of our developers and cross-border businesses, to allow them to trade freely.  Above all, this means agreeing on common standards for risk and impact assessments alongside tools for audit and continuous monitoring for higher-risk applications. In that way it may be possible to draw the USA into the fold as well.  That is not to mention the whole defence and lethal autonomous systems space: we still await the promised defence AI strategy.

 

We have no settled regulation, or legal framework, for intrusive AI technologies such as live facial recognition.

 AI skills

AI is becoming embedded in everything we do.  A huge amount is happening on supporting AI specialist skills development and the Treasury is providing financial backing.  But as the roadmap produced by the AI Council itself points out, the Government needs to take further steps to ensure that the general digital skills and digital literacy of the UK are brought up to speed.

I do not believe that the adoption of AI will necessarily make huge numbers of people redundant. But as the pandemic recedes, the nature of work will change, and there will be a need for different jobs and skills.  This will be complemented by opportunities for AI, so the Government and industry must ensure that training and retraining opportunities take account of this.  The Lords AI Select Committee also shared the priority of the AI Council roadmap for diversity and inclusion in the AI workforce and wanted to see much more progress on this.

But we need however, to ensure that people have the opportunity to retrain in order to be able to adapt to the evolving labour market caused by AI.  The Skills and Post-16 Education Bill with the introduction of a lifelong loan entitlement is welcome but is not ambitious enough.

A recent estimate suggests that 90% of UK jobs within 20 years will require digital skills.  That is not just about STEM skills such as maths and coding.  Social and creative skills as well as critical thinking will be needed. The humanities will be as important as the sciences, and the top skills currently being sought by tech companies, as the University of Kingston's future league table has shown, include many creative skills: problem solving, communication, critical thinking, and so on.  Careers advice and Adult Education likewise need a total rethink.

We need to learn how to live and work alongside AI.  The AI Council roadmap recommends an online academy for understanding AI.  Every child leaving school should have a basic sense of how AI works.  Finally, given the disruption in the job market, we need to modernise employment rights to make them fit for the age of the AI- driven gig economy, in particular by establishing a new dependent contractor employment status, which fits between employment and self-employment.


Lord C-J introduces new Public Authority Algorithm Bill

I recently introduced a  private members bill in the House of Lords designed to ensure that decisions made by public authorities-local and national -are fully transparent and propoerly assessed for the the impact they have on the rights of the individual citizen .

 It mandates the government to draw up a framework for an impact assessment which follows a set of principles laid out in the Bill  so that (a) decisions made in and by a public authority are responsible and comply with procedural fairness and due process requirements, and its duties under the Equality Act, (b) impacts of algorithms on administrative decisions are assessed and negative outcomes are minimized, and (c) data and information on the use of automated decision systems in public authorities are made available to the public. It will apply in general to  to any automated decision system developed or procured by a public authority other than the security services