Advertisement
Social Justice

‘Rushed implementation’ of AI in DWP benefits system could ‘harm’ people, experts fear

Experts are concerned that the ‘historical data used to train AI may perpetuate bias and discrimination’ within the benefits system

Keir Starmer has announced a plan to “transform our public services” through artificial intelligence (AI) – but experts have warned against “rushed implementation” which could cause “serious harm to people relying on support”. This includes within the Department for Work and Pensions (DWP).

Labour’s 50-point plan for “mainlining AI into the veins” of the UK does not explicitly mention the DWP, speaking more broadly about how it will “make our public services better” and “boost growth”.

But the government has previously announced that the DWP will be using “the latest technologies and AI” to reform Jobcentres, providing information on jobs, skills and other support to save work coaches time.

In fact, the DWP is a government department which is already using AI and machine learning to “read and automatically identify the most vulnerable people”, intended to connect them to support more quickly. It also uses automated systems to detect fraud and error within the welfare system.

The Tony Blair Institute previously found that the DWPcould free up 40% of its time using AI tools, equivalent to a productivity gain of close to £1bn a year.

Shelley Hopkinson, head of policy and influencing at Turn2us, said: “AI has the potential to improve speed and consistency in the social security system, but errors from rushed implementation could cause serious harm to people relying on support. We are concerned that the historical data used to train AI may perpetuate bias and discrimination against marginalised groups.”

Advertising helps fund Big Issue’s mission to end poverty
Advertisement

An investigation by the Guardian found that the machine-learning programme used by the DWP to detect universal credit fraud incorrectly selected people from some groups more than others. It showed that there was bias according to people’s age, disability, marital status and nationality.

Further research found that 200,000 people have been wrongly investigated for housing benefit fraud and error because of poor algorithmic judgment.

The Big Issue has previously reported on the impact errors within the benefits system, with people being mistakenly accused of owing the DWP thousands of pounds. One single mother who was mistakenly accused of owing £12,000 described being left “devastated” and “fearful of ever claiming again”.

Hopkinson added: “AI integration should be guided by consultation and transparency so that the system meets the needs of everyone and builds trust that decisions are fair and accurate. This must come with clear accountability and safeguards to allow for challengeAI must work for people, not against them, prioritising people’s lives and wellbeing in decision-making.”

Do you have a story to tell or opinions to share about this? Get in touch and tell us moreBig Issue exists to give homeless and marginalised people the opportunity to earn an income. To support our work buy a copy of the magazine or get the app from the App Store or Google Play

Advertising helps fund Big Issue’s mission to end poverty

SIGN THE PETITION

Will you sign Big Issue's petition to ask Keir Starmer to pass a Poverty Zero law? It's time to hold government to account on poverty once and for all.

Recommended for you

Read All
'I am not a scrounger': Paralympic champions blast Labour over disability benefit cuts
Paralympians Sophie Christansen, David Smith and Ben Pritchard
Disability benefit cuts

'I am not a scrounger': Paralympic champions blast Labour over disability benefit cuts

'Broken' council tax system means millions of Brits face visit from bailiffs – but that's set to change
a person paying a bill and working out on a calculator
Council tax

'Broken' council tax system means millions of Brits face visit from bailiffs – but that's set to change

Revealed: Majority of PIP claimants with heart disease, arthritis and Crohn's at risk of cuts
Keir Starmer
Disability benefits

Revealed: Majority of PIP claimants with heart disease, arthritis and Crohn's at risk of cuts

Could the government's disability benefit cuts be blocked by Labour MPs?
Keir Starmer
Disability benefits

Could the government's disability benefit cuts be blocked by Labour MPs?

Most Popular

Read All
Renters pay their landlords' buy-to-let mortgages, so they should get a share of the profits
Renters: A mortgage lender's window advertising buy-to-let products
1.

Renters pay their landlords' buy-to-let mortgages, so they should get a share of the profits

Exclusive: Disabled people are 'set up to fail' by the DWP in target-driven disability benefits system, whistleblowers reveal
Pound coins on a piece of paper with disability living allowancve
2.

Exclusive: Disabled people are 'set up to fail' by the DWP in target-driven disability benefits system, whistleblowers reveal

Cost of living payment 2024: Where to get help now the scheme is over
next dwp cost of living payment 2023
3.

Cost of living payment 2024: Where to get help now the scheme is over

Citroën Ami: the tiny electric vehicle driving change with The Big Issue
4.

Citroën Ami: the tiny electric vehicle driving change with The Big Issue