Skip to content
Search

Latest Stories

Tackle racial bias in AI to save labour market, say experts

It comes after an Uber Eats delivery driver received a payout for race discrimination after ethnically-biased facial recognition technology led to his suspension from the app.

Tackle racial bias in AI to save labour market, say experts

BRITAIN’S labour landscape risks turning into the “Wild West” if bosses fail to tackle racial bias in Artificial Intelligence (AI), experts have warned.

It comes after an Uber Eats delivery driver received a payout for race discrimination after ethnically-biased facial recognition technology led to his suspension from the app.


Pa Edrissa Manjang was removed from the app’s drivers platform after a failed recognition check. Uber Eats told him they had found “continued mismatches” in the photos of his face he had taken to access the platform. An employment tribunal case in March involving Manjang, from Oxfordshire, sparked concerns about using AI to screen employees and the potential for discrimination.

Kate Bell, the TUC’s assistant general secretary who leads the union’s work on AI, told Eastern Eye: “AI is already making life-changing decisions about the way millions work – including how people are hired, performance-managed and fired.

“But UK employment law is way behind the curve – leaving many workers vulnerable to exploitation and discrimination. We urgently need new employment legislation, so workers and employers know where they stand.

“Without proper regulation of AI, our labour market risks turning into a wild west. That is why the TUC is working with a range of stakeholders to draft an AI and Employment Bill.”

Meanwhile, the Information Commissioner’s Office is investigating whether AI systems are showing racial bias when dealing with job applications.

Regulators are concerned that AI tools could produce outcomes that disadvantage certain groups if they are not represented accurately or fairly in the datasets they are trained and tested on.

LEAD AI racism INSET Jasvir Singh Jasvir Singh CBE

Jasvir Singh CBE, a barrister, believes it is problematic when more research is showing that AI is known to have some racial biases.

He told Eastern Eye: “In Mr Manjang’s case, the technology was in effect denying that he existed.

“Facial recognition software can be useful in some circumstances, but there needs to be more work done to ensure that any glitches in technology can be ironed out to prevent any racial bias or discrimination from taking place.

“Until that happens, we may see more cases of this nature coming to employment tribunals and the courts in general, and the courts will need to develop a better understanding about the impact of AI in everyday life in order to tackle such issues properly and justly.”

The Equality and Human Rights Commission (EHRC) and the App Drivers and Couriers Union (ADCU) provided funding for Manjang’s case.

Baroness Kishwer Falkner, chairwoman of the EHRC, said: “AI is complex, and presents unique challenges for employers, lawyers and regulators.

“It is important to understand that as AI usage increases, the technology can lead to discrimination and human rights abuses. We are particularly concerned that Mr Manjang was not made aware that his account was in the process of deactivation, nor provided any clear and effective route to challenge the technology. More needs to be done to ensure employers are transparent and open with their workforces about when and how they use AI. When such companies rely on automation to help manage their staff they need to guard against unlawful discrimination.”

An Uber spokesperson said: “Our realtime ID check is designed to help keep everyone who uses our app safe and includes robust human review to make sure that we’re not making decisions about someone’s livelihood in a vacuum, without oversight.”

Elsewhere, new research from recruitment tech firm Tribepad suggested that 89 per cent of candidates believe recruiters show bias when hiring. Some 16 per cent felt there was a racial bias while 33 per cent believe that diversity data is used by prospective employers in a way that benefits them.

Dean Sadler, CEO of Tribepad, said: “These new findings paint a mixed picture. In some cases perceived bias is on the up – yet candidates do seem to be more trusting that employers are using diversity data for good. But it’s still not enough.

“We need a world where it’s not about where you’ve come from, what you look like, or your family situation, but the opportunities, skills and aptitude to land you a job.

Biases can be so ingrained, and unconsciously so, making it difficult to change mindsets, but it can be done.”

Last year, Bank of England officials warned that racist and sexist AI bots pose a risk to the financial system.

A report said self-teaching algorithms could pick up biases from datasets and wider society which could then be used to discriminate against customers or staff in the workplace.

The government recently published guidance on responsible AI in recruitment to help employers.

It outlines what organisations should consider, including asking what problems they are trying to solve and how AI can help address them, how the organisation will communicate the use of the tech to potential job applicants, whether the AI systems on the market have the capabilities to produce the desired outputs, and whether employees will need training or additional resources to use the system.

More For You

Baiju Bhatt

At 40, Bhatt is the only person of Indian origin in this group, which includes figures such as Meta’s Mark Zuckerberg. (Photo: Getty Images)

Baiju Bhatt named among youngest billionaires in US by Forbes

INDIAN-AMERICAN entrepreneur Baiju Bhatt, co-founder of the commission-free trading platform Robinhood, has been named among the 10 youngest billionaires in the United States in the 2025 Forbes 400 list.

At 40, Bhatt is the only person of Indian origin in this group, which includes figures such as Meta’s Mark Zuckerberg. Forbes estimates his net worth at around USD 6–7 billion (£4.4–5.1 billion), primarily from his roughly 6 per cent ownership in Robinhood.

Keep ReadingShow less
UK business district
The Canary Wharf business district including global financial institutions in London. (Photo: Getty Images)
Getty Images

Economy shows no growth in July amid political turbulence

UK's ECONOMY showed no growth in July, according to official data released on Friday, adding to a difficult week for prime minister Keir Starmer’s government.

The Office for National Statistics (ONS) said gross domestic product was flat in July, following a 0.4 per cent rise in June.

Keep ReadingShow less
India’s IT sector

India’s $283 billion IT industry, which contributes more than 7 per cent to the country’s GDP, has for over three decades provided services to major clients including Apple, American Express, Cisco, Citigroup, FedEx and Home Depot.

iStock

India’s IT sector faces uncertainty as US proposes 25 per cent outsourcing tax

INDIA’s IT sector is facing uncertainty as US lawmakers consider a 25 per cent tax on companies using foreign outsourcing services.

Analysts and lawyers said the proposal has led to customers delaying or re-negotiating contracts, raising concerns in India, the world’s largest outsourcing hub.

Keep ReadingShow less
Rachel Reeves

'Our economy isn't broken, but it does feel stuck,' Reeves said, speaking alongside the release of a finance ministry report on business property taxation, known as rates.

Getty Images

Reeves signals possible changes to business property taxes ahead of budget

CHANCELLOR Rachel Reeves said on Thursday she is considering changes to business property taxes to support small firms looking to expand, as part of her plans to boost growth.

Reeves’ comments come ahead of her annual budget on November 26, at a time when concerns about possible tax rises and inflation are weighing on businesses and households.

Keep ReadingShow less
Rachel Reeves

Reeves pledged to keep a tight hold on spending to reduce inflation and borrowing costs amid concerns over Britain’s fiscal outlook.

Getty Images

Reeves urges ministers to back Bank of England on inflation

CHANCELLOR Rachel Reeves has said the government must support the Bank of England in bringing down inflation while also focusing on growth, ahead of a budget later this year that is expected to include tax rises.

Last week, Reeves said the economy was not “broken” as she announced November 26 as the date for her annual budget.

Keep ReadingShow less