All articles

Artificial Intelligence

AI recruiters exposed: the outcome is different every time

If you feed A.I. a pile of CVs and then ask it to rank the candidates, you get a very different list each time, research shows. Far too unreliable to use, concludes Martyn Redstone.

AI recruiters exposed: the outcome is different every time

He has been warning about it for years. A.I. can offer excellent solutions for many recruitment tasks, but you should never place too much trust in it, says automation specialist Martyn Redstone. This is particularly true when you ask LLMs to rank candidates. He refers, for example, to ‘rank roulette‘: today’s number 2 can easily be number 5 or even lower tomorrow, meaning the outcome is different every time. And perhaps worse still: A.I. recruiters rarely agree with one another. In only 14% of cases do their recommendations more or less match.

‘LLM screeners reinforce the inconsistency that already plagues selection, rather than remedying it’,

‘LLM screeners reinforce the inconsistency that already plagues recruitment and selection, rather than remedying it’, Redstone therefore concludes. ‘Until that volatility is tamed, all claims about the “fairness” such systems are said to bring are nothing more than marketing smoke.’ A.I. is really a kind of ‘overconfident intern’, he says: ‘quick and smooth, but shockingly inconsistent’ in its assessments. Good candidates also sometimes simply ‘disappear’, and the A.I. systems also remarkably often use the same reasoning points in their assessments.

Read this article in full

Become a Werf& member for unlimited access to all articles, research and exclusive insights into the labour market.

Sign up now

No obligations Cancel anytime Secure payment

Related posts

All articles
Why AI literacy belongs in every onboarding programme

A.I. literacy is becoming important in every role. If you offer it during the onboarding phase, you immediately create a shared starting point for the entire organisation. What is the best way to approach this?

Redactie Redactie Read article
Why Accenture, ASML and Bol.com benefit from growing AI search behaviour

Do you, as an employer, want to rank well with candidates searching for new jobs via A.I.? Then make sure your name starts with a letter from the beginning of the alphabet, according to new research.

Redactie Redactie Read article
How to keep online job interviews free from AI-assisted answers

Candidates who use AI in their online job interviews—this is becoming an increasingly significant problem for many organizations. How should companies handle this? Researchers offer five practical recommendations in the Harvard Business Review.

Peter Boerman Peter Boerman Read article

Altijd op de hoogte van de ontwikkelingen op de arbeidsmarkt?

Sign up for our newsletter and receive the latest updates, news and invitations to our events.