Intelligence Economy

Intelligence Economy

The Algorithm Is Lying to You: How AI Quietly Discriminates in Hiring

Why algorithms don’t erase discrimination but they automate it at scale.

Sameer Khan's avatar
Sameer Khan
Sep 28, 2025
∙ Paid

Hey AI Leader,

I’ve been spending time on career forums, trying to cut through the noise about how AI is reshaping recruitment. The headlines say it’s changing the hiring landscape for good, but the posts from new grads paint a harsher picture: jobs are scarcer, competition is brutal, and the algorithms screening résumés feel like black boxes deciding their future. Some claim it’s two or three times harder to land a role than just a few years ago.

I don’t take off-the-shelf narratives at face value. That’s not my style because, as a researcher and someone who feels the weight of responsibility to my Solve with AI readers, I dig until I find the real story. If I’m going to share insights in this newsletter, they need to be grounded in more than LinkedIn hot takes and clickbait.

One thread I came across stopped me cold. Buried in the comments, someone linked back to a story from 2018, one that should have been a warning for every company rushing to automate hiring.

That was the year Amazon quietly killed an experimental AI hiring tool. On paper, it was designed to solve one of the biggest headaches in recruitment: drowning in resumes and struggling to identify top talent quickly. But within months, engineers discovered something unsettling. The system had learned to downgrade résumés that included the word “women’s” as in “women’s chess club captain” or “women’s coding society.”

Why?

Because it was trained on a decade’s worth of résumés, most of which came from men.

The lesson should have been that algorithms don’t magically erase bias, but they learn from our past and then scale those mistakes with ruthless efficiency. Yet, seven years later, AI hiring tools are even more widespread (thanks to Gen AI), embedded in resume screening, video interviews, chatbots, and even “cultural fit” assessments. The illusion of objectivity still impacts leaders with a false sense of security.

Bias today isn’t just a recruiter glancing too quickly at a name or a manager relying on a gut feeling. It’s mathematical, invisible, and systemic, hidden inside algorithms your HR team may not fully understand but rely on every single day.

Table of Contents

  1. The Promise and Peril of AI in Hiring

  2. Hidden Sources of Bias

  3. When AI Amplifies Discrimination

  4. Measuring and Mitigating Bias

  5. Legal and Ethical Frameworks

  6. Bonus: AI Bias Audit Super Prompt

The Promise and Peril of AI in Hiring

Keep reading with a 7-day free trial

Subscribe to Intelligence Economy to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2026 Sameer Khan · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture