Algorithms Quote by Cathy O'Neil

“With recidivism algorithms, for example, I worry about racist outcomes. With personality tests [for hiring], I worry about filtering out people with mental health problems from jobs. And with a teacher value-added model algorithm [used in New York City to score teachers], I worry literally that…” quote by Cathy O'Neil — Download Open image

“With recidivism algorithms, for example, I worry about racist outcomes. With personality tests [for hiring], I worry about filtering out people with mental health problems from jobs. And with a teacher value-added model algorithm [used in New York City to score teachers], I worry literally that it's not meaningful. That it's almost a random number generator.”

Cathy O'Neil

About This Quote

The speaker highlights how algorithmic tools in criminal justice, hiring, and education can produce biased, harmful, or meaningless outcomes, especially when they overlook systemic issues or individual well‑being.

In simple terms: Algorithms can reinforce bias and miss nuance.

Key Takeaway

Beware of unexamined algorithmic impact.

Themes

bias fairness algorithmic accountability social justice data ethics

Mood

concern critical skeptical

Type

critical analysis social commentary policy warning

When to use this quote

criminal sentencing decisions
recruitment screening
teacher performance reviews
policy design for AI oversight

Key Concepts

recidivism risk scoring personality testing teacher evaluation metrics

Practical Applications

audit algorithmic fairness
design transparent evaluation frameworks

Questions to Reflect On

How can we ensure algorithms reflect ethical standards?
What safeguards are needed to prevent harmful filtering?

A Different Perspective

Some argue that algorithmic tools, when properly calibrated, can improve consistency and reduce human prejudice, though this assumes flawless data and implementation.

★ ★ ★ ★ ★ 3.0 out of 5 (9 ratings)

Algorithms Cities Example Example Worry Generator Health Health problem Health problems Hiring Jobs Meaningful Meaningful Random Mental health Models New york New york city Numbers Outcomes People Personality Problem Racist Recidivism Recidivism Algorithms Score Teacher Tests Used Values Worry Worry Filtering Worry Racist York City

More by Cathy O'Neil

“They draw statistical correlations between a person’s zip code or language patterns and her potential to pay back a loan or handle a job.…

Cathy O'Neil

Image

I don't think anybody's ever notified that they were sentenced to an extra two years because their recidivism score had been high, or notified…

Cathy O'Neil

Image

The national conversation around white entitlement, around institutionalized racism, the Black Lives Matter movement, I think, came about in large part because of the…

Cathy O'Neil

Image

“model’s blind spots reflect the judgments and priorities of its creators. While the choices in Google Maps and avionics software appear cut and dried,…

Cathy O'Neil

Image

I would argue that one of the major problems with our blind trust in algorithms is that we can propagate discriminatory patterns without acknowledging…

Cathy O'Neil

Image

We've learned our lesson with finance because they made a huge goddamn explosion that almost shut down the world. But the thing I realized…

Cathy O'Neil

Image

“Employers, for example, are increasingly using credit scores to evaluate potential hires. Those who pay their bills promptly, the thinking goes, are more likely…

Cathy O'Neil

Image

Google is so big you have no idea what a given person does.

Cathy O'Neil

Image

It's a standard thing you hear from startup people - that their product is somehow improving the world. And if you follow the reasoning,…

Cathy O'Neil

Image

The NSA buys data from private companies, so the private companies are the source of all this stuff.

Cathy O'Neil

Image

“The algorithms would make sure that those deemed losers would remain that way. A lucky minority would gain ever more control over the data…

Cathy O'Neil

Image

“As we’ve seen, they (the companies) routinely reject applicants on the basis of credit scores and personality tests. Health scores represent a natural—and frightening—next…

Cathy O'Neil

Image

Explore all 59 Cathy O'Neil quotes

More Algorithms quotes

“He considers it for a moment and spits out the seeds, which sprout, quickly, into tiny junkblossoms sizzling with recursive algorithms. The algorithms wriggle…

Catherynne M. Valente

Image

“no matter how much tech companies talk about algorithms like they’re nothing but advanced math, they always reflect the values of their creators:”

Sara Wachter-Boettcher

Image

Google has - at least at this point - maintained the line where it keeps organic results separate from the advertisements. But over time…

Tim Wu

Image

The classes of problems which are respectively known and not known to have good algorithms are of great theoretical interest. [...] I conjecture that…

Jack Edmonds

Image

No one knows what the right algorithm is, but it gives us hope that if we can discover some crude approximation of whatever this…

Andrew Ng

Image

“Data Scientists should recall innovation often times is not providing fancy algorithms, but rather value to the customer.”

Damian Mingle

Image

I don't think anybody's ever notified that they were sentenced to an extra two years because their recidivism score had been high, or notified…

Cathy O'Neil

Image

Object-oriented programming aficionados think that everything is an object… this [isn't] so. There are things that are objects. Things that have state and change…

Alexander Stepanov