Complaining Quote by Cathy O'Neil
“When people are not given an option by some secret scoring system, it's very hard to complain, so they often don't even know that they've been victimized.”
About This Quote
Source Book: Weapons of Math Destruction by Cathy O'Neil, 2016
When opaque algorithms decide outcomes, people often cannot see or challenge the bias, leaving them unaware of being harmed.
In simple terms: Hidden scoring hides unfairness.
Key Takeaway
Question transparency in decision‑making.
Themes
fairness
technology
power
accountability
bias
Mood
concerned
critical
hopeful
Type
analytical
advocacy
When to use this quote
- public policy
- employment decisions
- credit scoring
- healthcare triage
- education admissions
Key Concepts
algorithmic governance
social justice
information asymmetry
Questions to Reflect On
- How can we ensure people understand algorithmic impacts?
- What safeguards protect against hidden bias?
A Different Perspective
Even with transparency, complex models may still be hard to interpret.
![“With recidivism algorithms, for example, I worry about racist outcomes. With personality tests [for hiring], I worry about filtering out people with mental health problems from jobs. And with a teacher value-added model algorithm [used in New York City to score teachers], I worry literally that…” quote by Cathy O'Neil](https://sms4smile.com/quotes/img-quotes/7df/cathy-o-neil-11478_algorithms_with-recidivism-algorithms-for-example-i_18212.jpg)
