Education Quote by Cathy O'Neil
““model’s blind spots reflect the judgments and priorities of its creators. While the choices in Google Maps and avionics software appear cut and dried, others are far more problematic. The value-added model in Washington, D.C., schools, to return to that example, evaluates teachers largely on the basis of students’ test scores, while ignoring how much the teachers engage the students, work on specific skills, deal with classroom management, or help students with personal and family problems. It’s overly simple, sacrificing accuracy and insight for efficiency.””
About This Quote
Source Book: Weapons of Math Destruction by Cathy O'Neil, 2016
Models inherit biases from their designers, leading to oversimplified evaluations that ignore complex human factors.
In simple terms: Models reflect creator biases and miss important details.
Key Takeaway
Questionify models to include qualitative factors.
Themes
bias
evaluation
education
technology
policy
Mood
critical
concerned
Type
analytical
cautionary
When to use this quote
- teacher performance reviews
- student support services
- policy making
- software design
Key Concepts
algorithmic bias
fairness
assessment metrics
Questions to Reflect On
- How can qualitative data be integrated into assessments?
- What safeguards prevent bias in algorithmic decisions?
A Different Perspective
Quantitative metrics alone cannot capture nuanced human interactions.
![“With recidivism algorithms, for example, I worry about racist outcomes. With personality tests [for hiring], I worry about filtering out people with mental health problems from jobs. And with a teacher value-added model algorithm [used in New York City to score teachers], I worry literally that…” quote by Cathy O'Neil](https://sms4smile.com/quotes/img-quotes/7df/cathy-o-neil-11478_algorithms_with-recidivism-algorithms-for-example-i_18212.jpg)
