Obviously the more transparency we have as auditors, the more we can get, but the main goal is to understand important characteristics about a black box algorithm without necessarily having to understand every single granular detail of the algorithm. — Cathy O'Neil Copy Share Image
With recidivism algorithms, for example, I worry about racist outcomes. With personality tests [for hiring], I worry about filtering out people with mental health… — Cathy O'Neil Copy Share
“They draw statistical correlations between a person’s zip code or language patterns and her potential to pay back a loan or handle a job.… — Cathy O'Neil Copy Share
I don't think anybody's ever notified that they were sentenced to an extra two years because their recidivism score had been high, or notified… — Cathy O'Neil Copy Share
The national conversation around white entitlement, around institutionalized racism, the Black Lives Matter movement, I think, came about in large part because of the… — Cathy O'Neil Copy Share
“model’s blind spots reflect the judgments and priorities of its creators. While the choices in Google Maps and avionics software appear cut and dried,… — Cathy O'Neil Copy Share
I would argue that one of the major problems with our blind trust in algorithms is that we can propagate discriminatory patterns without acknowledging… — Cathy O'Neil Copy Share
We've learned our lesson with finance because they made a huge goddamn explosion that almost shut down the world. But the thing I realized… — Cathy O'Neil Copy Share
“Employers, for example, are increasingly using credit scores to evaluate potential hires. Those who pay their bills promptly, the thinking goes, are more likely… — Cathy O'Neil Copy Share
It's a standard thing you hear from startup people - that their product is somehow improving the world. And if you follow the reasoning,… — Cathy O'Neil Copy Share
The NSA buys data from private companies, so the private companies are the source of all this stuff. — Cathy O'Neil Copy Share
“The algorithms would make sure that those deemed losers would remain that way. A lucky minority would gain ever more control over the data… — Cathy O'Neil Copy Share
“As we’ve seen, they (the companies) routinely reject applicants on the basis of credit scores and personality tests. Health scores represent a natural—and frightening—next… — Cathy O'Neil Copy Share
We don't let a car company just throw out a car and start driving it around without checking that the wheels are fastened on.… — Cathy O'Neil Copy Share
