““I suspect that if we can build such ultra-intelligent machines, then the first one will be severely limited by the software we’ve written for it, and that we’ll have compensated for our lack of understanding about how to optimally program intelligence by building hardware with significantly more computing power than our brains have. After all, our neurons are no better or more numerous than those of dolphins, just differently connected, suggesting that software can sometimes be more important than hardware.””
