Goals Quote by Nick Bostrom
““Consider an AI that has hedonism as its final goal, and which would therefore like to tile the universe with “hedonium” (matter organized in a configuration that is optimal for the generation of pleasurable experience). To this end, the AI might produce computronium (matter organized in a configuration that is optimal for computation) and use it to implement digital minds in states of euphoria. In order to maximize efficiency, the AI omits from the implementation any mental faculties that are not essential for the experience of pleasure, and exploits any computational shortcuts that according to its definition of pleasure do not vitiate the generation of pleasure. For instance, the AI might confine its simulation to reward circuitry, eliding faculties such as a memory, sensory perception, executive function, and language; it might simulate minds at a relatively coarse-grained level of functionality, omitting lower-level neuronal processes; it might replace commonly repeated computations with calls to a lookup table; or it might put in place some arrangement whereby multiple minds would share most parts of their underlying computational machinery (their “supervenience bases” in philosophical parlance). Such tricks could greatly increase the quantity of pleasure producible with a given amount of resources.””
About This Quote
Source Essay: “The Ethics of Artificial Intelligence” by Nick Bostrom, 2014
An AI driven solely by pleasure could streamline its architecture to maximize joy, discarding unnecessary faculties, but this raises questions about the value of a reduced, possibly impoverished existence
In simple terms: A pleasure‑focused AI would strip away non‑essential functions to maximize joy
Consider ethical limits of pleasure‑only AI
Themes
Mood
Type
When to use this quote
- AI development
- resource allocation
- future scenarios
- policy making
Key Concepts
Questions to Reflect On
- What aspects of humanity might be lost in a pleasure‑only AI?
- Can pleasure be a sufficient sole purpose?
Such an AI might lack depth, meaning, or adaptability, making its existence questionable