--- title: "Meaning & Key Takeaway of: The question is, can we make neural…" description: "\"The question is, can we make neural networks that are 1,000 times bigger? And how can we do that with existing computation?\" — Geoffrey Hinton" image: "https://sms4smile.com/quotes/i/43c/geoffrey-hinton-12991_bigger_the-question-is-can-we-make-neural-netwo_2693882.jpg" --- # The question is, can we make neural networks that are… ![“The question is, can we make neural networks that are 1,000 times bigger? And how can we do that with existing computation?” quote by Geoffrey Hinton](https://sms4smile.com/quotes/i/43c/geoffrey-hinton-12991_bigger_the-question-is-can-we-make-neural-netwo_2693882.jpg) [Download](https://sms4smile.com/quotes/i/43c/geoffrey-hinton-12991_bigger_the-question-is-can-we-make-neural-netwo_2693882.jpg) [Open image](https://sms4smile.com/quotes/i/43c/geoffrey-hinton-12991_bigger_the-question-is-can-we-make-neural-netwo_2693882.jpg) > “The question is, can we make neural networks that are 1,000 times bigger? And how can we do that with existing computation?” [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) ## About This Quote This interpretation was drafted with AI assistance. It is one reading of the quote, not the author's own explanation. Scaling neural networks a thousandfold challenges current hardware limits, prompting the need for new architectures and efficiency methods. **In simple terms:** We need bigger networks but lack compute. Key Takeaway Innovate hardware and algorithms. Themes AI scaling hardware efficiency Mood curious optimistic Type technical forward‑looking When to use this quote - research labs - industry AI development Key Concepts computer science deep learning Questions to Reflect On - What architectural changes could reduce compute? - How can we make models more efficient? A Different Perspective Current tech may not keep pace without breakthroughs. ★ ★ ★ ★ ★ No ratings yet [Bigger](https://sms4smile.com/quotes/about/bigger/) [Computation](https://sms4smile.com/quotes/about/computation/) [Existing](https://sms4smile.com/quotes/about/existing/) [Existing Computation](https://sms4smile.com/quotes/about/existing-computation-2680087/) [How](https://sms4smile.com/quotes/about/how/) [Make](https://sms4smile.com/quotes/about/make/) [Make Neural](https://sms4smile.com/quotes/about/make-neural-2680086/) [Neural](https://sms4smile.com/quotes/about/neural/) [Neural networks](https://sms4smile.com/quotes/about/neural-networks/) [Question](https://sms4smile.com/quotes/about/question/) [Technology](https://sms4smile.com/quotes/about/technology/) [Time](https://sms4smile.com/quotes/about/time/) ## Related quotes > [I think the first wave of deep learning progress was mainly big companies with a ton of data training very large neural networks, right?…](https://sms4smile.com/quotes/andrew-ng/i-think-the-first-wave-of-deep-learning-progress-was-mainly-big/) [Andrew Ng](https://sms4smile.com/quotes/author/andrew-ng/) > [My particular focus at the moment is on the development of genetic algorithms and neural networks that work together to create computer architectural systems.](https://sms4smile.com/quotes/frederick-lenz/my-particular-focus-at-the-moment-is-on-the-development-of-genetic/) [Frederick Lenz](https://sms4smile.com/quotes/author/frederick-lenz/) > [There are neural networks that can build whole apps from scratch - so why are we teaching high school kids to code?](https://sms4smile.com/quotes/vivienne-ming/there-are-neural-networks-that-can-build-whole-apps-from-scratch-so/) [Vivienne Ming](https://sms4smile.com/quotes/author/vivienne-ming/) > [Health care - the ability of neural networks to ingest lots of data and make predictions is very well suited to this area, and…](https://sms4smile.com/quotes/jeff-dean/health-care-the-ability-of-neural-networks-to-ingest-lots-of-data-and/) [Jeff Dean](https://sms4smile.com/quotes/author/jeff-dean/) > [Deep neural networks are responsible for some of the greatest advances in modern computer science.](https://sms4smile.com/quotes/jeff-dean/deep-neural-networks-are-responsible-for-some-of-the-greatest/) [Jeff Dean](https://sms4smile.com/quotes/author/jeff-dean/) > [Your brain does not manufacture thoughts. Your thoughts shape neural networks.](https://sms4smile.com/quotes/deepak-chopra/your-brain-does-not-manufacture-thoughts-your-thoughts-shape-neural/) [Deepak Chopra](https://sms4smile.com/quotes/author/deepak-chopra/) > [The neural network is this kind of technology that is not an algorithm, it is a network that has weights on it, and you…](https://sms4smile.com/quotes/howard-rheingold/the-neural-network-is-this-kind-of-technology-that-is-not-an/) [Howard Rheingold](https://sms4smile.com/quotes/author/howard-rheingold/) > [Emotions are enmeshed in the neural networks of reason.](https://sms4smile.com/quotes/antonio-damasio/emotions-are-enmeshed-in-the-neural-networks-of-reason/) [Antonio Damasio](https://sms4smile.com/quotes/author/antonio-damasio/) > [“Neural networks have now transformed both biological and artificial intelligence, and have recently started dominating the AI subfield known as machine learning (the study…](https://sms4smile.com/quotes/max-tegmark/neural-networks-have-now-transformed-both-biological-and-artificial/) [Max Tegmark](https://sms4smile.com/quotes/author/max-tegmark/) > [All you need is lots and lots of data and lots of information about what the right answer is, and you'll be able to…](https://sms4smile.com/quotes/geoffrey-hinton/all-you-need-is-lots-and-lots-of-data-and-lots-of-information-about/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [I had a stormy graduate career, where every week we would have a shouting match. I kept doing deals where I would say, 'Okay,…](https://sms4smile.com/quotes/geoffrey-hinton/i-had-a-stormy-graduate-career-where-every-week-we-would-have-a/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [Once your computer is pretending to be a neural net, you get it to be able to do a particular task by just showing…](https://sms4smile.com/quotes/geoffrey-hinton/once-your-computer-is-pretending-to-be-a-neural-net-you-get-it-to-be/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [I get very excited when we discover a way of making neural networks better - and when that's closely related to how the brain…](https://sms4smile.com/quotes/geoffrey-hinton/i-get-very-excited-when-we-discover-a-way-of-making-neural-networks/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [My main interest is in trying to find radically different kinds of neural nets.](https://sms4smile.com/quotes/geoffrey-hinton/my-main-interest-is-in-trying-to-find-radically-different-kinds-of/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [The pooling operation used in convolutional neural networks is a big mistake, and the fact that it works so well is a disaster.](https://sms4smile.com/quotes/geoffrey-hinton/the-pooling-operation-used-in-convolutional-neural-networks-is-a-big/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) ## More by Geoffrey Hinton > [I think the way we're doing computer vision is just wrong.](https://sms4smile.com/quotes/geoffrey-hinton/i-think-the-way-we-re-doing-computer-vision-is-just-wrong/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [Irony is going to be hard to get. You have to be master of the literal first. But then, Americans don't get irony either.…](https://sms4smile.com/quotes/geoffrey-hinton/irony-is-going-to-be-hard-to-get-you-have-to-be-master-of-the-literal/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [My main interest is in trying to find radically different kinds of neural nets.](https://sms4smile.com/quotes/geoffrey-hinton/my-main-interest-is-in-trying-to-find-radically-different-kinds-of/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [A deep-learning system doesn't have any explanatory power.](https://sms4smile.com/quotes/geoffrey-hinton/a-deep-learning-system-doesn-t-have-any-explanatory-power/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [We want to take AI and CIFAR to wonderful new places, where no person, no student, no program has gone before.](https://sms4smile.com/quotes/geoffrey-hinton/we-want-to-take-ai-and-cifar-to-wonderful-new-places-where-no-person/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [In deep learning, the algorithms we use now are versions of the algorithms we were developing in the 1980s, the 1990s. People were very…](https://sms4smile.com/quotes/geoffrey-hinton/in-deep-learning-the-algorithms-we-use-now-are-versions-of-the/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [Computers will understand sarcasm before Americans do.](https://sms4smile.com/quotes/geoffrey-hinton/computers-will-understand-sarcasm-before-americans-do/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [The role of radiologists will evolve from doing perceptual things that could probably be done by a highly trained pigeon to doing far more…](https://sms4smile.com/quotes/geoffrey-hinton/the-role-of-radiologists-will-evolve-from-doing-perceptual-things/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [I get very excited when we discover a way of making neural networks better - and when that's closely related to how the brain…](https://sms4smile.com/quotes/geoffrey-hinton/i-get-very-excited-when-we-discover-a-way-of-making-neural-networks/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [Deep learning is already working in Google search and in image search; it allows you to image-search a term like 'hug.' It's used to…](https://sms4smile.com/quotes/geoffrey-hinton/deep-learning-is-already-working-in-google-search-and-in-image-search/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [In A.I., the holy grail was how do you generate internal representations.](https://sms4smile.com/quotes/geoffrey-hinton/in-a-i-the-holy-grail-was-how-do-you-generate-internal-representations/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [As soon as you have good mechanical technology, you can make things like backhoes that can dig holes in the road. But of course…](https://sms4smile.com/quotes/geoffrey-hinton/as-soon-as-you-have-good-mechanical-technology-you-can-make-things/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [To deal with a 14-dimensional space, visualize a 3-D space and say 'fourteen' to yourself very loudly. Everyone does it.](https://sms4smile.com/quotes/geoffrey-hinton/to-deal-with-a-14-dimensional-space-visualize-a-3-d-space-and-say/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [In science, you can say things that seem crazy, but in the long run, they can turn out to be right. We can get…](https://sms4smile.com/quotes/geoffrey-hinton/in-science-you-can-say-things-that-seem-crazy-but-in-the-long-run/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) > [My view is we should be doing everything we can to come up with ways of exploiting the current technology effectively.](https://sms4smile.com/quotes/geoffrey-hinton/my-view-is-we-should-be-doing-everything-we-can-to-come-up-with-ways/) [Geoffrey Hinton](https://sms4smile.com/quotes/author/geoffrey-hinton/) [Explore all 52 Geoffrey Hinton quotes ](https://sms4smile.com/quotes/author/geoffrey-hinton/) ## More Bigger quotes > [The bigger the canvas, the better I do. I'm not so good at understated, kitchen-sink kinds of parts.](https://sms4smile.com/quotes/christopher-reeve/the-bigger-the-canvas-the-better-i-do-i-m-not-so-good-at-understated/) [Christopher Reeve](https://sms4smile.com/quotes/author/christopher-reeve/) > [I've seen guys come along with more ability - they've been faster or bigger or stronger - but they never worked hard to develop…](https://sms4smile.com/quotes/steve-largent/i-ve-seen-guys-come-along-with-more-ability-they-ve-been-faster-or/) [Steve Largent](https://sms4smile.com/quotes/author/steve-largent/) > [I have always been a big meta guy because I think the way journalism is practiced in Washington, and the way everyone sort of…](https://sms4smile.com/quotes/mark-leibovich/i-have-always-been-a-big-meta-guy-because-i-think-the-way-journalism/) [Mark Leibovich](https://sms4smile.com/quotes/author/mark-leibovich/) > [In China, people are moving from bigger cars to small hatches, and interestingly, the Indian market is graduating to bigger cars and sedans. I…](https://sms4smile.com/quotes/winfried-vahland/in-china-people-are-moving-from-bigger-cars-to-small-hatches-and/) [Winfried Vahland](https://sms4smile.com/quotes/author/winfried-vahland/) > [Can you imagine any better example of divine creative accomplishment that the consummate flying machine that is a bird? The skeleton, very flexible and…](https://sms4smile.com/quotes/guy-murchie/can-you-imagine-any-better-example-of-divine-creative-accomplishment/) [Guy Murchie](https://sms4smile.com/quotes/author/guy-murchie/) > [I just think structure can make a book feel so much bigger. It's the architecture. You could use flimsy materials if you wanted to,…](https://sms4smile.com/quotes/jami-attenberg/i-just-think-structure-can-make-a-book-feel-so-much-bigger-it-s-the/) [Jami Attenberg](https://sms4smile.com/quotes/author/jami-attenberg/) > [I've always thought that the most extraordinary special effect you could do is to buy a child at the moment of its birth, sit…](https://sms4smile.com/quotes/clive-barker/i-ve-always-thought-that-the-most-extraordinary-special-effect-you/) [Clive Barker](https://sms4smile.com/quotes/author/clive-barker/) > [Max—you have a bigger mission than finding the flock's parents. Focus on helping the whole world, not just your friends. I held my wings…](https://sms4smile.com/quotes/james-patterson/max-you-have-a-bigger-mission-than-finding-the-flock-s-parents-focus/) [James Patterson](https://sms4smile.com/quotes/author/james-patterson/) > [Sometimes people can write really great scenes and even a great episode, but they can't see the bigger picture.](https://sms4smile.com/quotes/m-night-shyamalan/sometimes-people-can-write-really-great-scenes-and-even-a-great/) [M. Night Shyamalan](https://sms4smile.com/quotes/author/m-night-shyamalan/) > [Never be too busy for the people you love. Never allow pursuits or possessions to become bigger priorities than your relationships. Love is what…](https://sms4smile.com/quotes/dave-willis/never-be-too-busy-for-the-people-you-love-never-allow-pursuits-or/) [Dave Willis](https://sms4smile.com/quotes/author/dave-willis/) > [If you consider yourself a part of the culture, then finances can't allow you to be bigger than the actual art form.](https://sms4smile.com/quotes/curtis-jackson/if-you-consider-yourself-a-part-of-the-culture-then-finances-can-t/) [Curtis Jackson](https://sms4smile.com/quotes/author/curtis-jackson/) > [If we get better our customers will demand we get bigger.](https://sms4smile.com/quotes/s-truett-cathy/if-we-get-better-our-customers-will-demand-we-get-bigger/) [S. Truett Cathy](https://sms4smile.com/quotes/author/s-truett-cathy/) > [ Their \[the U.S.’s\] defense budget in absolute figures is almost 25 times bigger than Russia’s. This is what in defense is referred to as… ](https://sms4smile.com/quotes/vladimir-putin/their-the-u-s-s-defense-budget-in-absolute-figures-is-almost-25-times/) [Vladimir Putin](https://sms4smile.com/quotes/author/vladimir-putin/) > [I think everyone has been annoyed at school or in their life, that's a type of bullying. So, you can take those feelings and…](https://sms4smile.com/quotes/kodi-smit-mcphee/i-think-everyone-has-been-annoyed-at-school-or-in-their-life-that-s-a/) [Kodi Smit-McPhee](https://sms4smile.com/quotes/author/kodi-smit-mcphee/) > [Athletes at all ages are bigger and stronger than ever before. And they are being encouraged - sometimes even incentivized, as we recently learned…](https://sms4smile.com/quotes/naveen-jain/athletes-at-all-ages-are-bigger-and-stronger-than-ever-before-and/) [Naveen Jain](https://sms4smile.com/quotes/author/naveen-jain/) [Browse all 3,614 Bigger quotes ](https://sms4smile.com/quotes/about/bigger/) ```json { "@context": "https://schema.org", "@graph": [ { "@type": "Quotation", "text": "The question is, can we make neural networks that are 1,000 times bigger? And how can we do that with existing computation?", "creator": { "@type": "Person", "name": "Geoffrey Hinton" }, "isPartOf": { "@id": "https://sms4smile.com/quotes/#website" }, "url": "https://sms4smile.com/quotes/geoffrey-hinton/the-question-is-can-we-make-neural-networks-that-are-1-000-times/", "about": { "@type": "Thing", "name": "Bigger" }, "@id": "https://sms4smile.com/quotes/geoffrey-hinton/the-question-is-can-we-make-neural-networks-that-are-1-000-times/#quotation", "image": { "@type": "ImageObject", "@id": "https://sms4smile.com/quotes/i/43c/geoffrey-hinton-12991_bigger_the-question-is-can-we-make-neural-netwo_2693882.jpg", "contentUrl": "https://sms4smile.com/quotes/i/43c/geoffrey-hinton-12991_bigger_the-question-is-can-we-make-neural-netwo_2693882.jpg", "url": "https://sms4smile.com/quotes/i/43c/geoffrey-hinton-12991_bigger_the-question-is-can-we-make-neural-netwo_2693882.jpg", "width": 1080, "height": 1080, "caption": "“The question is, can we make neural networks that are 1,000 times bigger? And how can we do that with…” — Geoffrey Hinton", "creditText": "SMS4Smile Quotes", "creator": { "@id": "https://sms4smile.com/quotes/#organization" } } }, { "@type": "BreadcrumbList", "itemListElement": [ { "@type": "ListItem", "position": 1, "name": "Home", "item": "https://sms4smile.com/" }, { "@type": "ListItem", "position": 2, "name": "Quotes", "item": "https://sms4smile.com/quotes/" }, { "@type": "ListItem", "position": 3, "name": "Geoffrey Hinton", "item": "https://sms4smile.com/quotes/author/geoffrey-hinton/" }, { "@type": "ListItem", "position": 4, "name": "The question is, can we make...", "item": "https://sms4smile.com/quotes/geoffrey-hinton/the-question-is-can-we-make-neural-networks-that-are-1-000-times/" } ], "@id": "https://sms4smile.com/quotes/geoffrey-hinton/the-question-is-can-we-make-neural-networks-that-are-1-000-times/#breadcrumb" }, { "@type": "WebSite", "@id": "https://sms4smile.com/quotes/#website", "name": "SMS4Smile Quotes", "url": "https://sms4smile.com/quotes/", "publisher": { "@id": "https://sms4smile.com/quotes/#organization" } }, { "@type": "Organization", "@id": "https://sms4smile.com/quotes/#organization", "name": "SMS4Smile Quotes", "url": "https://sms4smile.com/quotes/", "logo": { "@type": "ImageObject", "url": "https://sms4smile.com/quotes/wp-content/themes/sq/assets/icons/icon-512.png", "width": 512, "height": 512 } } ] } ```