Computers Quote by Andrew Ng
“Want to train a machine translation system? Train it on a gazillion pairs of sentences of parallel corpora, and that creates a lot of breakthrough results. Increasingly, I'm seeing results on small data where you want to try to take in results even if you have 1,000 images.”
About This Quote
Source Talk: Machine Learning Conference, 2022
Training translation models on massive parallel data yields breakthroughs, yet even small datasets can produce valuable results with careful techniques.
In simple terms: Big data helps, but small data can work too.
Leverage both large and small data wisely.
Themes
Mood
Type
When to use this quote
- building MT systems
- research labs
- startup product development
Key Concepts
Questions to Reflect On
- How can you maximize performance with limited data?
- What trade‑offs exist between data size and quality?
Limited data may not capture rare language nuances.