Nonlinear Quote by Leonard A. Smith
““Taking least squares is no longer optimal, and the very idea of ‘accuracy’ has to be rethought. This simple fact is as important as it is neglected. This problem is easily illustrated in the Logistic Map: given the correct mathematical formula and all the details of the noise model – random numbers with a bell-shaped distribution – using least squares to estimate α leads to systematic errors. This is not a question of too few data or insufficient computer power, it is the method that fails. We can compute the optimal least squares solution: its value for α is too small at all noise levels. This principled approach just does not apply to nonlinear models because the theorems behind the principle of least squares repeatedly assume bell-shaped distributions.””
About This Quote
Source Paper: Statistical Modeling Review, 2020
Least‑squares fails for non‑Gaussian noise; new methods needed for accurate modeling.
In simple terms: Old methods don’t work for all data.
Adopt robust statistical techniques.
Themes
Mood
Type
When to use this quote
- research
- engineering
- data analysis
Key Concepts
Questions to Reflect On
- When to replace least‑squares?
- What alternatives suit non‑Gaussian data?
Transition to new methods can be costly.