Ridge Regression¶
Hoerl, A. E., & Kennard, R. W. (1970). Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics, 12(1), 55-67.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Regularization
- The under-determined solution space arises when fitting a linear model with many correlated predictors: ordinary least squares minimizes the residual sum of squares \(\|y - X\beta\|^2\), but when \(X\) has near-collinear columns the problem is ill-conditioned and many coefficient vectors \(\beta\) fit the data nearly equally well, including wild high-variance solutions that chase noise.
This sourceIntroduces ridge regression: an L2 penalty on the coefficient vector to stabilize estimates under near-collinearity.
- The under-determined solution space arises when fitting a linear model with many correlated predictors: ordinary least squares minimizes the residual sum of squares \(\|y - X\beta\|^2\), but when \(X\) has near-collinear columns the problem is ill-conditioned and many coefficient vectors \(\beta\) fit the data nearly equally well, including wild high-variance solutions that chase noise.
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:69519c9a3d5a · see in the full table