edgepedia

Linear and multiple regression

11 articles

General

Cross-sectional regression

Cross-sectional regression estimates relationships between variables measured across different units, such as firms, households, or stocks, at a single point in time, unlike time-series regression.

General

Errors-in-variables models

Errors-in-variables models are regression models that account for measurement error in predictor variables, correcting the biased, attenuated estimates ordinary least squares produces when covariates are observed with noise.

General

Feasible generalized least squares

Feasible generalized least squares (FGLS) is a two-step regression estimator that first estimates the error covariance matrix from least squares residuals, then applies generalized least squares.

General

Linear model

A linear model is a statistical model that expresses a response variable as a linear combination of predictors with unknown coefficients, written Y = Xβ + ε and fitted by least squares.

General

Non-negative least squares

Non-negative least squares (NNLS) is a constrained regression method fitting a linear least squares model with every coefficient zero or positive, used in deconvolution and unmixing.

General

Polynomial transformation (statistics)

A polynomial transformation adds powers and cross-products of existing predictors as new features, so a linear regression model can represent curved relationships while remaining linear in its coefficients.

General

Quadratic regression

Quadratic regression is a statistical method that fits a second-degree polynomial curve to data, estimating U-shaped or inverted-U relationships between one predictor and an outcome.

General

Regression calibration

Regression calibration is a statistical method for correcting bias from measurement error in a covariate, replacing it with its conditional expectation given the observed data before running the usual regression analysis.

General

Segmented regression

Segmented regression is a statistical method that fits piecewise linear relationships between a predictor and an outcome, estimating breakpoint locations and slopes, widely used in interrupted time series analysis.

General

Total least squares

Total least squares is an estimation method for fitting a model when every variable is subject to error, minimizing the smallest correction to both the data matrix and observations.

General

Weighted regression (statistics)

Weighted regression, most commonly weighted least squares (WLS), fits a regression model by giving each observation its own weight, so that more precise observations count more.