edgepedia

Stochastic processes

190 articles

Gaussian Markov process

A Gaussian Markov process is a stochastic process that is both Gaussian and Markov, so its future depends only on its present value; examples include Brownian motion and the Ornstein–Uhlenbeck process.

Gaussian measure

A Gaussian measure is a probability measure on an infinite-dimensional space, such as a Banach or Hilbert space, where every continuous linear functional is a Gaussian random variable.

Gaussian process

A Gaussian process, also called a Gaussian stochastic process, is a stochastic process where every finite subset of variables has a joint multivariate Gaussian distribution.

Gaussian simulation

Gaussian simulation is a computational method that generates samples from Gaussian distributions, multivariate normal vectors, and Gaussian process realizations, typically by transforming independent standard normal draws to match a required mean and covariance.

Generalized renewal process

The generalized renewal process (GRP), or g-renewal process, is a stochastic model for repairable systems where repairs restore an intermediate state via a virtual age function.

Geometric Brownian motion

Geometric Brownian motion, also known as exponential Brownian motion, is a continuous-time stochastic process, always positive, that serves as the standard model for asset prices and underlies the Black–Scholes option pricing model.

Gibbs random field

A Gibbs random field is a random field whose probability is proportional to the exponential of a negative energy built from clique potentials, originating in statistical mechanics.

Gillespie algorithm

The Gillespie algorithm, also called the stochastic simulation algorithm, is a Monte Carlo method proposed by Daniel T. Gillespie in 1976 for simulating chemical reactions exactly.

Girsanov theorem

The Girsanov theorem, also called the Cameron–Martin–Girsanov theorem, is a stochastic analysis result stating Brownian motion with drift becomes driftless under an equivalent probability measure.

Hard-core point process

A hard-core point process is a spatial stochastic model where no two points lie closer than a fixed minimum distance, modeling repulsive patterns like cells and trees.

Hawkes process

The Hawkes process is a self-exciting point process introduced by Alan G. Hawkes in 1971, in which each event temporarily raises the probability of further arrivals.

Heston model

The Heston model is a stochastic volatility model in mathematical finance in which an asset's variance is itself random and mean-reverting, introduced by Steven Heston in 1993.

Hidden Markov model

A hidden Markov model (HMM), also called a hidden Markov chain, is a statistical model for sequential data where hidden states follow a Markov chain and each emits observations.

Hidden semi-Markov model

A hidden semi-Markov model (HSMM), also called an explicit duration HMM, is a statistical model extending the hidden Markov model by letting hidden states persist for explicitly modeled random durations.

Hille–Yosida theorem

The Hille–Yosida theorem, proved independently by Einar Hille and Kôsaku Yosida in the late 1940s, characterizes which linear operators generate strongly continuous one-parameter semigroups on a Banach space.

Hitting time

In mathematics and physics, a hitting time, or first-passage time, is the first time a stochastic process reaches a specified state or crosses a threshold.

Infinitesimal generator (stochastic processes)

The infinitesimal generator of a Markov process is the linear operator giving the instantaneous rate of change of expected values, and it determines the process via the Hille–Yosida theorem.

Innovation process

The innovation process is the sequence of one-step-ahead prediction errors of a stochastic process, forming the basis of linear time series models, the Kalman filter's correction, and model-fit diagnostics.

Innovations process

The innovations process is the part of a noisy observation record carrying new information about an unobserved signal, the basis of the innovations approach to filtering.

Invariant measure

An invariant measure, also called a stationary measure, is a measure left unchanged by a transformation, flow, or Markov kernel, central to ergodic theory and Markov chains.

Itô calculus

Itô calculus, also called Ito stochastic calculus, is the branch of mathematics defining integration with respect to random processes like Brownian motion, created by Kiyosi Itô in 1942.

Itô's lemma

Itô's lemma, also called Itô's formula, is the chain rule of stochastic calculus, proved by Kiyosi Itô and central to the Black–Scholes option pricing framework.

Jump diffusion

Jump diffusion is a class of stochastic process, also called jump-diffusion models, that combines smooth diffusion with sudden jumps, best known through Merton's 1976 option pricing model.

Kalman filter

The Kalman filter is a recursive algorithm that estimates a system's hidden state by combining a motion model with noisy measurements, introduced by Rudolf E. Kalman in 1960.

Kolmogorov equations

The Kolmogorov equations are the forward and backward differential equations, introduced by Andrei Kolmogorov in 1931, that describe how the transition probabilities of a Markov process change over time.

Kosambi–Karhunen–Loève theorem

The Kosambi–Karhunen–Loève theorem, or Karhunen–Loève theorem, represents a square-integrable stochastic process as orthogonal functions weighted by uncorrelated coefficients; developed in the 1940s, its discrete form is equivalent to principal component analysis.

Law of the iterated logarithm

The law of the iterated logarithm (LIL) is a probability theorem giving the exact envelope, of order sqrt(2n log log n), that random-walk fluctuations touch infinitely often, first proved by Khinchin in 1924.

Leimkuhler–Matthews method

The Leimkuhler–Matthews method is a numerical integrator for overdamped Langevin dynamics that modifies Euler–Maruyama by averaging consecutive Gaussian noise increments, giving second-order accuracy for invariant averages.

Lévy flight

A Lévy flight is a random walk whose step lengths follow a heavy-tailed power-law distribution, named for Paul Lévy; the rare long jumps make the motion superdiffusive.

Lévy measure

A Lévy measure assigns to each set of jump sizes the expected number of jumps per unit time in a Lévy process, allowing infinitely many small jumps.