Bayesian Parameter Estimation
Definition: A Bayesian approach to estimating parameter values by updating a prior belief about model parameters (i.e., prior distribution) with new evidence (i.e., observed data) via a likelihood function, resulting in a posterior distribution. The posterior distribution may be summarised in a number of ways including: point estimates (mean/mode/median of a posterior probability distribution), intervals of defined boundaries, and intervals of defined mass (typically referred to as a credible interval). In turn, a posterior distribution may become a prior distribution in a subsequent estimation. A posterior distribution can also be sampled using Monte-Carlo Markov Chain methods which can be used to determine complex model uncertainties (e.g. Foreman-Mackey et al., 2013).
Related terms: Bayes Factor, Bayesian inference, Bayesian statistics, Null Hypothesis Significance Testing (NHST)
References:
- Foreman-Mackey, D., Hogg, D. W., Lang, D., & Goodman, J. (2013). emcee: The MCMC Hammer. Publications of the Astronomical Society of the Pacific, 125(925), 306â312. https://doi.org/10.1086/670067
- McElreath, R. (2020). Statistical rethinking: A Bayesian course with examples in R and Stan (2nd ed.). Taylor.
- Press, W. (2007). Numerical recipes: the art of scientific computing, 3rd edition.
- Huber, C. (2016). Introduction to Bayesian statistics, part 2: MCMC and the MetropolisâHastings algorithm. In The Stata Blog. https://blog.stata.com/2016/11/15/introduction-to-bayesian-statistics-part-2-mcmc-and-the-metropolis-hastings-algorithm/
Originally drafted by: Alaa AlDoh
Reviewed by: Mahmoud Elsherif, Helena Hartmann, Dominik Kiersz, Meng Liu, Ana Todorovic, Markus Weinmann