Conceptual and Statistical Knowledge

 

Null hypothesis significance testing: a review of an old and continuing controversy

Null hypothesis significance testing (NHST) is arguably the most widely used approach to hypothesis evaluation among behavioral and social scientists. It is also very controversial. A major concern expressed by critics is that such testing is …

On the origins of the .05 level of statistical significance

Examination of the literature in statistics and probability that predates Fisher's Statistical Methods for Research Workers indicates that although Fisher is responsible for the first formal statement of the .05 criterion for statistical …

On the plurality of (methodological) worlds: estimating the analytic flexibility of fMRI experiments

How likely are published findings in the functional neuroimaging literature to be false? According to a recent mathematical model, the potential for false positives increases with the flexibility of analysis methods. Functional MRI (fMRI) experiments …

On the Use and Misuses of Preregistration: A Reply to Klonsky (2024)

In his commentary, Klonsky (2024) outlines several arguments for why preregistration mandates (PRMs) will have a negative impact on the field. Klonsky’s overarching concern is that when preregistration ceases to be a tool for research and becomes an …

Open Science and Methodological Improvements

In recent years, meta-research methods issues (e.g., reproducibility, open science, etc.) have yielded provocative findings, vigorous discussions, and novel innovations. This course will engage with these issues in ways that are primarily practical, …

Open Science Workshop Materials of the LMU Open Science Center

Open Science workshop materials created at LMU Munich, available for everyone under a CC-BY license. Look in the README folder for more information.

Open Science: What, Why, and How

Open Science is a collection of actions designed to make scientific processes more transparent and results more accessible. Its goal is to build a more replicable and robust science; it does so using new technologies, altering incentives, and …

Optimizing Research Payoff

In this article, we present a model for determining how total research payoff depends on researchers’ choices of sample sizes, α levels, and other parameters of the research process. The model can be used to quantify various tradeoffs inherent in the …

P-curve: A key to the file-drawer.

Because scientists tend to report only studies (publication bias) or analyses (p-hacking) that “work,” readers must ask, “Are these effects true, or do they merely reflect selective reporting?” We introduce p-curve as a way to answer this question. …

PewTranslate Census Language Lookup

A free, account-free browser lookup of U.S. Census Bureau ACS 2020-2024 table C16001 home-language and English-ability estimates for ZIP Code Tabulation Areas and counties in the United States and Puerto Rico. The page displays speaker estimates and …
JUST-OS