Conceptual and Statistical Knowledge

 

Toward a more credible assessment of the credibility of science by many-analyst studies

We discuss a relatively new meta-scientific research design: many-analyst studies that attempt to assess the replicability and credibility of research based on large-scale observational data. In these studies, a large number of analysts try to answer …

When is science (un)reliable?

In this course, we will explore the so‐called “reproducibility crisis” that has struck fields from psychology and economics to ecology and cancer biology. You will learn statistical principles at the heart of the reproducibility crisis, how disregard …

When power analyses based on pilot data are biased: Inaccurate effect size estimators and follow-up bias

When designing a study, the planned sample size is often based on power analyses. One way to choose an effect size for power analyses is by relying on pilot data. A-priori power analyses are only accurate when the effect size estimate is accurate. In …

Why most of psychology is statistically unfalsifiable

Low power in experimental psychology is an oft-discussed problem. We show in the context of the Replicability Project: Psychology (Open Science Collaboration, 2015) that sample sizes are so small in psychology that often one cannot detect even large …

With Low Power Comes Low Credibility? Toward a Principled Critique of Results From Underpowered Tests

Researchers should be motivated to adequately power statistical tests because tests with low power have a low probability of detecting true effects. However, it is also often claimed that significant results obtained by underpowered tests are less …

AI sanctions screening study: The OFAC List Said Yes. Google AI Said No.

A company-authored case study of source verification and outcome classification in sanctions-status research. A deliberately selected panel contained 64 companies removed from the OFAC SDN List and 32 listed controls. In 96 Google searches on 8 …

Sanctions list data: dates of birth, names and IDs

A company-authored worked example of measuring structured-field availability in two official sanctions XML snapshots retrieved on 30 September 2026. It separates absent birth dates from partial dates, aliases from primary-name variations, and …

Global Data Tracker: country-level sanitation data explorer

Free browser-based exploration of published country-level statistics on access to at least basic sanitation. The interface provides historical indicator views, source references, reporting years and CSV downloads linked to a dated release. It can …

ASCENT FOSS Resource List for Global South Researchers

A curated, open-access directory of Free and Open Source Software (FOSS) and research tools. Designed to support early-career researchers, particularly in the Global South, across the entire research lifecycle: data collection, …

A critique of using the labels confirmatory and exploratory in modern psychological research

Psychological science is experiencing a rise in the application of complex statistical models and, simultaneously, a renewed focus on applying research in a confirmatory manner. This presents a fundamental conflict for psychological researchers as …
JUST-OS