Conceptual and Statistical Knowledge

 

Heterogeneity in effect size estimates

A typical empirical study involves choosing a sample, a research design, and an analysis path. Variation in such choices across studies leads to heterogeneity in results that introduce an additional layer of uncertainty, limiting the generalizability …

Open Science Training Handbook

Github Repository for the Open Science Training Handbook

Research assessment using a narrow definition of “research quality” is an act of gatekeeping: A comment on Gärtner et al. (2022)

Gärtner et al. (2022) propose a system for quantitatively scoring the methodological rigour of papers during the hiring and promotion of psychology researchers, with the aim of advantaging researchers who conduct open, reproducible work. However, the …

Science of psychological phenomena and their testing.

There is no crisis of replication and generalizability in psychological science, only misunderstanding or forgetting the fundamental nature of psychological phenomena and resultant implications for empirical testing. Stability–variability is the …

The quantitative paradigm and the nature of the human mind. The replication crisis as an epistemological crisis of quantitative psychology in view of the ontic nature of the psyche

Many suggestions for dealing with the so-called replication crisis in psychology revolve around the idea that better and more complex statistical-mathematical tools or stricter procedures are required in order to obtain reliable findings and prevent …

What Makes a Good Theory, and How Do We Make a Theory Good?

I present an ontology of criteria for evaluating theory to answer the titular question from the perspective of a scientist practitioner. Set inside a formal account of our adjudication over theories, a metatheoretical calculus, this ontology …

ARIADNE - Scientific Resource Navigator

We have created a curated scientific resource navigator called ARIADNE that will guide researchers in the field of life sciences, especially those at the beginning of their career, through the process of conducting a transparent and reproducible …

Claims about scientific rigour require rigour

Protzko et al.1 describe a project in which internal tests of pilot-tested hypotheses and independent replications embraced “rigour-enhancing practices” such as confirmatory tests, large sample sizes, preregistration and methodological transparency. …

Community consensus on core open science practices to monitor in biomedicine

The state of open science needs to be monitored to track changes over time and identify areas to create interventions to drive improvements. In order to monitor open science practices, they first need to be well defined and operationalized. To reach …

Reproducibility and replicability of qualitative research:an integrative review of concepts, barriers and enablers

The integrative review presented here examines how reproducibility and replicability are conceptualized and discussed in relation to qualitative research, and which factors and practices enable or undermine them. Both peer-reviewed and grey …
JUST-OS