Conceptual and Statistical Knowledge

 

Responsible assessment of what research? Beware of epistemic diversity!

Schönbrodt et al. (2022) and Gärtner et al. (2022) aim to outline in the target articles why and how research assessment could be improved in psychological science in accordance with DORA, resulting in a focus on abandoning the impact factor as an …

Rigorous Exploration in a Model-Centric Science via Epistemic Iteration

Urgent attention is needed to address generalizability problems in psychology. However, the current dominant paradigm centered on dichotomous results and rapid discoveries cannot provide the solution because of its theoretical inadequacies. We …

Type I Error Rates are Not Usually Inflated

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high …

Approaching psychology’s current crises by exploring the vagueness of psychological concepts: Recommendations for advancing the discipline.

Psychology is currently facing a multilayered crisis stemming from the fact that the results of many psychological studies cannot be replicated (replication crisis), that psychological research has neglected cross-cultural and cross-temporal …

Conflicting Results and Statistical Malleability: Embracing Pluralism of Empirical Results

Conflicting results undermine making inferences from the empirical literature. So far, the replication crisis is mainly seen as resulting from honest errors and questionable research practices such as p-hacking or the base-rate fallacy. I discuss the …

Heterogeneity in effect size estimates

A typical empirical study involves choosing a sample, a research design, and an analysis path. Variation in such choices across studies leads to heterogeneity in results that introduce an additional layer of uncertainty, limiting the generalizability …

Open Science Training Handbook

Github Repository for the Open Science Training Handbook

Research assessment using a narrow definition of “research quality” is an act of gatekeeping: A comment on Gärtner et al. (2022)

Gärtner et al. (2022) propose a system for quantitatively scoring the methodological rigour of papers during the hiring and promotion of psychology researchers, with the aim of advantaging researchers who conduct open, reproducible work. However, the …

Science of psychological phenomena and their testing.

There is no crisis of replication and generalizability in psychological science, only misunderstanding or forgetting the fundamental nature of psychological phenomena and resultant implications for empirical testing. Stability–variability is the …

The quantitative paradigm and the nature of the human mind. The replication crisis as an epistemological crisis of quantitative psychology in view of the ontic nature of the psyche

Many suggestions for dealing with the so-called replication crisis in psychology revolve around the idea that better and more complex statistical-mathematical tools or stricter procedures are required in order to obtain reliable findings and prevent …
JUST-OS