Metascience

 

The logical structure of experiments lays the foundation for a theory of reproducibility

The scientific reform movement has proposed openness as a potential remedy to the putative reproducibility or replication crisis. However, the conceptual relationship among openness, replication experiments and results reproducibility has been …

Can a Good Theory Be Built Using Bad Ingredients?

The replication crisis threatens to seriously impact theory development in the cognitive, behavioral, and social sciences. We canvas three desiderata of scientific theories (explanation, prediction, and unification) and argue that the extent to which …

How to Produce, Identify, and Motivate Robust Psychological Science: A Roadmap and a Response to Vize et al.

Some wish to mandate preregistration as a response to the replication crisis, while I and others caution that such mandates inadvertently cause harm and distract from more critical reforms. In this article, after briefly critiquing a recently …

What Makes a Good Theory, and How Do We Make a Theory Good?

I present an ontology of criteria for evaluating theory to answer the titular question from the perspective of a scientist practitioner. Set inside a formal account of our adjudication over theories, a metatheoretical calculus, this ontology …

Guidelines to improve internationalization in the psychological sciences

Conversations about the internationalization of psychological sciences have occurred over a few decades with very little progress. Previous work shows up to 95% of participants in the studies published in mainstream journals are from Western, …

Revisiting the replication crisis without false positives

Efforts to replicate portions of the scientific literature have lead to widely varying and often low rates of replicability. This has raised concerns over a ``replication crisis'' whereby many of the statistically significant claims in the published …

Will Funders Have The Patience to Reform Science?

Discussions about metascience are frequently not about science, but about money. From reforming grantmaking regimes to new frameworks for evaluating the impact of funding, much of the science reform agenda focuses on how to allocate dollars to good …

Questionable Metascience Practices

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned …

Reflections on the Unintended Consequences of the Science Reform Movement

The scientific community has entered a challenging era, as originally noted by Wagenmakers . High-profile instances of fraud, failures to replicate foundational studies in psychology, and admissions of research misconduct cast a shadow over the …

Reputation Without Practice? A Dynamic Computational Model of the Unintended Consequences of Open Scientist Reputations

Practicing open science can have benefits for the career prospects of individual researchers or labs through higher quality work and increased chances of publication. However, being an outspoken advocate of open science might also indirectly benefit …
JUST-OS