Reproducibility and Replicability Knowledge

 

False-Positive Citations

We describe why we wrote “False-Positive Psychology,” analyze how it has been cited, and explain why the integrity of experimental psychology hinges on the full disclosure of methods, the sharing of materials and data, and, especially, the …

Falsifiability Is Not Optional

Finkel, Eastwick, and Reis (2016; FER2016) argued the post-2011 methodological reform movement has focused narrowly on replicability, neglecting other essential goals of research. We agree multiple scientific goals are essential, but argue, however, …

Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study in deficiencies in modal research practice.

In this methodological commentary, we use Bem’s (2011) recent article reporting experimental evidence for psi as a case study for discussing important deficiencies in modal research practice in empirical psychology. We focus on (a) overemphasis on …

Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration

Social scientists generally enjoy substantial latitude in selecting measures and models for hypothesis testing. Coupled with publication and related biases, this latitude raises the concern that researchers may intentionally or unintentionally select …

Forcing a Deterministic Frame on Probabilistic Phenomena: A Communication Blind Spot in Media Coverage of the “Replication Crisis''

The current controversy surrounding research replication in biomedical and psychosocial sciences often overlooks the uncertainties surrounding both the original and replication studies. Overemphasizing single attempts as definitive replication …

Getting ontologically serious about the replication crisis in psychology.

Discussions of the so-called replication crisis (RC) in psychology have focused on methodological–epistemological considerations. In this article, I follow a speculative approach within analytic philosophy to focus on ontological considerations, as …

HARKing: How Badly Can Cherry-Picking and Question Trolling Produce Bias in Published Results?

The practice of hypothesizing after results are known (HARKing) has been identified as a potential threat to the credibility of research results. We conducted simulations using input values based on comprehensive meta-analyses and reviews in applied …

How scientists can stop fooling themselves

Sampling simulated data can reveal common ways in which our cognitive biases mislead us.

Identifying Participants in the Personal Genome Project by Name

We linked names and contact information to publicly available profiles in the Personal Genome Project. These profiles contain medical and genomic information, including details about medications, procedures and diseases, and demographic information, …

Improving (Our) Science: Reproducibility, Reporting, and Openness

The goal of the course is to become a better scientist. You will learn about newest standards for scientific openness, and how they influence the reporting and interpretation of empirical evidence. One component of the course is an intervention to …
JUST-OS