Reproducibility Crisis and Credibility Revolution

Analytic Review as a Solution to the Misreporting of Statistical Results in Psychological Science

In this article, we propose analytic review (AR) as a solution to the problem of misreporting statistical results in psychological science. AR requires authors submitting manuscripts for publication to also submit the data file and syntax used during …

Are We Wasting a Good Crisis? The Availability of Psychological Research Data after the Storm

To study the availability of psychological research data, we requested data from 394 papers, published in all issues of four APA journals in 2012. We found that 38% of the researchers sent their data immediately or after reminders. These findings are …

Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency

Beginning January 2014, Psychological Science gave authors the opportunity to signal open data and materials if they qualified for badges that accompanied published articles. Before badges, less than 3% of Psychological Science articles reported open …

Benefits of Open and High-Powered Research Outweigh Costs

Several researchers recently outlined unacknowledged costs of open science practices, arguing these costs may outweigh benefits and stifle discovery of novel findings. We scrutinize these researchers’ (a) statistical concern that heightened …

Best practices in data analysis and sharing in neuroimaging using MRI

Given concerns about the reproducibility of scientific findings, neuroimaging must define best practices for data analysis, results reporting, and algorithm and data sharing to promote transparency, reliability and collaboration. We describe insights …

Best research practices in psychology: Illustrating epistemological and pragmatic considerations with the case of relationship science.

In recent years, a robust movement has emerged within psychology to increase the evidentiary value of our science. This movement, which has analogs throughout the empirical sciences, is broad and diverse, but its primary emphasis has been on the …

Bite-Size Science and Its Undesired Side Effects

Short and rapid publication of research findings has many advantages. However, there is another side of the coin that needs careful consideration. We argue that the most dangerous aspect of a shift toward “bite-size” publishing is the relationship …

Boas práticas em ciência

Reprodutibilidade e replicabilidade de estudos científicos. Randomização, cegamento, planejamento amostral e pré-registro de projeto. Diferença entre estudos exploratórios e confirmatórios, P hacking, HARKing e double dipping. Práticas de …

Campbell Open and Reproducible Science Syllabus

The purpose of this course is to acquaint students with recent developments in open science and reproducibility of the research workflow. By the end of this course students will be familiar with documenting their research workflow (e.g., idea …

Capstone: Advanced General

How do psychologists determine what is true and what is false about human behavior, affect, and cognition? The question encompasses more than we can know from a single study or even a single research paper, and the issues run deeper than just …