Reproducible Analyses

 

Introduction to Open Science principles and practices (in Health Economics)

This series of lecture slides were used during the "Advanced Simulation for Health Economic Analysis" course at the University of Twente, which took place in February - May 2023. The following Open Science topics were introduced to the course …

Investigating Variation in Replicability: A “Many Labs” Replication Project

Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In …

Is the replicability crisis overblown? Three arguments examined

We discuss three arguments voiced by scientists who view the current outpouring of concern about replicability as overblown. The first idea is that the adoption of a low alpha level (e.g., 5%) puts reasonable bounds on the rate at which errors can …

Is there a credibility crisis in strategic management research? Evidence on the reproducibility of study findings

Recent studies report an inability to replicate previously published research, leading some to suggest that scientific knowledge is facing a credibility crisis. In this essay, we provide evidence on whether strategic management research may itself be …

JPA Promotes Open Science

The scientific endeavor is one in which the capacity to replicatefindings is a foundational tenant. It is unfortunate that therehave been a number of highly publicized cases over the pastdecade of scientists who have not practiced science with …

Just Post It: The Lesson From Two Cases of Fabricated Data Detected by Statistics Alone

I argue that requiring authors to post the raw data supporting their published results has the benefit, among many others, of making fraud much less likely to go undetected. I illustrate this point by describing two cases of suspected fraud I …

Last Contact: A Science Adventure

Last Contact is a game is a game that is intended to inform people about the open science movement. In the game players encounter common problems of current scientific practice in form of a parody science fiction scenario. The problems that players …

Let’s Put Our Money Where Our Mouth Is: If Authors Are to Change Their Ways, Reviewers (and Editors) Must Change With Them

A number of scholars recently have argued for fundamental changes in the way psychological scientists conduct and report research. The behavior of researchers is influenced partially by incentive structures built into the manuscript evaluation …

Making Research Data Publicly Accessible: Estimates of Institutional & Researcher Expenses

Academic institutions have made significant investments to support public access to research data requirements, yet little to no data about these services, infrastructure, and costs currently exist or are widely shared. For public access to research …

Maximizing Data Transparency with Rigor Icons

Scientific meetings are an important venue for disseminating findings, but space and time for experimental design details is often limited. Thus, to facilitate increased transparency in scientific presentations, rigor icons can quickly and easily …