Reproducibility and Replicability Knowledge

 

Using prediction markets to estimate the reproducibility of scientific research

Concerns about a lack of reproducibility of statistically significant results have recently been raised in many fields, and it has been argued that this lack comes at substantial economic costs. We here report the results from prediction markets set …

Expectations for Replications: Are Yours Realistic?

Failures to replicate published psychological research findings have contributed to a "crisis of confidence." Several reasons for these failures have been proposed, the most notable being questionable research practices and data fraud. We examine …

Framework for Value Based Academic Assessment

We present a framework designed to help academic institutions and departments rethink and reform academic assessments - including tenure and promotion evaluations - using a values-based approach. For each of the 14 values included, we outline some …

Number of countries with open science policies has almost doubled since adoption of UNESCO Recommendation

Eleven countries have introduced open science policies, strategies and legislative frameworks since the adoption of the UNESCO Recommendation on Open Science two years ago, according to the UNESCO Open Science Outlook 1: Status and Trends Around the …

Research Transparency and Reproducibility: A Complementary Module for All

The Berkeley Initiative for Transparency in the Social Sciences awarded me a Catalyst grant for a project aimed at advancing transparent, reproducible, and ethical research in early 2022. The purpose of my project was to create a set of teaching …

A 21 word solution.

One year after publishing "False-Positive Psychology," we propose a simple implementation of disclosure that requires but 21 words to achieve full transparency. This article is written in a casual tone. It includes phone-taken pictures of milk-jars …

A Bayesian Perspective on the Reproducibility Project: Psychology

We revisit the results of the recent Reproducibility Project: Psychology by the Open Science Collaboration. We compute Bayes factors—a quantity that can be used to express comparative evidence for an hypothesis but also for the null hypothesis—for a …

A call for open science in forensics

The modern canon of open science consists of five “schools of thought” that justify unfettered access to the fruits of scientific research: i) public engagement, ii) democratic right of access, iii) efficiency of knowledge gain, iv) shared …

A general course outline for an overview of Open Science

To help ease the process with content development, we provide here a course outline in the form of a syllabus (i.e. module description) for a general open science course that overviews the most pertinent topics important to early career researchers …

A Powerful Nudge? Presenting Calculable Consequences of Underpowered Research Shifts Incentives Toward Adequately Powered Designs

If psychologists have recognized the pitfalls of underpowered research for decades, why does it persist? Incentives, perhaps: underpowered research benefits researchers individually (increased productivity), but harms science collectively (inflated …
JUST-OS