Reproducibility and Replicability Knowledge

 

Framework for Value Based Academic Assessment

We present a framework designed to help academic institutions and departments rethink and reform academic assessments - including tenure and promotion evaluations - using a values-based approach. For each of the 14 values included, we outline some …

Getting ontologically serious about the replication crisis in psychology.

Discussions of the so-called replication crisis (RC) in psychology have focused on methodological–epistemological considerations. In this article, I follow a speculative approach within analytic philosophy to focus on ontological considerations, as …

Good clinical practice improves rigor and transparency: Lessons from the ACTIVE trial

Clinical trials are governed by principles of good clinical practice (GCP), which can strengthen the achievement of rigor, reproducibility, and transparency in scientific research. Rigor, reproducibility, and transparency are key for producing …

Good Science, Bad Science

A syllabi about open science: good science and bad science.

Graduate Research Methods

Completion of this course will provide a foundation for the practice of science. We will wrestle with the fundamental issues for designing and executing a program of research, and in the interpretation and reporting of research results. The class is …

Growth from uncertainty: understanding the replication 'crisis' in infant psychology

Psychology is a discipline that has a high number of failed replications, which has been characterised as a ‘crisis’ on the assumption that failed replications are indicative of untrustworthy research. This paper uses Chang’s concept of epistemic …

Guide Your Students to Become Better Research Consumers

Blog post going over making undergraduate students better consumers of research

Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024

Background and objective: Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health …

HARKing: How Badly Can Cherry-Picking and Question Trolling Produce Bias in Published Results?

The practice of hypothesizing after results are known (HARKing) has been identified as a potential threat to the credibility of research results. We conducted simulations using input values based on comprehensive meta-analyses and reviews in applied …

Harvard Professor’s Papers Contain Copied Images, Says Science Sleuth

A Harvard Medical School scientist who studies deadly brain tumors is facing accusations that more than two dozen papers he co-authored contain scientific images that appear doctored or copied.