Open Science

Improving (Our) Science

The goal of science is to accumulate knowledge about nature. There are scientific values guiding how scientists should work, and scientific practices guiding how scientists do work. This course will examine the discrepancy between scientific values …

Improving (Our) Science: Reproducibility, Reporting, and Openness

The goal of the course is to become a better scientist. You will learn about newest standards for scientific openness, and how they influence the reporting and interpretation of empirical evidence. One component of the course is an intervention to …

Increasing transparency through a multiverse analysis.

Empirical research inevitably includes constructing a data set by processing raw data into a form ready for statistical analysis. Data processing often involves choices among several reasonable options for excluding, transforming, and coding data. We …

Instead of “playing the game” it is time to change the rules: Registered Reports at AIMS Neuroscience and beyond.

The last ten years have witnessed increasing awareness of questionable research practices (QRPs) in the life sciences [1,2], including p-hacking [3], HARKing [4], lack of replication [5], publication bias [6], low statistical power [7] and lack of …

Intellectual humility is central to science

Transparency is indispensable for accuracy and correction in science, and is discussed frequently in the credibility revolution. A less often mentioned aspect of credibility is the need for intellectual humility: When scientific communication is …

Internal conceptual replications do not increase independent replication success

Recently, many psychological effects have been surprisingly difficult to reproduce. This article asks why, and investigates whether conceptually replicating an effect in the original publication is related to the success of independent, direct …

Introducing Open Science in Teaching Health Economic Modelling

Open Science is gaining ground in all research fields, including health economics and outcomes research (HEOR). However, teaching Open Science is still in its infancy. This paper describes the design, implementation and evaluation of a teaching …

Introduction to Open Science principles and practices (in Health Economics)

This series of lecture slides were used during the "Advanced Simulation for Health Economic Analysis" course at the University of Twente, which took place in February - May 2023. The following Open Science topics were introduced to the course …

Investigating Variation in Replicability: A “Many Labs” Replication Project

Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In …

Investigation and its discontents: Some constraints on progress in psychological research.

Examines several prominent trends in the conduct of psychological research and considers how they may limit progress in the field. Failure to appreciate important differences in temperament among researchers, and differences in the particular talents …