Reproducible Analyses

 

Publication bias and the canonization of false facts.

Science is facing a “replication crisis” in which many experimental findings cannot be replicated and are likely to be false. Does this imply that many scientific facts are false as well? To find out, we explore the process by which a claim becomes …

Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size

Background: The p value obtained from a significance test provides no information about the magnitude or importance of the underlying phenomenon. Therefore, additional reporting of effect size is often recommended. Effect sizes are theoretically …

Publication bias in the social sciences: Unlocking the file drawer

We studied publication bias in the social sciences by analyzing a known population of conducted studies—221 in total—in which there is a full accounting of what is published and unpublished. We leveraged Time-sharing Experiments in the Social …

Publication pressure and scientific misconduct in medical scientists

There is increasing evidence that scientific misconduct is more common than previously thought. Strong emphasis on scientific productivity may increase the sense of publication pressure. We administered a nationwide survey to Flemish biomedical …

Quantitative Emerging Practices and Methods in Psychology

Recently, a reporter in the Chronicle of Higher Education wrote that “psychology is having an uneasy moment” (Zamudio-Suarez, 2016). The “uneasy moment” to which she referred is a movementof field self-criticism that has gained incredible steam and …

Questionable research practices among researchers in the most research-productive management programs

Questionable research practices (QRPs) among researchers have been a source of concern in many fields of study. QRPs are often used to enhance the probability of achieving statistical significance which affects the likelihood of a paper being …

Raising awareness of uncertain choices in empirical data analysis: A teaching concept toward replicable research practices

Throughout their education and when reading the scientific literature, students may get the impression that there is a unique and correct analysis strategy for every data analysis task and that this analysis strategy will always yield a significant …

Repetitive research: a conceptual space and terminology of replication, reproduction, revision, reanalysis, reinvestigation and reuse in digital humanities

This article is motivated by the ‘reproducibility crisis’ that is being discussed intensely in fields such as Psychology or Biology but is also becoming increasingly relevant to Artificial Intelligence, Natural Language Processing and Digital …

Replicability and reproducibility

A video about replicability and reproducibility debate

Replicability syllabus (2018)

A syllabus about replicability seminar