Resources

 

We have an amazing team who curated many resources for the community.

Shall we really do it again? The powerful concept of replication is neglected in the social sciences

Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of the notion of replication reveals that there are many different meanings to this concept and the relevant …

Statistical Reporting Errors and Collaboration on Statistical Analyses in Psychological Science

Statistical analysis is error prone. A best practice for researchers using statistics would therefore be to share data among co-authors, allowing double-checking of executed tasks just as co-pilots do in aviation. To document the extent to which this …

The (mis)reporting of statistical results in psychology journals

In order to study the prevalence, nature (direction), and causes of reporting errors in psychology, we checked the consistency of reported test statistics, degrees of freedom, and p values in a random sample of high- and low-impact psychology …

The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time

Data-dependent analysis—a “garden of forking paths”— explains why many statistically significant comparisons don't hold up.

Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results

Background: The widespread reluctance to share published research data is often hypothesized to be due to the authors’ fear that reanalysis may expose errors in their work or may produce conclusions that contradict their own. However, these …

A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null

Publication bias remains a controversial issue in psychological science. The tendency of psychological science to avoid publishing null results produces a situation that limits the replicability assumption of science, as replication cannot be …

An exploratory test for an excess of significant findings

Background The published clinical research literature may be distorted by the pursuit of statistically significant results. Purpose: We aimed to develop a test to explore biases stemming from the pursuit of nominal statistical significance. Methods …

Bayes Factor

Bayes factors are somewhat essential to Bayesian statistics. Tony O’Hagan explains their basics

Comparing Published Scientific Journal Articlesto Their Pre-print VersionsMart

Academic publishers claim that they add value to scholarly communications by coordinating reviews and contributing and enhancing text during publication. These contributions come at a considerable cost: U.S. academic libraries paid $1.7 billion for …

Curating Research Assets: A Tutorial on the Git Version Control System

Recent calls for improving reproducibility have increased attention to the ways in which researchers curate, share, and collaborate on their research assets. In this Tutorial, we explain how version control systems, such as the popular Git program, …
JUST-OS