Resources

 

We have an amazing team who curated many resources for the community.

Building reproducible bridges to cross the “valley of death”

Research is cumulative. New investigations build on, challenge, or qualify claims based on prior evidence. When we have limited evidence, it is normal that some explanations are wrong and need to be refined or reconsidered. This self-corrective …

Building transparency and reproducibility into the practice of pharmacoepidemiology and outcomes research

Real-world evidence (RWE) studies are increasingly used to inform policy and clinical decisions. However, there remain concerns about the credibility and reproducibility of RWE studies. While there is universal agreement on the critical importance of …

Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs

Effect sizes are the most important outcome of empirical studies. Most articles on effect sizes highlight their importance to communicate the practical significance of results. For scientists themselves, effect sizes are most useful because they …

Calculating the overlap of two normal distributions using monte carlo intergration

I read this post over at the blog Cartesian Faith about Probability and Monte Carlo methods. The post describe how to numerically intregate using Monte Carlo methods. I thought the results looked cool so I used the method to calculate the overlap of …

Campbell Open and Reproducible Science Syllabus

The purpose of this course is to acquaint students with recent developments in open science and reproducibility of the research workflow. By the end of this course students will be familiar with documenting their research workflow (e.g., idea …

Campbell’s Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating

Campbell’s Law explains the replication crisis. In brief, useful tools such as hypotheses, p-values, and multi-study designs came to be viewed as indicators of strong science, and thus goals in and of themselves. Consequently, their use became …

Can a Good Theory Be Built Using Bad Ingredients?

The replication crisis threatens to seriously impact theory development in the cognitive, behavioral, and social sciences. We canvas three desiderata of scientific theories (explanation, prediction, and unification) and argue that the extent to which …

Can You Trust the Data from Your Wearable? A Critical Evaluation of Heart Rate and HRV Accuracy

This study critically evaluated four wearable devices for their accuracy in measuring heart rate (HR) and heart rate variability (HRV) against a gold-standard monitor. Surprisingly, even a widely used research-grade device did not outperform consumer …

Canadian Open Neuroscience Platform (CONP) Portal

The Canadian Open Neuroscience Platform (CONP) provides an infrastructure for the promotion of open-science workflows and the sharing of neuroscience data. This platform brings together many of the country’s leading scientists in basic and clinical …

Cancer researchers’ experiences with and perceptions of research data sharing: Results of a cross-sectional survey

Background: Despite wide recognition of the benefits of sharing research data, public availability rates have not increased substantially in oncology or medicine more broadly over the last decade. Methods: We surveyed 285 cancer researchers to …
JUST-OS Open in new tab