There are more than 700 resources submitted so far in our database. We are currently curating a new and improved version that is compliant with OER Commons for greater findability, accessibility, interoperability, and reusability (FAIR) of these resources.
If you notice there is an educational resource, research article or pedagocial tool missing in our database, please consider adding it here on FORRT’s resource submission form or via the direct link.
Loading search data...
*Significance testing based on p-values is standard in psychological research and teaching. Typically, research articles and textbooks …
Author(s): Johansson, T.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Survey sheds light on the ‘crisis’ rocking research.
Author(s): Monya Baker
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
One year after publishing “False-Positive Psychology,” we propose a simple implementation of disclosure that requires but …
Author(s): Simmons, Joseph P. and Nelson, Leif D. and Simonsohn, Uri, A
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We revisit the results of the recent Reproducibility Project: Psychology by the Open Science Collaboration. We compute Bayes factors—a …
Author(s): Alexander Etz and Joachim Vandekerckhove
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The ideal of scientific progress is that we accumulate measurements and integrate these into theory, but recent discussion of …
Author(s): Frank et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Although many researchers have discussed replication as a means to facilitate self-correcting science, in this article, we identify …
Author(s): Sacha D Brown, David Furrow, Daniel F Hill, Jonathon C Gable, Liam P Porter, W Jake Jacobs
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Improving the reliability and efficiency of scientific research will increase the credibility of the published scientific literature …
Author(s): Munafo, M. R., et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Good self-control has been linked to adaptive outcomes such as better health, cohesive personal relationships, success in the workplace …
Author(s): Hagger, M. S., Chatzisarantis, N. L., Alberts, H., Anggono, C. O., Batailler, C., Birt, A. R., ... & Calvillo, D. P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
One possible reason for the continued neglect of statistical power analysis in research in the behavioral sciences is the …
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
If psychologists have recognized the pitfalls of underpowered research for decades, why does it persist? Incentives, perhaps: …
Author(s): Will M. Gervais, Jennifer A. Jewell, Maxine B. Najle, and Ben K. L. Ng
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
“… there’s this desert prison, see, with an old prisoner, resigned to his life, and a young one just arrived. The young one talks …
Author(s): G. William Walster &T. Anne Cleary
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Background: This paper presents the first meta-analysis for the inter-rater reliability (IRR) of journal peer reviews. IRR is defined …
Author(s): Lutz Bornmann, Rüdiger Mutz and Hans-Dieter Daniel
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Crisis of replicability is one term that psychological scientists use for the current introspective phase we are in—I argue instead …
Author(s): Barbara A. Spellman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A recent paper by Chatterjee, Rose, and Sinha (2013) reported impressively large “money priming” effects: incidental exposure to …
Author(s): Harold Pashler, Doug Rohrer, Ian Abramson, Tanya Wolfson &Christine R. Harris
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We created a software tool that accurately removes all patient identifying information from various kinds of clinical data documents, …
Author(s): Friedlin, F. J., & McDonald, C. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
We estimated the statistical power of the first and last statistical test presented in 697 papers from 10 behavioral journals. First …
Author(s): Jennions, M. D., & Møller, A. P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science, Math & Statistics
Tag(s):
Link to resource
Statistical power is an inherent part of empirical studies that employ significance testing and is essential for the planning of …
Author(s): Dybå, T., Kampenes, V. B., & Sjøberg, D. I.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
An abstract about transparency and robustness for two papers
Author(s): Michael Inzlicht
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, Researcher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Blog, Reproducibility Crisis and Credibility Revolution
Link to resource
Societies invest in scientific studies to better understand the world and attempt to harness such improved understanding to address …
Author(s): Etienne P. LeBel, Randy J. McCarthy, Brian D. Earp, Malte Elson and Wolf Vanpaemel
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Publication bias remains a controversial issue in psychological science. The tendency of psychological science to avoid publishing null …
Author(s): Christopher J. Ferguson, Moritz Heene
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We discuss problems the null hypothesis significance testing (NHST) paradigm poses for replication and more broadly in the biomedical …
Author(s): McShane, B. B., Gal, D., Gelman, A., Robert, C., & Tackett, J. L.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Over the last 50 years, we argue that incentives for academic scientists have become increasingly perverse in terms of competition for …
Author(s): Marc A. Edwards and Siddhartha Roy
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Monte-Carlo simulation was used to model the biasing of effect sizes in published studies. The findings from the simulation indicate …
Author(s): ANDREW BRAND, MICHAEL T. BRADLEY, LISA A. BEST, AND GEORGE STOICA
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
We review and evaluate selection methods, a prominent class of techniques first proposed by Hedges (1984) that assess and adjust for …
Author(s): McShane, B. B., Böckenholt, U., & Hansen, K. T
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This is a blogpost describing why we should use Welch t-test instead of Student t-test
Author(s): Daniel Lakens
Type of resources: Reading, R Code
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Blog, Code, Reproducibility Crisis and Credibility Revolution
Link to resource
The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss …
Author(s): Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Mass, H. L. J., & Kievit, R. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This study compiles information from more than 250 meta-analyses conducted over the past 30 years to assess the magnitude of reported …
Author(s): Paterson, T. A., Harms, P. D., Steel, P., & Credé, M
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Background The published clinical research literature may be distorted by the pursuit of statistically significant results. Purpose: We …
Author(s): John PA Ioannidis and Thomas A Trikalinos
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s):
Link to resource
An article about an Introduction to Registered Replication Reports at Perspectives on Psychological Science
Author(s): Daniel J. Simons, Alex O. Holcombe, Barbara A. Spellman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this article, we propose analytic review (AR) as a solution to the problem of misreporting statistical results in psychological …
Author(s): John Sakaluk, Alexander Williams, Monica Biernat
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This classic text on multiple regression is noted for its nonmathematical, applied, and data-analytic approach. Readers profit from its …
Author(s): Jacob Cohen, Patricia Cohen, Stephen G. West, Leona S. Aiken
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
To study the availability of psychological research data, we requested data from 394 papers, published in all issues of four APA …
Author(s): Wolf Vanpaemel, Maarten Vermorgen, Leen Deriemaecker and Gert Storms
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Sample correlations converge to the population value with increasing sample size, but the estimates are often inaccurate in small …
Author(s): Felix D. Schonbrodt and Marco Perugini
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Articles about Bad Science
Author(s): Ben Goldacre
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Blog, Reproducibility Knowledge, Open Science
Link to resource
Blogs about bad science
Author(s): Ben Goldacre
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics
Tag(s): Blog
Link to resource
Beginning January 2014, Psychological Science gave authors the opportunity to signal open data and materials if they qualified for …
Author(s): Mallory C. Kidwell et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog about bayesian Statistics
Author(s): David Funder
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
Bayes factors are somewhat essential to Bayesian statistics. Tony O’Hagan explains their basics
Author(s): O'Hagan
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A blog about Bayes for Beginners: Probability and Likelihood
Author(s): C. Randy Gallistel
Type of resources: Blog
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
This blog post is about a new statistical visualization. This time I’ve tried to illustrate the logic of bayesian updating and …
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction
Link to resource
A video about battling bad science
Author(s): TED/Ben Goldacre
Type of resources: Video
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video
Link to resource
Several researchers recently outlined unacknowledged costs of open science practices, arguing these costs may outweigh benefits and …
Author(s): Etienne P. LeBel, Lorne Campbell and Timothy J. Loving
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Given concerns about the reproducibility of scientific findings, neuroimaging must define best practices for data analysis, results …
Author(s): Thomas E. Nichols et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In recent years, a robust movement has emerged within psychology to increase the evidentiary value of our science. This movement, which …
Author(s): Finkel, E. J., Eastwick, P. W., & Reis, H. T.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
When studies examine true effects, they generate right-skewed p-curves, distributions of statistically significant results with more …
Author(s): Uri Simonsohn, Joseph P Simmons, Leif D Nelson
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Statistical power analysis provides the conventional approach to assess error rates when designing a research study. However, power …
Author(s): Andrew Gelman1 and John Carlin
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Vul, Harris, Winkielman, and Pashler (2009), (this issue) argue that correlations in many cognitive neuroscience studies are grossly …
Author(s): Tal Yarkoni
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Short and rapid publication of research findings has many advantages. However, there is another side of the coin that needs careful …
Author(s): Marco Bertamini, Marcus R. Munafò
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A video about Frequentist accuracy of Bayesian estimates
Author(s): RoyalStatSoc/Bradley Efron
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Video, Bayesian
Link to resource
Effect sizes are the most important outcome of empirical studies. Most articles on effect sizes highlight their importance to …
Author(s): Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
I read this post over at the blog Cartesian Faith about Probability and Monte Carlo methods. The post describe how to numerically …
Author(s): Kristoffer Magnusson
Type of resources: Reading, Student Guide, Teaching/Learning Strategy, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Tutorial
Link to resource
some remarks on science, pseudoscience, and learning how to not fool yourself. Caltech’s 1974 commencement address
Author(s): Richard Feynman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The editors of the Journal of Advanced Academics comment on Makel (2014). The replicability crisis in psychology is summarized in terms …
Author(s): Matthew T. McBee and Michael S. Matthews
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A paper about open science and novelty
Author(s): Forscher, B. K.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Psychology has historically been concerned, first and foremost, with explaining the causal mechanisms that give rise to behavior. …
Author(s): Yarkoni, T., & Westfall, J.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Chromebook Data Science (CBDS) is a free, massive open online educational program offered through Leanpub to help anyone who can read, …
Author(s): Jeff Leek, Ashley Johnson, Shannon Ellis, Aboozar Hadavand, John Muschelli, Sean Kross, Leo Collado-Torres, Leah Jager, Sarah McClymont, Leslie Myint
Type of resources: Full Course, Lesson, Module
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Data Science Tool
Link to resource
Welcome to Episode 8, where I talk to SIMINE VAZIRE, Associate Professor of Psychology at the University of California at Davis, about …
Author(s): Jim Coan
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
A website about questions on psychology
Author(s): Anon
Type of resources: Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher, Adminstrator, Parent, Librarian
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Website
Link to resource
A paper about statistical power
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Academic publishers claim that they add value to scholarly communications by coordinating reviews and contributing and enhancing text …
Author(s): Martin Klein, Peter Broadwell, Sharon E. Farb, Todd Grappone
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Knowledge
Link to resource
Context: As of 2005, the International Committee of Medical Journal Editors required investigators to register their trials prior to …
Author(s): Sylvain Mathieu, Isabelle Boutron, David Moher, Douglas G Altman, Philippe Ravaud
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Examined the consequences of prejudice against accepting the null hypothesis through (a) a mathematical model intended to stimulate the …
Author(s): Anthony G. Greenwald
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Publication bias leads consumers of research to observe a selected sample of statistical estimates calculated by producers of research. …
Author(s): Justin McCrary, Garret Christensen, Daniele Fanelli
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Whether or not a replication attempt counts as “direct” often cannot be determined definitively after the fact as a result of …
Author(s): Daniel J. Simons, Yuichi Shoda and D. Stephen Lindsay
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The verity of results about a psychological construct hinges on the validity of its measurement, making construct validation a …
Author(s): Flake, J. K., Pek, J., & Hehman, E.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The current crisis in scientific psychology about whether our findings are irreproducible was presaged years ago by Tversky and …
Author(s): Sanford L. Braver, Felix J. Thoemmes, Robert Rosenthal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Publication bias and questionable research practices in primary research can lead to badly overestimated effects in meta-analysis. …
Author(s): Evan C. Carter, Felix D. Schönbrodt, Will M. Gervais, and Joseph Hilgard
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Effect size information is essential for the scientific enterprise and plays an increasingly central role in the scientific process. We …
Author(s): Bosco, F. A., Aguinis, H., Singh, K., Field, J. G., & Pierce, C. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A collection of course syllabi from any discipline featuring content to examine or improve open and reproducible research practices. …
Author(s): Ball et al.
Type of resources: Reading
Primary user(s): Student, Teacher, Researchers
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Collection, Reproducibility Knowledge
Link to resource
CREP’s mission is to provide training, support, and professional growth opportunities for students and instructors completing …
Author(s): Jon Grahe et al.
Type of resources: Primary Source, Reading, Project
Primary user(s): Student, Teacher, Researchers
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Knowledge, OSF Project
Link to resource
A website about questions on statistics
Author(s): Anon
Type of resources: Student Guide, Teaching/Learning Strategy, Unit of Study, Website
Primary user(s): Student, Teacher, Librarian
Subject area(s): Math & Statistics
Tag(s): Website
Link to resource
Recent calls for improving reproducibility have increased attention to the ways in which researchers curate, share, and collaborate on …
Author(s): Matti Vuorre and James P. Curley
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
DAGitty is a browser-based environment for creating, editing, and analyzing causal diagrams (also known as directed acyclic graphs or …
Author(s): Johannes Texor, Maciej Liśkiewicz and Benito van der Zander
Type of resources: Teaching/Learning Strategy, R code
Primary user(s): Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Website
Link to resource
Blog post going over data peeking without p-hacking
Author(s): Daniel Lakens
Type of resources: Reading, R Code
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Code, Open Science, Reproducibility Crisis and Credibility Revolution
Link to resource
Background. Attribution to the original contributor upon reuse of published data is important both as a reward for data creators and to …
Author(s): Heather A. Piwowar and Todd J. Vision
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Despite its potential to accelerate academic progress in psychological science, public data sharing remains relatively uncommon. In …
Author(s): Houtkoop et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Data sharing promotes scientific progress by permitting replication of prior scientific analyses and by increasing the return on the …
Author(s): Margaret C. Levenstein and Jared A. Lyle
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
The concept of validity has suffered because the term has been used to refer to 2 incompatible concerns: the degree of support for …
Author(s): G.J. Cizek
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
The designing, collecting, analyzing, and reporting of psychological studies entail many choices that are often arbitrary. The …
Author(s): Jelte M. Wicherts, Coosje L. S. Veldkamp, Hilde E. M. Augusteijn, Marjan Bakker, Robbie C. M. van Aert, and Marcel A. L. M. van Assen
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A lot of researchers seem to be struggling with their understanding of the statistical concept of degrees of freedom. Most do not …
Author(s): Ron Dotsch
Type of resources: Reading, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Tutorial
Link to resource
Calls for public access to research data have been ongoing for some time. For instance, in their “Recommendations for Secure Storage …
Author(s): Schönbrodt, F., Gollwitzer, M., & Abele-Brehm, A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recently there has been a growing concern that many published research findings do not hold up in attempts to replicate them. We argue …
Author(s): Wolfgang Forstmeier, Eric-Jan Wagenmakers and Timothy H. Parker
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
He’s been called a “Data vigilante.” In this episode, Prof. Uri Simonsohn describes how he detects fraudulent work in …
Author(s): Julia Galef/Uri Simonsohn
Type of resources: Teaching/Learning Strategy, Unit of Study, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
An interactive visualisation of the distribution of p-values when comparing two groups
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Reading, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
We examine the APSR and the AJPS for the presence of publication bias due to reliance on the 0.05 significance level. Our analysis …
Author(s): Alan Gerber and Neil Malhotra
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
The long-term impact of studies of statistical power is investigated using J. Cohen’s (1962) pioneering work as an example. We …
Author(s): Sedlmeier, P. & Gigerenzer, G.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Interpersonal phenomena such as attachment, conflict, person perception, helping, and influence have traditionally been studied by …
Author(s): David A. Kenny, Deborah A. Kashy, William L. Cook
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
An article about easy preregistration will benefit any research.
Author(s): David T. Mellor and Brian Nosek
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
why aren’t more replications published? While there are many possible reasons, one simple one could be that journals prefer not …
Author(s): Neuliep, James W. and Rick Crandall
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Objectives: To examine the effect on peer review of asking reviewers to have their identity revealed to the authors of the paper. …
Author(s): Susan van Rooyen et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Open Science
Link to resource
The authors conducted a 30-year review (1969-1998) of the size of moderating effects of categorical variables as assessed using …
Author(s): Herman Aguinis, James C Beaty, Robert J Boik and Charles A Pierce
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The Publication Manual of the American Psychological Association (American Psychological Association, 2001, 2010) calls for the …
Author(s): Catherine O. Fritz et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A central goal of translational neuroimaging is to establish robust links between brain measures and clinical outcomes. Success hinges …
Author(s): Marianne C. Reddan, Martin A. Lindquist and Tor D. Wager
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Individual differences researchers very commonly report Pearson correlations between their variables of interest. Cohen (1988) provided …
Author(s): Gilles E.Gignac and Eva T.Szodorai
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Despite publication of many well-argued critiques of null hypothesis testing (NHT), behavioral science researchers continue to rely …
Author(s): ANTHONY G. GREENWALD, RICHARD GONZALEZ, RICHARD J. HARRIS and DONALD GUTHRIE
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics
Tag(s):
Link to resource
The effect size (ES) is the magnitude of a study outcome or research finding, such as the strength of the relationship obtained between …
Author(s): Rosnow, R. L., & Rosenthal, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Concerns that the growing competition for funding and citations might distort science are frequently discussed, but have not been …
Author(s): Daniele Fanelli
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Logically and conceptually, the use of statistical significance testing in the analysis of research data has been thoroughly …
Author(s): Schmidt, J. E. H. F. L., Hunter, J. E., Harlow, L., Mulaik, S., & Steiger, J.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Context Most medical interventions have modest effects, but occasionally some clinical trials may find very large effects for benefits …
Author(s): Tiago V. Pereira, PhD Ralph I. Horwitz, MD John P. A. Ioannidis, MD, DSc
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The psychological and psychiatric communities are generating data on an ever-increasing scale. To ensure that society reaps the …
Author(s): Walsh, C., Xia, W., Li, M., Denny, J., Harris, P., & Malin, B
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The purpose of this paper is to extend to the field of relationship science, recent discussions and suggested changes in open research …
Author(s): LORNE CAMPBELL TIMOTHY J. LOVING ETIENNE P. LEBEL
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In theory, a comparison of two experimental effects requires a statistical test on their difference. In practice, this comparison is …
Author(s): Nieuwenhuis, S., Forstmann, B. U., & Wagenmakers, E. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted …
Author(s): Open Science Collaboration.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This blog evaluates the R-Index and the P-Curve
Author(s): Jeff Hughes
Type of resources: Reading
Primary user(s): Student, Researcher
Subject area(s): Math & Statistics
Tag(s): Blog
Link to resource
A podcast about open science and psychology
Author(s): Sound Cloud
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
Importance: The use and misuse of P values has generated extensive debates. Objective: To evaluate in large scale the P values reported …
Author(s): David Chavalarias, Joshua David Wallach, Alvin Ho Ting Li, John P A Ioannidis
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This article describes a systematic analysis of the relationship between empirical data and theoretical conclusions for a set of …
Author(s): Gregory Francis, Jay Tanzman, William J. Matthews
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Failures to replicate published psychological research findings have contributed to a “crisis of confidence.” Several …
Author(s): David J Stanley 1, Jeffrey R Spence
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Traditional methods of analyzing data from psychological experiments are based on the assumption that there is a single random factor …
Author(s): Judd, C. M., Westfall, J., & Kenny, D. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This book provides a non-mathematical introduction to the underlying theory of Efa and reviews the key decisions that must be made in …
Author(s): Leandre R. Fabrigar, Dueane T. Wegener
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
Despite increased attention to methodological rigor in education research, the field has focused heavily on experimental design and not …
Author(s): Matthew C. Makel and Jonathan A. Plucker
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A book about Academic Fraud
Author(s): Diederik Stapel/Translated by Nicholas J. L. Brown
Type of resources: Primary Source
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Textbook, Reproducibility Crisis and Credibility Revolution
Link to resource
A lecture on when analysis goes wrong A look at false-positive psychology
Author(s): Dermot Lynott
Type of resources: Lecture, Lecture Notes, Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Lecture, Reproducibility Knowledge
Link to resource
We describe why we wrote “False-Positive Psychology,” analyze how it has been cited, and explain why the integrity of experimental …
Author(s): Joseph P. Simmons, Leif D. Nelson, and Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this article, we accomplish two things. First, we show that despite empirical psychologists’ nominal endorsement of a low rate of …
Author(s): Joseph P. Simmons
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog post that describes analyses of all p-values
Author(s): Uri Simonsohn
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog
Link to resource
Finkel, Eastwick, and Reis (2016; FER2016) argued the post-2011 methodological reform movement has focused narrowly on replicability, …
Author(s): LeBel, E. P., Berger, D., Campbell, L., & Loving, T. J. (2017).
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this methodological commentary, we use Bem’s (2011) recent article reporting experimental evidence for psi as a case study for …
Author(s): LeBel, E.P., & Peters, K.R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The term psi denotes anomalous processes of information or energy transfer that are currently unexplained in terms of known physical or …
Author(s): Daryl J Bem
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Social scientists generally enjoy substantial latitude in selecting measures and models for hypothesis testing. Coupled with …
Author(s): Macartan Humphreys, Raul Sanchez de la Sierra and Peter van der Windt
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
GPower is a tool to compute statistical power analyses for many different t tests, F tests, χ2 tests, z tests and some exact tests. G …
Author(s): The G*Power Team
Type of resources: Reading, Simulation
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Reproducibility Knowledge, Power Analysis Tool
Link to resource
Amidst increased pressure for transparency in science, researchers and community members are calling for open access to study stimuli …
Author(s): Crystal N. Steltenpohl, Amy J. Anderson, and Katherine M. Daniels
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Welcome to GLIMMPSE. The GLIMMPSE software calculates power and sample size for study designs with normally distributed outcomes. …
Author(s): Anon
Type of resources: Reading, Simulation
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Reproducibility Knowledge, Power Analysis Tool
Link to resource
A syllabi about open science: good science and bad science.
Author(s): Eric-Jan Wagenmakers
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Social Science
Tag(s): Syllabus
Link to resource
The language and conceptual framework of “research reproducibility” are nonstandard and unsettled across the sciences. In this …
Author(s): Goodman, S. N., Fanelli, D., & Ioannidis, J. P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This chapter discusses the use of directed acyclic graphs (DAGs) for causal inference in the observational social sciences. It focuses …
Author(s): Felix Elwert
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Blog post going over making undergraduate students better consumers of research
Author(s): Beth Morling
Type of resources: Reading, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Social Science
Tag(s): Blog, Open Science
Link to resource
You’re a social scientist with a hunch: The U.S. economy is affected by whether Republicans or Democrats are in office. Try to show …
Author(s): Anon
Type of resources: Activity/Lab, Interactive, Simulation, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Demo, Reproducibility Knowledge
Link to resource
The practice of hypothesizing after results are known (HARKing) has been identified as a potential threat to the credibility of …
Author(s): Kevin R. Murphy & Herman Aguinis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This article considers a practice in scientific communication termed HARKing (Hypothesizing After the Results are Known). HARKing is …
Author(s): Kerr, N. L.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Over the past 10 years, crises surrounding replication, fraud, and best practices in research methods have dominated discussions in the …
Author(s): William J. Chopik, Ryan H. Bremner, Andrew M. Defever, Victor N. Keller
Type of resources: Primary Source, Reading, Paper
Primary user(s): Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution
Link to resource
Sampling simulated data can reveal common ways in which our cognitive biases mislead us.
Author(s): Professor Dorothy Bishop
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
An essay about How to Make More Published Research True
Author(s): John Ioannidis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog about reproducibility crisis
Author(s): John Bohannon
Type of resources: Primary Source, Reading, Blog
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We linked names and contact information to publicly available profiles in the Personal Genome Project. These profiles contain medical …
Author(s): Sweeney, Latanya, Akua Abu, and Julia Winn.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this article, the Society for Personality and Social Psychology (SPSP) Task Force on Publication and Research Practices offers a …
Author(s): Funder et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
This course aims to help you to draw better statistical inferences from empirical research. First, we will discuss how to correctly …
Author(s): Daniel Lakens
Type of resources: Full Course
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Course
Link to resource
Jacob Cohen (see record 1995-12080-001) raised a number of questions about the logic and information value of the null hypothesis …
Author(s): Richard L. Hagen
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Much has been written regarding p-values below certain thresholds (most notably 0.05) denoting statistical significance and the …
Author(s): Gary L. Gadbury and David B. Allison
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Empirical research inevitably includes constructing a data set by processing raw data into a form ready for statistical analysis. Data …
Author(s): Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The last ten years have witnessed increasing awareness of questionable research practices (QRPs) in the life sciences [1,2], including …
Author(s): Chambers, C. D., Feredoes, E., Muthukumaraswamy, S. D., & Etchells, P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Transparency is indispensable for accuracy and correction in science, and is discussed frequently in the credibility revolution. A less …
Author(s): Rink Hoekstra and Simine Vazire
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recently, many psychological effects have been surprisingly difficult to reproduce. This article asks why, and investigates whether …
Author(s): Richard Kunert
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog about the visualisation of Confidence intervals
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Simulation, Student Guide, Teaching/Learning Strategy, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
Correlation is one of the most widely used tools in statistics. The correlation coefficient summarizes the association between two …
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Reading, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
Improved research practice is based on estimation of effect sizes rather than statistical significance. We discuss the challenging task …
Author(s): ARTHUR A. STUKAS AND GEOFF CUMMING
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A paper about a special issue on cognitive modelling
Author(s): Kevin Glucka, Paul Bellob, Jerome Busemeyer
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
A blog about JASP to replace SPSS
Author(s): Jonas Haslbeck
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Blog, Reproducibility Knowledge
Link to resource
Explaining the fundamentals of mediation and moderation analysis, this engaging book also shows how to integrate the two using an …
Author(s): Andrew F. Hayes
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Social Science
Tag(s): Book
Link to resource
A book about meta analyses
Author(s): Borenstein, M., Hedges, L.V., Higgins, J. P. T., & Rothstein, H. R. (2009).
Type of resources: Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the …
Author(s): Klein et al.
Type of resources: Primary Source, Reading, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Examines several prominent trends in the conduct of psychological research and considers how they may limit progress in the field. …
Author(s): Paul L. Wachtel
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The ability to self-correct is considered a hallmark of science. However, self-correction does not always happen to scientific evidence …
Author(s): John Ioannidis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Psychology has recently been viewed as facing a replication crisis because efforts to replicate past study findings frequently do not …
Author(s): Scott E. Maxwell, Michael Y. Lau and George S. Howard
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A paper about Is the call to abandon p-values the red herring of the replicability crisis?
Author(s): Victoria Savalei and Elizabeth Dunn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
We discuss three arguments voiced by scientists who view the current outpouring of concern about replicability as overblown. The first …
Author(s): Pashler, H., & Harris, C. R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recent studies report an inability to replicate previously published research, leading some to suggest that scientific knowledge is …
Author(s): Donald D Bergh, Barton M Sharp, Herman Aguinis and Ming Li
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The field of psychology, including cognitive science, is vexed by a crisis of confidence. Although the causes and solutions are varied, …
Author(s): Jeffrey N Rouder, Richard D Morey, Josine Verhagen, Jordan M Province, Eric-Jan Wagenmakers
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
Psychology is in the early stages of examining a crisis of replicability stemming from several high-profile failures to replicate …
Author(s): Jennifer L. Tackett et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A video detailing whether reproducible research is true or false
Author(s): John Ioannidis
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video
Link to resource
I argue that requiring authors to post the raw data supporting their published results has the benefit, among many others, of making …
Author(s): Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science
Tag(s):
Link to resource
In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently …
Author(s): Daniel Lakens et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
In recent years, researchers have attempted to provide an indication of the prevalence of inflated Type 1 error rates by analyzing the …
Author(s): Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A video about scientific studies
Author(s): Last Week Tonight/John Oliver
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Video
Link to resource
This book demonstrates how to conduct latent variable modeling (LVM) in R by highlighting the features of each model, their specialized …
Author(s): W. Holmes Finch, Brian F. French
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Book
Link to resource
Back in the grimdark pre-Snapchat era of humanity (i.e. early 2011), I started teaching an introductory statistics class for psychology …
Author(s): Danielle Navarro
Type of resources: Textbook, R Tutorial
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Statistical Book, Tutorial
Link to resource
A statistical tutorial about using Jamovi
Author(s): Danielle Navarro and David R Foxcraft
Type of resources: Data Set, Textbook, Tutorial
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Statistical Book, Tutorial
Link to resource
A paper about publishing few papers
Author(s): Leif D. Nelson, Joseph P. Simmons & Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A number of scholars recently have argued for fundamental changes in the way psychological scientists conduct and report research. The …
Author(s): Jon K. Maner
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background: We explore whether the number of null results in large National Heart Lung, and Blood Institute (NHLBI) funded trials has …
Author(s): Kaplan RM, Irvin VL
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
Genetics and neuroscience are two areas of science that pose particular methodological problems because they involve detecting weak …
Author(s): Grabitz, C.R. et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Featuring actual datasets as illustrative examples, this book reveals numerous ways to apply structural equation modeling (SEM) to any …
Author(s): Todd D. Little
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
The vast majority of health-related observational studies are not prospectively registered and the advantages of registration have not …
Author(s): Rafael Dal-Ré, John P. Ioannidis, Michael B. Bracken, Patricia A. Buffler, An-Wen Chan, Eduardo L. Franco, Carlo La Vecchia, ElisabeteWeiderpass
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Many philosophers of science and methodologists have argued that the ability to repeat studies and obtain similar results is an …
Author(s): Rolf A. Zwaan, Alexander Etz Richard E. Lucas and M. Brent Donnellan
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Crowdsourcing research can balance discussions, validate findings and better inform policy, say Raphael Silberzahn and Eric L. Uhlmann.
Author(s): Silberzahn, R., & Uhlmann, E.L.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The university participant pool is a key resource for behavioral research, and data quality is believed to vary over the course of the …
Author(s): Charles R. Ebersole et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A chapter to discuss maximising the reproducibility of research
Author(s): Open Science Collaboration
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The assumption that measurement error always reduces effect sizes is false
Author(s): Loken, E., & Gelman, A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This resource list contains reading material on the topic of measurement in psychological sciences. We hope the list will be a useful …
Author(s): Eiko Fried and Jessica Flake
Type of resources: Reading
Primary user(s): Student, Researcher
Subject area(s): Social Science
Tag(s): Collection, Reproducibility Knowledge
Link to resource
Cases of clear scientific misconduct have received significant media attention recently, but less flagrantly questionable research …
Author(s): Leslie K. John, George Loewenstein, Drazen Prelec
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
According to a recent meta-analysis, religious priming has a positive effect on prosocial behavior (Shariff et al., 2015). We first …
Author(s): Michiel van Elk, Dora Matzke, Quentin F. Gronau, Maime Guan, Joachim Vandekerckhove and Eric-Jan Wagenmakers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Publication selection bias is a serious challenge to the integrity of all empirical sciences. We derive meta-regression approximations …
Author(s): TD Stanley, H Doucouliagos
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A syllabus about the methods for reliable, transparent and open science
Author(s): Jeffrey Rouder and Joachim Vandekerckhove
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Social Science
Tag(s): Syllabus
Link to resource
Statistical rituals largely eliminate statistical thinking in the social sciences. Rituals are indispensable for identification with …
Author(s): Gerd Gigerenzer
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
We outline the need to, and provide a guide on how to, conduct a meta-analysis on one’s own studies within a manuscript. Although …
Author(s): Jin X. Goh, Judith A. Hall and Robert Rosenthal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A blog about the p-curve
Author(s): Will Gervais
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Blog
Link to resource
The main methods, techniques and issues for carrying out multilevel modeling and analysis are covered in this book. The book is an …
Author(s): Tom A.B. Snijders, Roel Bosker
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
Science is often romanticised as a flawless system of knowledge building, where scientists work together to systematically find …
Author(s): Matosin, N., Frank, E., Engel, M., Lum, J. S., & Newell, K. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Daniel Glaser apprehensively revisits an article of his that saw some fallout due to a study he cited. But that study was not the only …
Author(s): Daniel Glaser
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
A video about replicability and reproducibility debate
Author(s): BPSOfficial/Nick Brown
Type of resources: Video
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Video, Replication Research
Link to resource
Objective: To assess the performance of novel contour enhanced funnel plots and a regression based adjustment method to detect and …
Author(s): Santiago G Moreno, Alex J Sutton, Erick H Turner, Keith R Abrams, Nicola J Cooper, Tom M Palmer, A E Ades
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Null hypothesis significance testing (NHST) is the researcher’s workhorse for making inductive inferences. This method has often …
Author(s): J Krueger
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Null hypothesis significance testing (NHST) is arguably the most widely used approach to hypothesis evaluation among behavioral and …
Author(s): Nickerson, R. S. (2000).
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
P values, the ‘gold standard’ of statistical validity, are not as reliable as many scientists assume.
Author(s): Nuzzo, R.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Examination of the literature in statistics and probability that predates Fisher’s Statistical Methods for Research Workers …
Author(s): MICHAEL COWLES and CAROLINE DAVIS
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
How likely are published findings in the functional neuroimaging literature to be false? According to a recent mathematical model, the …
Author(s): Carp, J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background: Meta-analyses play an important role in cumulative science by combining information across multiple studies and attempting …
Author(s): Daniel Lakens et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Investigators from a large consortium of scientists recently performed a multi-year study in which they replicated 100 psychology …
Author(s): Valen E. Johnson, Richard D. Payne, Tianying Wang, Alex Asher &Soutrik Mandal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Criticisms of null-hypothesis significance tests (NHSTs) are reviewed. Used as formal, two-valued decision procedures, they often …
Author(s): Robert P. Abelson
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Null hypothesis testing as a tool in research is defended. Six examples are offered of situations in which, if all the researcher could …
Author(s): H. Wainer
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Open science practices including open access (OA) publication, open methods, study preregistration, and open data are gaining …
Author(s): Tamminen, K.A. and Poucher, Z.A.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
There is a vast body of helpful tools that can be used in order to foster Open Science practices. For reasons of clarity, this toolbox …
Author(s): Lutz Heil
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Knowledge
Link to resource
Open science has been highlighted as one of the priorities of the Dutch presidency of the European Union in 2016. Matthew Dovey …
Author(s): Jisc
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
Open Science is a collection of actions designed to make scientific processes more transparent and results more accessible. Its goal is …
Author(s): Bobbie Spellman, Elizabeth Gilbert and Katherine Corker
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This article reports on an adversarial (but friendly) collaboration examining the issues that lie at the intersection of …
Author(s): Joel, S., Eastwick, P., & Finkel, E.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A website about open statistic labs with data and activities
Author(s): Kevin P. McIntyre
Type of resources: Activity/Lab, Data Set
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Website
Link to resource
The Evolving Guide on How the Internet is Changing Research, Collaboration and Scholarly Publishing
Author(s): Sönke Bartling and Sascha Friesike
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this article, we present a model for determining how total research payoff depends on researchers’ choices of sample sizes, α …
Author(s): Jeff Miller and Rolf Ulrich
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
An article about P Values and Statistical Practice
Author(s): Andrew Gelman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
An abstract about the p-curve
Author(s): Will Gervais
Type of resources: Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Blog
Link to resource
My p-curve tool now lets you show the x-axis on a log₁₀ scale, which makes it a lot easier to look at really small p-values
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Reading, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction
Link to resource
Because scientists tend to report only studies (publication bias) or analyses (p-hacking) that “work,” readers must ask, “Are these …
Author(s): Simonsohn, Uri, Nelson, Leif D., Simmons, Joseph P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
What’s wrong with the social sciences? In this episode, Massimo and Julia are joined by Professor Daniel Lakens from the …
Author(s): Julia Galef, Massimo Pigliucci and Benny Pollak
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
PANGEA is the first power analysis program for general ANOVA designs (e.g., Winer, Brown, & Michels, 1991). PANGEA can handle …
Author(s): Jake Westfall
Type of resources: Reading, Simulation
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Reproducibility Knowledge, Power Analysis Tool
Link to resource
A growing interest in and concern about the adequacy and fairness of modern peer-review practices in publication and funding are …
Author(s): Peters, D. P., & Ceci, S. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Open Science, Open Review
Link to resource
Running studies with high statistical power, while effect size estimates in psychology are often inaccurate, leads to a practical …
Author(s): Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
P. E. Meehl did first 10 sessions (Winter Quarter, Jan–Mar 1989). In the Spring Quarter, several other department members lectured on …
Author(s): P. E. Meehl
Type of resources: Primary Source, Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Course, Video
Link to resource
Open access, open data, open source and other open scholarship practices are growing in popularity and necessity. However, widespread …
Author(s): Erin C McKiernan et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In psychology, attempts to replicate published findings are less successful than expected. For properly powered studies replication …
Author(s): Brysbaert, M. and Stevens, M.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A study with low statistical power has a reduced chance of detecting a true effect, but it is less well appreciated that low power also …
Author(s): Katherine Button et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million …
Author(s): Joe Simmons and Uri Simonsohn
Type of resources: Reading
Primary user(s): Student
Subject area(s): Education, Social Science
Tag(s): Blog
Link to resource
Recently, evidence for endemically low statistical power has cast neuroscience findings into doubt. If low statistical power plagues …
Author(s): Camilla L. Nord, Vincent Valton, John Wood and Jonathan P. Roiser
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Widespread sharing of data and materials (including displays and text- and video-based descriptions of experimental procedures) will …
Author(s): Rick O. Gilmore, Joy Lorenzo Kennedy, and Karen E. Adolph
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Open Science
Link to resource
Pre-registration of studies before they are conducted has recently become more feasible for researchers, and is encouraged by an …
Author(s): van ‘t Veer, A.E., & Giner-Sorolla, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Transparency
Link to resource
Pre-registration of clinical trials is associated with fewer positive findings
Author(s): Bill Gardner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Open Science, Reproducibility Crisis and Credibility Revolution
Link to resource
A challenge when interpreting replications is determining whether the results of a replication “successfully” replicate the original …
Author(s): Jeffrey R.Spence and David J. Stanley
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A blog about Preregistration Becoming the Norm in Psychological Science
Author(s): Brian Nosek and Stephen Lindsay
Type of resources: Reading, blog
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Blog
Link to resource
Concerns have been raised recently about the replicability of behavioral priming effects, and calls have been issued to identify …
Author(s): Joseph Cesairo
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
What can we, as users of microdata, formally guarantee to the individuals (or firms) in our dataset, regarding their privacy? We retell …
Author(s): Heffetz, Ori, and Katrina Liggett.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
The idea that birth-order position has a lasting impact on personality has been discussed for the past 100 years. Recent large-scale …
Author(s): Julia M Rohrer, Boris Egloff, Stefan C Schmukle
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background. The p-curve is a plot of the distribution of p-values reported in a set of scientific studies. Comparisons between ranges …
Author(s): Bishop, D. V, & Thompson, P. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Project TIER (Teaching Integrity in Empirical Research) promotes the integration of principles and practices related to transparency …
Author(s): TIER Team
Type of resources: Activity/Lab, Asssessment, Homework/Assignment, Lesson Plan, Module, Syllabus
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Framework, Reproducibility Knowledge
Link to resource
Author guidelines for journals could help to promote transparency, openness, and reproducibility
Author(s): Nosek et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Social scientists should adopt higher transparency standards to improve the quality and credibility of research.
Author(s): Miguel, E., C. Camerer, K. Casey, J. Cohen, K. M. Esterling, A. Gerber, R. Glennerster, D. P. Green, M. Humphreys, G. Imbens, D. Laitin, T. Madon, L. Nelson, B. A. Nosek, M. Petersen, R. Sedlmayr, J. P. Simmons, U. Simonsohn, M. Van der Laan.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A statistics book and tutorial about statistics
Author(s): Dr Matt Crump
Type of resources: Data Set, Full Course, Lecture, Lecture Notes, Lesson, Lesson Plan, Module, Reading, Student Guide, Syllabus, Teaching/Learning Strategy, Tutorial, Textbook
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Statistical Book, Tutorial
Link to resource
This article summarizes evidence and issues associated with psychological assessment. Data from more than 125 meta-analyses on test …
Author(s): Meyer et al.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science
Tag(s):
Link to resource
Psychologists must change the way they conduct and report their research—this notion has been the topic of much debate in recent years. …
Author(s): Heather M. Fuchs, Mirjam Jenny, Susann Fiedler
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In 2010–2012, a few largely coincidental events led experimental psychologists to realize that their approach to collecting, analyzing, …
Author(s): Leif D. Nelson, Joseph Simmons, and Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Psychology advances knowledge by testing statistical hypotheses using empirical observations and data. The expectation is that most …
Author(s): Patrick E. Shrout and Joseph L. Rodgers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The past several years have been a time for soul searching in psychology, as we have gradually come to grips with the reality that some …
Author(s): Scott O. Lilienfeld
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Science is facing a “replication crisis” in which many experimental findings cannot be replicated and are likely to be false. Does this …
Author(s): Nissen, S. B., Magidson, T., Gross, K., & Bergstrom, C. T.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Few models of self-control have generated as much scientific interest as has the limited strength model. One of the entailments of this …
Author(s): Evan C. Carter and Michael E. McCullough
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background: The p value obtained from a significance test provides no information about the magnitude or importance of the underlying …
Author(s): Anton Kuhberger, Astrid Fritz, Thomas Scherndl
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We studied publication bias in the social sciences by analyzing a known population of conducted studies—221 in total—in which there is …
Author(s): Annie Franco, Neil Malhotra, Gabor Simonovits
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
There is some evidence that in fields where statistical tests of significance are commonly used, research which yields nonsignificant …
Author(s): Theodore D. Sterling
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Confirmatory bias is the tendency to emphasize and believe experiences which support one’s views and to ignore or discredit those …
Author(s): Michael J. Mahoney
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
When consumers of science (readers and reviewers) lack relevant details about the study design, data, and analyses, they cannot …
Author(s): S. Vazire
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The current discussion of questionable research practices (QRPs) is meant to improve the quality of science. It is, however, important …
Author(s): Klaus Fiedler and Norbert Schwarz
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This practical guide provides more than 150 recipes to help you generate high-quality graphs quickly, without having to comb through …
Author(s): Winston Chang
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Book, Software, R
Link to resource
C. Glenn Begley and Lee M. Ellis propose how methods, publications and incentives must change if patients are to benefit.
Author(s): C. Glenn Begley and Lee M. Ellis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
According to R.A. Fisher, randomization “relieves the experimenter from the anxiety of considering innumerable causes by which the data …
Author(s): Uwe Saint-Mont
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Replicability of findings is at the heart of any empirical science. The aim of this article is to move the current replicability debate …
Author(s): Asendorpf et al.
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In contrast to the truncated view that replications have only a little to offer beyond what is already known, we suggest a broader …
Author(s): Joachim Hüffmeier, Jens Mazei and Thomas Schultze
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We propose to change the default P-value threshold for statistical signifcance from 0.05 to 0.005 for claims of new discoveries.
Author(s): Daniel J. Benjamin
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Language can be viewed as a complex set of cues that shape people’s mental representations of situations. For example, people think of …
Author(s): Eerland, A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Open Science, Registered Reports
Link to resource
In an anonymous 4-person economic game, participants contributed more money to a common project (i.e., cooperated) when required to …
Author(s): Bouwmeester, S., Verkoeijen, P. P., Aczel, B., Barbosa, F., Bègue, L., Brañas-Garza, P., ... & Evans, A. M.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Trying to remember something now typically improves your ability to remember it later. However, after watching a video of a simulated …
Author(s): Alogna, V. K et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Open Science, Registered Reports
Link to resource
According to the facial feedback hypothesis, people’s affective responses can be influenced by their own facial expression (e.g., …
Author(s): Wagenmakers et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Finkel, Rusbult, Kumashiro, and Hannon (2002, Study 1) demonstrated a causal link between subjective commitment to a relationship and …
Author(s): Cheung, I., Campbell, L., LeBel, E. P., Ackerman, R. A., Aykutoğlu, B., Bahník, Š., ... & Carcedo, R. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Registered reports a Method to Increase the Credibility of Published Results
Author(s): Brian Nosek and Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
An article about registered Reports: A new publishing initiative at Cortex
Author(s): Christopher Chambers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog post about choosing Bayes Factor over p-value
Author(s): Ulrich Schimmack
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
In a direct replication, the typical goal is to reproduce a prior experimental result with a new but comparable sample of participants …
Author(s): Jacob Westfall, Charles M. Judd, David A. Kenny
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution
Link to resource
Blog post going over the replication crisis and how it has led to the open science movement.
Author(s): David Funder
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Open Science, Reproducibility Crisis and Credibility Revolution
Link to resource
Replications and robustness checks are key elements of the scientific method and a staple in many disciplines. However, leading …
Author(s): Greg J Duncan, Mimi Engel, Amy Claessens, Chantelle J Dowsett
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The field of replication studies remains a controversial, misunderstood, and unappreciated piñata of 18 replication typologies spanning …
Author(s): Fernando Martel García
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The reproducibility of psychological findings has generated much discussion of late. However, the question of replication is not a new …
Author(s): Michael Pettit
Type of resources: Interactive
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Blog, Reproducibility Knowledge
Link to resource
Many published research results are false (Ioannidis, 2005), and controversy continues over the roles of replication and publication …
Author(s): Richard McElreath, Paul E. Smaldino
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recent controversies in psychology have spurred conversations about the nature and quality of psychological research. One topic …
Author(s): Matthew C. Makel, Jonathan A. Plucker, and Boyd Hegarty
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog that summarises a reply to Uri Simonsohn’s Critique of Default Bayesian Tests
Author(s): Jeff Rouder
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Life Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
Statistical practice in psychological science is undergoing reform which is reflected in part by strong recommendations for reporting …
Author(s): Jolynn Pek and David B Flora
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Serving mugs of Reproducibili☕️: Blends include transparency, openness and robustness + a spoonful of science.
Author(s): Sophia Cruwell, Amy Orben and Sam Parsons
Type of resources: Student Guide, Unit of Study
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Objectives: We aim to introduce the discussion on the crisis of confidence to sport and exercise psychology. We focus on an important …
Author(s): Schweizer, G., & Furley, P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
A syllabus about evaluating research methods
Author(s): Morton-Ann Gernsbacher
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Applied Science, Education, Social Science
Tag(s): Syllabus
Link to resource
Recent studies have indicated that research practices in psychology may be susceptible to factors that increase false-positive rates, …
Author(s): Kou Murayama, Reinhard Pekrun, Klaus Fiedler
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog about pre-registration
Author(s): Lindsay, D.S., Simons, D.J., Lilienfeld, S.O.
Type of resources: Blog
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Blog
Link to resource
Many psychology studies are statistically underpowered. In part, this may be because many researchers rely on intuition, rules of …
Author(s): Bakker et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
A website about moderation and mediation
Author(s): Kristopher J. Preacher
Type of resources: Lesson
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Website
Link to resource
Gilbert et al. conclude that evidence from the Open Science Collaboration’s Reproducibility Project: Psychology indicates high …
Author(s): Christopher J. Anderson et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
How easy is it to change people’s minds? In 2014, a Science study suggested that a short conversation could have a lasting impact on …
Author(s): Alison McCook
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Math & Statistics, Physical Science, Social Science
Tag(s): Blog
Link to resource
Social science journal reviewers (N=8) responded to questionnaires regarding their reviewing history, and attitudes towards and …
Author(s): Neuliep, J W; Crandall, R.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Although replications are vital to scientific progress, psychologists rarely engage in systematic replication efforts. In this article, …
Author(s): Sander L Koole, Daniël Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Lack of reproducibility is an ongoing problem in some areas of the biomedical sciences. Poor experimental design and a failure to …
Author(s): Masca et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
An essential first step in planning a confirmatory or a replication study is to determine the sample size necessary to draw …
Author(s): Marco Perugini, Marcello Gallucci, and Giulio Costantini
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Recent events have led psychologists to acknowledge that the inherent uncertainty encapsulated in an inductive science is amplified by …
Author(s): Daniel Lakens and Ellen R K Evers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The American Psychological Association (APA) Task Force on Statistical Inference was formed in 1996 in response to a growing body of …
Author(s): Jacob M Marszalek, Carolyn Barber, Julie Kohlhart, Cooper B Holmes
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This review examines recent advances in sample size planning, not only from the perspective of an individual researcher, but also with …
Author(s): Scott E. Maxwell, Ken Kelley and Joseph R. Rausch
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Methods for planning sample size (SS) for the standardized mean difference so that a narrow confidence interval (CI) can be obtained …
Author(s): Ken Kelley 1, Joseph R Rausch
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
The sample size necessary to obtain a desired level of statistical power depends in part on the population value of the effect size, …
Author(s): Anderson, S. F., Kelley, K., & Maxwell, S. E.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Using 50,000 tests published in the AER, JPE, and QJE, we identify a residual in the distribution of tests that cannot be explained …
Author(s): Sangnier, M., & Zylberberg, Y.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Functional neuroimaging techniques have transformed our ability to probe the neurobiological basis of behaviour and are increasingly …
Author(s): Russell A. Poldrack, Chris I. Baker, Joke Durnez, Krzysztof J. Gorgolewski, Paul M. Matthews, Marcus R. Munafò, Thomas E. Nichols, Jean-Baptiste Poline, Edward Vul & Tal Yarkoni
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of …
Author(s): Stefan Schmidt
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A podcast about science and pseudoscience
Author(s): London School of Economics and Political Science
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
The current crisis in psychological research involves issues of fraud, replication, publication bias, and false positive results. I …
Author(s): Giner-Sorolla, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This article uses distributional matching and posterior predictive checks to estimate the extent of false and inflated findings in …
Author(s): BRENT GOLDFARB and ANDREW A. KING
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
An academic scientist’s professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, …
Author(s): Nosek, B. A., Spies, J. R., & Motyl, M.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Existing norms for scientific communication are rooted in anachronistic practices of bygone eras making them needlessly inefficient. We …
Author(s): Brian A. Nosek & Yoav Bar-Anan
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Replication is vital for increasing precision and accuracy of scientific claims. However, when replications “succeed” or “fail,” they …
Author(s): Charles R. Ebersole, Jordan R. Axt, Brian A. Nosek
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This blog describes how to plot effect sizes (Cohen’s d) and shade overlapping area with R scripts
Author(s): Kristoffer Magnusson
Type of resources: Reading, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Tutorial
Link to resource
Our field has witnessed a rapid increase in the appeal and prevalence of the short report format over the last two decades. In this …
Author(s): Alison Ledgerwood, Jeffrey W. Sherman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Visual comics about significance testing
Author(s): Randall Munroe
Type of resources: Diagram/Illustration
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Comic
Link to resource
Null-hypothesis significance tests (NHST), properly used, tell us whether we have sufficient evidence to be confident of the sign of …
Author(s): Richard J. Harris
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, …
Author(s): Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A paper about social, behavioural economic perspective on reproducible science
Author(s): Cacioppo, J. T., Kaplan, R. M., Krosnick, J. A., Olds, J. L., & Dean, H.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A video about open science, pre-registration etc.
Author(s): Society for Social and Personality Psychology
Type of resources: Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video, Reproducibility Knowledge
Link to resource
A website detailing spurious correlations
Author(s): Tyler Vigen
Type of resources: Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Math & Statistics, Social Science
Tag(s): Website
Link to resource
Across the social sciences, growing concerns about research transparency have led to calls for pre-analysis plans (PAPs) that specify …
Author(s): Winston Lin and Donald P.Green
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This site is about everything that comes up during data analysis except for statistical modelling and inference. This might strike you …
Author(s): Jenny Bryan
Type of resources: Reading, Student Guide, Tutorial
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Tutorial
Link to resource
Interpreting statistical data as evidence, Statistical Evidence: A Likelihood Paradigm focuses on the law of likelihood, fundamental to …
Author(s): Richard Royall
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Book
Link to resource
In the light of continuing debate over the applications of significance testing in psychology journals and following the publication of …
Author(s): Wilkinson, L., & Task Force on Statistical Inference, American Psychological Association, Science Directorate.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A blog about statistics and open science
Author(s): Andrew Gelman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Reproducibility Knowledge
Link to resource
Researchers designing experiments in which a sample of participants responds to a sample of stimuli are faced with difficult questions …
Author(s): Jacob Westfall, David A Kenny, Charles M Judd
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The purpose of this study is to determine how well contemporary management research fares on the issue of statistical power with regard …
Author(s): Luke H. Cashen, Scott W. Geiger
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This paper discusses the need and importance of statistical power analysis in field-based empirical research in Production and …
Author(s): Rohit Verma and John C. Goodale
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Power was calculated for 6,155 statistical tests in 221 journal articles published in the 1982 volumes of the Journal of Abnormal …
Author(s): J S Rossi
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Due to the increasing importance of moderating (i.e., interaction) effects, the use of moderated multiple regression (MMR) has become …
Author(s): Herman Aguinis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Objective. —To describe the pattern over time in the level of statistical power and the reporting of sample size calculations in …
Author(s): David Moher, MSc; Corinne S. Dulberg, PhD, MPH; George A. Wells, PhD
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Justification, in the vernacular language of philosophy of science, refers to the evaluation, defense, and confirmation of claims of …
Author(s): Rosnow, R.L., & Rosenthal, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Statistical analysis is error prone. A best practice for researchers using statistics would therefore be to share data among …
Author(s): Coosje L. S. Veldkamp, 1, * Michèle B. Nuijten, Linda Dominguez-Alvarez, Marcel A. L. M. van Assen, and Jelte M. Wicherts
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
A video about Statistical Rethinking: A Bayesian Course with R
Author(s): Richard McElreath
Type of resources: Lecture, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Video, Bayesian
Link to resource
In light of recent concerns about reproducibility and replicability, the ASA issued a Statement on Statistical Significance and …
Author(s): Blakeley B. McShane & David Gal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
MOST THEORIES IN THE AREAS OF PERSONALITY, CLINICAL, AND SOCIAL PSYCHOLOGY PREDICT ONLY THE DIRECTION OF A CORRELATION, GROUP …
Author(s): Lykken
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Data analysis methods in psychology still emphasize statistical significance testing, despite numerous articles demonstrating its …
Author(s): F.L. Schmidt
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Misinterpretation and abuse of statistical tests, confidence intervals, and statistical power have been decried for decades, yet remain …
Author(s): Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A podcast about stereotype threat and replication
Author(s): Simon Adler, Amanda Aronczyk and Dan Engber
Type of resources: Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
certain systematic methods of scientific thinking may produce much more rapid progress than others.
Author(s): John R Platt
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The application of statistics to science is not a neutral act. Statistical tools have shaped and were also shaped by its objects. In …
Author(s): Gerd Gigerenzer and Julian N. Marewski
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Swirl teaches you R programming and data science interactively, at your own pace, and right in the R console!
Author(s): Anon
Type of resources: Activity/Lab, Homework/Assignment, Student Guide, Teaching/Learning Strategy, Tutorial
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics
Tag(s): Tutorial
Link to resource
A collection of activities to teach APA writing and statistics
Author(s): Lewandowski, Jr., Ciarocco and Strohmetz
Type of resources: Activity/Lab, Asssessment
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Replication is held as the gold standard for ensuring the reliability of published scientific literature. But conducting direct …
Author(s): Michael C. Frank and Rebecca Saxe
Type of resources: Primary Source, Reading, Paper
Primary user(s): Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution
Link to resource
This symposium explores the “replication crisis” from the perspective of teachers and students. Presenters will describe the major …
Author(s): Bradford Wiggins
Type of resources: Lecture, Lecture Notes, Syllabus
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): OSF Project
Link to resource
Participants will develop materials for teaching replicability and reproducible science. Possible materials to be generated include …
Author(s): Lane et al.
Type of resources: Lesson, Teaching/Learning Strategy
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Knowledge
Link to resource
An excel spreadsheet about collection of open science items
Author(s): Courtney Soderberg
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Knowledge
Link to resource
A paper about Ten Simple Rules for Effective Statistical Practice
Author(s): Robert E.Kass et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A paper about ten Simple Rules for the Care and Feeding of Scientific Data
Author(s): Goodman, Alyssa, et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In order to study the prevalence, nature (direction), and causes of reporting errors in psychology, we checked the consistency of …
Author(s): Marjan Bakker & Jelte M. Wicherts
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Depression severity is assessed in numerous research disciplines, ranging from the social sciences to genetics, and used as a dependent …
Author(s): Eiko I.Fried
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A post that describes significance values
Author(s): Dorothy Bishop
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Education, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Reproducibility Crisis and Credibility Revolution
Link to resource
The many criticisms of null hypothesis testing suggest when it is not useful and what is should not be used for. This article explores …
Author(s): R.W. Frick
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics
Tag(s):
Link to resource
An editorial about p value
Author(s): Ronald L. Wasserstein & Nicole A. Lazar
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Science studies scholars have shown that the management of natural complexity in lab settings is accomplished through a mixture of …
Author(s): David Peterson
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this episode JP and Alex interview Zoltan Dienes. They discuss Zoltan’s passion for the martial arts, why Bayesian inference …
Author(s): Prof. JP De Ruiter
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Podcast
Link to resource
Blog about Bayesfactor and statistics
Author(s): Richard Morey
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
An abstract about bayesian reproducibility project
Author(s): Alexander Etz
Type of resources: Data Set, Reading, Simulation, R code
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Blog, R code
Link to resource
Three psychologists talk about doing science. Hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire.
Author(s): Sanjay Srivastava, Alexa Tullett, and Simine Vazire
Type of resources: Student Guide, Unit of Study, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
In recent years the use of traditional statistical methods in educational research has increasingly come under attack. In this article, …
Author(s): Ronald P Carver
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The issue of a published literature not representative of the population of research is most often discussed in terms of entire studies …
Author(s): Ernest Hugh O’Boyle, Jr., George Christopher Banks, Erik Gonzalez-Mulé
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Notes that social psychologists' early enthusiasm has been replaced by serious doubts about the future of their field. Difficulties in …
Author(s): A.C. Elms
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
When considering any statistical tool I think it is useful to answer the following two practical questions: 1. “Does it give …
Author(s): Uri Simonsohn
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog
Link to resource
After 4 decades of severe criticism, the ritual of null hypothesis significance testing (mechanical dichotomous decisions around a …
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A growing body of research has suggested that horizontal saccadic eye movements facilitate the retrieval of episodic memories in free …
Author(s): Matzke et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
Most discussions of rigor and replication focus on empirical practices (methods used to collect and analyze data). Typically overlooked …
Author(s): Mark Schaller
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Psychology has been criticized recently for a range of research quality issues. The current article organizes these problems around the …
Author(s): Matthew Makel
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Publication bias is the tendency on the parts of investigators, reviewers, and editors to submit or accept manuscripts for publication …
Author(s): Kay Dickersin
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A few years back, a famous psychologist published a series of studies that found people could predict the future — not all the time, …
Author(s): Planet Money
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
A focus on novel, confirmatory, and statistically significant results leads to substantial bias in the scientific literature. One type …
Author(s): Head, M. L., Holman, L., Lanfear, R., Kahn, A. T., & Jennions, M. D.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The reliability and reproducibility of science are under scrutiny. However, a major cause of this lack of repeatability is not being …
Author(s): Lewis G Halsey, Douglas Curran-Everett, Sarah L Vowler & Gordon B Drummond
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
For any given research area, one cannot tell how many studies have been conducted but never reported. The extreme view of the …
Author(s): R.Rosenthal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recent controversies have questioned the quality of scientific practice in the field of psychology, but these concerns are often based …
Author(s): Gregory Francis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Data-dependent analysis—a “garden of forking paths”— explains why many statistically significant comparisons don’t hold up.
Author(s): Andrew Gelman and Eric Loken
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Survey experiments have become a central methodology across the social sciences. Researchers can combine experiments’ causal power with …
Author(s): Kevin J. Mullinix et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We present a simple mathematical technique that we call granularity-related inconsistency of means (GRIM) for verifying the summary …
Author(s): Nicholas J. L. Brown, James A. J. Heathers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Blogposts about psychology, reproducibility, replication etc.
Author(s): Sanjay Srivastava
Type of resources: Reading
Primary user(s): Student, Researcher
Subject area(s): Math & Statistics, Social Science
Tag(s): Blog, Reproducibility Knowledge
Link to resource
Three historical episodes in which the application of null hypothesis significance testing (NHST) led to the mis-interpretation of data …
Author(s): Ezra Hauer
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
A podcast about replication crisis
Author(s): Shankar Vedantam and Maggie Penman
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
Cohen (1962) pointed out the importance of statistical power for psychology as a science, but statistical power of studies has not …
Author(s): Schimmack U
Type of resources: Primary Source, Reading, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Adrianus Dingeman de Groot (1914-2006) was one of the most influential Dutch psychologists. He became famous for his work …
Author(s): De Groot, A. D. translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han LJ van der Maas
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
Course on computer sciences skills needed for all scientific research
Author(s): MIT
Type of resources: Full Course
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Career and Technical Education, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Computer Sciences
Link to resource
The authors evaluate the quality of research reported in major journals in social-personality psychology by ranking those journals with …
Author(s): R. Chris Fraley, Simine Vazire
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Poor research design and data analysis encourage false-positive findings. Such poor methods persist despite perennial calls for …
Author(s): Smaldino, P. E., & McElreath, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A video about Confidence Intervals, NHST, and p Values
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Video
Link to resource
A video about effect sizes and confidence intervals
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics, Social Science
Tag(s): Video
Link to resource
A video about meta analysis and meta-analytical thinking
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Video
Link to resource
A video about power analysis and precision
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics
Tag(s): Video
Link to resource
A video about Research Integrity & the New Statistics
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Video, Reproducibility Knowledge
Link to resource
A video about New statistics in action
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video
Link to resource
We need to make substantial changes to how we conduct research. First, in response to heightened concern that our published research …
Author(s): Geoff Cumming
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A chapter about null hypothesis significance testing in personality research
Author(s): R. Chris Fraley and Michael J. Marks
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A chapter about significance testing
Author(s): Gerd Gigerenzer, Stefan Krauss, and Oliver Vitouch
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
A collection about open science
Author(s): Sonja Bezjak, Philipp Conzett, Pedro L. Fernandes, Edit Görögh, Kerstin Helbig, Bianca Kramer, Ignasi Labastida, Kyle Niemeyer, Fotis Psomopoulos, Tony Ross-Hellauer, René Schneider, Jon Tennant, Ellen Verbakel
Type of resources: Activity/Lab, Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Openness is one of the central values of science. Open scientific practices such as sharing data, materials and analysis scripts …
Author(s): Richard Morey et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Peer-Review
Link to resource
Underpowered studies persist in the psychological literature. This article examines reasons for their persistence and the effects on …
Author(s): S.E. Maxwell
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which …
Author(s): Martin Schweinsberg et al.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The origin of the present comment lies in a failed attempt to obtain, through e-mailed requests, data reported in 141 empirical …
Author(s): Wicherts, Jelte M., Borsboom, Denny, Kats, Judith, Molenaar, Dylan
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The syntax or codes used to fit Structural Equation Models (SEMs) convey valuable information on model specifications and the manner in …
Author(s): Jelte M. Wicherts and Elise A. V. Crompvoets
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. …
Author(s): Brian A. Nosek, Charles R. Ebersole, Alexander C. DeHaven, and David T. Mellor
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
This study documents reporting errors in a sample of over 250,000 p-values reported in eight major psychology journals from 1985 until …
Author(s): Michèle B. Nuijten, Chris H. J. Hartgerink, Marcel A. L. M. van Assen, Sacha Epskamp & Jelte M. Wicherts
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Statistically underpowered studies can result in experimental failure even when all other experimental considerations have been …
Author(s): Cremers, H. R., Wager, T. D., & Yarkoni, T.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science, Math & Statistics
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In science, replication is the process of repeating research to determine the extent to which findings generalize across time and …
Author(s): Edward Diener and Robert Biswas-Diener
Type of resources: Primary Source, Reading, Blog
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Psychological scientists have recently started to reconsider the importance of close replications in building a cumulative knowledge …
Author(s): Brandt et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Scientists are dedicating more attention to replication efforts. While the scientific utility of replications is unquestionable, the …
Author(s): Adam K. Fetterman and Kai Sassenberg
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
If science were a game, a dominant rule would probably be to collect results that are statistically significant. Several reviews of the …
Author(s): Marjan Bakker, Annette van Dijk, Jelte M. Wicherts
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The scientific quality of social and personality psychology has been debated at great length in recent years. Despite research on the …
Author(s): Motyl et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
An article about statistical power of abnormal and social psychology
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science, Social Science
Tag(s):
Link to resource
Statistical reasoning is an art and so demands both mathematical knowledge and informed judgment. When it is mechanized, as with the …
Author(s): Gerd Gigerenzer
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
I just published a new interactive visualization in my series of basic statistical concepts and techniques. This time I am trying to …
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
A blog about The Test of Insufficient Variance (TIVA): A New Tool for the Detection of Questionable Research Practices
Author(s): Shimmack, U.
Type of resources: Blog
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Reproducibility is the cornerstone of science. If an effect is reliable, any competent researcher should be able to obtain it when …
Author(s): Daniel Simons
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Although many researchers agree that scientific data should be open to scrutiny to ferret out poor analyses and outright fraud, most …
Author(s): Jeffrey N. Rouder
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Theories in “soft” areas of psychology (e.g., clinical, counseling, social, personality, school, and community) lack the …
Author(s): Meehl, P. E
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Meeting a crucial need for graduate students and newly minted researchers, this innovative text provides hands-on tools for generating …
Author(s): James Jaccard, Jacob Jacoby
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Book
Link to resource
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and …
Author(s): Paul E.Meehl
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This is an account of what I have learned (so far) about the application of statistics to psychology and the other sociobiomedical …
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
There is increasing evidence that scientific misconduct is more common than previously thought. Strong emphasis on scientific …
Author(s): Joeri K. Tijdink, Reinout Verbeke, Yvo M. Smulders
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Psychology journals rarely publish nonsignificant results. At the same time, it is often very unlikely (or “too good to be true”) that …
Author(s): Lakens, D., & Etz, A. J.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This report identifies useful and available tools and techniques for the deidentification of personal information from interoperable …
Author(s): Ross Fraser and Don Willison
Type of resources: Reading
Primary user(s): Administrator, Researcher
Subject area(s): Life Science, Social Science
Tag(s):
Link to resource
Recent reports have suggested that many published results are unreliable. To increase the reliability and accuracy of published papers, …
Author(s): Hartshorne, J. K., & Schachner, A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Demand is growing for evidence-based policy making, but there is also growing recognition in the social science community that limited …
Author(s): Berkeley Initiative for Transparency in the Social Sciences
Type of resources: Full Course, Lecture, Module, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Course, Video, Reproducibility Knowledge
Link to resource
This is an exciting time to be a psychological scientist. There is a major new movement that seeks to promote the credibility and …
Author(s): David Mellor, Simine Vazire and D. Lindsay
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A paper about Open Your Data and Code
Author(s): Victoria Stodden
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Meta-analyses are often accompanied by two popular forms of data visualization: forest plots and funnel plots. In this post, I’ll show …
Author(s): John K. Sakaluk
Type of resources: Reading, R code
Primary user(s): Student, Teacher
Subject area(s): Life Science, Math & Statistics, Social Science
Tag(s): Blog, Tutorial
Link to resource
ggplot2, as I’ve already made clear, is one of my favourite packages for R. And since that original post about ggplot2 remains one of …
Author(s): John K. Sakaluk
Type of resources: Reading, R code
Primary user(s): Student, Teacher
Subject area(s): Life Science, Math & Statistics, Social Science
Tag(s): Blog, Tutorial
Link to resource
With this post, I’m going to be showing how you can use the psych package in conjunction with ggplot2 in order to create a prettier …
Author(s): John K Sakaluk
Type of resources: Reading, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Tutorial
Link to resource
Many scholars have raised concerns about the credibility of empirical findings in psychology, arguing that the proportion of false …
Author(s): Annie Franco, Neil Malhotra, and Gabor Simonovits
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog about bayesian statistics
Author(s): Alexander Etz
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
An abstract about Understanding Bayes and visualising Bayes Factor
Author(s): Alexander Etz
Type of resources: Diagram/Illustration, Reading, Student Guide, Teaching/Learning Strategy, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, R code
Link to resource
How can we objectively define categories of truth in scientific thinking? How can we reliably measure the results of research? In this …
Author(s): Zoltan Dienes
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
Much has been said about significance testing – most of it negative. Methodologists constantly point out that researchers misinterpret …
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
Why most published scientific research is probably false
Author(s): The Economist
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video
Link to resource
Sharing data, materials, and analysis scripts with reviewers and readers is valued in psychological science. To facilitate this …
Author(s): Courtney K. Soderberg
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Concerns about a lack of reproducibility of statistically significant results have recently been raised in many fields, and it has been …
Author(s): Anna Drebner et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
I often get asked how to fit different multilevel models (or individual growth models, hierarchical linear models or linear …
Author(s): Kristoffer Magnusson
Type of resources: Reading, R code
Primary user(s): Student, Teacher, Researcher
Subject area(s): Education, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Tutorial
Link to resource
Here I outline some of what science can tell us about the problems in psychological publishing and how to best address those problems. …
Author(s): Brett T. Buttliere
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog post and tutorial on visualizing one-way ANOVA
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Reading, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interactive, Tutorial
Link to resource
Three mostly positive developments in academic psychology—the cognitive revolution, the virtual requirement for multiple study reports …
Author(s): Robert B. Cialdini
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A critique about Daryl Bem’s (2011) paper and reproducibility
Author(s): Arina K Bones
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The self-correcting nature of psychological and educational science has been seriously questioned. Recent special issues of …
Author(s): Matthew T. McBee, Michael S. Matthews
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Blog post going over the p value, misnomers and what p < .05 means
Author(s): Daniel Lakens
Type of resources: Reading, R Code
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Blog, Code, Reproducibility Crisis and Credibility Revolution
Link to resource
We review the literature on evidence-based best practices on how to enhance methodological transparency, which is the degree of detail …
Author(s): Herman Aguinis, Ravi S. Ramani and Nawaf Alabduljader
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This chapter considers various factors that have been responsible for the comparatively slow development of psychology into a …
Author(s): David T. Lykken
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
This chapter considers problems with null hypothesis significance testing (NHST). The literature in this area is quite large. D. …
Author(s): R.B. Kline
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
When designing a study, the planned sample size is often based on power analyses. One way to choose an effect size for power analyses …
Author(s): Casper Albers and Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This paper explains how to select the correct statistical test for a research project, clinical trial, or other investigation. The …
Author(s): Evie McCrum-Gardner
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A video about psychology being trouble
Author(s): SciShow/Michael Aranda
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Video
Link to resource
Newly discovered true (non-null) associations often have inflated effects compared with the true effect sizes. I discuss here the main …
Author(s): John P A Ioannidis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Low power in experimental psychology is an oft-discussed problem. We show in the context of the Replicability Project: Psychology (Open …
Author(s): Richard Morey and Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
There is increasing concern that most current published research findings are false. The probability that a research claim is true may …
Author(s): John Ioannidis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This post discusses the why p value around .048 should be rare
Author(s): Simine Vazire
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Blog
Link to resource
Does psi exist? D. J. Bem (2011) conducted 9 studies with over 1,000 participants in an attempt to demonstrate that future events …
Author(s): Wagenmakers, E.-J., Wetzels, R., Borsboom, D., & van der Maas, H. L. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
“Important findings” haven’t been replicated, and science may have to change its ways.
Author(s): Michelle N.Meyer and Christopher Chabris
Type of resources: Blog
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Blog, Open Science, Reproducibility Crisis and Credibility Revolution
Link to resource
Null hypothesis testing of correlational predictions from weak substantive theories in soft psychology is subject to the influence of …
Author(s): Paul Meehl
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background: The widespread reluctance to share published research data is often hypothesized to be due to the authors’ fear that …
Author(s): Jelte M. Wicherts, Marjan Bakker, Dylan Molenaar
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Psychology is working on the hardest problems in all of science. Physics, astronomy, geology — those are easy, by comparison. …
Author(s): David McRaney
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
Statistical power depends on the size of the effect of interest. However, effect sizes are rarely fixed in psychological research: …
Author(s): Blakeley B McShane, Ulf Böckenholt
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The hypothesis of a Hierarchy of the Sciences with physical sciences at the top, social sciences at the bottom, and biological sciences …
Author(s): Daniele Fanelli
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Fill out the form below or here is the direct link to open the Google form in a new window