Conceptual and Statistical Knowledge

 

On the plurality of (methodological) worlds: estimating the analytic flexibility of fMRI experiments

How likely are published findings in the functional neuroimaging literature to be false? According to a recent mathematical model, the potential for false positives increases with the flexibility of analysis methods. Functional MRI (fMRI) experiments …

On the Surprising Longevity of Flogged Horses: Why There Is a Case for the Significance Test

Criticisms of null-hypothesis significance tests (NHSTs) are reviewed. Used as formal, two-valued decision procedures, they often generate misleading conclusions. However, critics who argue that NHSTs are totally meaningless because the null …

On the Use and Misuses of Preregistration: A Reply to Klonsky (2024)

In his commentary, Klonsky (2024) outlines several arguments for why preregistration mandates (PRMs) will have a negative impact on the field. Klonsky’s overarching concern is that when preregistration ceases to be a tool for research and becomes an …

One cheer for null hypothesis significance testing

Null hypothesis testing as a tool in research is defended. Six examples are offered of situations in which, if all the researcher could do was "reject H₀ at α = .05" the scientific contribution would still be substantial. The examples are drawn from …

Open and Reproducible Methods Syllabus

This course will examine current controversies and new developments in research methods in psychology. The goal of the course is to learn to think critically about how psychological science is conducted and how conclusions are drawn. We will cover …

Open and Reproducible Research in Psychology

Psychological research is in the midst of what has been called the “replication crisis”, in which questions have been raised about the validity of even seminal research findings. How can we tell if the research we’re reading and doing is rigorous and …

Open and reproducible science

This course is designed to be delivered to master and doctoral students at the Universidade Federaldo Rio Grande do Sul (UFRGS). The structure is organized to (1) provide basic skills to enhance overall transparency and methodological …

Open and Reproducible Science Syllabus

To provide educators with an example of how they can draw resources from FORRT’s educational nexus to integrate open scholarship into their teaching, FORRT has developed an Open and Reproducible Science 101 syllabus. FORRT’s syllabus was developed …

Open for Insight (Experimental Methods + Open Science)

A syllabus about open science and experimental methods

Open Science & Inclusive Psychology

This course is an introduction to the Open Science approach to psychology. We will investigate if how the field has experienced a “replicability crisis” and explore the potential structural and methodological factors that may be creating false …