Reproducibility and Replicability Knowledge

 

The Replication Crisis in Psychology

In science, replication is the process of repeating research to determine the extent to which findings generalize across time and across situations. Recently, the science of psychology has come under criticism because a number of research findings do …

Constraints on generality statements are needed to define direct replication

Whether or not a replication attempt counts as “direct” often cannot be determined definitively after the fact as a result of flexibility in how procedural differences are interpreted. Specifying constraints on generality in original articles can …

Der Umgang mit Forschungsdaten im Fach Psychologie: Konkretisierung der DFG-Leitlinien. [Data Management in Psychological Science: Specification of the DFG Guidelines].

Calls for public access to research data have been ongoing for some time. For instance, in their “Recommendations for Secure Storage and Availability of Digital Primary Research Data” (2009) the German Research Foundation (“Deutsche …

Is There a Free Lunch in Inference?

The field of psychology, including cognitive science, is vexed by a crisis of confidence. Although the causes and solutions are varied, we focus here on a common logical problem in inference. The default mode of inference is significance testing, …

Opening Science

The Evolving Guide on How the Internet is Changing Research, Collaboration and Scholarly Publishing

Priming, Replication, and the Hardest Science

Concerns have been raised recently about the replicability of behavioral priming effects, and calls have been issued to identify priming methodologies with effects that can be obtained in any context and with any population. I argue that such …

Quality Uncertainty Erodes Trust in Science

When consumers of science (readers and reviewers) lack relevant details about the study design, data, and analyses, they cannot adequately evaluate the strength of a scientific study. Lack of transparency is common in science, and is encouraged by …

The crisis of confidence in social psychology.

Notes that social psychologists' early enthusiasm has been replaced by serious doubts about the future of their field. Difficulties in conducting research, unfulfilled expectations about research payoffs, and outside pressures had all contributed to …

The meaning of “significance” for different types of research

Adrianus Dingeman de Groot (1914-2006) was one of the most influential Dutch psychologists. He became famous for his work "Thought and Choice in Chess", but his main contribution was methodological--De Groot co-founded the Department of Psychological …

The Null Hypothesis Significance-Testing Debate and Its Implications for Personality Research

A chapter about null hypothesis significance testing in personality research
JUST-OS