Reproducibility and Replicability Knowledge

 

There Is No Theory Crisis in Psychological Science

Numerous scholars believe that there is a crisis in psychology because of the “poor quality” of our theories. However, we believe that it is misleading to suggest that psychology is going through a “theory crisis” because the major shortcomings of …

Toolkit for Aligning Incentives 2.0

Colleges and universities largely exist to advance knowledge for the public good through research, teaching, and public service. Yet, for far too long academic incentive systems have been misaligned with the foundational values upon which …

Tópicos Especiais em Biotecnologia: Planejamento e Otimização de Experimentos

A crise de confiança na ciência. Práticas e condutas questionáveis na pesquisa. Delineamento experimental adequado. Definição de variáveis. Armadilhas à validade. Cálculo amostral. Transparência na pesquisa. Pré-registro. Dados e código aberto.

Topics in Social Psychology and Personality

This seminar class will focus on the theme of Reproducibility in Social Psychology. We will discuss issues surrounding open science as well as the “replication crisis” in social psychology.

Toward a More Accurate Notion of Exploratory Research (And Why it Matters)

The paper analyzes the notion of exploration that can be found in the distinction between exploratory and confirmatory research, which is sometimes appealed to in the metascience literature. We argue that this notion (a) differs in important respects …

Toward a more credible assessment of the credibility of science by many-analyst studies

We discuss a relatively new meta-scientific research design: many-analyst studies that attempt to assess the replicability and credibility of research based on large-scale observational data. In these studies, a large number of analysts try to answer …

Tracking replicability as a method of post-publication open evaluation

Recent reports have suggested that many published results are unreliable. To increase the reliability and accuracy of published papers, multiple changes have been proposed, such as changes in statistical methods. We support such reforms. However, we …

Transparent science: A more credible, reproducible, and publishable way to do science

This is an exciting time to be a psychological scientist. There is a major new movement that seeks to promote the credibility and replicability of psychological research by enhancing its transparency, with scholarly societies promoting the principles …

Trust your science? Open your data and code.

A paper about Open Your Data and Code

Underreporting in Psychology Experiments: Evidence from a Study Registry.

Many scholars have raised concerns about the credibility of empirical findings in psychology, arguing that the proportion of false positives reported in the published literature dramatically exceeds the rate implied by standard significance levels. A …