Replicability

A Replication Crisis in Methodological Research?

Statisticians have been keen to critique statistical aspects of the “replication crisis” in other scientific disciplines. But new statistical tools are often published and promoted without any thought to replicability. This needs to change, argue …

All is well that replicates well: The replicability of reported moderation and interaction effects in leading organizational sciences journals.

We examine 244 independent tests of interaction effects published in recent issues of four leading journals in the organizational sciences in order to estimate the replicability of reported statistically significant interaction effects. A z-curve …

Challenges and opportunities in preregistration of coordinated data analysis: A tutorial and template

The credibility revolution in social science has led to the recommendation and adoption of practices to increase the replicability of scientific findings. Many of the recommended practices, such as replication and preregistration, present unique …

Incorporating ecological momentary assessment into multimethod investigations of cognitive aging: Promise and practical considerations

Ecological momentary assessment (EMA) represents a promising approach to study cognitive aging. In contrast to laboratory-based studies, EMA involves the repeated sampling of experiences in daily life contexts, enabling investigators to gain access …

Opening open science to all: Demystifying reproducibility and transparency practices in linguistic research

In recent years, numerous fields of research have seen a push for increased reproducibility and transparency practices. As a result, specific transparency practices have emerged, such as open access publishing, preregistration, sharing data, …

Preregistration of Analyses of Preexisting Data

The preregistration of a study’s hypotheses, methods, and data-analyses steps is becoming a popular psychological research practice. To date, most of the discussion on study preregistration has focused on the preregistration of studies that include …

Preregistration of Studies with Existing Data

Preregistration of research plans is becoming an increasingly popular and common tool to enhance the transparency of a study’s methodology. In a preregistration, researchers document their research plans and register them to a public repository prior …

Raising awareness of uncertain choices in empirical data analysis: A teaching concept toward replicable research practices

Throughout their education and when reading the scientific literature, students may get the impression that there is a unique and correct analysis strategy for every data analysis task and that this analysis strategy will always yield a significant …

Re-run, Repeat, Reproduce, Reuse, Replicate: Transforming Code into Scientific Contributions

Scientific code is different from production software. Scientific code, by producing results that are then analyzed and interpreted, participates in the elaboration of scientific conclusions. This imposes specific constraints on the code that are …

Sources of nonreplicability in aging ethnoracial health disparities research

The older adult population in the U.S. is becoming increasingly diverse across a constellation of factors including ethnoracial group, socioeconomic status, and immigration status. However, our understanding of the consequences of this diversity for …