Reproducibility and Replicability Knowledge

 

Decisions, Decisions, Decisions: An Ethnographic Study of Researcher Discretion in Practice

This paper is a study of the decisions that researchers take during the execution of a research plan: their researcher discretion. Flexible research methods are generally seen as undesirable, and many methodologists urge to eliminate these so-called …

Evading Open Science: The Black Box of Student Data Collection

While Open Science has arguably initiated positive changes at some stages of the research process (e.g., increasing transparency through preregistration), problematic behaviors during data collection are still almost impossible to detect and pose a …

Forcing a Deterministic Frame on Probabilistic Phenomena: A Communication Blind Spot in Media Coverage of the “Replication Crisis''

The current controversy surrounding research replication in biomedical and psychosocial sciences often overlooks the uncertainties surrounding both the original and replication studies. Overemphasizing single attempts as definitive replication …

Framework for Value Based Academic Assessment

We present a framework designed to help academic institutions and departments rethink and reform academic assessments - including tenure and promotion evaluations - using a values-based approach. For each of the 14 values included, we outline some …

Growth from uncertainty: understanding the replication 'crisis' in infant psychology

Psychology is a discipline that has a high number of failed replications, which has been characterised as a ‘crisis’ on the assumption that failed replications are indicative of untrustworthy research. This paper uses Chang’s concept of epistemic …

Is replication possible in qualitative research? A response to Makel et al. (2022)

There has been much debate in recent years about how open research practices, which have been promoted in efforts to improve research robustness, may (not) be appropriate for qualitative methodologies, particularly in educational research. Among …

It’s time to join the conversation: Visions of the Future for Qualitative Transparency and Openness in Management and Organisation Studies

The social sciences continue to move towards more open and transparent research practices. However, these changes have been driven by researchers outside of management and organisational studies and are primarily designed with quantitative methods in …

Kinds of replication

In their article ‘Self-correction in science: The diagnostic and integrative motives for replication‘, David Peterson and Aaron Panofsky (2021) distinguish two kinds of replication: diagnostic and integrative replication. In this blog post we discuss …

Mapping open and internationally relevant open science capacity building and training modules to support the implementation of the UNESCO Recommendation on Open Science

Map of open and internationally relevant open science capacity building and training modules to support the implementation of the UNESCO Recommendation on Open Science

Methods and results of studies on reporting guideline adherence are poorly reported: a meta-research study

We investigated recent meta-research studies on adherence to four reporting guidelines to determine the proportion that provided (1) an explanation for how adherence to guideline items was rated and (2) results from all included individual studies. …
JUST-OS