Resources

This paper is a study of the decisions that researchers take during the execution of a research plan: their researcher discretion. Flexible research methods are generally seen as undesirable, and many methodologists urge to eliminate these so-called …

While Open Science has arguably initiated positive changes at some stages of the research process (e.g., increasing transparency through preregistration), problematic behaviors during data collection are still almost impossible to detect and pose a …

Preregistration has been proposed as a useful method for making a publicly verifiable distinction between confirmatory hypothesis tests, which involve planned tests of ante hoc hypotheses, and exploratory hypothesis tests, which involve unplanned …

The current controversy surrounding research replication in biomedical and psychosocial sciences often overlooks the uncertainties surrounding both the original and replication studies. Overemphasizing single attempts as definitive replication …

We present a framework designed to help academic institutions and departments rethink and reform academic assessments - including tenure and promotion evaluations - using a values-based approach. For each of the 14 values included, we outline some …

Psychology is a discipline that has a high number of failed replications, which has been characterised as a ‘crisis’ on the assumption that failed replications are indicative of untrustworthy research. This paper uses Chang’s concept of epistemic …

During multiple testing, researchers often adjust their alpha level to control the familywise error rate for a statistical inference about a joint union alternative hypothesis (e.g., “H1,1 or H1,2”). However, in some cases, they do not make this …

There has been much debate in recent years about how open research practices, which have been promoted in efforts to improve research robustness, may (not) be appropriate for qualitative methodologies, particularly in educational research. Among …

The social sciences continue to move towards more open and transparent research practices. However, these changes have been driven by researchers outside of management and organisational studies and are primarily designed with quantitative methods in …

In their article ‘Self-correction in science: The diagnostic and integrative motives for replication‘, David Peterson and Aaron Panofsky (2021) distinguish two kinds of replication: diagnostic and integrative replication. In this blog post we discuss …