Conceptual and Statistical Knowledge

 

Is replication possible in qualitative research? A response to Makel et al. (2022)

There has been much debate in recent years about how open research practices, which have been promoted in efforts to improve research robustness, may (not) be appropriate for qualitative methodologies, particularly in educational research. Among …

It’s time to join the conversation: Visions of the Future for Qualitative Transparency and Openness in Management and Organisation Studies

The social sciences continue to move towards more open and transparent research practices. However, these changes have been driven by researchers outside of management and organisational studies and are primarily designed with quantitative methods in …

Open Stats Lab: Teach Statistics Using Open Data from Psychological Science

Each OSL lab is comprised of three elements: An activity, A data set and A published article. The activities guide students through the reproduction of the results published in the journal Psychological Science. Activities also focus on different …

Responsible assessment of what research? Beware of epistemic diversity!

Schönbrodt et al. (2022) and Gärtner et al. (2022) aim to outline in the target articles why and how research assessment could be improved in psychological science in accordance with DORA, resulting in a focus on abandoning the impact factor as an …

Type I Error Rates are Not Usually Inflated

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high …

Conflicting Results and Statistical Malleability: Embracing Pluralism of Empirical Results

Conflicting results undermine making inferences from the empirical literature. So far, the replication crisis is mainly seen as resulting from honest errors and questionable research practices such as p-hacking or the base-rate fallacy. I discuss the …

Open Science Training Handbook

Github Repository for the Open Science Training Handbook

Research assessment using a narrow definition of “research quality” is an act of gatekeeping: A comment on Gärtner et al. (2022)

Gärtner et al. (2022) propose a system for quantitatively scoring the methodological rigour of papers during the hiring and promotion of psychology researchers, with the aim of advantaging researchers who conduct open, reproducible work. However, the …

The quantitative paradigm and the nature of the human mind. The replication crisis as an epistemological crisis of quantitative psychology in view of the ontic nature of the psyche

Many suggestions for dealing with the so-called replication crisis in psychology revolve around the idea that better and more complex statistical-mathematical tools or stricter procedures are required in order to obtain reliable findings and prevent …

What Makes a Good Theory, and How Do We Make a Theory Good?

I present an ontology of criteria for evaluating theory to answer the titular question from the perspective of a scientist practitioner. Set inside a formal account of our adjudication over theories, a metatheoretical calculus, this ontology …
JUST-OS