Conceptual and Statistical Knowledge

 

Is replication possible in qualitative research? A response to Makel et al. (2022)

There has been much debate in recent years about how open research practices, which have been promoted in efforts to improve research robustness, may (not) be appropriate for qualitative methodologies, particularly in educational research. Among …

It’s time to join the conversation: Visions of the Future for Qualitative Transparency and Openness in Management and Organisation Studies

The social sciences continue to move towards more open and transparent research practices. However, these changes have been driven by researchers outside of management and organisational studies and are primarily designed with quantitative methods in …

Open science saves lives: lessons from the COVID-19 pandemic

In the last decade Open Science principles have been successfully advocated for and are being slowly adopted in different research communities. In response to the COVID-19 pandemic many publishers and researchers have sped up their adoption of Open …

Open Stats Lab: Teach Statistics Using Open Data from Psychological Science

Each OSL lab is comprised of three elements: An activity, A data set and A published article. The activities guide students through the reproduction of the results published in the journal Psychological Science. Activities also focus on different …

Responsible assessment of what research? Beware of epistemic diversity!

Schönbrodt et al. (2022) and Gärtner et al. (2022) aim to outline in the target articles why and how research assessment could be improved in psychological science in accordance with DORA, resulting in a focus on abandoning the impact factor as an …

Rigorous Exploration in a Model-Centric Science via Epistemic Iteration

Urgent attention is needed to address generalizability problems in psychology. However, the current dominant paradigm centered on dichotomous results and rapid discoveries cannot provide the solution because of its theoretical inadequacies. We …

Type I Error Rates are Not Usually Inflated

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high …

Approaching psychology’s current crises by exploring the vagueness of psychological concepts: Recommendations for advancing the discipline.

Psychology is currently facing a multilayered crisis stemming from the fact that the results of many psychological studies cannot be replicated (replication crisis), that psychological research has neglected cross-cultural and cross-temporal …

Conflicting Results and Statistical Malleability: Embracing Pluralism of Empirical Results

Conflicting results undermine making inferences from the empirical literature. So far, the replication crisis is mainly seen as resulting from honest errors and questionable research practices such as p-hacking or the base-rate fallacy. I discuss the …

Heterogeneity in effect size estimates

A typical empirical study involves choosing a sample, a research design, and an analysis path. Variation in such choices across studies leads to heterogeneity in results that introduce an additional layer of uncertainty, limiting the generalizability …
JUST-OS