Conceptual and Statistical Knowledge

 

Exploratory hypothesis tests can be more compelling than confirmatory hypothesis tests

Preregistration has been proposed as a useful method for making a publicly verifiable distinction between confirmatory hypothesis tests, which involve planned tests of ante hoc hypotheses, and exploratory hypothesis tests, which involve unplanned …

Inconsistent multiple testing corrections: The fallacy of using family-based error rates to make inferences about individual hypotheses

During multiple testing, researchers often adjust their alpha level to control the familywise error rate for a statistical inference about a joint union alternative hypothesis (e.g., “H1,1 or H1,2”). However, in some cases, they do not make this …

Is replication possible in qualitative research? A response to Makel et al. (2022)

There has been much debate in recent years about how open research practices, which have been promoted in efforts to improve research robustness, may (not) be appropriate for qualitative methodologies, particularly in educational research. Among …

It’s time to join the conversation: Visions of the Future for Qualitative Transparency and Openness in Management and Organisation Studies

The social sciences continue to move towards more open and transparent research practices. However, these changes have been driven by researchers outside of management and organisational studies and are primarily designed with quantitative methods in …

Open science saves lives: lessons from the COVID-19 pandemic

In the last decade Open Science principles have been successfully advocated for and are being slowly adopted in different research communities. In response to the COVID-19 pandemic many publishers and researchers have sped up their adoption of Open …

Open Stats Lab: Teach Statistics Using Open Data from Psychological Science

Each OSL lab is comprised of three elements: An activity, A data set and A published article. The activities guide students through the reproduction of the results published in the journal Psychological Science. Activities also focus on different …

Responsible assessment of what research? Beware of epistemic diversity!

Schönbrodt et al. (2022) and Gärtner et al. (2022) aim to outline in the target articles why and how research assessment could be improved in psychological science in accordance with DORA, resulting in a focus on abandoning the impact factor as an …

Rigorous Exploration in a Model-Centric Science via Epistemic Iteration

Urgent attention is needed to address generalizability problems in psychology. However, the current dominant paradigm centered on dichotomous results and rapid discoveries cannot provide the solution because of its theoretical inadequacies. We …

Type I Error Rates are Not Usually Inflated

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high …

Approaching psychology’s current crises by exploring the vagueness of psychological concepts: Recommendations for advancing the discipline.

Psychology is currently facing a multilayered crisis stemming from the fact that the results of many psychological studies cannot be replicated (replication crisis), that psychological research has neglected cross-cultural and cross-temporal …
JUST-OS