A recent workshop focused on the idea that protocols for nonrandomized studies should be registered in advance of their conduct. In reviewing the workshop report and publications citing it, I note a number of unfounded assumptions and little …
In an attempt to increase the reliability of empirical findings, psychological scientists have recently proposed a number of changes in the practice of experimental psychology. Most current reform efforts have focused on the analysis of data and the …
There is an ongoing debate regarding preregistration of epidemiologic study protocols. We examine the basic idea that preregistration of study protocols and their associated hypotheses would enhance the reliability of observational research. We …
Current attempts at methodological reform in sciences come in response to an overall lack of rigor in methodological and scientific practices in experimental sciences. However, most methodological reform attempts suffer from similar mistakes and …
Kerr ([1998]) coined the term ‘HARKing’ to refer to the practice of ‘hypothesizing after the results are known’. This questionable research practice has received increased attention in recent years because it is thought to have contributed to low …
I discuss Van Drimmelen’s (2023) Metascience2023 presentation on researchers’ decision making during the research process. In particular, I consider his evidence that researchers’ discretion over research decisions is unavoidable when they follow …
Hypothesizing after the results are known, or HARKing, occurs when researchers check their research results and then add or remove hypotheses on the basis of those results without acknowledging this process in their research report (Kerr, 1998). In …
A recently published series of open science guides help researchers in the Netherlands navigate open science. They cover topics such as pre-prints, open licenses, questionable publication practices (forthcoming) and how to apply open science in …
Objective
The goals of this study were to evaluate the extent that physical therapy journals support open science research practices by adhering to the Transparency and Openness Promotion guidelines and to assess the relationship between journal …
Several researchers have recently argued that p values lose their meaning in exploratory analyses due to an unknown inflation of the alpha level (e.g., Nosek & Lakens, 2014; Wagenmakers, 2016). For this argument to be tenable, the familywise error …