Estimating the Reproducibility of Experimental Philosophy

Florian Cova, Brent Strickland, Angela Abatista, Aurélien Allard, James Andow, Mario Attie, James Beebe, Renatas Berniūnas, Jordane Boudesseul, Matteo Colombo, Fiery Cushman, Rodrigo Diaz, Noah N'Djaye Nikolai van Dongen, Vilius Dranseika, Brian D. Earp, Antonio Gaitán Torres, Ivar Hannikainen, José V. Hernández-Conde, Wenjia Hu, François Jaquet, Kareem Khalifa, Hanna Kim, Markus Kneer, Joshua Knobe, Miklos Kurthy, Anthony Lantian, Shen-yi Liao, Edouard Machery, Tania Moerenhout, Christian Mott, Mark Phelan, Jonathan Phillips, Navin Rambharose, Kevin Reuter, Felipe Romero, Paulo Sousa, Jan Sprenger, Emile Thalabard, Kevin Tobia, Hugo Viciana, Daniel Wilkenfeld, Xiang Zhou

Review of Philosophy and Psychology, 2018. DOI 10.1007/s13164-018-0400-9

Has this study been replicated?

This paper is itself a replication attempt, targeting 37 studies, listed below.

Studies replicated

Two conceptions of subjective experience, Sytsma & Machery (2009). Philosophical Studies. View paper
What in the world is weakness of will?, May & Holton (2010). Philosophical Studies. View paper
The Actor–Observer Bias and Moral Intuitions: Adding Fuel to Sinnott-Armstrong's Fire, Nadelhoffer & Feltz (2008). Neuroethics. View paper
The Lesson of Bypassing, Rose & Nichols (2013). Review of Philosophy and Psychology. View paper
Attitudes Towards Reference and Replaceability, Grau & Pury (2013). Review of Philosophy and Psychology. View paper
Semantics, cross-cultural style, Machery (2004). Cognition. View paper
Cognitive load selectively interferes with utilitarian moral judgment, Greene et al. (2008). Cognition. View paper
Lay denial of knowledge for justified true beliefs, Nagel et al. (2013). Cognition. View paper
Causal superseding, Kominsky et al. (2015). Cognition. View paper
Temperament and intuition: A commentary on Feltz and Cokely, Nadelhoffer et al. (2009). Consciousness and Cognition. View paper
GETTIERIZED KNOBE EFFECTS, Beebe & Shea (2013). Episteme. View paper
Blame, Badness, and Intentional Action: A Reply to Knobe and Mendlow, Nadelhoffer (2004). Journal of Theoretical and Philosophical Psychology. View paper
Intentional action in folk psychology: An experimental investigation, Knobe (2003). Philosophical Psychology. View paper
After objectivity: an empirical study of moral judgment, Nichols (2004). Philosophical Psychology. View paper
Skill, luck, control, and intentional action, Nadelhoffer (2005). Philosophical Psychology. View paper
Surveying Freedom: Folk Intuitions about free will and moral responsibility, Nahmias et al. (2005). Philosophical Psychology. View paper
Reading Conflicted Minds: An Empirical Follow-up to Knobe and Roedder, Gonnerman (2008). Philosophical Psychology. View paper
Folk psychological concepts: Causation1, Roxborough & Cumby (2009). Philosophical Psychology. View paper
If you like it, does it matter if it's real?, De Brigard (2010). Philosophical Psychology. View paper
Motivational internalism and folk intuitions, Björnsson et al. (2014). Philosophical Psychology. View paper
Bad acts, blameworthy agents, and intentional actions: Some problems for juror impartiality, Nadelhoffer (2006). Philosophical Explorations. View paper
Empirically Investigating Imaginative Resistance, Liao et al. (2014). The British Journal of Aesthetics. View paper
Intentional action and side effects in ordinary language, Knobe (2003). Analysis. View paper
Intention, intentional action and moral considerations, Knobe (2004). Analysis. View paper
The Epistemic Side-Effect Effect, BEEBE & BUCKWALTER (2010). Mind & Language. View paper
Folk Moral Relativism, SARKISSIAN et al. (2011). Mind & Language. View paper
Contrastive Knowledge Surveyed, Schaffer & Knobe (2010). Noûs. View paper
The Folk Probably Don't Think What You Think They Think: Experiments on Causation by Absence, LIVENGOOD & MACHERY (2007). Midwest Studies in Philosophy. View paper
Free Will, Moral Responsibility, and Mechanism: Experiments on Folk Intuitions, NAHMIAS et al. (2007). Midwest Studies in Philosophy. View paper
Reflection and Reasoning in Moral Judgment, Paxton et al. (2011). Cognitive Science. View paper
Explaining Away Incompatibilist Intuitions, Murray & Nahmias (2012). Philosophy and Phenomenological Research. View paper
Knowledge, Stakes, and Mistakes, Buckwalter & Schaffer (2013). Noûs. View paper
The Folk Concepts of Intention and Intentional Action: A Cross-Cultural Study, Knobe & Burra (2006). Journal of Cognition and Culture. View paper
Folk Intuitions on Free Will, Nichols (2006). Journal of Cognition and Culture. View paper
Cause and Norm, Hitchcock & Knobe (2009). Journal of Philosophy. View paper
Causation, Norm Violation, and Culpable Control, Alicke et al. (2011). Journal of Philosophy. View paper
Distinguishing the appearance from the reality of pain, Reuter (2011). Journal of Consciousness Studies. View paper

Cite this record

Cova, F., Strickland, B., Abatista, A., Allard, A., Andow, J., Attie, M., Beebe, J., Berniūnas, R., Boudesseul, J., Colombo, M., Cushman, F., Diaz, R., N'Djaye Nikolai van Dongen, N., Dranseika, V., Earp, B. D., Torres, A. G., Hannikainen, I., Hernández-Conde, J. V., Hu, W., … Zhou, X. (2018). Estimating the Reproducibility of Experimental Philosophy. Review of Philosophy and Psychology, 12(1), 9–44. https://doi.org/10.1007/s13164-018-0400-9 Individual report available at https://osf.io/z2fj8

Other studies in the atlas

Failed replications · Successful replications · All browse pages