FORRT’s curated resources database now hosts over 1,400 open science materials below, thanks to key partnerships. Initially boosted by over 60% by the Open Science Knowledge Base ( see also OSKB’s OER commons page)— a Center for Open Science (COS) initiative. Recently, our collection recently grew by 30% through contributions from JUST-OS, increasing resources from 1,140 to 1,402. OSKB’s work involved almost 300 hours (valued at €10,000) and JUST-OS’s work involved 150 hours (valued around €5,000), reflecting significant effort and dedication. COS, OSKB, JUST-OS and FORRT forged partnerships to promote open and reproducible research practices, enabling the scientific community to build upon each other’s work and advance knowledge collaboratively. Learn more about it FORRT’s and OSKB’s partnership in the COS’s announcement.
If you notice there is an educational resource, research article or pedagogical tool missing in our database, please consider adding it below in our on submission form or directly into a separate g-forms.
Loading search data...
*We live in an exciting, dynamic time for science, medicine, and publication. Rapid technological and clinical advances are being …
Author(s): Nicholas J Zyromski
Type of resources: Reading
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Open Access
Link to resource
Electronic health records (EHRs) and other administrative health data are increasingly used in research to generate evidence on the …
Author(s): Linda Nab, Andrea L. Schaffer, William Hulme, Nicholas J. DeVito, Iain Dillingham, Milan Wiedemann, Colm D. Andrews, Helen Curtis, Louis Fisher, Amelia Green, Jon Massey, Caroline E. Walters, Rose Higgins, Christine Cunningham, Jessica Morley, Amir Mehrkar, Liam Hart, Simon Davy, David Evans, George Hickman, Peter Inglesby, Caroline E. Morton, Rebecca M. Smith, Tom Ward, Thomas O'Dwyer, Steven Maude, Lucy Bridges, Ben F. C. Butler-Cole, Catherine L. Stables, Pete Stokes, Chris Bates, Jonny Cockburn, Frank Hester, John Parry, Krishnan Bhaskaran, Anna Schultze, Christopher T. Rentsch, Rohini Mathur, Laurie A. Tomlinson, Elizabeth J. Williamson, Liam Smeeth, Alex Walker, Sebastian Bacon, Brian MacKenna, Ben Goldacre
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Electronic Health Records
Link to resource
The hypothesis of a Hierarchy of the Sciences with physical sciences at the top, social sciences at the bottom, and biological sciences …
Author(s): Daniele Fanelli
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A journal reviewer accused Lizzie Wolkovich of using ChatGPT to write a manuscript. She hadn’t — but her paper was rejected anyway.
Author(s): E M Wolkovich
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science, Physical Science
Tag(s): Writing Fraud, ChatGPT, Artificial Intelligence
Link to resource
Qualitative research plays a pivotal role in health psychology, offering insights into the intricacies of health-related issues. …
Author(s): Gabriela Gore-Gorszewska
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Data Sharing, Ethics, Informed Consent, Older Adults, Qualitative Methods, Sexuality
Link to resource
This website is a long-time dream finally bearing fruit, a needed remix of the widely circulated article WHITE SUPREMACY CULTURE …
Author(s): Tema Okun
Type of resources: Reading
Primary user(s): Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): White Supremacy, Antiracist
Link to resource
Survey sheds light on the ‘crisis’ rocking research.
Author(s): Monya Baker
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
10 Things for Curating Reproducible and FAIR Research (CURE-FAIR) provides standards-based guidelines to follow CURE-FAIR best …
Author(s): RDA CURE-FAIR WG (Consortium)
Type of resources: Primary Source, Teaching/Learning Strategy
Primary user(s): Librarian
Subject area(s): Social Science
Tag(s): Reproducibility, Curation, Open Data, Open Science
Link to resource
This course coversa range of approachesthat aim to enhance the transparency and reproducibility of social science research. It is …
Author(s): Edward Miguel
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In September 2022 the Helmholtz Association adopted a new Open Science Policy. The policy stipulates that scholarly publications, …
Author(s): Helmholz Open Science
Type of resources: Reading, Lecture Slides, Seminar Recording
Primary user(s): Student, Teacher
Subject area(s): Physical Science
Tag(s): Helmholz Open Science, Open Data, Open Software, Open Access
Link to resource
The Open Science movement is rapidly changing the scientific landscape. Because exact definitions are often lacking and reforms are …
Author(s): Alexander Etz, Amy Orben, Hannah Moshontz, Jesse Niebaum, Johnny van Doorn, Matthew Makel, Michael Schulte-Mecklenbeck, Sam Parsons, Sophia Crüwell
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Materials, Open Scholarship Guidelines, Policy, Publishing, Reproducibility, Researchers
Link to resource
One year after publishing “False-Positive Psychology,” we propose a simple implementation of disclosure that requires but …
Author(s): Simmons, Joseph P. and Nelson, Leif D. and Simonsohn, Uri, A
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We revisit the results of the recent Reproducibility Project: Psychology by the Open Science Collaboration. We compute Bayes factors—a …
Author(s): Alexander Etz and Joachim Vandekerckhove
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The modern canon of open science consists of five “schools of thought” that justify unfettered access to the fruits of scientific …
Author(s): Thomas D. Albright and Nicholas Scurich
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Law, Physical Science
Tag(s): Forensics, Due process, Evidence
Link to resource
Dashboards for data visualisation, such as R Shiny and Tableau, allow an interactive exploration of data by means of drop-down lists …
Author(s): Pablo Bernabeu
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Librarians, Open Data, Open Source Software, Publishers, Researchers, Visualization
Link to resource
This article addresses aggregation as a fundamental practice in educational psychology and ties it into the idiographic/nomothetic …
Author(s): Georg Krammer
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, researcher
Subject area(s): Education
Tag(s): Aggregation, Best Practice, Educational Psychology, Idiographic, Nomothetic, Quantitative Psychology
Link to resource
Irreproducibility of preclinical biomedical research has gained recent attention. It is suggested that requiring authors to complete a …
Author(s): Doris M. Rubio, Janet S. Lee, Jill Zupetic, John P. Pribis, Joo Heung Yoon, Kwonho Jeong, Kyle M. Holleran, Nader Shaikh, SeungHye Han, Tolani F. Olonisakin
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology
Tag(s): Animal Studies, Clinical Trials, Genetically Modified Animals, Inbred Strains, Medical Journals, Randomized Controlled Trials, Reproducibility, Research Reporting Guidelines, Scientific Publishing, Systematic Reviews
Link to resource
The ideal of scientific progress is that we accumulate measurements and integrate these into theory, but recent discussion of …
Author(s): Frank et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This manuscript describes the ISMRM OSIPI (Open Science Initiative for Perfusion Imaging) lexicon for dynamic contrast-enhanced and …
Author(s): Ben R. Dickie, Zaki Ahmed, Jonathan Arvidsson, Laura C. Bell, David L. Buckley, Charlotte Debus, Andrey Fedorov, Ralf Floca, Ingomar Gutmann, Rianne A. van der Heijden, Petra J. van Houdt, Steven Sourbron, Michael J. Thrippleton, Chad Quarles, Ina N. Kompan, on behalf of The Perfusion Study Group of the ISMRM
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): CAPLEX, DCE-MRI, DSC-MRI, ISMRM OSIPI, Perfusion, Standardization, Lexicon
Link to resource
We present a consensus-based checklist to improve and document the transparency of research reports in social and behavioural research. …
Author(s): Agneta Fisher, Alexandra M. Freund, Alexandra Sarafoglou, Alice S. Carter, Andrew A. Bennett, Andrew Gelman, Balazs Aczel, Barnabas Szaszi, Benjamin R. Newell, Brendan Nyhan, Candice C. Morey, Charles Clifton, Christopher Beevers, Christopher D. Chambers, Christopher Sullivan, Cristina Cacciari, Daniel Benjamin, Daniel J. Simons, David R. Shanks, Debra Lieberman, Derek Isaacowitz, Dolores Albarracin, Don P. Green, D. Stephen Lindsay, Eric-Jan Wagenmakers, Eric Johnson, Eveline A. Crone, Fernando Hoces de la Guardia, Fiammetta Cosci, George C. Banks, Gordon D. Logan, Hal R. Arkes, Harold Pashler, Janet Kolodner, Jarret Crawford, Jeffrey Pollack, Jelte M. Wicherts, John Antonakis, John Curtin, John P. Ioannidis, Joseph Cesario, Kai Jonas, Lea Moersdorf, Lisa L. Harlow, Marcus Munafò, Mark Fichman, M. Gareth Gaskell, Mike Cortese, Mitja D. Back, Morton A. Gernsbacher, Nelson Cowan, Nicole D. Anderson, Pasco Fearon, Randall Engle, Robert L. Greene, Roger Giner-Sorolla, Ronán M. Conroy, Scott O. Lilienfeld, Simine Vazire, Simon Farrell, Šimon Kucharský, Stavroula Kousta, Ty W. Boyer, Wendy B. Mendes, Wiebke Bleidorn, Willem Frankenhuis, Zoltan Kekecs
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Inside Your Classroom, Publishing
Link to resource
Psychological science is experiencing a rise in the application of complex statistical models and, simultaneously, a renewed focus on …
Author(s): Ross Jacobucci
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Exploratory Research, Confirmatory Research, Big Data, Machine Learning, Philosophy Of Science
Link to resource
This paper reflects upon calls for “open data” in ethnography, drawing on our experiences doing research on sexual violence. The core …
Author(s): Shamus Khan, Jennifer S. Hirsch, Ohad Zeltzer-Zubida
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Ethnography, Open Science, Epistemology, Qualitative Method, Methodology
Link to resource
Although many researchers have discussed replication as a means to facilitate self-correcting science, in this article, we identify …
Author(s): Sacha D Brown, David Furrow, Daniel F Hill, Jonathon C Gable, Liam P Porter, W Jake Jacobs
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background: The Observational Health Data Sciences and Informatics (OHDSI) community has emerged as a leader in observational research …
Author(s): Star Liu, Asieh Golozar, Nathan Buesgens, Jody-Ann McLeggon, Adam Black, Paul Nagy
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): OHDSI, Observational Research, Clinical Data, Open Science
Link to resource
Growth of the open science movement has drawn significant attention to data sharing and availability across the scientific community. …
Author(s): Colette L. Ward, Gavin McDonald, Jessica L. Couture, Rachael E. Blake
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology, Social Science
Tag(s): Communications, Data, Data Acquisition, Data Management, Language, Open Data, Open Science, Policy, Public Policy, Research Funding, Research Grants, Science Policy
Link to resource
Digital public goods (DPGs), if implemented with effective policies, can facilitate the realization of the United Nations Sustainable …
Author(s): Dong Liang, Huadong Guo, Stefano Nativi, Markku Kulmala, Zeeshan Shirazi, Fang Chen, Gretchen Kalonji, Dongmei Yan, Jianhui Li, Robert Duerler, Lei Luo, Qunli Han, Siming Deng, Yuanyuan Wang, Lingyi Kong, Thorsten Jelinek
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Environmental Impact, Policy
Link to resource
Journal editors have a large amount of power to advance open science in their respective fields by incentivising and mandating open …
Author(s): Priya Silverstein, Colin Elman, Amanda Montoya, Barbara McGillivray, Charlotte R. Pennington, Chase H. Harrison, Crystal N. Steltenpohl, Jan Philipp Röer, Katherine S. Corker, Lisa M. Charron, Mahmoud Elsherif, Mario Malicki, Rachel Hayes-Harb, Sandra Grinschgl, Tess Neal, Thomas Rhys Evans, Veli-Matti Karhulahti, William L. D. Krenzer, Anabel Belaus, David Moreau, Debora I. Burin, Elizabeth Chin, Esther Plomp, Evan Mayo-Wilson, Jared Lyle, Jonathan M. Adler, Julia G. Bottesini, Katherine M. Lawson, Kathleen Schmidt, Kyrani Reneau, Lars Vilhuber, Ludo Waltman, Morton Ann Gernsbacher, Paul E. Plonski, Sakshi Ghai, Sean Grant, Thu-Mai Christian, William Ngiam, Moin Syed
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, Editor
Subject area(s): Education, Life Science, Social Science
Tag(s): Open Science, Journal Editing, Scholarly Publishing, Peer Review
Link to resource
Journal editors have a large amount of power to advance open science in their respective fields by incentivising and mandating open …
Author(s): Priya Silverstein, Colin Elman, Amanda Montoya, Barbara McGillivray, Charlotte Rebecca Pennington, Chase H. Harrison, Crystal N. Steltenpohl, Jan Philipp Röer, Katherine S. Corker, Lisa M Charron, Mahmoud Elsherif, Mario Malički, Rachel Hayes-Harb, Sandra Grinschgl, Tess M.S. Neal, Thomas Rhys Evans, Veli-Matti Karhulahti, William Leo Donald Krenzer, Anabel Belaus, David Moreau, DI Burin, Elizabeth Chin, Esther Plomp, Evan Mayo-Wilson, Jared Lyle, Jonathan M Adler, Julia G. Bottesini, Katherine M. Lawson, Kathleen Schmidt, Kyrani Reneau, Lars Vilhuber, Ludo Waltman, Morton Ann Gernsbacher, Paul E. Plonski, Sakshi Ghai, Sean Grant, Thu-Mai Lewis Christian, William X. Q. Ngiam, and Moin Syed
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, Journal Editors
Subject area(s): Social Science
Tag(s): Journal Editors, Open Science
Link to resource
The National Institutes of Health (NIH) prefers data to be shared via a data repository. This article provides a guide to data …
Author(s): Federation of American Societies for Experimental Biology
Type of resources: Data Repository Guide
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Data Sharing, Data Repository, Open Access
Link to resource
This applied webinar explores best practices for communicating open educational data with a wide audience. Topics include different …
Author(s): Daniel Anderson
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Data Communication, Data Visualization, Open Education Research
Link to resource
Supporting early career researchers in their open science journey is critical for the future of the field. The development of open …
Author(s): Jesse Fleming, Sarah Emily Wilson, Ummul Kathawalla
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): #earlycareerresearchers #openscience #education
Link to resource
PhD training in psychology asks people to receive training while simultaneously executing the essential work of a university. A healthy …
Author(s): Michael W. Kraus
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): PhD, Student Wellbeing, Psychology, Social Sciences
Link to resource
Electrophysiology in plants is understudied, and, moreover, an ideal model for student inclusion at all levels of education. Here, we …
Author(s): Danae Madariaga, Derek Arro, Catalina Irarrázaval, Alejandro Soto, Felipe Guerra, Angélica Romero, Fabián Ovalle, Elsa Fedrigolli, Thomas DesRosiers, Étienne Serbe-Kamp, Timothy Marzullo
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Plant Electrical Signals, Electrophysiology, Environmental Stress, Plant Physiology, Comparative Physiology, DIY Science, Open Science
Link to resource
Improving the reliability and efficiency of scientific research will increase the credibility of the published scientific literature …
Author(s): Munafo, M. R., et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The Scientific Reform Movement has highlighted the need for large research teams with diverse skills. This has necessitated the growth …
Author(s): Arielle Bennett, Daniel Garside, Cassandra Gould van Praag, Thomas J. Hostler, Ismael Kherroubi Garcia, Esther Plomp, Antonio Schettino, Samantha Teplitzky, and Hao Ye
Type of resources: Reading
Primary user(s): Student, Teacher, (Scientific) Project Managers, Research Support
Subject area(s): Business and Communication, Career and Technical Education, Social Science
Tag(s): Team Infrastructure Roles, Rewards and Recognition, Research Evaluation, Team Science, Career
Link to resource
Although biomedical research is experiencing a data explosion, the accumulation of vast quantities of data alone does not guarantee a …
Author(s): Anastasios Moresis, Leonardo Restivo, Sophie Bromilow, Gunnar Flik, Giorgio Rosati, Fabrizio Scorrano, Michael Tsoory, Eoin C. O’Connor, Stefano Gaburro & Alexandra Bannach-Brown
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Biomedical Research, Data, Metadata, Animal Welfare, In-vivo Data
Link to resource
Good self-control has been linked to adaptive outcomes such as better health, cohesive personal relationships, success in the workplace …
Author(s): Hagger, M. S., Chatzisarantis, N. L., Alberts, H., Anggono, C. O., Batailler, C., Birt, A. R., ... & Calvillo, D. P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The recently released draft South African Ethics in Health Research Guidelines: Principles, Processes and Structures (Draft Guidelines) …
Author(s): Amy Gooden
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Data, Genomics, Health Research, Open Access, Open Science, Policy, South Africa
Link to resource
Over the past several decades, the movement for open science, which promises a more inclusive, efficient, and trustworthy way of …
Author(s): Greg Tananbaum, Chelle Gentemann, Kamran Naim, Christopher Steven Marcum
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Life Science, Physical Science
Tag(s): Open Science, Data Sharing, Equality
Link to resource
In response to a crisis of confidence, several methodological initiatives have been launched to improve the robustness of psychological …
Author(s): Bruno Verschuere, Franziska M. Yasrebi-de Kom, Iza van Zelm, Scott O. Lilienfeld
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Personality Disorders, Preregistration, Clinical Psychology, Psychopathology
Link to resource
One possible reason for the continued neglect of statistical power analysis in research in the behavioral sciences is the …
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
If psychologists have recognized the pitfalls of underpowered research for decades, why does it persist? Incentives, perhaps: …
Author(s): Will M. Gervais, Jennifer A. Jewell, Maxine B. Najle, and Ben K. L. Ng
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Registered reports are a publication format that involves peer reviewing studies both before and after carrying out research …
Author(s): Veli-Matti Karhulahti, Peter Branney, Miia Siutila, Moin Syed
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Social Science
Tag(s): Qualitative, Registered Reports
Link to resource
A systematic review is a rigorous process that involves identifying, selecting, and synthesizing available evidence pertaining to an a …
Author(s): Deirdre K. Tobias, Stefania Papatheodorou, Jennifer M. Yamamoto, Frank B. Hu
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Systematic Review, Meta Analysis, Diabetes
Link to resource
“… there’s this desert prison, see, with an old prisoner, resigned to his life, and a young one just arrived. The young one talks …
Author(s): G. William Walster &T. Anne Cleary
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Science advances through rich, scholarly discussion. More than ever before, digital tools allow us to take that dialogue online. To …
Author(s): Bodo M. Stern, Erin K. O’Shea
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Bibliometrics, Careers, Citation Analysis, Internet, Peer Review, Publishing, Quality Control, Research Funding, Scientific Publishing, Scientists
Link to resource
The case of clinical trials for convalescent plasma during COVID-19 illustrates important lessons for realizing public sector …
Author(s): Victor Roy, Joseph S, Reshma Ramachandran
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Law, Life Science
Tag(s): COVID-19, Plasma, Public sector
Link to resource
Unreliable and irreproducible research is a significant problem that wastes resources and risks undermining the public perception of …
Author(s): Anusuiya Bora, Mark Ziemann
Type of resources: Reading
Primary user(s): Teacher, Librarian
Subject area(s): Life Science
Tag(s): Bioinformatics, Docker, Enrichment Analysis, Reproducibility
Link to resource
Open research practices seek to enhance the transparency and reproducibility of research. While there is evidence of increased uptake …
Author(s): Priya Silverstein, Charlotte R. Pennington, Peter Branney, Daryl B. O'Connor, Emma Lawlor, Emer O'Brien, Dermot Lynott
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Credibility Revolution, Open Science Practices, Replication Crisis, Researcher Engagement, Responsible Research Practices
Link to resource
Background: This paper presents the first meta-analysis for the inter-rater reliability (IRR) of journal peer reviews. IRR is defined …
Author(s): Lutz Bornmann, Rüdiger Mutz and Hans-Dieter Daniel
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Statisticians have been keen to critique statistical aspects of the “replication crisis” in other scientific disciplines. But new …
Author(s): Anne-Laure Boulesteix, Sabine Hoffmann, Alethea Charlton, Heidi Seibold
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Replication Crisis, Statistics, Statistical Tools, Replicability
Link to resource
Open access to research data has been described as a driver of innovation and a potential cure for the reproducibility crisis in many …
Author(s): Benedikt Fecher, Marcel Hebing, Sascha Friesike, Stephanie Linek
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Data Sharing, Open Data, Publishing, Reproducibility
Link to resource
Crisis of replicability is one term that psychological scientists use for the current introspective phase we are in—I argue instead …
Author(s): Barbara A. Spellman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The Journal of European Psychology Students (JEPS) is an open-access, double-blind, peer-reviewed journal for psychology students …
Author(s): Cedric Galetzka
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Publishing
Link to resource
A recent paper by Chatterjee, Rose, and Sinha (2013) reported impressively large “money priming” effects: incidental exposure to …
Author(s): Harold Pashler, Doug Rohrer, Ian Abramson, Tanya Wolfson &Christine R. Harris
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A crescendo of incidents have raised concerns about whether scientific practices in psychology may be suboptimal, sometimes leading to …
Author(s): Jon A. Krosnick, Lee Jussim, Sean T. Stevens, Stephanie M. Anglin
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Meta-Xcience, Questionable Research Practices, Replication Crisis, Reproducibility, Science Reform
Link to resource
We created a software tool that accurately removes all patient identifying information from various kinds of clinical data documents, …
Author(s): Friedlin, F. J., & McDonald, C. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Data analysis in psychopathology research typically entails multiple stages of data preprocessing (e.g., coding of physiological …
Author(s): Angelos-Miltiadis Krypotos, Irene Klugkist, Gaëtan Mertens, Iris M. Engelhard
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Psychopathology, Clinical Psychology, Data Sharing
Link to resource
Open science training should be embedded throughout an undergraduate degree - “A Student’s Guide to Open Science” provides a resource …
Author(s): Charlotte R Pennington & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading, Student Guide, Book
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education, Social Science
Tag(s): Replication Crisis; Psychological Research; Academic Reform; Preregistration
Link to resource
This study estimates the effect of data sharing on the citations of academic articles, using journal policies as a natural experiment. …
Author(s): Allan Dafoe, Andrew K. Rose, Don A. Moore, Edward Miguel, Garret Christensen
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Economics
Tag(s): Citation Analysis, Data, Instrumental Variable Analysis, Policy, Political Science, Publishing, Science Policy, Science Policy and Economics, Scientific Publishing, Scientists, Statistical Data
Link to resource
In recent years, with the trend of open science, there have been many efforts to share research data on the internet. To promote …
Author(s): Yasuyuki Minamiyama, Hideaki Takeda, Masaharu Hayashi, Makoto Asaoka, Kazutsuna Yamaji
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science, Social Science
Tag(s): Open Science, Data Sharing, Data Curation, Reusability
Link to resource
Missing or inaccessible information about the methods used in scientific research slows the pace of discovery and hampers …
Author(s): Marcel LaFlamme, James Harney, Iain Hrynaszkiewicz
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Methods Sharing, Protocol Sharing, Research Methods, Open Science
Link to resource
We estimated the statistical power of the first and last statistical test presented in 697 papers from 10 behavioral journals. First …
Author(s): Jennions, M. D., & Møller, A. P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science, Math & Statistics
Tag(s):
Link to resource
The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social …
Author(s): Alexandra Sarafoglou, Marton Kovacs, Bence Bakos, Eric-Jan Wagenmakers, Balazs Aczel
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Science, Metascience, Replication Crisis, Preregistration
Link to resource
Statistical power is an inherent part of empirical studies that employ significance testing and is essential for the planning of …
Author(s): Dybå, T., Kampenes, V. B., & Sjøberg, D. I.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
An abstract about transparency and robustness for two papers
Author(s): Michael Inzlicht
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, Researcher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Blog, Reproducibility Crisis and Credibility Revolution
Link to resource
People with higher IQ scores also tend to perform better on elementary cognitive-perceptual tasks, such as deciding quickly whether an …
Author(s): Alexander Ly, Andreas Pedroni, Dora Matzke, Eric-Jan Wagenmakers, Gilles Dutilh, Joachim Vandekerckhove, Jörg Rieskamp, Renato Frey
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Reproducibility
Link to resource
Cognitive aging researchers are interested in understanding how cognitive processes change in old age, but the relationship between …
Author(s): Nathaniel R. Green
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Cognitive Aging, Cognitive Modeling, Replication
Link to resource
Societies invest in scientific studies to better understand the world and attempt to harness such improved understanding to address …
Author(s): Etienne P. LeBel, Randy J. McCarthy, Brian D. Earp, Malte Elson and Wolf Vanpaemel
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Publication bias remains a controversial issue in psychological science. The tendency of psychological science to avoid publishing null …
Author(s): Christopher J. Ferguson and Moritz Heene
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog posts about Bayesian statistics
Author(s): A.Solomon Kurz
Type of resources: Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Bayesian statistics
Link to resource
We discuss problems the null hypothesis significance testing (NHST) paradigm poses for replication and more broadly in the biomedical …
Author(s): McShane, B. B., Gal, D., Gelman, A., Robert, C., & Tackett, J. L.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
More transparency is needed to hold researchers to account.
Author(s): The Editorial Board
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Academic Fraud, Accountability
Link to resource
Given the scarcity of full-time, permanent academic jobs, more and more PhDs are looking abroad for employment. When I was on the job …
Author(s): Anna Meier & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading
Primary user(s): Student
Subject area(s): Education
Tag(s): Academic Job Market; Higher Education; Academic Labor Conditions; Funding; Transnational
Link to resource
Over the last 50 years, we argue that incentives for academic scientists have become increasingly perverse in terms of competition for …
Author(s): Marc A. Edwards and Siddhartha Roy
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Data curators are uniquely positioned to help improve access not just to individual datasets, but to the world of research data at …
Author(s): Emily Oxford, Rachel Woodbrook
Type of resources: Student Guide
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Accessibility, Data Sharing, Data Management, Open Data, FAIR Data
Link to resource
Feedback has the potential to evaluate and promote research quality, helping academics to incrementally improve their research …
Author(s): Dr Thomas Evans, Roksana Sobolak, Magda Skubera & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading
Primary user(s): Researchers
Subject area(s): Career and Technical Education
Tag(s): Diversity & Inclusion; Feedback; Peer Review; Transparency; Marginalised Scholars; Systemic Barriers in Academia; Academic Professional Development
Link to resource
Monte-Carlo simulation was used to model the biasing of effect sizes in published studies. The findings from the simulation indicate …
Author(s): ANDREW BRAND, MICHAEL T. BRADLEY, LISA A. BEST, AND GEORGE STOICA
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Open science practices, such as pre-registration and data sharing, increase transparency and may improve the replicability of …
Author(s): Isaac T. Petersen, Keith S. Apfelbaum, Bob McMurray
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Development, Longitudinal, Open Science, Preregistration, Replication, Reproducibility
Link to resource
Open science practices, such as pre-registration and data sharing, increase transparency and may improve the replicability of …
Author(s): Isaac T. Petersen, Keith S. Apfelbaum, Bob McMurray
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Development, Longitudinal, Open Science, Pre-registration, Replication, Reproducibility
Link to resource
Insights from intersectionality and open science
Author(s): Annalisa Myer & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading, Article
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Psychology; Diversity; Research Integrity; Collaboration
Link to resource
Beneficial consequences for student’s engagement, satisfaction and feeling seen
Author(s): Heather Urry & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading, Article
Primary user(s): Teacher
Subject area(s): Education, Social Science
Tag(s): Psychology Education; Representation in Science; Diversity & Inclusion; Student Engagement; Higher Education; Undergraduate Teaching; Equity in Academia; Gender Bias; Pedagogy; Academic Reform
Link to resource
We review and evaluate selection methods, a prominent class of techniques first proposed by Hedges (1984) that assess and adjust for …
Author(s): McShane, B. B., Böckenholt, U., & Hansen, K. T
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Social determinants of learning (SDOL) impact students’ abilities to successfully complete their courses. An economic barrier for …
Author(s): Ernstmeyer, Kimberly E.; Christman, Elizabeth I.
Type of resources: Reading
Primary user(s): Teacher, Administrator
Subject area(s): Life Science
Tag(s): Equity in Nursing Education, Nursing Textbooks, Open Educational Resources, Social Determinants of Learning
Link to resource
In this page, we describe easy ways to adopt principled teaching and mentoring practices. That is, (a) integrating open and …
Author(s): Framework for Open and Reproducible Research Training FORRT
Type of resources: Reading, Teaching/Learning Strategy
Primary user(s): Teacher
Subject area(s): Education
Tag(s): Teaching; Mentoring; Higher Education; Educational Resources
Link to resource
The ease with which scientific data, particularly certain types of raw data in experimental biology, can be fabricated without trace …
Author(s): Shahar Dubiner, Matan Arbel-Groissman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Best Practice, Data Integrity, Data Manipulation, Fraud, Reproducibility, Scientific Misconduct
Link to resource
Today marks a significant milestone as the Bill & Melinda Gates Foundation (BMGF) announces a new Open Access policy, representing …
Author(s): Tom Drake
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Arts and Humanities, History, Law
Tag(s): Open Access Policy, Article Publishing Fees, Preprint, Academic Publishing
Link to resource
This funding instrument aims at contributing to equity and inclusion of underrepresented ethnics groups and a cultural change in …
Author(s): Setareh Mohammadin
Type of resources: Funding Programme
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Education, Social Science
Tag(s): Equity in Academia, Innovation
Link to resource
Replication endeavors contribute to the accumulation of scientific evidence about previously reported findings and are crucial for …
Author(s): Mikaella Polyviou, Johnny Rungtusanatham, Rebecca W. Reczek, Kevin Dooley, A. Michael Knemeyer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Career and Technical Education, Social Science
Tag(s): Recplication, Reliability of Findings, Reproducibility Test, Robustness Check, Scientific Progress
Link to resource
Open science practices have the potential to greatly accelerate progress in scientific research if widely adopted, but individual …
Author(s):
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): #centerforopenscience, #openpractice, #openscience, Reproducibility, Research, #TOPguidelines
Link to resource
Advancing scientific discovery requires investigators to embrace research practices that increase transparency and disclosure about …
Author(s): F.C. Hankenson, E.M. Prager, B.R. Berridge
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Animal Research, Extrinsic Factors, Generalizability, Reproducibility, Translation, Variability
Link to resource
In this course, we will introduce you to the world of open science. Perhaps you are familiar with some of the concepts and ideas of …
Author(s): Aswathi Surendran, Cassandra Murphy, Ciarán Purcell, Marco Prevedello, Mohammed Mahmoud, Nina Trubanová, Philipp Junk, Rasaq Semiu Abolore, Tendai Mukande, Una Ruddock, Wei Qi Koh, Yao Zhang
Type of resources: Full Course
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Open Science, Early Career Researchers, Course, Open Data, Open Access, Data Management, FAIR, Data Repositories, Scientific Integrity
Link to resource
We examine 244 independent tests of interaction effects published in recent issues of four leading journals in the organizational …
Author(s): M Crede, L K Sotola
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics, Physical Science
Tag(s): Interaction Effects, Organizational Sciences, Replicability
Link to resource
For those of us who are autistic and racialized, we often struggle to find representation in mass media, academic work about autism or …
Author(s): Lydia X. Z. Brown, E. Ashkenazy and Morénike Giwa Onaiwu
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Parent, Librarian
Subject area(s): Applied Science, Education, Social Science
Tag(s): Diversity, Equity and Inclusion
Link to resource
This is a blogpost describing why we should use Welch t-test instead of Student t-test
Author(s): Daniel Lakens
Type of resources: Reading, R Code
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Blog, Code, Reproducibility Crisis and Credibility Revolution
Link to resource
The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss …
Author(s): Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Mass, H. L. J., & Kievit, R. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This study compiles information from more than 250 meta-analyses conducted over the past 30 years to assess the magnitude of reported …
Author(s): Paterson, T. A., Harms, P. D., Steel, P., & Credé, M
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
When studies with positive results that support the tested hypotheses have a higher probability of being published than studies with …
Author(s): Anne M. Scheel, Daniel Lakens, Mitchell Schijen
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Publication Bias, Publishing
Link to resource
Background The published clinical research literature may be distorted by the pursuit of statistically significant results. Purpose: We …
Author(s): John PA Ioannidis and Thomas A Trikalinos
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s):
Link to resource
An article about an Introduction to Registered Replication Reports at Perspectives on Psychological Science
Author(s): Daniel J. Simons, Alex O. Holcombe, Barbara A. Spellman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this webinar, Doctors David Mellor (Center for Open Science) and Stavroula Kousta (Nature Human Behavior) discuss the Registered …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
It is widely believed that research that builds upon previously published findings has reproduced the original work. However, it is …
Author(s): Brian A Nosek, Elizabeth Iorns, Fraser Elisabeth Tan, Joelle Lomax, Timothy M Errington, William Gunn
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology
Tag(s): Data, Methodology, Open Science, Replication, Reproducibility, Reproducibility Project: Cancer Biology, Research Methods
Link to resource
We provide a neuroimaging database consisting of 102 synaesthetic brains using state-of-the-art 3 T MRI protocols from the Human …
Author(s): Chris Racey, Christina Kampoureli, Oscar Bowen-Hill, Mathilde Bauer, Ivor Simpson, Charlotte Rae, Magda del Rio, Julia Simner, Jamie Ward
Type of resources: Data Set
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Cognitive Neuroscience, Human Behaviour
Link to resource
“Open Science” has become a buzzword in academic circles. However, exactly what it means, why you should care about it, and – most …
Author(s): Eike Mark Rinke
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Social Science
Tag(s): Data, Materials, Open Access Policies, Open Scholarship Guidelines, Policy, Publishing, Reproducibility, Researchers
Link to resource
In an Essay, Matthew Todd and colleagues discuss an open source approach to drug development. This Essay outlines how open source …
Author(s): Els Torreele, Jaykumar Menon, John McKew, John Wilbanks, Manica Balasegaram, Matthew H. Todd, Peter Kolb, Piero Olliaro, Tomasz Sablinski, Zakir Thomas
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology
Tag(s): Drug Discovery, Drug Research and Development, Finance, Global Health, Open Source Drug Discovery, Open Source Software, Public and Occupational Health, Tuberculosis
Link to resource
Python es un lenguaje de programación general que es útil para escribir scripts para trabajar con datos de manera efectiva y …
Author(s): Alejandra Gonzalez-Beltran, April Wright, chekos, Christopher Erdmann, Enric Escorsa O'Callaghan, Erin Becker, Fernando Garcia, Hely Salgado, Juan Martín Barrios, Juan M. Barrios, Katrin Leinweber, Laura Angelone, Leonardo Ulises Spairani, LUS24, Maxim Belkin, Miguel González, monialo2000, Nicolás Palopoli, Nohemi Huanca Nunez, Paula Andrea Martinez, Raniere Silva, Rayna Harris, rzayas, Sarah Brown, Silvana Pereyra, Spencer Harris, Stephan Druskat, Trevor Keller, Wilson Lozano
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Jupyter Notebooks, Open Scholarship Tools and Technologies, Python, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Ongoing technological developments have made it easier than ever before for scientists to share their data, materials, and analysis …
Author(s): Daniel Lakens, Jaroslav Gottfried, Nicholas Alvaro Coles, Pepijn Obels, Seth Ariel Green
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Analysis, Data, Materials, Open Data, Publishing, Registered Reports, Reproducibility
Link to resource
In this article, we propose analytic review (AR) as a solution to the problem of misreporting statistical results in psychological …
Author(s): John Sakaluk, Alexander Williams, Monica Biernat
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Data-driven computational analysis is becoming increasingly important in biomedical research, as the amount of data being generated …
Author(s): Nitesh Kumar Sharma, Ram Ayyala, Dhrithi Deshpande, Yesha M Patel, Viorel Munteanu, Dumitru Ciorba, Andrada Fiscutean, Mohammad Vahed, Aditya Sarkar, Ruiwei Guo, Andrew Moore, Nicholas Darci-Maher, Nicole A Nogoy, Malak S. Abedalthagafi, Serghei Mangul
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science
Tag(s): Open Code, Open Data, Biomedical Research, Replication, Reproducibility
Link to resource
This workshop demonstrates how using R can advance open science practices in education. We focus on R and RStudio because it is an …
Author(s): Cynthia D'Angelo, Joshua Rosenberg
Type of resources: Teaching/Learning Strategy
Primary user(s):
Subject area(s): Computer Science, Education
Tag(s): Data Analysis Tools, Education Research, Open Data, Open Science, Open Science Framework, OSF, Osfr, R for Researchers, Rstats, Statistical Programming
Link to resource
Today, we are releasing DataCite’s first public data file with metadata for over 52 million DOIs.
Author(s): Mike Bennett, Kelly Stathis, Maria Gould
Type of resources: Public Data File
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Education, Life Science, Physical Science, Social Science
Tag(s): Metadata, Product
Link to resource
This classic text on multiple regression is noted for its nonmathematical, applied, and data-analytic approach. Readers profit from its …
Author(s): Jacob Cohen, Patricia Cohen, Stephen G. West, Leona S. Aiken
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
Applied Open Science Talk GSA 2020
Author(s): Jennifer Lodi-smith, Yunhwan Lee
Type of resources: Lecture Notes
Primary user(s):
Subject area(s): Life Science, Social Science
Tag(s): Aging, Aging Science, Gerontology, Open Science
Link to resource
n.a.
Author(s): Steve M. Newell
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): USA, Data-sharing
Link to resource
Psychology is currently facing a multilayered crisis stemming from the fact that the results of many psychological studies cannot be …
Author(s): Fabian Hutmacher, David J Franz
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Replication Crisis, Universality Crisis, Theory Crisis, Theoretical and Philosophical Psychology, Methodological Pluralism
Link to resource
Psychology is currently facing a multilayered crisis stemming from the fact that the results of many psychological studies cannot be …
Author(s): Hutmacher, F., & Franz, D. J.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Theoretical Psychology, Context, Crisis, Philosophical Psychology
Link to resource
In this study, we examined participants’ choice behavior in a sequential risk-taking task. We were especially interested in the …
Author(s): Peter Haffke, Ronald Hübner
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Columbia Card Task (CCT), Conditional Probability, Conjunctive Probability, Data, Dependent Events, Sequential Risk-Taking
Link to resource
Preregistration of study hypotheses has been proclaimed as the “revolution”1 to curb publication bias and data dredging such as …
Author(s): Jiang Bian, Jae S. Min, Mattia Prosperi, Mo Wang
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Preregistration, Registered Reports, Hacking, Editorial
Link to resource
Recent research in psychology has highlighted a number of replication problems in the discipline, with publication bias – the …
Author(s): G. N. Martin, Richard M. Clarke
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): JOURNAL EDITORIAL PRACTICES, P-Hacking, Psychology, Publication Bias, Replication
Link to resource
To study the availability of psychological research data, we requested data from 394 papers, published in all issues of four APA …
Author(s): Wolf Vanpaemel, Maarten Vermorgen, Leen Deriemaecker and Gert Storms
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We have created a curated scientific resource navigator called ARIADNE that will guide researchers in the field of life sciences, …
Author(s): Helena Hartmann, Çağatay Gürsoy, Alexander Lischke, Marie Mückstein, Matthias F. J. Sperl, Susanne Vogel, Yu-Fang Yang, Gordon B. Feld, Alexandros Kastrinogiannis and Alina Koppold
Type of resources: Resource Navigator
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): ARIADNE, Resource Navigation, Transparency, Reproducibility
Link to resource
Performing high-quality research is a challenging endeavor, especially for early career researchers (ECRs). Most research is …
Author(s): Helena Hartmann, Çağatay Necati Gürsoy, Alexander Lischke, Marie Mueckstein, Matthias F.J. Sperl, Susanne Vogel, Yu-Fang Yang, Gordon Feld, Alexandros Kastrinogiannis, and Alina Koppold (all are members of IGOR, the Interest Group for Open and Reproducible Science of the German Psychological Association (DGPs), section Biological Psychology and Neuropsychology)
Type of resources: Data Set, Interactive, Student Guide, Tool, Resource
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Data visualization, Code, Reproducibility, Education, Learning, Resource, Tool, Research cycle, Research process, Early career researcher
Link to resource
Performing high-quality research is a challenging endeavor, especially for early career researchers, in many fields of psychological …
Author(s): Helena Hartmann, Çağatay Gürsoy, Alexander Lischke, Marie Mueckstein, Matthias FJ Sperl, Susanne Vogel, Yu-Fang Yang, Gordon B Feld, Alexandros Kastrinogiannis, Alina Koppold
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Brain, Early Career Researcher, Education, Learning, Neuropsychology, Neuroscience, Research Cycle, Research Process, Resource, Tool, Open Materials
Link to resource
Science progresses by finding and correcting problems in theories. Good theories are those that help facilitate this process by being …
Author(s): Aba Szollosi, Chris Donkin
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Philosophy of Science, Theory Development, Confirmatory Research, Exploratory Research, Preregistration, Direct Replication
Link to resource
Poor research reporting is a major contributing factor to low study reproducibility, financial and animal waste. The ARRIVE (Animal …
Author(s): Daniel S. J. Pang, Frédérik Rousseau-Blass, Guy Beauchamp, Vivian Leung
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Life Science
Tag(s): Adverse Events, Analgesics, Anesthetics, Animal Slaughter, Animal Welfare, Finance, Publishing, Reporting Bias, Reporting Guidelines
Link to resource
Recent decades have witnessed tremendous progress in artificial intelligence and in the development of autonomous systems that rely on …
Author(s): Peter Königs
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Artificial Intelligence, Responsibility, Ethics, Just in Bello
Link to resource
The 2015 consensus statement published by the International Society for Magnetic Resonance in Medicine (ISMRM) Perfusion Study Group …
Author(s): Yuriko Suzuki, Patricia Clement, Weiying Dai, Sudipto Dolui, Maria A. Fernández-Seara, Thomas Lindner, Henk J. M. M. Mutsaerts, Jan Petr, Xingfeng Shao, Manuel Taso, David L. Thomas, ISMRM Perfusion Study Group
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Arterial Spin Labeling, Interoperability, Noninvasive, Perfusion Imaging, Reproducibility
Link to resource
There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of …
Author(s): Adel M. Abdallah, David E. Rosenberg, Hadia Akbar, James H. Stagge, Nour A. Attallah, Ryan James
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Information Science, Physical Science, Hydrology
Tag(s): Data, Reproducibility
Link to resource
Open scholarship practices, which involve sharing data, materials, preregistering studies, replication, sharing preprints, and …
Author(s): Crystal Steltenpohl, Katie Corker, Andrew Tyner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Open Scholarship Practices, Researcher Attitudes
Link to resource
Space medicine is a vital discipline with often time-intensive and costly projects and constrained opportunities for studying various …
Author(s): Rosa Katia Bellomo, Emmanual A Zavalis, John P A Ioannidis
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Space Medicine, Transparecy Indicators, Data Sharing, Code Sharing
Link to resource
To increase transparency in research, the International Committee of Medical Journal Editors required, in 2005, prospective …
Author(s): Agnès Dechartres, Carolina Riveros, Ignacio Atal, Isabelle Boutron, Philippe Ravaud
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Bias, ClinicalTrials.gov, Meta-analysis, Meta-epidemiology, Metascience, Meta-Science, Preregistration, Publishing, Randomised Controlled Trial, Registration, Reproducibility
Link to resource
Sample correlations converge to the population value with increasing sample size, but the estimates are often inaccurate in small …
Author(s): Felix D. Schonbrodt and Marco Perugini
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Objectives Prospective registration of animal studies has been suggested as a new measure to increase value and reduce waste in …
Author(s): André Bleich, Daniel Strech, Emily S. Sena, Hans Laser, René Tolba, Susanne Wieschowski
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology
Tag(s): Animal Studies, Chi Square Tests, Medical Journals, Psychological Attitudes, Publication Ethics, Publishing, Survey Research, Surveys, Theft
Link to resource
Accumulating evidence indicates high risk of bias in preclinical animal research, questioning the scientific validity and …
Author(s): Christina Nathues, Hanno Würbel, Lucile Vogt, Thomas S. Reichlin
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Experimental Design, Language, Mammals, Peer Review, Reproducibility, Research Reporting Guidelines, Research Validity, Rodents
Link to resource
Journal authorship practices have not sufficiently evolved to reflect the way research is now done. Improvements to support teams, …
Author(s): Veronique Kiermer
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Research Assessment, Open Science, Taxonomy, Medical Journals, Metadata, Centrality, Citation Analysis, Computer Software
Link to resource
A book about the autistic community and the neurodivergent movement
Author(s): Steven K. Kapp
Type of resources: Reading
Primary user(s): Student, Teacher, Parent
Subject area(s): Education, Social Science
Tag(s): Diversity, Equity, Inclusion, Neurodiversity, Autism
Link to resource
A Software Carpentry lesson to learn how to use Make Make is a tool which can run commands to read files, process these files in some …
Author(s): Adam Richie-Halford, Ana Costa Conrado, Andrew Boughton, Andrew Fraser, Andy Kleinhesselink, Andy Teucher, Anna Krystalli, Bill Mills, Brandon Curtis, David E. Bernholdt, Deborah Gertrude Digges, François Michonneau, Gerard Capes, Greg Wilson, Jake Lever, Jason Sherman, John Blischak, Jonah Duckles, Juan F Fung, Kate Hertweck, Lex Nederbragt, Luiz Irber, Matthew Thomas, Michael Culshaw-Maurer, Mike Jackson, Pete Bachant, Piotr Banaszkiewicz, Radovan Bast, Raniere Silva, Rémi Emonet, Samuel Lelièvre, Satya Mishra, Trevor Bekolay
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Make, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Scientific data and tools should, as much as possible, be free as in beer and free as in freedom. The vast majority of science today is …
Author(s): Austin Soplata
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Materials, Policy, Publishing, Reproducibility, Researchers
Link to resource
A curated list of reproducible research case studies, projects, tutorials, and media
Author(s): Jeremy Leipzig et al
Type of resources: Case Study, Data Set
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Case Studies, Tools, Ontologies, Courses, Exemplars, Runnable Papers, Organizations
Link to resource
Articles about Bad Science
Author(s): Ben Goldacre
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Blog, Reproducibility Knowledge, Open Science
Link to resource
Blogs about bad science
Author(s): Ben Goldacre
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics
Tag(s): Blog
Link to resource
Background: The reproducibility policy at the journal Biostatistics rewards articles with badges for data and code sharing. This study …
Author(s): Adrian G. Barnett, Anisa Rowhani-Farid
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Data
Link to resource
Beginning January 2014, Psychological Science gave authors the opportunity to signal open data and materials if they qualified for …
Author(s): Mallory C. Kidwell et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The research information landscape requires fundamental change. The signatories of the Barcelona Declaration on Open Research …
Author(s): Karina Batthayány, Marin Dacos, Nathalie Drach-Temam, Paola Galimberti, Marcus Munafo, Mogens Sandfaer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Physical Science, Social Science
Tag(s): Barcelona Open Research Declaration, Open Science, Open Research
Link to resource
A blog about bayesian Statistics
Author(s): David Funder
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
Bayes factors are somewhat essential to Bayesian statistics. Tony O’Hagan explains their basics
Author(s): O'Hagan
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A blog about Bayes for Beginners: Probability and Likelihood
Author(s): C. Randy Gallistel
Type of resources: Blog
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Bayesian statistics?! Once an obscure term outside specialized industry and research circles, Bayesian methods are enjoying a …
Author(s): Alicia A. Johnson, Miles Ott, Mine Dogucu
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Bayesian statistics
Link to resource
This site is dedicated to the book “Bayesian Cognitive Modeling: A Practical Course”, published by Cambridge University Press.
Author(s): Michael Lee and Eric-Jan Wagenmakers
Type of resources: Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Bayesian statistics
Link to resource
This blog post is about a new statistical visualization. This time I’ve tried to illustrate the logic of bayesian updating and …
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction
Link to resource
Bayesian hypothesis testing presents an attractive alternative to p value hypothesis testing. Part I of this series outlined several …
Author(s): Akash Raj, Alexander Etz, Alexander Ly, Alexandra Sarafoglou, Bruno Boutin, Damian Dropmann, Don van den Bergh, Dora Matzke, Eric-Jan Wagenmakers, Erik-Jan van Kesteren, Frans Meerhoff, Helen Steingroever, Jeffrey N. Rouder, Johnny van Doorn, Jonathon Love, Josine Verhagen, Koen Derks, Maarten Marsman, Martin Šmíra, Patrick Knight, Quentin F. Gronau, Ravi Selker, Richard D. Morey, Sacha Epskamp, Tahira Jamil, Tim de Jong
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Analysis, Data, Statistics
Link to resource
Experienced Registered Reports editors and reviewers come together to discuss the format and best practices for handling submissions. …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
A video about battling bad science
Author(s): TED/Ben Goldacre
Type of resources: Video
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video
Link to resource
Several researchers recently outlined unacknowledged costs of open science practices, arguing these costs may outweigh benefits and …
Author(s): Etienne P. LeBel, Lorne Campbell and Timothy J. Loving
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This repository contains materials and talks for the Berlin|Oxford Summer School 2020 from 28th September to 1st of October
Author(s): Toelch et al.
Type of resources: Lesson, Module
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Open Research
Link to resource
Given concerns about the reproducibility of scientific findings, neuroimaging must define best practices for data analysis, results …
Author(s): Thomas E. Nichols et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In recent years, a robust movement has emerged within psychology to increase the evidentiary value of our science. This movement, which …
Author(s): Finkel, E. J., Eastwick, P. W., & Reis, H. T.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
When studies examine true effects, they generate right-skewed p-curves, distributions of statistically significant results with more …
Author(s): Uri Simonsohn, Joseph P Simmons, Leif D Nelson
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
We argue that many of the crises currently afflicting science can be associated with a present failure of science to sufficiently …
Author(s): Flourishing Science Think Tank
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Academia, Flourishing, Ethics, Culture, Management
Link to resource
Statistical power analysis provides the conventional approach to assess error rates when designing a research study. However, power …
Author(s): Andrew Gelman1 and John Carlin
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
One year ago, the White House Office of Science and Technology Policy (OSTP) launched a Year of Open Science, announcing actions across …
Author(s): White House Office of Science and Technology Policy (OSTP)
Type of resources: Website
Primary user(s): Student, Teacher, Librarian
Subject area(s): Business and Communication, Career and Technical Education, Law, Life Science, Physical Science, Social Science
Tag(s): White House Office of Science and Technology Policy (OSTP), Open Science, Open Science Policy
Link to resource
Vul, Harris, Winkielman, and Pashler (2009), (this issue) argue that correlations in many cognitive neuroscience studies are grossly …
Author(s): Tal Yarkoni
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Keener et al. (2023) raise concerns about the trustworthiness of Industrial/Organizational (IO) Psychology research and related fields …
Author(s): Liana M. Kreamer, Haley R. Cobb, Christopher Castille, Joshua Cogswell
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Social Science
Tag(s): Big Team Science Initiatives, Big Team Science, Large Collaborations, Team Science
Link to resource
This guide is one of the “talks” for ABRIR’s workshop series: Increased Representation: A Vision for Inclusive Big-team Science. The …
Author(s): Lisa DeBruine
Type of resources: Workshop guide
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Big Team Science, Collaboration
Link to resource
The demand for open data and open science is on the rise, fueled by expectations from the scientific community, calls to increase …
Author(s): Dawei Lin, Matthew McAuliffe, Kim D. Pruitt, Anupama Gururaj, Christine Melchior, Charles Schmitt & Susan N. Wright
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Biomedical sciences, Data repositories
Link to resource
Academic journals have been publishing the results of biomedical research for more than 350 years. Reviewing their history reveals that …
Author(s): Richard Sever
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science, Social Science
Tag(s): Impact Factor, Publishing, Open Access, Preprints
Link to resource
Short and rapid publication of research findings has many advantages. However, there is another side of the coin that needs careful …
Author(s): Marco Bertamini, Marcus R. Munafò
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Blaze is an email newsletter service that automatically curates the best independent technical writing from the past week into …
Author(s): Alastair Rushworth
Type of resources: Search Engine/Resource Navigation Tool
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Career and Technical Education, Physical Science
Tag(s): Search Engine, Email Newsletter, Email Subscription, Technical Writings, Technical Content, Technical Blogs
Link to resource
Reprodutibilidade e replicabilidade de estudos científicos. Randomização, cegamento, planejamento amostral e pré-registro de projeto. …
Author(s): Ana Paula Herrmann and Mailton França de Vasconcelos
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Bounded ethicality refers to people’s limited capacity to consistently behave in line with their ethical standards. Here, we present …
Author(s): Amanda M. Lindkvist, Lina Koppel, Gustav Tinghög
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Life Science, Social Science
Tag(s): Bounded Ethicality, Research Ethics, Research Practice
Link to resource
A video about Frequentist accuracy of Bayesian estimates
Author(s): RoyalStatSoc/Bradley Efron
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Video, Bayesian
Link to resource
Neuroscience is advancing standardization and tool development to support rigor and transparency. Consequently, data pipeline …
Author(s): Soichi Hayashi, Bradley A. Caron, Anibal Sólon Heinsfeld, Sophia Vinci-Booher, Brent McPherson, Daniel N. Bullock, Giulia Bertò, Guiomar Niso, Sandra Hanekamp, Daniel Levitas, Kimberly Ray, Anne MacKenzie, Paolo Avesani, Lindsey Kitchell, Josiah K. Leong, Filipi Nascimento-Silva, Serge Koudoro, Hanna Willis, Jasleen K. Jolly, Derek Pisner, Taylor R. Zuidema, Jan W. Kurzawski, Kyriaki Mikellidou, Aurore Bussalb, Maximilien Chaumon, Nathalie George, Christopher Rorden, Conner Victory, Dheeraj Bhatia, Dogu Baran Aydogan, Fang-Cheng F. Yeh, Franco Delogu, Javier Guaje, Jelle Veraart, Jeremy Fischer, Joshua Faskowitz, Ricardo Fabrega, David Hunt, Shawn McKee, Shawn T. Brown, Stephanie Heyman, Vittorio Iacovella, Amanda F. Mejia, Daniele Marinazzo, R. Cameron Craddock, Emanuale Olivetti, Jamie L. Hanson, Eleftherios Garyfallidis, Dan Stanzione, James Carson, Robert Henschel, David Y. Hancock, Craig A. Stewart, David Schnyer, Damian O. Eke, Russell A. Poldrack, Steffen Bollmann, Ashley Stewart, Holly Bridge, Ilaria Sani, Winrich A. Freiwald, Aina Puce, Nicholas L. Port & Franco Pestilli
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science, Social Science
Tag(s): Cognitive Neuroscience, Computational Neuroscience, Databases, Technology, Translational Research
Link to resource
Pre-registration has become an increasingly popular proposal to address concerns regarding questionable research practices. Yet …
Author(s): Rose McDermott
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Critique
Link to resource
Not all people conform to what is socially construed as the norm and divergences should be expected. Neurodiversity is fundamental to …
Author(s): Mahmoud Elsherif, Sara Middleton, Jenny Mai Phan, Flavio Azevedo, Bethan Iley, Magdalena Grose-Hodge, Samantha Tyler, Steven Kapp, Amélie Gourdon-Kanhukamwe, Desiree Grafton-Clarke, Siu Kit Yeung, John J Shaw, Helena Hartmann, Maria Cairney, and FORRT
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education
Tag(s): Neurodiversity; Inclusivity in Academia; Open Scholarship; Higher Education; Accessibility Intersectionality; Systematic Barriers
Link to resource
The FAIR Principles are a set of good practices to improve the reproducibility and quality of data in an Open Science context. …
Author(s): Fernando Aguilar Gómez, Isabel Bernal
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Information Technology, Scientific Data, Software
Link to resource
Preregistration, which involves documentation of hypotheses, methods, and plans for data analysis prior to data collection or analysis, …
Author(s): Jennifer Tackett, Cassandra Brandes, Elizabeth Dworak, Allison Shields
Type of resources: Lesson Plan, Teaching/Learning Strategy
Primary user(s): Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Graduate Training
Link to resource
Research is cumulative. New investigations build on, challenge, or qualify claims based on prior evidence. When we have limited …
Author(s): Timothy M Errington
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Evidence, Credibility, Research, Knowledge
Link to resource
Real-world evidence (RWE) studies are increasingly used to inform policy and clinical decisions. However, there remain concerns about …
Author(s): Shirley V Wang, Anton Pottegård
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Transparency, Reproducibility, Real-World Evidence, Open Science, Pharmacoepidemiology
Link to resource
Effect sizes are the most important outcome of empirical studies. Most articles on effect sizes highlight their importance to …
Author(s): Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
I read this post over at the blog Cartesian Faith about Probability and Monte Carlo methods. The post describe how to numerically …
Author(s): Kristoffer Magnusson
Type of resources: Reading, Student Guide, Teaching/Learning Strategy, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Tutorial
Link to resource
The purpose of this course is to acquaint students with recent developments in open science and reproducibility of the research …
Author(s): Lorne Campbell
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
Campbell’s Law explains the replication crisis. In brief, useful tools such as hypotheses, p-values, and multi-study designs came to be …
Author(s): E. David Klonsky
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): HARKing, PRARKing, Preregistration Badges
Link to resource
The replication crisis threatens to seriously impact theory development in the cognitive, behavioral, and social sciences. We canvas …
Author(s): Sarahanne M. Field, Leonhard Volz, Artem Kaznatcheev & Noah van Dongen
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Metascience, Theory, Replication, Reproducibility
Link to resource
The Canadian Open Neuroscience Platform (CONP) provides an infrastructure for the promotion of open-science workflows and the sharing …
Author(s): Canadian Open Neuroscience Platform (CONP)
Type of resources: Website
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Canadian Open Neuroscience Platform (CONP), Open Science, Neuroscience Data, Data Sharing
Link to resource
Background: Despite wide recognition of the benefits of sharing research data, public availability rates have not increased …
Author(s): Daniel G Hamilton, Matthew J Page, Sarah Everitt, Hannah Fraser, Fiona Fidler
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Data Sharing, Survey, Oncology, Cancer, Open Science
Link to resource
How do psychologists determine what is true and what is false about human behavior, affect, and cognition? The question encompasses …
Author(s): Katie Corker
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Transparency, Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The current movement toward open data and open science does not fully engage with Indigenous Peoples rights and interests. Existing …
Author(s): Global Indigenous Data Alliance (GIDA)
Type of resources: Data Governance Principles
Primary user(s): Student, Teacher, Librarian
Subject area(s): Arts and Humanities, English Language Arts, History, Social Science
Tag(s): Indigenous Data Governance, Indigenous Peoples, Data Sharing, Data Governance, FAIR Principles, CARE Principles
Link to resource
some remarks on science, pseudoscience, and learning how to not fool yourself. Caltech’s 1974 commencement address
Author(s): Richard Feynman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A two-day introduction to modern evidence-based teaching practices, built and maintained by the Carpentry community.
Author(s): Aleksandra Nenadic, Alexander Konovalov, Alistair John Walsh, Allison Weber, amoskane, Amy E. Hodge, Andrew B. Collier, Anita Schürch, AnnaWilliford, Ariel Rokem, Brian Ballsun-Stanton, Callin Switzer, Christian Brueffer, Christina Koch, Christopher Erdmann, Colin Morris, Dan Allan, DanielBrett, Danielle Quinn, Darya Vanichkina, davidbenncsiro, David Jennings, Eric Jankowski, Erin Alison Becker, Evan Peter Williamson, François Michonneau, Gerard Capes, Greg Wilson, Ian Lee, Jason M Gates, Jason Williams, Jeffrey Oliver, Joe Atzberger, John Bradley, John Pellman, Jonah Duckles, Jonathan Bradley, Karen Cranston, Karen Word, Kari L Jordan, Katherine Koziar, Katrin Leinweber, Kees den Heijer, Laurence, Lex Nederbragt, Maneesha Sane, Marie-Helene Burle, Mik Black, Mike Henry, Murray Cadzow, naught101, Neal Davis, Neil Kindlon, Nicholas Tierney, Nicolás Palopoli, Noah Spies, Paula Andrea Martinez, Petraea, Rayna Michelle Harris, Rémi Emonet, Rémi Rampin, Sarah Brown, Sarah M Brown, Sarah Stevens, satya-vinay, Sean, Serah Anne Njambi Kiburu, Stefan Helfrich, Stéphane Guillou, Steve Moss, Ted Laderas, Tiago M. D. Pereira, Toby Hodges, Tracy Teal, Yo Yehudi
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Education, Higher Education, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
The biomedical sciences must maintain and enhance a research culture that prioritizes rigour and transparency. The US National …
Author(s): Audrey C Brumback, William X Q Ngiam, Dana M Lapato, David B Allison, Christin L Daniels, Michael Dougherty, Haley F Hazlett, Kara L Kerr, Susan Pusek, Melissa L Rethlefsen, Naomi Schrag
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Open Science, Scientific Rigour, Reproducibility
Link to resource
We present the design of a portable coronagraph, CATEcor (where CATE stands for Continental-America Telescope Eclipse), that …
Author(s): Craig DeForest, Daniel B. Seaton, Amir Caspi, Matt Beasley, Sarah J. Davis, Nicholas F. Erickson, Sarah A. Kovac, Ritesh Patel, Anna Tosolini & Matthew J. West
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Physical Science
Tag(s): Coronagraph
Link to resource
The credibility revolution in social science has led to the recommendation and adoption of practices to increase the replicability of …
Author(s): Emily C. Willroth, Eileen K. Graham, Daniel K. Mroczek
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Replicability, Template
Link to resource
As the field of education, and especially gifted education, gradually moves toward open science, our research community increasingly …
Author(s): Renbarger, R., Adelson, J. L., Rosenberg, J. M., Stegenga, S., Lowrey, O., Buckley, P. R., & Zhang, Q.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Open Science, Journal Reviewer, Peer Review, Education, Research Transparency
Link to resource
The editors of the Journal of Advanced Academics comment on Makel (2014). The replicability crisis in psychology is summarized in terms …
Author(s): Matthew T. McBee and Michael S. Matthews
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Peer review is a core component of scientific progression. Although peer review ideally improves research and promotes rigor, it also …
Author(s): Reviewer Zero
Type of resources: Reading
Primary user(s): Researchers, journal editors
Subject area(s): Social Science
Tag(s): Peer review, open review, diversity, inclusion, equity
Link to resource
A paper about open science and novelty
Author(s): Forscher, B. K.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Context Recent reports highlight gaps between guidelines-based treatment recommendations and evidence from clinical trials that …
Author(s): Robert M. Califf, Deborah A. Zarin, Judith M. Kramer, Rachel E. Sherman, Laura H. Aberle, Asba Tasneem
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Clinical Trials, Preregistration
Link to resource
I asked ChatGPT to talk about open science. This post is the unabridged conversation. ChatGPT is a trained algorithm using machine …
Author(s): Nate Breznau
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Artificial Intelligence, Open Science, Public Science, Teaching, ChatGPT, Machine Learning
Link to resource
Breaking Continuous Flash Suppression (bCFS) has been adopted as an appealing means to study human visual awareness, but the literature …
Author(s): Guido Hesselmann, Isabell Wartenburger, James Allen Kerr, Philipp Sterzer, Romy Räling
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Data
Link to resource
Psychology has historically been concerned, first and foremost, with explaining the causal mechanisms that give rise to behavior. …
Author(s): Yarkoni, T., & Westfall, J.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Chromebook Data Science (CBDS) is a free, massive open online educational program offered through Leanpub to help anyone who can read, …
Author(s): Jeff Leek, Ashley Johnson, Shannon Ellis, Aboozar Hadavand, John Muschelli, Sean Kross, Leo Collado-Torres, Leah Jager, Sarah McClymont, Leslie Myint
Type of resources: Full Course, Lesson, Module
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Data Science Tool
Link to resource
Esta disciplina destina-se a alunos em níveis de Mestrado e Doutorado do Programade Pós-Graduação em Ciências da Saúde: Cardiologia e …
Author(s): Daniel Umpierre de Moraes
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Welcome to Episode 8, where I talk to SIMINE VAZIRE, Associate Professor of Psychology at the University of California at Davis, about …
Author(s): Jim Coan
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
Introduction to citations as a presentation. Citing data and code as well as getting citations for data and code.
Author(s): Vicky Steeves
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Citation, Data, Materials, Open Scholarship Guidelines, Repositories, Research Data Management Tools, Researchers
Link to resource
This editorial announces the decision of the Canadian Journal of Experimental Psychology (CJEP) to offer Open Science Framework (OSF) …
Author(s): Penny M Pexman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Science Badges
Link to resource
Protzko et al.1 describe a project in which internal tests of pilot-tested hypotheses and independent replications embraced …
Author(s): Joseph Bak-Coleman & Berna Devezer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Preregistration, False Preregistration
Link to resource
Many clinical trials conducted by academic organizations are not published, or are not published completely. Following the US Food and …
Author(s): Anthony Keyes, Audrey Omar, Carrie Dykes, Daniel E. Ford, Diane Lehman Wilson, Evan Mayo-Wilson, G. Caleb Alexander, Hila Bernstein, James Heyward, Jesse Reynolds, Keren Dunn, Leah Silbert, M. E. Blair Holbein, Nidhi Atri, Niem-Tzu (Rebecca) Chen, Sarah White, Yolanda P. Davis
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Publishing, Reporting
Link to resource
Altruism and trust lie at the heart of research on human subjects. Altruistic individuals volunteer for research because they trust …
Author(s): Catherine De Angelis, Jeffrey M Drazen, Frank A Frizelle, Charlotte Haug, John Hoey, Richard Horton, Sheldon Kotzin, Christine Laine, Ana Marusic, A John PM Overbeke, Torben V Schroeder, Hal C Sox, Martin B Van Der Weyden
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Preregistration, Medicine, Clinical Trial Registration
Link to resource
In 2005, the International Committee of Medical Journal Editors (ICMJE) initiated a policy requiring investigators to deposit …
Author(s): Christine Laine, Richard Horton, Catherine D DeAngelis, Jeffrey M Drazen, Frank A Frizelle, Fiona Godlee, Charlotte Haug, Paul C Hébert, Sheldon Kotzin, Ana Marusic, Peush Sahni, Torben V Schroeder, Harold C Sox, Martin B Van Der Weyden, Freek WA Verheugt
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Trial Registration, Medicine, Preregistration
Link to resource
All parties associated in clinical trials—patients, doctors, scientists, industry—share a common desire for a vigorous clinical …
Author(s): Ida Sim, An-Wen Chan, A Metin Gülmezoglu, Tim Evans, Tikki Pang
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Trial Registration, Medicine, Preregistration
Link to resource
In order to teach Open and Reproducible Science effectively, educators need to make sense of almost a decade of literature, across …
Author(s): Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Diagram/Illustration, Student Guide, Teaching/Learning Strategy
Primary user(s): Teacher
Subject area(s): Education
Tag(s): Clusters; Replicability; Conceptual and statistical knowledge; Pre-analysis planning; Transparency; Reproducibility; FAIR data; Replication; Meta-research; Academic
Link to resource
A website about questions on psychology
Author(s): Anon
Type of resources: Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher, Adminstrator, Parent, Librarian
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Website
Link to resource
This document is summarised in the table below. It shows the linear models underlying common parametric and “non-parametric” tests. …
Author(s): Jonas Kristoffer Lindeløv
Type of resources: Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Statistics
Link to resource
The state of open science needs to be monitored to track changes over time and identify areas to create interventions to drive …
Author(s): Kelly D. Cobey, Stefanie Haustein, Jamie Brehaut, Ulrich Dirnagl, Delwen L. Franzen, Lars G. Hemkens, Justin Presseau, Nico Riedel, Daniel Strech, Juan Pablo Alperin, Rodrigo Costas, Emily S. Sena, Thed van Leeuwen, Clare L. Ardern, Isabel O. L. Bacellar, Nancy Camack, Marcos Britto Correa, Roberto Buccione, Maximiliano Sergio Cenci, Dean A. Fergusson, Cassandra Gould van Praag, Michael M. Hoffman, Renata Moraes Bielemann, Ugo Moschini, Mauro Paschetta, Valentina Pasquale, Valeria E. Rac, Dylan Roskams-Edris, Hermann M. Schatzl, Jo Anne Stratton, David Moher
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Open Science, Open Science Practices, Biomedicine
Link to resource
In order to reduce barriers to entry and understanding, we present a Glossary of terms relating to open scholarship. We aim that the …
Author(s): Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading, Student Guide, Teaching/Learning Strategy, Glossary
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education, Math & Statistics, Social Science
Tag(s): Glossary; Guide; Open Scholarship; Open Scholarship Terms; Terminology; Teaching
Link to resource
Discrepancies between pre-specified and reported outcomes are an important source of bias in trials. Despite legislation, guidelines …
Author(s): Aaron Dale, Anna Powell-Smith, Ben Goldacre, Carl Heneghan, Cicely Marston, Eirion Slade, Henry Drysdale, Ioan Milosevic, Kamal R. Mahtani, Philip Hartley
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Bias, Data, Preregistration, Registration, Reporting, Reporting Guidelines, Reproducibility
Link to resource
In psychology, preregistration is the most widely used method to ensure the confirmatory status of analyses. However, the method has …
Author(s): Alexandra Sarafoglou, Suzanne Hoogeveen, Eric-Jan Wagenmakers
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Open Science, Metascience, Replication Crisis, Many Analysts, Open Data, Open Materials, Preregistration
Link to resource
Academic publishers claim that they add value to scholarly communications by coordinating reviews and contributing and enhancing text …
Author(s): Martin Klein, Peter Broadwell, Sharon E. Farb, Todd Grappone
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Knowledge
Link to resource
Preregistration forces researchers to front-load a lot of decision-making to an early stage of a project. Choosing which …
Author(s): Steve Haroz
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Preregistration
Link to resource
Clinical trial registries can improve the validity of trial results by facilitating comparisons between prospectively planned and …
Author(s): Christopher W. Jones, Lukas G. Keil, Melissa C. Caughey, Timothy F. Platts-Mills, Wesley C. Holland
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Data, Publishing
Link to resource
Context: As of 2005, the International Committee of Medical Journal Editors required investigators to register their trials prior to …
Author(s): Sylvain Mathieu, Isabelle Boutron, David Moher, Douglas G Altman, Philippe Ravaud
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Puberty is a phase in which individuals often test the boundaries of themselves and surrounding others and further define their …
Author(s): Timon Elmer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Computational Social Science, Passive Measurement, Digital Trace Data, Validity, Open science Practices, Metascience
Link to resource
In recent years, the field of psychology has increasingly recognized the importance of conducting research with …
Author(s): Lydia F. Emery, David M. Silverman, Rebecca M. Carey
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Social Science
Tag(s): Diversity, Participants, Socioeconomic Status, SES
Link to resource
Conflicting results undermine making inferences from the empirical literature. So far, the replication crisis is mainly seen as …
Author(s): Mariusz Maziarz
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Questionable Research Practices, Quantitative Research
Link to resource
This webinar (recorded Sept. 27, 2017) introduces how to connect other services as add-ons to projects on the Open Science Framework …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Informed consent documentation is legally, ethically, and scientifically imperative for research and provides prospective trial …
Author(s): Sydney A. Axson, PhD, MPH; Reshma Ramachandran, MD, MPP, MHS; Alexa Lisenby, BS; Nicholas A. Giordano, PhD, RN
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Informed Consent
Link to resource
This video will go over three issues that can arise when scientific studies have low statistical power. All materials shown in the …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Examined the consequences of prejudice against accepting the null hypothesis through (a) a mathematical model intended to stimulate the …
Author(s): Anthony G. Greenwald
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Publication bias leads consumers of research to observe a selected sample of statistical estimates calculated by producers of research. …
Author(s): Justin McCrary, Garret Christensen, Daniele Fanelli
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The number of papers presenting machine learning (ML) models that are being submitted to and published in the Journal of Medical …
Author(s): Khaled El Emam, Tiffany I Leung, Bradley Malin, William Klemen, Gunther Eysenbach
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Career and Technical Education, Life Science
Tag(s): Reporting Guidelines, MAchine Learning, Predictive Models, Diagnostic Models, Prognostic Models, Artificial Intelligence, Editorial Policy
Link to resource
Background Recently, trials have supported changes in deep caries management. However, reporting might lack details, affecting …
Author(s): Rokaia Ahmed Elagami, Thais Marchezini Reis, Mohamed Ahmed Hassan, Tamara Kerber Tedesco, Mariana Minatel Braga, Fausto Medeiros Mendes, Maximiliano Sérgio Cenci, Marie-Charlotte Huysmans & Daniela Prócida Raggio
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): CONSORT, Metascience
Link to resource
Whether or not a replication attempt counts as “direct” often cannot be determined definitively after the fact as a result of …
Author(s): Daniel J. Simons, Yuichi Shoda and D. Stephen Lindsay
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The verity of results about a psychological construct hinges on the validity of its measurement, making construct validation a …
Author(s): Flake, J. K., Pek, J., & Hehman, E.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The current crisis in scientific psychology about whether our findings are irreproducible was presaged years ago by Tversky and …
Author(s): Sanford L. Braver, Felix J. Thoemmes, Robert Rosenthal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
It is normal to deal with difficult situations during PhD studies. Students and their advisors can set themselves up for success and …
Author(s): Evie Vergauwe
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Psychology, Research Management, Scientific Community, PhD
Link to resource
Publication bias and questionable research practices in primary research can lead to badly overestimated effects in meta-analysis. …
Author(s): Evan C. Carter, Felix D. Schönbrodt, Will M. Gervais, and Joseph Hilgard
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Effect size information is essential for the scientific enterprise and plays an increasingly central role in the scientific process. We …
Author(s): Bosco, F. A., Aguinis, H., Singh, K., Field, J. G., & Pierce, C. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The session was part of the COS 10 Year Anniversary, which took place in Washington, DC on May 8, 2023.
Author(s): Center for Open Science (COS), Brian Nosek
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Education, Life Science, Physical Science, Social Science
Tag(s): Center for Open Science, Credibility, Trustworthiness
Link to resource
Registered Reports: Peer review before results are known to align scientific values and practices.
Registered Reports is a publishing …
Author(s): Center for Open Science, David Mellor
Type of resources: Student Guide
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Preregistration, Publishing Models, Registered Reports, Reproducibility
Link to resource
Learn about courses, in a wide range of fields at a variety of institutions, where principles and resources from Project TIER have been …
Author(s): Project TIER
Type of resources: Module, Syllabus
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
These lectures and tutorials introduce students to the scientific process and open research practices, in order to ensure that …
Author(s): Dermot Lynott & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Full Course
Primary user(s): Teacher
Subject area(s): Education, Social Science
Tag(s): Open Science Education; Research Integrity; Undergraduate; Reproducibility; Questionable Research Practices; Preregistration; Ethics; Academic Course; Psychological Research Methods
Link to resource
A collection of course syllabi from any discipline featuring content to examine or improve open and reproducible research practices. …
Author(s): Ball et al.
Type of resources: Reading, syllabus
Primary user(s): Student, Teacher, Researchers
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Collection, Reproducibility Knowledge
Link to resource
Formal onboarding materials help to introduce new undergraduate researchers to a specific laboratory and the broader culture of the …
Author(s): Ivan A. Hernandez, Jessi L. Smith, Miguel T. Villodas & Dustin B. Thoman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Culture, Human Behaviour, Research Management, Scientific Community, Onboarding Materials
Link to resource
Preprints increase accessibility and can speed scholarly communication if researchers view them as credible enough to read and use. …
Author(s): Courtney K. Soderberg et al.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preprints
Link to resource
CREP’s mission is to provide training, support, and professional growth opportunities for students and instructors completing …
Author(s): Jon Grahe et al.
Type of resources: Primary Source, Reading, Project
Primary user(s): Student, Teacher, Researchers
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Knowledge, OSF Project
Link to resource
This playlist was created to help students and their instructors complete CREP projects.
Author(s): Dr Jordan Wagge
Type of resources: Videos
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility and replicability
Link to resource
A blog about the crisis of research
Author(s): Anna Scheel
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Open science
Link to resource
A website about questions on statistics
Author(s): Anon
Type of resources: Student Guide, Teaching/Learning Strategy, Unit of Study, Website
Primary user(s): Student, Teacher, Librarian
Subject area(s): Math & Statistics
Tag(s): Website
Link to resource
Crowdsourcing research can balance discussions, validate findings and better inform policy, say Raphael Silberzahn and Eric L. Uhlmann.
Author(s): Silberzahn, R., & Uhlmann, E.L.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background Transcriptomes present a rich, multi-dimensional subset of genomics data. They provide broad insights into genetic sequence, …
Author(s): Camerion J Hyde, Tomer Ventura
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Crustacea, Differential Gene Expression, Online Resource, RNA-Seq, Transcriptome
Link to resource
Curate Science is a unified curation system and platform to verify that research is transparent and credible. It will allow …
Author(s):
Type of resources: Data Set
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Funders, Open Scholarship Guidelines, Publishers, Reproducibility, Research Administration, Researchers, Research Integrity
Link to resource
Recent calls for improving reproducibility have increased attention to the ways in which researchers curate, share, and collaborate on …
Author(s): Matti Vuorre and James P. Curley
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
We can regard the wider incentive structures that operate across science, such as the priority given to novel findings, as an ecosystem …
Author(s): Andrew D. Higginson, Marcus R. Munafò
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Careers, Careers in Research, Drug Discovery, Ecosystems, Peer Review, Research Assessment, Research Errors, Scientists
Link to resource
Improving the usability of psychological research has been encouraged through practices such as prospectively registering research …
Author(s): Danielle B. Rice, David Moher
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Registration, Open Science, Preregistration, Registered Reports
Link to resource
DAGitty is a browser-based environment for creating, editing, and analyzing causal diagrams (also known as directed acyclic graphs or …
Author(s): Johannes Texor, Maciej Liśkiewicz and Benito van der Zander
Type of resources: Teaching/Learning Strategy, R code
Primary user(s): Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Website
Link to resource
Python is a general purpose programming language that is useful for writing scripts to work effectively and reproducibly with data. …
Author(s): Maxim Belkin, Tania Allard
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Python, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Data Carpentry lesson from Ecology curriculum to learn how to analyse and visualise ecological data in R. Data Carpentry’s aim is to …
Author(s): Ankenbrand, Markus, Arindam Basu, Ashander, Jaime, Bahlai, Christie, Bailey, Alistair, Becker, Erin Alison, Bledsoe, Ellen, Boehm, Fred, Bolker, Ben, Bouquin, Daina, Burge, Olivia Rata, Burle, Marie-Helene, Carchedi, Nick, Chatzidimitriou, Kyriakos, Chiapello, Marco, Conrado, Ana Costa, Cortijo, Sandra, Cranston, Karen, Cuesta, Sergio Martínez, Culshaw-Maurer, Michael, Czapanskiy, Max, Daijiang Li, Dashnow, Harriet, Daskalova, Gergana, Deer, Lachlan, Direk, Kenan, Dunic, Jillian, Elahi, Robin, Fishman, Dmytro, Fouilloux, Anne, Fournier, Auriel, Gan, Emilia, Goswami, Shubhang, Guillou, Stéphane, Hancock, Stacey, Hardenberg, Achaz Von, Harrison, Paul, Hart, Ted, Herr, Joshua R., Hertweck, Kate, Hodges, Toby, Hulshof, Catherine, Humburg, Peter, Jean, Martin, Johnson, Carolina, Johnson, Kayla, Johnston, Myfanwy, Jordan, Kari L, K. A. S. Mislan, Kaupp, Jake, Keane, Jonathan, Kerchner, Dan, Klinges, David, Koontz, Michael, Leinweber, Katrin, Lepore, Mauro Luciano, Lijnzaad, Philip, Li, Ye, Lotterhos, Katie, Mannheimer, Sara, Marwick, Ben, Michonneau, François, Millar, Justin, Moreno, Melissa, Najko Jahn, Obeng, Adam, Odom, Gabriel J., Pauloo, Richard, Pawlik, Aleksandra Natalia, Pearse, Will, Peck, Kayla, Pederson, Steve, Peek, Ryan, Pletzer, Alex, Quinn, Danielle, Rajeg, Gede Primahadi Wijaya, Reiter, Taylor, Rodriguez-Sanchez, Francisco, Sandmann, Thomas, Seok, Brian, Sfn_brt, Shiklomanov, Alexey, Shivshankar Umashankar, Stachelek, Joseph, Strauss, Eli, Sumedh, Switzer, Callin, Tarkowski, Leszek, Tavares, Hugo, Teal, Tracy, Theobold, Allison, Tirok, Katrin, Tylén, Kristian, Vanichkina, Darya, Voter, Carolyn, Webster, Tara, Weisner, Michael, White, Ethan P, Wilson, Earle, Woo, Kara, Wright, April, Yanco, Scott, Ye, Hao
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Ecology, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Python is a general purpose programming language that is useful for writing scripts to work effectively and reproducibly with data. …
Author(s): Geoffrey Boushey, Stephen Childs
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Python, Reproducibility, Research Data Management Tools, Researchers
Link to resource
n.a.
Author(s): TONELLI MJ;ZAMBALDI F
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication
Tag(s): .
Link to resource
Access to data is a critical feature of an efficient, progressive and ultimately self-correcting scientific ecosystem. But the extent …
Author(s): Alicia Hofelich Mohr, Bria Long, Elizabeth Clayton, Erica J. Yoon, George C. Banks, Gustav Nilsonne, Kyle MacDonald, Mallory C. Kidwell, Maya B. Mathur, Michael C. Frank, Michael Henry Tessler, Richie L. Lenne, Sara Altman, Tom E. Hardwicke
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Data, Policy, Reproducibility
Link to resource
Data Carpentry trains researchers in the core data skills for efficient, shareable, and reproducible research practices. We run …
Author(s): Data Carpentry Community
Type of resources: Full Course
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analyses, Data, Reproducibility, Research Data Management, Researchers
Link to resource
The Biology Semester-long Course was developed and piloted at the University of Florida in Fall 2015. Course materials include …
Author(s): Ethan White, Zachary Brym
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Biology, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers, SQL
Link to resource
Course materials on using OpenRefine, a powerful tool for cleaning and transforming tabular data.
Author(s): Nick Wolf, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Data, Open Scholarship Tools and Technologies, Research Data Management Tools, Researchers
Link to resource
A part of the data workflow is preparing the data for analysis. Some of this involves data cleaning, where errors in the data are …
Author(s): Cam Macdonell, Deborah Paul, Phillip Doehle, Rachel Lombardi
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
This Library Carpentry lesson introduces archivists to working with data. At the conclusion of the lesson you will: be able to explain …
Author(s): James Baker, Jeanine Finn, Jenny Bunn, Katherine Koziar, Noah Geraci, Scott Peterson
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Applied Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Librarians, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools
Link to resource
Original data has become more accessible thanks to cultural and technological advances. On the internet, we can find innumerable data …
Author(s): Pablo Bernabeu
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Librarians, Open Data, Open Source Software, Publishers, Researchers, Visualization
Link to resource
A series of video of data management
Author(s): Patrick S. Forscher
Type of resources: Video
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Data management
Link to resource
Introduction to data management and reproducibility for researchers as a presentation.
Author(s): Vicky Steeves
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Data, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management, Researchers
Link to resource
Providing access to research data collected as part of scientific publications and publicly funded research projects is now regarded as …
Author(s): Mario Gollwitzer, Andrea Abele-Brehm, Christian Fiebach, Roland Ramthun, Anne Scheel, Felix Schönbrodt, Ulf Steinberg
Type of resources: Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Open data
Link to resource
Data management - including data preparation, cleaning, storage, and sharing - is critical to psychological research. Despite its …
Author(s): Debolt et al.
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Applied Science, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Data management, Reproducible Analyses
Link to resource
Background Open Science Graphs (OSGs) are scientific knowledge graphs representing different entities of the research lifecycle (e.g. …
Author(s): Elli Papadopoulou, Alessia Bardi, George Kakaletris, Diamadis Tziotzios, Paolo Manghi, Natalia Manola
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Research Data Management, Data Management Plans, FAIR DMPs, Machine Actionable, Research Graphs, Knowledge Graphs, Open Science
Link to resource
Databases are useful for both storing and using data effectively. Using a relational database serves several purposes. It keeps your …
Author(s): Christina Koch, Donal Heidenblad, Katy Felkner, Rémi Rampin, Timothée Poisot
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Databases, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, SQL
Link to resource
This is an alpha lesson to teach Data Management with SQL for Social Scientists, We welcome and criticism, or error; and will take your …
Author(s): Peter Smyth
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data, Social Science
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, SQL
Link to resource
Good data organization is the foundation of any research project. Most researchers have data in spreadsheets, so it’s the place that …
Author(s): Christie Bahlai, Peter R. Hoyt, Tracy Teal
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, Spreadsheets
Link to resource
Lesson on spreadsheets for social scientists. Good data organization is the foundation of any research project. Most researchers have …
Author(s): David Mawdsley, Erin Becker, François Michonneau, Karen Word, Lachlan Deer, Peter Smyth
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science, Measurement and Data, Social Science
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, Spreadsheets
Link to resource
Aging and lifespan development researchers have been fortunate to have public access to many longitudinal datasets. These data are …
Author(s): Daniel K. Mroczek, Sara J. Weston, Eileen K. Graham, Emily C. Willroth
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Lifespan Development, Aging, Data Overuse, Bias
Link to resource
Blog post going over data peeking without p-hacking
Author(s): Daniel Lakens
Type of resources: Reading, R Code
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Code, Open Science, Reproducibility Crisis and Credibility Revolution
Link to resource
By encouraging and requiring that authors share their data in order to publish articles, scholarly journals have become an important …
Author(s): Abigail Schwartz, Dessi Kirilova, Gerard Otalora, Julian Gautier, Mercè Crosas, Sebastian Karcher
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Social Science, Psychology
Tag(s): Data, Data-Sharing Policies, Funder Policies, Open Data, Open Science, Policy
Link to resource
Background. Attribution to the original contributor upon reuse of published data is important both as a reward for data creators and to …
Author(s): Heather A. Piwowar and Todd J. Vision
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Background Scientific research in the 21st century is more data intensive and collaborative than in the past. It is important to study …
Author(s): Arsev Umur Aydinoglu, Carol Tenopir, Eleanor Read, Kimberly Douglass, Lei Wu, Maribeth Manoff, Mike Frame, Suzie Allard
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Ecology, Social Science
Tag(s): Data, Data Acquisition, Data Management, Data Processing, Ecology and Environmental Sciences, Europe, Scientists, Social Sciences, Surveys
Link to resource
A number of publishers and funders, including PLOS, have recently adopted policies requiring researchers to share the data underlying …
Author(s): Alicia Livinski, Christopher W. Belter, Douglas J. Joubert, Holly Thompson, Lisa M. Federer, Lissa N. Snyders, Ya-Ling Lu
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Computer Science, Health, Medicine and Nursing, Information Science, Social Science
Tag(s): Data, Institutional Repositories, Open Data, Policy, Public Policy, Publishing, Randomized Controlled Trials, Reproducibility, Research Validity, Science Policy, Scientific Publishing
Link to resource
Despite its potential to accelerate academic progress in psychological science, public data sharing remains relatively uncommon. In …
Author(s): Houtkoop et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Introduction The practice of creating large databases has become increasingly common by combining research participants’ data into …
Author(s): Deborah Ekusai-Sebatta, Moses Ocan, Shenuka Singh, David Kyaddondo, Dickens Akena, Loyce Nakalembe, Robert Apunyo, Alison Annet Kinengyere, Eve Namisango, Ekwaro A. Obuku, Erisa Mwaka
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Human Genomics, Low and Middle Income Countries, Systematic Reviews, Database Searching, Science Policy, Research Ethics, Research Design, Survey Research
Link to resource
A tutorial on a priori and sensitivity power analyses using G*power
Author(s): Andrew Livingstone
Type of resources: Video
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Power analysis
Link to resource
Data Carpentry lesson to learn how to use command-line tools to perform quality control, align reads to a reference genome, and …
Author(s): Adam Thomas, Ahmed R. Hasan, Aniello Infante, Anita Schürch, dbmarchant, Dev Paudel, Erin Alison Becker, Fotis Psomopoulos, François Michonneau, Gaius Augustus, Gregg TeHennepe, Jason Williams, Jessica Elizabeth Mizzi, Karen Cranston, Kari L Jordan, Kate Crosby, Kevin Weitemier, Lex Nederbragt, Luis Avila, Peter R. Hoyt, Rayna Michelle Harris, Ryan Peek, Sheldon John McKay, Sheldon McKay, Taylor Reiter, Tessa Pierce, Toby Hodges, Tracy Teal, Vasilis Lenis, Winni Kretzschmar
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Genetics, Measurement and Data
Tag(s): Analysis, Data, Education, Genomics, Inside Your Classroom, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, Shell
Link to resource
Data sharing promotes scientific progress by permitting replication of prior scientific analyses and by increasing the return on the …
Author(s): Margaret C. Levenstein and Jared A. Lyle
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Software Carpentry lesson that teaches how to use databases and SQL In the late 1920s and early 1930s, William Dyer, Frank Pabodie, and …
Author(s): Amy Brown, Andrew Boughton, Andrew Kubiak, Avishek Kumar, Ben Waugh, Bill Mills, Brian Ballsun-Stanton, Chris Tomlinson, Colleen Fallaw, Daniel Suess, Dan Michael Heggø, Dave Welch, David W Wright, Deborah Gertrude Digges, Donny Winston, Doug Latornell, Erin Alison Becker, Ethan Nelson, Ethan P White, François Michonneau, George Graham, Gerard Capes, Gideon Juve, Greg Wilson, Ioan Vancea, Jake Lever, James Mickley, John Blischak, JohnRMoreau@gmail.com, Jonah Duckles, Jonathan Guyer, Joshua Nahum, Kate Hertweck, Kevin Dyke, lorra, Louis Vernon, Luc Small, Luke William Johnston, Maneesha Sane, Mark Stacy, Matthew Collins, Matty Jones, Mike Jackson, Morgan Taschuk, Patrick McCann, Paula Andrea Martinez, Pauline Barmby, Piotr Banaszkiewicz, Raniere Silva, Ray Bell, Rayna Michelle Harris, Rémi Emonet, Rémi Rampin, Seda Arat, Sheldon John McKay, Sheldon McKay, slimlime, Stephen Davison, Thomas Guignard, Trevor Bekolay
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, SQL
Link to resource
Background All clinical research benefits from transparency and validity. Transparency and validity of studies may increase by …
Author(s): Bart Hiemstra, Christian Gluud, Frederik Keus, Iwan C. C. van der Horst, Jørn Wetterslev
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Authorship, Data, Data Management, Publishing, Randomized Trial, Research Ethics
Link to resource
The reported inability to replicate research findings from the published literature precipitated extensive efforts to identify and …
Author(s): Michael F Jarvis
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Replication, Reproducibility, Reliability, Cystic Fibrosis
Link to resource
This paper is a study of the decisions that researchers take during the execution of a research plan: their researcher discretion. …
Author(s): Tom van Drimmelen, M. Nienke Slagboom, Ria Reis, Lex M. Bouter & Jenny T. van der Steen
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Physical Science
Tag(s): Researcher Discretion, Researcher Degrees Of Freedom, Ethnography, Research Integrity, Responsible Conduct Of Research
Link to resource
Preregistration of studies is a recognized tool in clinical research to improve the quality and reporting of all gained results. In …
Author(s): Céline Heinl, Anna M D Scholman-Végh, David Mellor, Gilbert Schönfelder, Daniel Strech, Steven Chamuleau, Bettina Bert
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Open Science, Preregistration, Animal Research, Preclinical Research, 3R, Research Methods
Link to resource
The World Medical Association’s Declaration of Helsinki is in the process of being revised. The following amendments are recommended to …
Author(s): Chieko Kurihara, Sandor Kerpel-Fronius, Sander Becker, Anthony Chan, Yasmin Nagaty, Shehla Naseem, Johanna Schenk, Kotone Matsuyama, Varvara Baroutsou
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Declaration of Helsinki, Data-driven Research, Placebo, Post-Trial Access, Stakeholder Involvement, Health for all
Link to resource
Despite the progressive efforts of the Open Science movement to produce more internationally inclusive models of research and …
Author(s): Forum for Open Research in MENA (FORM)
Type of resources: Activity/Lab, Symposium
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Education, Social Science
Tag(s): Open Science, Inclusive Research and Education, Global South
Link to resource
This deep dive session on replications and large-scale collaborations introduces a glossary of relevant terms, the problems these …
Author(s): Erin Miller, Jay Carter, Matt Makel, Scott Peters
Type of resources: Lesson
Primary user(s): other
Subject area(s): Education
Tag(s): Open Science, Replication, Research Best Practices, Research Collaboration, Research Replication
Link to resource
In this deep dive session, Dr. Willa van Dijk discusses how transparency with data, materials, and code is beneficial for educational …
Author(s): Willa van Dijk
Type of resources: Lesson
Primary user(s): other
Subject area(s): Education
Tag(s): Code Transparency, Educational Research, Education Research, Inside Your Classroom, Open Code, Open Data, Open Materials, Open Scholarship, Open Science, Research Best Practices
Link to resource
In this deep dive session, we discuss the current model of scholarly publishing, and highlight the challenges and limitations of this …
Author(s): Bryan Cook, Stacy Shaw
Type of resources: Lesson
Primary user(s): other
Subject area(s): Education
Tag(s): Open Access, Open Scholarship, Open Science, Preprints, Scholarly Publishing
Link to resource
In this deep dive session, Amanda Montoya (UCLA) and Karen Rambo-Hernandez (Texas A&M University) introduce the basics of …
Author(s): Amanda Montoya, Karen Rambo-Hernandez
Type of resources: Lesson
Primary user(s): other
Subject area(s): Education
Tag(s): Open Scholarship, Open Science, Preregistration, Registered Reports, Research Best Practices
Link to resource
As sharing data openly becomes more and more the norm, and not just because of mandates for federal funding, more researchers may …
Author(s): Sara Hart
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Center for Open Science, Data Sharing, Education, Sara Hart, Unconference 2022
Link to resource
In this deep dive session, we introduce the basics of pre-registration: a method for creating a permanent record of a research plan …
Author(s): Karen Rambo-Hernandez, Scott Peters
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Center for Open Science, Education, Karen Rambo-Hernandez, Open Science, Preregistration, Pre-registration in Education Research, Pre-registration in Science, Scott Peters, Unconference 2022
Link to resource
Deep Dive on Open Practices: Understanding Registered Reports in Education Research with Amanda Montoya and Betsy McCoach - Registered …
Author(s): Amanda Montoya, Betsy McCoach
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Amanda Montoya, Betsy McCoach, Center for Open Science, Education, Open Science, Registered Reports, Registered Reports in Education Research, Unconference 2022
Link to resource
Deep Dive on Open Practices: Understanding Replication in Education Research with Matt Makel - In this deep dive session, we introduce …
Author(s): Matt Makel
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Center for Open Science, Education, Matt Makel, Open Science, Replication in Education Research, Unconference 2022
Link to resource
The concept of validity has suffered because the term has been used to refer to 2 incompatible concerns: the degree of support for …
Author(s): G.J. Cizek
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Author(s): Fiona Fidler
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
The designing, collecting, analyzing, and reporting of psychological studies entail many choices that are often arbitrary. The …
Author(s): Jelte M. Wicherts, Coosje L. S. Veldkamp, Hilde E. M. Augusteijn, Marjan Bakker, Robbie C. M. van Aert, and Marcel A. L. M. van Assen
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A lot of researchers seem to be struggling with their understanding of the statistical concept of degrees of freedom. Most do not …
Author(s): Ron Dotsch
Type of resources: Reading, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Tutorial
Link to resource
Although there is clear potential to improve science and innovation systems through big data and open science, barriers still remain …
Author(s): OECD
Type of resources: Reading
Primary user(s):
Subject area(s): Life Science, Biology
Tag(s): Aging Science, Big Data, Consumer Policy, Dementia, E-commerce, E-Government, Health, Innovation, OECD, Openness, Open Science, Science, Security
Link to resource
Open Science practices are integral to increasing transparency, reproducibility, and accessibility of research in health psychology and …
Author(s): Emma Norris, Aoife O’Mahony, Rory Coyne, Tugce Varol, James A. Green, James Reynolds and Elaine Toomey
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Open Science, Open Scholarship, Open Research, Registered Reports, Data Notes, Health Psychology, Behavioral Medicine
Link to resource
Open Science practices are integral to increasing transparency, reproducibility and accessibility of research in health psychology and …
Author(s): Emma Norris, Aoife O'Mahony, Rory Coyne, Tugce Varol, James Green, James Reynolds, and Elaine Toomey
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Science, Open Scholarship, Open Research, Registered Reports, Data Notes, Health Psychology, Behavioural Medicine
Link to resource
Calls for public access to research data have been ongoing for some time. For instance, in their “Recommendations for Secure Storage …
Author(s): Schönbrodt, F., Gollwitzer, M., & Abele-Brehm, A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Introduction The development and use of digital tools in various stages of research highlight the importance of novel open science …
Author(s): Maryam Zarghani, Leila Nemati-Anaraki, Shahram Sedghi, Abdolreza Noroozi Chakoli & Anisa Rowhani-Farid
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Conceptual Model, Open Science, Open Research, Openness in Science, Openness in Research, Validation
Link to resource
The replication crisis—a failure to replicate foundational studies—has sparked a conversation in psychology, HCI, and …
Author(s): Xiaoying Pu, Licheng Zhu, Matthew Kay, Frederick Conrad
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Human-Centered Computing, Human Computer Interaction (HCI), Empirical Studies in HCI, Interaction design
Link to resource
Recently there has been a growing concern that many published research findings do not hold up in attempts to replicate them. We argue …
Author(s): Wolfgang Forstmeier, Eric-Jan Wagenmakers and Timothy H. Parker
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This course is developed for students in research master programs and PhD candidates in the social and behavioral sciences broadly …
Author(s): René Bekkers
Type of resources: Full Course, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Education, Life Science, Physical Science, Social Science
Tag(s): Bad Science ; Research Critique; Reproducible Science
Link to resource
He’s been called a “Data vigilante.” In this episode, Prof. Uri Simonsohn describes how he detects fraudulent work in …
Author(s): Julia Galef/Uri Simonsohn
Type of resources: Teaching/Learning Strategy, Unit of Study, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
Unprecedented social, environmental, political and economic challenges — such as pandemics and epidemics, environmental degradation and …
Author(s): Dolores Albarracín, Bita Fayaz-Farkhad & Javier A. Granados Samayoa
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Human Behaviour, Psychology
Link to resource
How to introduce your students to the gamut of software that can support their research projects
Author(s): Daniela Duca & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading, Teaching/Learning Strategy, Unit of Study
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Social Science
Tag(s): Social Sciences; Research Methods; Digital Tools; Data Collection Tools; Survey Tools; Qualitative Research Tools; Quantitative Research Tools; GitHub; Software; Teaching; Open Data
Link to resource
Background: Open research involves actions at all stages of the research cycle to make the research process and outputs more …
Author(s): Sophia Egan, Mary Tobin, Brendan Palmer, Aoife Coffey, Darren Dahly, Catherine Houghton, Eoghan Ó Carragáin, Elaine Toomey, Samantha Dockray, Karen Matvienko-Sikar
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Open Research, Open Educational Resource
Link to resource
Gilad Feldman is Assistant Professor at the Department of Psychology at the University of Hong Kong (HKU). His research focuses on …
Author(s): Gilad Feldman & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Interview
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Social Science
Tag(s): Teaching; Pedagogy; Course Materials; Inclusion; Reproducibility; Replicability; Community Resources; Registered Reports
Link to resource
Objectives Despite the growing importance of bioinformatics in molecular diagnostics, not all medical laboratory sciences (MLS) …
Author(s): Hana S Fukuto, Gloria I Viboud
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Life Science
Tag(s): Bioinformatics, Genomics, Open Educational Resources, Medical Laboratory Sciences, Education, Virtual Laboratory, Online Teaching
Link to resource
In the last decade, there has been increased recognition of the importance of disclosing and managing non-financial conflicts of …
Author(s): David B Resnik
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, Journal Editors
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Conflicts of Interest, Financial, Non-Financial, Bias, Ethics, Policy, Journals
Link to resource
This cross-sectional study examines discrepancies between registered protocols and subsequent publications for drug and diet trials …
Author(s): Cara B. Ebbeling, David S. Ludwig, Steven B. Heymsfield
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Bias, Preregistration, Registration, Reporting, Reporting Guidelines, Reproducibility
Link to resource
Undisclosed discrepancies often exist between study registrations and their associated publications. Discrepancies can increase risk of …
Author(s): TARG Meta-Research Group and Collaborators
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Peer Review, Outcome Switching, Selective Reporting, Pre-egistration, Trial Registration, Metaresearch
Link to resource
Objectives To identify and appraise empirical studies on publication and related biases published since 1998; to assess methods to deal …
Author(s): Aj Sutton, C Hing, C Pang, Cs Kwok, F Song, I Harvey, J Ryder, L Hooper, S Parekh, Yk Loke
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Data, Open Data, Preregistration, Publication Bias, Publishing, Reporting, Systematic Reviews
Link to resource
An interactive visualisation of the distribution of p-values when comparing two groups
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Reading, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
This is a collection of research methodology articles, which are first- or senior-authored by women, to promote diverse perspectives in …
Author(s): Kane et al.
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
Scientists and funding agencies invest considerable resources in writing and evaluating grant proposals. But do grant proposal texts …
Author(s): Müge Simsek, Mathijs de Vaan & Arnout van de Rijt
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Grants, Abstract, Resources, Proposal
Link to resource
Research resources like transgenic animals and antibodies are the workhorses of biomedicine, enabling investigators to relatively …
Author(s): Agata Piekniewska, Nathan Anderson, Martijn Roelandse, K. C. Kent Lloyd, Ian Korf, S. Randal Voss, Giovanni de Castro, Diogo M. Magnani, Zoltan Varga, Christina James-Zorn, Marko Horb, Jeffery S. Grethe, Anita Bandrowski
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Biomedicine, Transgenic Animals, Antibodies, Stock Centers, Citation, Reproducibility, Traceability
Link to resource
Several researchers have recently argued that p values lose their meaning in exploratory analyses due to an unknown inflation of the …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Teacher, Librarian, research
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Confirmatory Research, Exploratory Research, Familywise Error Rate, P Values, Type I Errors
Link to resource
Scholars assert that pre-analysis plans (PAPs) generate boring, lab-report style papers and thus hamper publication. We test this claim …
Author(s): George K. Ofosu, Daniel N. Posner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Pre-analysis Plans
Link to resource
Randomized controlled trials (RCTs) are increasingly prominent in economics, with pre-registration and pre-analysis plans (PAPs) …
Author(s): Abel Brodeur, Nikolai Cook, Jonathan Hartley, Anthony Heyes
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Pre-analysis Plan, Pre-registration, p-Hacking, Publication Bias, Research Credibility
Link to resource
We examine the APSR and the AJPS for the presence of publication bias due to reliance on the 0.05 significance level. Our analysis …
Author(s): Alan Gerber and Neil Malhotra
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
The long-term impact of studies of statistical power is investigated using J. Cohen’s (1962) pioneering work as an example. We …
Author(s): Sedlmeier, P. & Gigerenzer, G.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Preregistration entails researchers registering their planned research hypotheses, methods, and analyses in a time-stamped document …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Forking Paths, HARKing, Multiple Testing, Optional Stopping, P-hacking, Preregistration, Publication Bias
Link to resource
Background The Consolidated Standards of Reporting Trials (CONSORT) Statement is intended to facilitate better reporting of randomised …
Author(s): David Moher, Douglas G Altman, Kenneth F Schulz, Larissa Shamseer, Lucy Turner
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Bias, Inside Your Classroom, Publishing, Reporting, Reporting Bias, Reporting Guidelines
Link to resource
This course will provide a survey of current personality research and theorywith an emphasis on recent discussions around methods and …
Author(s): John M. Zelenski
Type of resources: Syllabus
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Interpersonal phenomena such as attachment, conflict, person perception, helping, and influence have traditionally been studied by …
Author(s): David A. Kenny, Deborah A. Kashy, William L. Cook
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
An article about easy preregistration will benefit any research.
Author(s): David T. Mellor and Brian Nosek
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
A syllabus about economics and statistics
Author(s): Richard Ball
Type of resources: Syllabus
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Economics, statistics
Link to resource
A Data Carpentry curriculum for Economics is being developed by Dr. Miklos Koren at Central European University. These materials are …
Author(s): Andras Vereckei, Arieda Muço, Miklós Koren
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data, Economics
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
why aren’t more replications published? While there are many possible reasons, one simple one could be that journals prefer not …
Author(s): Neuliep, James W. and Rick Crandall
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Bullying and misconduct in the realm of scientific and scholarly publishing have the potential to jeopardize the transparency and …
Author(s): Fawad Javed, Dimitrios Michelogiannakis, P Emile Rossouw
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Life Science, Physical Science, Social Science
Tag(s): Academic Bullying, Editor, Ethics, Harassment, Scientific Publishing, Peer-Revied, Personal Criticism, Intimidation
Link to resource
Academic institutions in Europe (e.g. universities, research funding institutions, academies) are increasingly committing themselves to …
Author(s): Marcus Düwell
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities
Tag(s): Open Science,
Link to resource
All of us involved in the mind and brain sciences, in whatever capacity, are increasingly aware of the importance of ensuring the …
Author(s): SETH AK;HOHWY J
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): RR, Publishing
Link to resource
The executive, associate, and advisory editors and all of the editorial board members of one of the most influential journals in moral …
Author(s): Justin Weinberg.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities
Tag(s): Editorial Independence, Journal, Open Access, Resignation
Link to resource
Special Issue of Educational Psychologist - Educational Psychology in the Open Science Era
Recently, scholars have noted how …
Author(s): OSKB Admin
Type of resources: Reading
Primary user(s):
Subject area(s): education
Tag(s): Research
Link to resource
Objectives: To examine the effect on peer review of asking reviewers to have their identity revealed to the authors of the paper. …
Author(s): Susan van Rooyen et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Open Science
Link to resource
In animal experiments, animals, husbandry and test procedures are traditionally standardized to maximize test sensitivity and minimize …
Author(s): Benjamin Zipser, Berry Spruijt, Britta Schindler, Chadi Touma, Christiane Brandwein, David P. Wolfer, Hanno Würbel, Johanneke van der Harst, Joseph P. Garner, Lars Lewejohann, Niek van Stipdonk, Norbert Sachser, Peter Gass, Sabine Chourbaji, S. Helene Richter, Vootele Võikar
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Animal Behavior, Experimental Design, Factorial Design, Field Tests, Inbred Strains, Mice, Reproducibility, Research Methods, Study Design, White Light
Link to resource
The authors conducted a 30-year review (1969-1998) of the size of moderating effects of categorical variables as assessed using …
Author(s): Herman Aguinis, James C Beaty, Robert J Boik and Charles A Pierce
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The Publication Manual of the American Psychological Association (American Psychological Association, 2001, 2010) calls for the …
Author(s): Catherine O. Fritz et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A central goal of translational neuroimaging is to establish robust links between brain measures and clinical outcomes. Success hinges …
Author(s): Marianne C. Reddan, Martin A. Lindquist and Tor D. Wager
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Individual differences researchers very commonly report Pearson correlations between their variables of interest. Cohen (1988) provided …
Author(s): Gilles E.Gignac and Eva T.Szodorai
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Despite publication of many well-argued critiques of null hypothesis testing (NHT), behavioral science researchers continue to rely …
Author(s): ANTHONY G. GREENWALD, RICHARD GONZALEZ, RICHARD J. HARRIS and DONALD GUTHRIE
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics
Tag(s):
Link to resource
The effect size (ES) is the magnitude of a study outcome or research finding, such as the strength of the relationship obtained between …
Author(s): Rosnow, R. L., & Rosenthal, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Logically and conceptually, the use of statistical significance testing in the analysis of research data has been thoroughly …
Author(s): Schmidt, J. E. H. F. L., Hunter, J. E., Harlow, L., Mulaik, S., & Steiger, J.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Software Carpentry lección para control de versiones con Git Para ilustrar el poder de Git y GitHub, usaremos la siguiente historia …
Author(s): Alejandra Gonzalez-Beltran, Amy Olex, Belinda Weaver, Bradford Condon, butterflyskip, Casey Youngflesh, Daisie Huang, Dani Ledezma, dounia, Francisco Palm, Garrett Bachant, Heather Nunn, Hely Salgado, Ian Lee, Ivan Gonzalez, James E McClure, Javier Forment, Jimmy O'Donnell, Jonah Duckles, Katherine Koziar, Katrin Leinweber, K.E. Koziar, Kevin Alquicira, Kevin MF, Kurt Glaesemann, LauCIFASIS, Leticia Vega, Lex Nederbragt, Mark Woodbridge, Matias Andina, Matt Critchlow, Mingsheng Zhang, Nelly Sélem, Nima Hejazi, Nohemi Huanca Nunez, Olemis Lang, Paula Andrea Martinez, Peace Ossom Williamson, P. L. Lim, Rayna M Harris, Romualdo Zayas-Lagunas, Sarah Stevens, Saskia Hiltemann, Shirley Alquicira, Silvana Pereyra, Tom Morrell, Valentina Bonetti, Veronica Ikeshoji-Orlati, Veronica Jimenez
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Git, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Reproducible research and open science practices have the potential to accelerate scientific progress by allowing others to reuse …
Author(s): Friederike E Kohrs, Susann Auer, Alexandra Bannach-Brown, Susann Fiedler, Tamarinde Laura Haven, Verena Heise, Constance Holman, Flavio Azevedo, René Bernard, Arnim Bleier, Nicole Bössel, Brian Patrick Cahill, Leyla Jael Castro, Adrian Ehrenhofer, Kristina Eichel, Maximillian Frank, Claudia Frick, Malte Friese, Anne Gärtner, Kerstin Gierend, David Joachim Grüning, Lena Hahn, Maren Hülsemann, Malika Ihle, Sabrina Illius, Laura König, Matthias König, Louisa Kulke, Anton Kutlin, Fritjof Lammers, David MA Mehler, Christoph Miehl, Anett Müller-Alcazar, Claudia Neuendorf, Helen Niemeyer, Florian Pargent, Aaron Peikert, Christina U Pfeuffer, Robert Reinecke, Jan Philipp Röer, Jessica L Rohmann, Alfredo Sánchez-Tójar, Stefan Scherbaum, Elena Sixtus, Lisa Spitzer, Vera Maren Straßburger, Marcel Weber, Clarissa J Whitmire, Josephine Zerna, Dilara Zorbek, Philipp Zumstein, Tracey L Weissgerber
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Business and Communication, Social Science
Tag(s): Reproducible Research, Open Science, Open Science Strategies, Training
Link to resource
Across disciplines, researchers increasingly recognize that open science and reproducible research practices may accelerate scientific …
Author(s): Friederike E. Kohrs, Susann Auer, Alexandra Bannach-Brown, Susann Fiedler, Tamarinde Haven, Verena Heise, Constance Holman, Flavio Azevedo, René Bernard, Arnim Bleier, Nicole Bössel, Brian Cahill, Leyla Jael Castro, Adrian Ehrenhofer, Kristina Eichel, Maximilian Frank, Claudia Frick, Malte Friese, Anne Gärtner, Kerstin Gierend, David Joachim Grüning, Lena Hahn, Maren Hülsemann, Malika Ihle, Sabrina Illius, Laura König, Matthias König, Louisa Kulke, Anton Kutlin, Fritjof Lammers, David M.A. Mehler, Christoph Miehl, Anett Müller-Alcazar, Claudia Neuendorf, Helen Niemeyer, Florian Pargent, Aaron Peikert, Christina U. Pfeuffer, Robert Reinecke, Jan Philipp Röer, Jessica L. Rohmann, Alfredo Sánchez-Tójar, Stefan Scherbaum, Elena Sixtus, Lisa Spitzer, Vera Maren Straßburger, Marcel Weber, Clarissa Whitmire, Josephine Zerna, Dilara Zorbek, Philipp Zumstein, Tracey L. Weissgerber
Type of resources: Teaching/Learning Strategy
Primary user(s): Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Curriculum Design, Higher Education, Hiring, Open Science, Reproducible Research, Research Institutions, Scientific Rigor, Teaching, Transparency
Link to resource
INTRODUCTION This study will explore the issue of pricing opacity associated with prices paid by academic libraries that have recently …
Author(s): Joel B. Thornton and Curtis Brundy
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Business and Communication, Career and Technical Education, Social Science
Tag(s): Journal, Subscription
Link to resource
Recently, there has been a growing emphasis on embedding open and reproducible approaches into research. One essential step in …
Author(s): Madeleine Pownall, Flavio Azevedo, Alaa Aldoh, Mahmoud Elsherif, Martin Vasilev, Charlotte R. Pennington, Olly Robertson, Myrthe Vel Tromp, Meng Liu, Matthew C. Makel, Natasha Tonge, David Moreau, Ruth Horry, John Shaw, Loukia Tzavella, Ronan McGarrigle, Catherine Talbot, Sam Parsons
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education
Tag(s): Open Scholarship; Research Training; Higher Education; Pedagogy; Teaching Resources; Lesson Plans; Open Educational Resources (OER)
Link to resource
Recently, there has been a growing emphasis on embedding open and reproducible approaches into research. One essential step in …
Author(s): Alaa Aldoh, Catherine V. Talbot, Charlotte Rebecca Pennington, David Moreau, Flavio Azevedo, John J Shaw, Loukia Tzavella, Madeleine Pownall, Mahmoud Elsherif, Martin Rachev Vasilev, Matthew C. Makel, Meng Liu, Myrthe Vel Tromp, Natasha April Tonge, Olly Robertson, Ronan McGarrigle, Ruth Horry, Sam Parsons
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s): Learning, Lesson Plans, Pedagogical Resources, Teaching
Link to resource
Beginning in the internet era, the landscape of medical research has undergone a notable evolution. Calls have been made to break down …
Author(s): Jeremy Y. Ng and Holger Cramer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Medicine, TCIM
Link to resource
This course aims to introduce students to current controversies and new developments in recommended scientific practices. The course is …
Author(s): Rodica Damian
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We have empirically assessed the distribution of published effect sizes and estimated power by analyzing 26,841 statistical records …
Author(s): Denes Szucs, John P. A. Ioannidis
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Analysis, Behavioral Neuroscience, Bibliometrics, Cognitive Neuroscience, Data, Neuroscience, Psychology, Publishing, Scientific Publishing, Statistical Data, Statistical Distributions, Statistics
Link to resource
Context Most medical interventions have modest effects, but occasionally some clinical trials may find very large effects for benefits …
Author(s): Tiago V. Pereira, PhD Ralph I. Horwitz, MD John P. A. Ioannidis, MD, DSc
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background Many journals now require authors share their data with other investigators, either by depositing the data in a public …
Author(s): Andrew J. Vickers, Caroline J. Savage
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Clinical Trials, Data, Data Acquisition, Genomic Libraries, Genomic Medicine, Genomics, Health Care Policy, Medicine and Health Sciences, Open Access, Open Access Publishing, Publishing, Scientific Publishing
Link to resource
As scientific investigations increasingly adopt Open Science practices, reuse of data becomes paramount. However, despite decades of …
Author(s): Shawn R. Wolfe, Barbara Lafuente, Richard M. Keller, Angela M. Detweiler, Thomas F. Bristow, Mary N. Parenteau, Kevin Boydstun, Christopher E. Dateo, David J. Des Marais, Linda L. Jahnke, Sara Rojo, Nathan Stone, and Mark Vorobets
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Data Reuse, Astrobiology, Metadata Standard, ARMS
Link to resource
The psychological and psychiatric communities are generating data on an ever-increasing scale. To ensure that society reaps the …
Author(s): Walsh, C., Xia, W., Li, M., Denny, J., Harris, P., & Malin, B
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Objectives This study evaluates the endorsement of open science practices by dental journals.
Materials and methods This was a …
Author(s): William Vinicius de Oliveira Santos, Lara Dotto, Ticiane de Góes Mário Ferreira, Rafael Sarkis-Onofre
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Dental Journals, Open Science Practices, Reporting Guidelines, Data Sharing in Dentistry, Preprints in Dental Research
Link to resource
The National Academies hosted a hybrid public workshop in Fall 2023, sponsored by the National Institutes of Health, to explore …
Author(s): Kyle Cavagnini, Carolyn Shore, Megan Snair (National Academies of Sciences, Engineering, and Medicine)
Type of resources: Workshop proceedings
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Workshop, National Academies, Public Access, Policy Changes, Publication
Link to resource
The information provided on this website is designed to assist the extramural community in addressing rigor and transparency in NIH …
Author(s): NIH
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Reproducibility
Link to resource
The purpose of this paper is to extend to the field of relationship science, recent discussions and suggested changes in open research …
Author(s): LORNE CAMPBELL TIMOTHY J. LOVING ETIENNE P. LEBEL
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Motivation The maturation of systems immunology methodologies requires novel and transparent computational frameworks capable of …
Author(s): Tudor-Stefan Cotet, Andreas Agrafiotis, Victor Kreiner, Raphael Kuhn, Danielle Shlesinger, Marcos Manero-Carranza, Keywan Khodaverdi, Evgenios Kladis, Aurora Desideri Perea, Dylan Maassen-Veeters, Wiona Glänzer, Solène Massery, Lorenzo Guerci, Kai-Lin Hong, Jiami Han, Kostas Stiklioraitis, Vittoria Martinolli D’Arcy, Raphael Dizerens, Samuel Kilchenmann, Lucas Stalder, Leon Nissen, Basil Vogelsanger, Stine Anzböck, Daria Laslo, Sophie Bakker, Melinda Kondorosy, Marco Venerito, Alejandro Sanz García, Isabelle Feller, Annette Oxenius, Sai T Reddy, Alexander Yermanos
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Life Science
Tag(s): Systems Immunology, Bioinformatics, Computational Immunology, Ligand-receptor Interactions, Structural Modeling, Simulations, Machine Learning, Graph Theory, Pseudotime, Spatial Transcriptomics, Phylogenetics
Link to resource
Knowledge is essential to saving lives and improving wellbeing. The term open science has been applied to improving the transparency of …
Author(s): Margaret A Winker, Theodora Bloom, Sandersan Onie, James Tumwine
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Equity, Transparency, Accountability, Open Science, Misconduct, Accuracy
Link to resource
Psychologists must be able to test both for the presence of an effect and for the absence of an effect. In addition to testing against …
Author(s): Anne Scheel, Daniel Lakens, Peder Isager
Type of resources: Reading
Primary user(s):
Subject area(s): Social Science, Psychology
Tag(s): Aging, Equivalence Testing, Falsification, Frequentist, Null-hypothesis, Null-hypothesis Significance Test, Open Materials, Open Science, Power
Link to resource
Scientists should be able to provide support for the absence of a meaningful effect. Currently, researchers often incorrectly conclude …
Author(s): Daniël Lakens
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Analysis, Reproducibility, Statistics
Link to resource
In theory, a comparison of two experimental effects requires a statistical test on their difference. In practice, this comparison is …
Author(s): Nieuwenhuis, S., Forstmann, B. U., & Wagenmakers, E. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Since its beginnings in the 1940s, automated reasoning by computers has become a tool of ever growing importance in scientific …
Author(s): Konrad Hinsen
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Social Science
Tag(s): computational science, machine learning, reliability, reviewability, software
Link to resource
Psychological science is navigating an unprecedented period of introspection about the credibility and utility of its research. A …
Author(s): Jessica Elizabeth Kosie, john Ioannidis, Joshua D Wallach, Mallory Kidwell, Robert T. Thibault, Tom Elis Hardwicke
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Data
Link to resource
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted …
Author(s): Open Science Collaboration.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Beginning in 2011, public scandals and high-visibility critiques of research methods in psychology fed a broader “replication crisis”: …
Author(s): Greg Downey
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Social Science
Tag(s): Anthropological Holism, Anthropological Methods, Cultural Diversity, Human Variation, Integrative Pluralism, Replication Crisis, Zombie Methodology
Link to resource
The MIT Press is thrilled to announce a groundbreaking partnership with the European Sociological Association (ESA), marking a …
Author(s): MIT Press
Type of resources: Reading
Primary user(s): Teacher, Librarian
Subject area(s): Arts and Humanities, Social Science
Tag(s): Journal, Open Access
Link to resource
While Open Science has arguably initiated positive changes at some stages of the research process (e.g., increasing transparency …
Author(s): Marlene Sophie Altenmüller, Matthias Fligge, Mario Gollwitzer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Questionable Research Practices, Research Misconduct, Data Collection, Supervision, Students
Link to resource
While Open Science has arguably initiated positive changes at some stages of the research process (e.g., increasing transparency …
Author(s): Tobias Ludwig, Marlene Sophie Altenmüller, Leonhard Falk Florentin Schramm, Mathias Twardawski
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Questionable Research Practices, Research Misconduct, Data Collection, Supervision, Students
Link to resource
Validity evidence based on test content is critical to meaningful interpretation of test scores. Within high-stakes testing and …
Author(s): Daniel Anderson, Brock Rowley, Sondra Stegenga, P. Shawn Irvin, Joshua M. Rosenberg
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Machine Learning, Text-mining, Textual Congruence, Validity
Link to resource
Registered Reports (RRs) is a publishing model in which initial peer review is conducted prior to knowing the outcomes of the research. …
Author(s): Brian A. Nosek, Felix Singleton Thorn, Lilian T. Hummer, Timothy M. Errington
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Life Science, Social Science
Tag(s): Preregistration, Publishing, Registered Reports
Link to resource
This blog evaluates the R-Index and the P-Curve
Author(s): Jeff Hughes
Type of resources: Reading
Primary user(s): Student, Researcher
Subject area(s): Math & Statistics
Tag(s): Blog
Link to resource
Objective The goals of this study were to evaluate the extent that physical therapy journals support open science research practices by …
Author(s): Jacqueline Plante, Leigh Langerwerf, Mareli Klopper, Daniel I Rhon, Jodi L Young
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Life Science
Tag(s): Openness, Reproducibility of Results, Research, Science, Transparency
Link to resource
A podcast about open science and psychology
Author(s): Sound Cloud
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
Despite the importance of patent landscape analyses in the commercialization process for life science and healthcare technologies, the …
Author(s): Andrew J. Carr, David A. Brindley, Hannah Thomas, James A. Smith, Zeeshaan Arshad
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Engineering, Biology
Tag(s): Licensing, Reproducibility
Link to resource
Importance: The use and misuse of P values has generated extensive debates. Objective: To evaluate in large scale the P values reported …
Author(s): David Chavalarias, Joshua David Wallach, Alvin Ho Ting Li, John P A Ioannidis
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This article describes a systematic analysis of the relationship between empirical data and theoretical conclusions for a set of …
Author(s): Gregory Francis, Jay Tanzman, William J. Matthews
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Failures to replicate published psychological research findings have contributed to a “crisis of confidence.” Several …
Author(s): David J Stanley 1, Jeffrey R Spence
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Preregistration requires scientists to describe the planned research activities before their project begins. Preregistration improves …
Author(s): Mike Felgenhauer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Experimentation, Manipulation
Link to resource
The crisis of confidence in the social sciences has many corollaries which impact our research practices. One of these is a push …
Author(s): Sarahanne M. Field, Maarten Derksen
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Reflexivity, Subjectivity, Reproducibility
Link to resource
Traditional methods of analyzing data from psychological experiments are based on the assumption that there is a single random factor …
Author(s): Judd, C. M., Westfall, J., & Kenny, D. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This book provides a non-mathematical introduction to the underlying theory of Efa and reviews the key decisions that must be made in …
Author(s): Leandre R. Fabrigar, Dueane T. Wegener
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
Preregistration has been proposed as a useful method for making a publicly verifiable distinction between confirmatory hypothesis …
Author(s): Mark Rubin, Chris Donkin
Type of resources: Reading
Primary user(s): Student, Parent, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Accommodation, Exploratory Analyses, Confirmatory Analyses, Prediction, Preregistration, Hypothesis Testing
Link to resource
Preregistration has been proposed as a useful method for making a publicly verifiable distinction between confirmatory hypothesis …
Author(s): Mark Rubin and Chris Donkin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Accommodation, Exploratory Analyses, Confirmatory Analyses, Prediction, Preregistration, Hypothesis Testing
Link to resource
In recent years, the discipline of political science has experienced demands and moves toward greater research transparency. While in …
Author(s): Florian G. Kern, Kristian Skrede Gleditsch
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Physical Science, Social Science
Tag(s): Transparency, Replication, Qualitative Inference, Pre-Analysis Plans, Preregistration
Link to resource
Efforts by governments, firms, and patients to deliver pioneering drugs for critical health needs face a challenge of diminishing …
Author(s): Jacqueline A. Sullivan, E. Richard Gold
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Collaboration, Drug Development, Incentives, Open Science, Patents, Regulatory Exclusivity
Link to resource
The Federation of Associations in Behavioral and Brain Sciences (FABBS) is a coalition of 29 scientific societies and 60 academic …
Author(s): Federation of Associations in Behavioural & Brain Sciences (FABBS)
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator
Subject area(s): Life Science, Physical Science, Social Science
Tag(s): FABBS, Open Science
Link to resource
Researchers increasingly engage in adopting open science practices in the field of research syntheses, such as preregistration. …
Author(s): Jürgen Schneider, Iris Backfisch, Andreas Lachner
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Science, Preregistration, Rmarkdown, R Package
Link to resource
Reforms would save students and borrowers billions in unnecessary fees and improve the college and loan repayment experience. Today, …
Author(s): wh.gov
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Education Fees, Higher Education, Junk Fees, Students, Borrowers
Link to resource
Despite increased attention to methodological rigor in education research, the field has focused heavily on experimental design and not …
Author(s): Matthew C. Makel and Jonathan A. Plucker
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Health data are extremely important in today’s data-driven world. Through automation, healthcare processes can be optimized, and …
Author(s): Dagmar Waltemath, Oya Beyan, Katrin Crameri, Angela Dedié, Kerstin Gierend, Petra Gröber, Esther Thea Inau, Lea Michaelis, Ines Reinecke, Martin Sedlmayr, Sylvia Thun & Dagmar Krefting
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Data Management, Interoperability, Data integration, IT infrastructure, German Network University Medicine
Link to resource
A book about Academic Fraud
Author(s): Diederik Stapel/Translated by Nicholas J. L. Brown
Type of resources: Primary Source
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Textbook, Reproducibility Crisis and Credibility Revolution
Link to resource
A lecture on when analysis goes wrong A look at false-positive psychology
Author(s): Dermot Lynott
Type of resources: Lecture, Lecture Notes, Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Lecture, Reproducibility Knowledge
Link to resource
We describe why we wrote “False-Positive Psychology,” analyze how it has been cited, and explain why the integrity of experimental …
Author(s): Joseph P. Simmons, Leif D. Nelson, and Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this article, we accomplish two things. First, we show that despite empirical psychologists’ nominal endorsement of a low rate of …
Author(s): Joseph P. Simmons, Leif D. Nelson, Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog post that describes analyses of all p-values
Author(s): Uri Simonsohn
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog
Link to resource
Finkel, Eastwick, and Reis (2016; FER2016) argued the post-2011 methodological reform movement has focused narrowly on replicability, …
Author(s): LeBel, E. P., Berger, D., Campbell, L., & Loving, T. J. (2017).
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this methodological commentary, we use Bem’s (2011) recent article reporting experimental evidence for psi as a case study for …
Author(s): LeBel, E.P., & Peters, K.R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The US Food and Drug Administration (FDA) has developed a framework to use data gathered outside of clinical trials (eg, electronic …
Author(s): Guneet S. Janda, Joshua D. Wallach, Meera M. Dhodapkar, Reshma Ramachandran, Joseph S. Ross
Type of resources: Reading
Primary user(s): Teacher, Librarian, researcher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Clinical Trials, Data, Drugs, Biologics
Link to resource
The term psi denotes anomalous processes of information or energy transfer that are currently unexplained in terms of known physical or …
Author(s): Daryl J Bem
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Questionable research practises (QRPs) have been the focus of the scientific community amid greater scrutiny and evidence highlighting …
Author(s): Michelle Jin Yee Neoh, Alessandro Carollo, Albert Lee, Gianluca Esposito
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Scientific Integrity, Ethics of Research, Questionable Research Practices
Link to resource
Introduction to finding and evaluating Open Data by NYU DataServices.
Author(s): Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Licenses, Open Data, Researchers
Link to resource
Social scientists generally enjoy substantial latitude in selecting measures and models for hypothesis testing. Coupled with …
Author(s): Macartan Humphreys, Raul Sanchez de la Sierra and Peter van der Windt
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
And so, my fellow scientists: ask not what you can do for reproducibility; ask what reproducibility can do for you! Here, I present …
Author(s): Florian Markowetz
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Organizational Change, Reproducibility, Researchers
Link to resource
Fake studies have flooded the publishers of top scientific journals, leading to thousands of retractions and millions of dollars in …
Author(s): Nidhi Subbaraman
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Business and Communication, Education, Life Science, Physical Science, Social Science
Tag(s): Fake Science, Scientific Journals, Wiley
Link to resource
The current controversy surrounding research replication in biomedical and psychosocial sciences often overlooks the uncertainties …
Author(s): Carol Ting and Sander Greenland
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication
Tag(s): Replication, Science Communicators
Link to resource
The FORRT community has prepared 100+ summaries of Open and Reproducible Science literature. The purpose of these summaries is to …
Author(s): Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading, Summaries
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Education
Tag(s): Summaries; Open and Reproducible Science; Diversity, Equity, & Inclusion
Link to resource
The FOSTER portal is an e-learning platform that brings together the best training resources addressed to those who need to know more …
Author(s): FOSTER Open Science
Type of resources: Full Course
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Data, Education, Materials, Policy, Publishing
Link to resource
Scientific research relies on computer software, yet software is not always developed following practices that ensure its quality and …
Author(s): Alejandra Gonzalez-Beltran, Allegra Via, Andrew Treloar, Bérénice Batut, Bernard Pope, Björn GrüningJonas Hagberg, Brane Leskošek, Carole Goble, Daniel S. Katz, Daniel Vaughan, David Mellor, Federico López Gómez, Ferran Sanz, Harry-Anton Talvik, Horst Pichler, Ilian Todorov, Jon Ison, Josep Ll. Gelpí, Leyla Garcia, Luis J. Oliveira, Maarten van Gompel, Madison Flannery, Manuel Corpas, Maria V. Schneider, Martin Cook, Mateusz Kuzak, Michelle Barker, Mikael Borg, Monther Alhamdoosh, Montserrat González Ferreiro, Nathan S. Watson-Haigh, Neil Chue Hong, Nicola Mulder, Petr Holub, Philippa C. Griffin, Radka Svobodová Vařeková, Radosław Suchecki, Rafael C. Jiménez, Robert Pergl, Rob Hooft, Rowland Mosbergen, Salvador Capella-Gutierrez, Simon Gladman, Sonika Tyagi, Steve Crouchc, Victoria Stodden, Xiaochuan Wang, Yasset Perez-Riverol
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Reproducibility
Link to resource
We present a framework designed to help academic institutions and departments rethink and reform academic assessments - including …
Author(s): Erin McKiernan, Caitlin Carter, Michael R Dougherty, and Greg Tananbaum
Type of resources: Asssessment
Primary user(s): Teacher
Subject area(s): Education
Tag(s): Values-Based Academic Assessment, Framework
Link to resource
A list of free or cheap resources (e.g. free and open statistical software) that support the processes of science
Author(s): Dr Jaclyn Siegel
Type of resources: Reading, Resource list
Primary user(s): Student, Teacher, Librarian, Early career researchers
Subject area(s): Applied Science, Social Science
Tag(s): Open science
Link to resource
We are thrilled to present our new Pedagogies, which features Dr. Thomas Rhys Evans. Thomas is Associate Professor of Occupational …
Author(s): Dr. Thomas Rhys Evans & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Module, Interview
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Social Science
Tag(s): Teaching; Pedagogy; Critical Skills; Evidence Based Practice; Module
Link to resource
In the past few years, there has been a notable shift in the open science landscape as more countries and international agencies …
Author(s): Sonya B. Dumanis, Kristen Ratan, Souad McIntosh, Hetal V. Shah, Matt Lewis, Timothy H. Vines, Randy Schekman, Ekemini A. Riley
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Life Science
Tag(s): Computer Software, Open Science, Science Policy, Research Assessment, Software Tools, Parkinson Disease, Programming Languages, Reproducibility
Link to resource
Meta-analysis synthesizes a body of research investigating a common research question. Outcomes from meta-analyses provide a more …
Author(s): Daniel S. Quintana
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Meta-Analysis, Primer, Methods, Preregistration, Statistics, Publication Bias
Link to resource
Pandemic preparedness and response have relied primarily on market dynamics to drive development and availability of new health …
Author(s): Els Torreele, Daniel Wolfe, Michel Kazatchkine, Amadou Sall, Kiat Ruxrungtham, Joseph Robert Anderson Fitchett, Joanne Liu, Gary Kobinger, Claudia Vaca-González, Carolina Gómez, Petro Terblanche, Soumya Swaminathan, Piero Olliaro, Helen Clark
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Research and Development, Pandemic Preparedness
Link to resource
This report covers funder data-sharing policies/practices, and provides recommendations to funders and others as they consider their …
Author(s): Stephanie Wykstra
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Life Science, Social Science
Tag(s): Data, Data-Sharing Policies, Funder Policies, Open Data, Open Science, Policy
Link to resource
GPower is a tool to compute statistical power analyses for many different t tests, F tests, χ2 tests, z tests and some exact tests. G …
Author(s): The G*Power Team
Type of resources: Reading, Simulation
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Reproducibility Knowledge, Power Analysis Tool
Link to resource
GelBox is open-source software that was developed with the goal of enhancing rigor, reproducibility, and transparency when analyzing …
Author(s): Utku Gulbulak, Austin G. Wellette-Hunsucker, Kenneth S. Campbell
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): GelBox, Gels, Immunoblots, Reproducibility
Link to resource
Preclinical studies using animals to study the potential of a therapeutic drug or strategy are important steps before translation to …
Author(s): Andrew S. C. Rice, Jan Vollert, Nathalie Percie du Sert, Wenlong Huang
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Experimental Bias, Hypothesis Generating, Hypothesis Testing, In Vivo Studies, Preclinical Research, Reproducibility
Link to resource
Workshop overview for the Data Carpentry genomics curriculum. Data Carpentry’s aim is to teach researchers basic concepts, skills, and …
Author(s): Amanda Charbonneau, Erin Alison Becker, François Michonneau, Jason Williams, Maneesha Sane, Matthew Kweskin, Muhammad Zohaib Anwar, Murray Cadzow, Paula Andrea Martinez, Taylor Reiter, Tracy Teal
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Genetics, Measurement and Data
Tag(s): Analysis, Data, Education, Genomics, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Accurately assessing the postmortem interval (PMI), or the time since death, remains elusive within forensic science research and …
Author(s): Katherine E Weisensee, Cristina I Tica, Madeline M Atwell, Carl Ehrett, D Hudson Smith, Patricia Carbajales-Dale, Patrick Claflin, Noah Nisbet
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science
Tag(s): Decomposition, PMI, Open Science, GIS, Machine Learning
Link to resource
Data Carpentry’s aim is to teach researchers basic concepts, skills, and tools for working with data so that they can get more done in …
Author(s): Anne Fouilloux, Arthur Endsley, Chris Prener, Jeff Hollister, Joseph Stachelek, Leah Wasser, Michael Sumner, Michele Tobias, Stace Maples
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science, Measurement and Data, Physical Science, Geology, Physical Geography, Social Science
Tag(s): Analysis, Data, Education, Geospatial, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
This webinar provides an overview of TOP Factor: its rationale, how it is being used, and how each of the TOP standards relate to …
Author(s):
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Center for Open Science, Data Citation, Journal Impact Factor, Open Science, Preregistration, Replication, Reproducibility, Research, Research Analysis, Research Best Practices, Research Design, Scientific Funding, Scientific Publishing, TOP Factor, TOP Guidelines
Link to resource
Discussions of the so-called replication crisis (RC) in psychology have focused on methodological–epistemological considerations. In …
Author(s): Burgos, J. E.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Social Science
Tag(s): Replication Crisis, Ontology, Objective-Subjective, Philosophy Of Science
Link to resource
This article presents multiple great solutions you should know for changing ggplot colors.
Author(s): Alboukadel
Type of resources: Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s): Data visualisation
Link to resource
Amidst increased pressure for transparency in science, researchers and community members are calling for open access to study stimuli …
Author(s): Crystal N. Steltenpohl, Amy J. Anderson, and Katherine M. Daniels
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Welcome to GLIMMPSE. The GLIMMPSE software calculates power and sample size for study designs with normally distributed outcomes. …
Author(s): Anon
Type of resources: Reading, Simulation
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Reproducibility Knowledge, Power Analysis Tool
Link to resource
Clinical trials are governed by principles of good clinical practice (GCP), which can strengthen the achievement of rigor, …
Author(s): Brad P. Taylor, George W. Rebok, Michael Marsiske
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Rigor, Transparency, Clinical Trials
Link to resource
Computers are now essential in all branches of science, but most researchers are never taught the equivalent of basic lab skills for …
Author(s): Greg Wilson, Jennifer Bryan, Justin Kitzes, Karen Cranston, Lex Nederbragt, Tracy K. Teal
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Computer Software, Control Systems, Data Management, Data Processing, Programming Languages, Reproducibility, Software Tools, Source Code
Link to resource
A syllabi about open science: good science and bad science.
Author(s): Eric-Jan Wagenmakers
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Social Science
Tag(s): Syllabus
Link to resource
Tamarinde Haven works as a postdoctoral researcher at the BIH QUEST Center for Responsible Research, Charité, Berlin, where she …
Author(s): Tamarinde Haven
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): PhD Supervision, Mentoring, Responsible Research Culture
Link to resource
Completion of this course will provide a foundation for the practice of science. We will wrestle with the fundamental issues for …
Author(s): Brian Nosek
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Graduate students in psychology need hands-on support to conduct research using quantitative techniques that exceed their curricular …
Author(s): Andrea L. Howard
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Education, Psychology, Quantitative Methods
Link to resource
In this editorial, the Founding Field Chief Editor of Frontiers in Social Psychology expresses several ideas about the past, present, …
Author(s): John T. Jost
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Social Psychology
Link to resource
This chapter discusses the use of directed acyclic graphs (DAGs) for causal inference in the observational social sciences. It focuses …
Author(s): Felix Elwert
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Psychology is a discipline that has a high number of failed replications, which has been characterised as a ‘crisis’ on the assumption …
Author(s): Lavelle, Jane Suilin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Replication Crisis, Epistemic Iteration, False Belief, Reproducibility, Scientific Progress
Link to resource
Blog post going over making undergraduate students better consumers of research
Author(s): Beth Morling
Type of resources: Reading, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Social Science
Tag(s): Blog, Open Science
Link to resource
Background and objective: Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement …
Author(s): Ellen B M Elsman, Lidwine B Mokkink, Caroline B Terwee, Dorcas Beaton, Joel J Gagnier, Andrea C Tricco, Ami Baba, Nancy J Butcher, Maureen Smith, Catherine Hofstetter, Olalekan Lee Aiyegbusi, Anna Berardi, Julie Farmer, Kirstie L Haywood, Karolin R Krause, Sarah Markham, Evan Mayo-Wilson, Ava Mehdipour, Juanna Ricketts, Peter Szatmari, Zahi Touma, David Moher, Martin Offringa
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): COSMIN, Measurement properties, Outcome measurement instrument, PRISMA, Reporting guideline, Systematic reviews.
Link to resource
Proprietary genetic datasets are valuable for boosting the statistical power of genome-wide association studies (GWASs), but their use …
Author(s): Camille M. Williams, Holly Poore, Peter T. Tanksley, Hyeokmoon Kweon, Natasia S. Courchesne-Krak, Diego Londono-Correa, Travis T. Mallard, Peter Barr, Philipp D. Koellinger, Irwin D. Waldman, Sandra Sanchez-Roige, K. Paige Harden, Abraham A. Palmer, Danielle M. Dick & Richard Karlsson Linnér
Type of resources: Reading
Primary user(s): Student, Teacher, researcher
Subject area(s): Life Science
Tag(s): Genomic SEM, Summary Statistics, Data Removal, Down-sample, Leave-one-out, Meta-analysis, Genomics, Genome-wide Association Study
Link to resource
Conversations about the internationalization of psychological sciences have occurred over a few decades with very little progress. …
Author(s): Arathy Puthillam, Lysander James Montilla Doble, Junix Jerald I. Delos Santos, Mahmoud Medhat Elsherif, Crystal N. Steltenpohl, David Moreau, Madeleine Pownall, Priya Silverstein, Shaakya Anand-Vembar, Hansika Kapoor
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Diversity, Global South, Internationalization of Psychology, Metascience, Open Scholarship, Science
Link to resource
The article describes the results of the online survey on open science (OS) carried out on researchers affiliated with universities and …
Author(s): Candela Ollé, Alexandre López-Borrull, Remedios Melero, Juan-José Boté-Vericad, Josep-Manuel Rodríguez-Gairín, Ernest Abadal
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Science, Science Policy, Open Access Publishing, Research Funding, Data Management, Open Peer Review, Open Data
Link to resource
You’re a social scientist with a hunch: The U.S. economy is affected by whether Republicans or Democrats are in office. Try to show …
Author(s): Anon
Type of resources: Activity/Lab, Interactive, Simulation, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Demo, Reproducibility Knowledge
Link to resource
This list of resources consists of resources for researchers, editors, and reviewers interested in practicing open science principles, …
Author(s): Crystal Steltenpohl, Rachel Renbarger, Sebastian Karcher, Sondra Stegenga, Thomas Lösch
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s): Open Science, Qualitative Research, Research
Link to resource
Significance testing based on p-values is standard in psychological research and teaching. Typically, research articles and textbooks …
Author(s): Johansson, T.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Experimental preregistration is required for publication in many scientific disciplines and venues. When experimental intentions are …
Author(s): Andy Cockburn, Carl Gutwin, Alan Dix
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Human-Centered Computing, Human Computer Interaction, Preregistration
Link to resource
The practice of hypothesizing after results are known (HARKing) has been identified as a potential threat to the credibility of …
Author(s): Kevin R. Murphy & Herman Aguinis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This article considers a practice in scientific communication termed HARKing (Hypothesizing After the Results are Known). HARKing is …
Author(s): Kerr, N. L.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
“Harry Potter and the Methods of Reproducibility – A brief Introduction to Open Science” gives a brief overview of …
Author(s): Mariella Paul
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility, Researchers, Students
Link to resource
A Harvard Medical School scientist who studies deadly brain tumors is facing accusations that more than two dozen papers he co-authored …
Author(s): Nidhi Subbaraman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Harvard Medical School, Brain Tumors, Questionable Research Practices
Link to resource
The Dana-Farber Cancer Institute, a Harvard Medical School affiliate, is seeking to retract six studies and correct 31 other papers as …
Author(s): Nidhi Subbaraman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Dana-Farber Cancer Institute, Harvard, Cancer Research, Review of Publications
Link to resource
A typical empirical study involves choosing a sample, a research design, and an analysis path. Variation in such choices across studies …
Author(s): Felix Holzmeister, Magnus Johannesson, Robert Böhm, and Michael Kirchler
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): External Validity, Theory Building, Theory
Link to resource
This course is designed to expose students to the history of psychology through a study of the methods used in research over time, with …
Author(s): Moin Syed
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this course, we will examine the on-going methodological controversies around psychology, cognitive science, and cognitive …
Author(s): Professor E.Machery
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Philosophy, History of Psychology
Link to resource
Research in the last decade has expressed considerable optimism about the clinical potential of psychedelics for the treatment of …
Author(s): Michiel van Elk, Eiko I. Fried
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Open Science, Psychedelics, Psychotherapy, Questionable Research Practices, Validity
Link to resource
Over the past 10 years, crises surrounding replication, fraud, and best practices in research methods have dominated discussions in the …
Author(s): William J. Chopik, Ryan H. Bremner, Andrew M. Defever, Victor N. Keller
Type of resources: Primary Source, Reading, Paper
Primary user(s): Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution
Link to resource
Comprehensive Results in Social Psychology (CRSP) is a novel journal for preregistered research (so-called registered reports, RR) in …
Author(s): Kai J. Jonas, Joseph Cesario
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Registered Reports, Social Psychology
Link to resource
N.A.
Author(s): Jordana Cepelewicz
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Failure, Math
Link to resource
Background Traditional research methods often involve a lengthy process, but the emergence of flash mobs as an innovative data …
Author(s): Hejdi Gamst-Jensen, Lone Dragnes Brix, Marie Oxenbøll Collet, Anne Højager Nielsen
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Flash Mob, Patient-Centered, Scoping Review
Link to resource
Dr Jemeen Sreedharan talks about his personal experiences of openness (and the opposite!) and how it has led to his research …
Author(s): Jemeen Sreedharan, UKRIO
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Openness, Data Sharing, Collaboration
Link to resource
“The problem is the way policing was built,” historian Khalil Muhammad says.
Author(s): Anna North
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Parent, Librarian
Subject area(s): Social Science
Tag(s): Diversity, Equity, Inclusion
Link to resource
Sampling simulated data can reveal common ways in which our cognitive biases mislead us.
Author(s): Professor Dorothy Bishop
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Much of the work done by faculty at both public and private universities has significant public dimensions: it is often paid for by …
Author(s): Carol Muñoz Nieves, Erin C McKiernan, Gustavo E Fischman, Juan P Alperin, Lesley A Schimanski, Meredith T Niles
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Academic Careers, Higher Education, Institutional Policy, Metrics, Open Access, Publishing, Scholarly Communications
Link to resource
Researchers often lack knowledge about how to deal with outliers when analyzing their data. Even more frequently, researchers do not …
Author(s): Christophe Leys, Marie Delacre, Youri L. Mora, Daniel Lakens, Christophe Ley
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Psychology, Transparency, Outliers, Preregistration, Robust Detection, Malahanobis Distance, Median Absolute Deviation, Minimum Covariance Determinant
Link to resource
The reproducibility problem that exists in various academic fields has been discussed in recent years, and it has been revealed that …
Author(s): Yuki Yamada
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration
Link to resource
Digital archivists are already experts at tackling the complex challenges of making research data open and accessible. We can help to …
Author(s): Jessica Farrell
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Research Data, Research Management, Funding, Policy, Librarians, Digital Archiving, Open Data
Link to resource
An essay about How to Make More Published Research True
Author(s): John Ioannidis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Some wish to mandate preregistration as a response to the replication crisis, while I and others caution that such mandates …
Author(s): E. David Klonsky
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Metascience, Preregistration Badges, Robust Science, Psychological Science, Open Science, Replication Crisis, Transparency
Link to resource
This webinar outlines how to use the free Open Science Framework (OSF) as an Electronic Lab Notebook for personal work or private …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Electronic Lab Notebooks, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Data show that Black scientists’ representation dwindles at each stage of academia in the United Kingdom. This article is the first in …
Author(s): Elizabeth Gibney
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Social Science
Tag(s): Diversity, Equality, Equity, Black Researchers
Link to resource
A blog about reproducibility crisis
Author(s): John Bohannon
Type of resources: Primary Source, Reading, Blog
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We linked names and contact information to publicly available profiles in the Personal Genome Project. These profiles contain medical …
Author(s): Sweeney, Latanya, Akua Abu, and Julia Winn.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This post follows one I wrote earlier in the summer, after ASSC. Since then I have been trying (in a first-person therapy sort of way) …
Author(s): Steve Fleming
Type of resources: Reading
Primary user(s): Student, Teacher, researcher
Subject area(s): Life Science, Social Science
Tag(s): Consciousness, IIT, GNWT, Accelerating Research on Consciousness, Higher Order Theories
Link to resource
This lesson shows how to use Python and skimage to do basic image processing. With support from an NSF iUSE grant, Dr. Tessa Durham …
Author(s): Mark Meysenberg
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Image Processing, Open Scholarship Tools and Technologies, Python, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Limiting the debilitating consequences of ageing is a major medical challenge of our time. Robust pharmacological interventions that …
Author(s): Anna B. Crist, Anna C. Foulger, Anna L. Coleman-Hulbert, Brian Onken, Carolina Ibanez-Ventoso, Christina Chang, Christine A. Sedore, Daniel Edgar, Dipa Bhaumik, Elizabeth A. Chao, Erik Johnson, Esteban Chen, Girish Harinath, Gordon J. Lithgow, Jailynn Harke, Jason L Kish, Jian Xue, John H. Willis, June Hope, Kathleen J. Dumas, Manish Chamoli, Mark Lucanic, Mary Anne Royal, Max Guo, Michael P. Presley, Michelle K. Chen, Monica Driscoll, Patrick C. Phillips, Shaunak Kamat, Shobhna Patel, Suzanne Angeli, Suzhen Guo, Theo Garrett, W. Todd Plummer
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Analysis, Genetics, Reproducibility, Research Methods
Link to resource
The emergence of large-scale replication projects yielding successful rates substantially lower than expected caused the behavioural, …
Author(s): Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., Elsherif, M., Breznau, N., Robertson, O., Kalandadze, T., Yu, S., Baker, B. J., O’Mahony, A., Olsnes, J. Ø.-S., Shaw, J. J., Gjoneska, B., Yamada, Y., Röer, J. P., Murphy, J., Alzahawi, S., Grinschgl, S., Oliveira, C. M., Wingen, T., Yeung, S. K., Liu, M., König, L. M., Albayrak-Aydemir, N., Lecuona, O., Micheli, L., & Evans, T. and FORRT
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education, Social Science
Tag(s): Replication Crisis; Reproducibility; Academic Reform
Link to resource
The goal of science is to accumulate knowledge about nature. There are scientific values guiding how scientists should work, and …
Author(s): Brian Nosek
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Transparency, Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The goal of the course is to become a better scientist. You will learn about newest standards for scientific openness, and how they …
Author(s): Don Moore and Leif Nelson
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
Preregistration is the practice of publicly publishing plans on central components of the research process before access to, or …
Author(s): Thomas Rhys Evans, Peter Branney, Andrew Clements, Ella Hatton
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Preregistration, Academia, Industry, Consulting, Applied Research, Evidence-based Practices
Link to resource
In this article, the Society for Personality and Social Psychology (SPSP) Task Force on Publication and Research Practices offers a …
Author(s): Funder et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Social science research has undergone a credibility revolution, but these gains are at risk due to problematic research practices. …
Author(s): Fiona Burlig
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Social Science
Link to resource
This course aims to help you to draw better statistical inferences from empirical research. First, we will discuss how to correctly …
Author(s): Daniel Lakens
Type of resources: Full Course
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Course
Link to resource
Pre-Analysis Plans (PAPs) for randomized evaluations are becoming increasingly common in Economics, but their definition remains …
Author(s): Abhijit Banerjee, Esther Duflo, Amy Finkelstein, Lawrence F. Katz, Benjamin A. Olken, Anja Sautmann
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Preregistration, Pre-Analysis Plans, Economics
Link to resource
Jacob Cohen (see record 1995-12080-001) raised a number of questions about the logic and information value of the null hypothesis …
Author(s): Richard L. Hagen
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Much has been written regarding p-values below certain thresholds (most notably 0.05) denoting statistical significance and the …
Author(s): Gary L. Gadbury and David B. Allison
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
During multiple testing, researchers often adjust their alpha level to control the familywise error rate for a statistical inference …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Familywise Error Rate, Multiplicity, Multiple Testing, Multiple Comparisons Per Family, Error Rate, Type I Error Rate
Link to resource
Ecological momentary assessment (EMA) represents a promising approach to study cognitive aging. In contrast to laboratory-based …
Author(s): Jennifer L. Crawford, Tammy English, Todd S. Braver
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Ecological Momentary Assessment, Methods, Cognitive Aging, Robustness, Replicability, Replication, Generalizability, Transferability
Link to resource
Despite the potential benefits of sequential designs, studies evaluating treatments or experimental manipulations in preclinical …
Author(s): Alice Schneider, Andre Rex, Bob Siegerink, George Karystianis, Ian Wellwood, John P. A. Ioannidis, Jonathan Kimmelman, Konrad Neumann, Oscar Florez-Vargas, Sophie K. Piper, Ulrich Dirnagl, Ulrike Grittner
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Bayesian Method, Bayesian Statistics, Clinical Trials, Experimental Design, Medicine and Health Sciences, Probability Distribution, Research Design, Research Errors
Link to resource
This paper presents a generalized registration form for systematic reviews that can be used when currently available forms are not …
Author(s): Olmo R. van den Akker, Gjalt-Jorn Ygram Peters, Caitlin J. Bakker, Rickard Carlsson, Nicholas A. Coles, Katherine S. Corker, Gilad Feldman, David Moreau, Thomas Nordström, Jade S. Pickering, Amy Riegelman, Marta K. Topor, Nieky van Veggel, Siu Kit Yeung, Mark Call, David T. Mellor, Nicole Pfeiffer
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, researcher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Registration, Systematic Reviews, Psychology, Economics, Law, Physics, Meta-Analysis
Link to resource
Empirical research inevitably includes constructing a data set by processing raw data into a form ready for statistical analysis. Data …
Author(s): Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Conservation science is a multidisciplinary and collaborative discipline. This journal’s policy is to encourage transparent and …
Author(s): Frith Jarrad, Ellen Main, Mark Burgman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Open Science Badges
Link to resource
The methods and results of health research are documented in study protocols, full study reports (detailing all analyses), journal …
Author(s): An-Wen Chan, Fujian Song, Andrew Vickers, Tom Jefferson, Kay Dickersin, Peter C Gøtzsche, Harlan M Krumholz, Davina Ghersi, H Bart van der Worp
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Protocols, Preregistration, Open Access, Open Data, Funding
Link to resource
Invest in Open Infrastructure (IOI) is thrilled to announce the launch of our latest resource: Infra Finder. This tool is designed to …
Author(s): Chrys Wu and others
Type of resources: Infrastructure Resource Navigator
Primary user(s): Student, Teacher, Administrator
Subject area(s): Applied Science, Career and Technical Education
Tag(s): Research, Open Infrastructure, Infra Finder
Link to resource
The Innovations in Graduate Education (IGE) Program is designed to encourage development and implementation of bold, new, and …
Author(s): US National Science Foundation
Type of resources: Funding Opportunity
Primary user(s): Student, Teacher, Researcher
Subject area(s): Career and Technical Education, Education, Life Science, Math & Statistics, Physical Science
Tag(s): STEM Graduate Education, Educational Efficiency
Link to resource
Easy steps you can take to elevate your mentoring
Author(s): Amanda Moehring & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading, Teaching/Learning Strategy
Primary user(s): Teacher
Subject area(s): Education
Tag(s): Mentoring; Teaching; Supervision; Lab Management; Equity, Diversity, and Inclusion (EDI); Professional Development
Link to resource
The last ten years have witnessed increasing awareness of questionable research practices (QRPs) in the life sciences [1,2], including …
Author(s): Chambers, C. D., Feredoes, E., Muthukumaraswamy, S. D., & Etchells, P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Transparency is indispensable for accuracy and correction in science, and is discussed frequently in the credibility revolution. A less …
Author(s): Rink Hoekstra and Simine Vazire
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recently, many psychological effects have been surprisingly difficult to reproduce. This article asks why, and investigates whether …
Author(s): Richard Kunert
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Research is global. This was clearly recognised recently when UNESCO released its Recommendation on Open Science, including a set of …
Author(s): UKRN
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education
Tag(s): UNESCO Recommendations on Open Science, Open Science, UKRN
Link to resource
Concerns about the replicability, reproducibility and transparency of research have ushered in a set of practices and behaviours under …
Author(s): Magda Skubera, Max Korbmacher, Thomas Rhys Evans, Flavio Azevedo, Charlotte R. Pennington and FORRT
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education, Social Science
Tag(s): Open Research; Reproducibility; Replicability; Research Transparency; Psychology; Systematic Mapping Review; International Initiatives; Community-Based Change; Research Culture
Link to resource
A blog about the visualisation of Confidence intervals
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Simulation, Student Guide, Teaching/Learning Strategy, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
Correlation is one of the most widely used tools in statistics. The correlation coefficient summarizes the association between two …
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Reading, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
Pre-requisites:
Author(s): Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Lesson Plan
Primary user(s): Teacher
Subject area(s): Math & Statistics
Tag(s): Statistics; Effect Sizes; Confidence Intervals; Data Analysis; Data Visualization; Data Interpretation.
Link to resource
Improved research practice is based on estimation of effect sizes rather than statistical significance. We discuss the challenging task …
Author(s): ARTHUR A. STUKAS AND GEOFF CUMMING
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This video will introduce how to calculate confidence intervals around effect sizes using the MBESS package in R. All materials shown …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers, Statistics
Link to resource
Welcome to R! Working with a programming language (especially if it’s your first time) often feels intimidating, but the rewards …
Author(s): Ahmed Moustafa, Alexia Cardona, Andrea Ortiz, Jason Williams, Krzysztof Poterlowicz, Naupaka Zimmerman, Yuka Takemon
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Biology, Measurement and Data
Tag(s): Analysis, Data, Education, Inside Your Classroom, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers
Link to resource
A paper about a special issue on cognitive modelling
Author(s): Kevin Glucka, Paul Bellob, Jerome Busemeyer
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Dramatic changes to the transparency, rigor, reproducibility and replicability of research practices have occurred in the last decade. …
Author(s): Flavio Azevedo, Sam Parsons, Leticia Micheli, Julia Strand, Eike Mark Rinke, Samuel Guay, Mahmoud Elsherif, Kimberly A. Quinn, Jordan Wagge, Crystal N. Steltenpohl, Tamara Kalandadze, Martin Rachev Vasilev, Catia Margarida Oliveira, Balazs Aczel, Jacob Francisco Miranda, Bradley James Baker, Carl Michael Galang, Charlotte Rebecca Pennington, Tamara Marques, Catherine Laverty, Meng Liu, Yanna Weisberg, Thomas Rhys Evans, Madeleine Pownall, Kait Clark, Nihan Albayrak-Aydemir, Samuel J Westwood, Helena Hartmann, and FORRT
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education
Tag(s): Open Scholarship; Pedagogy; Higher Education; Teaching; Mentorship; Research Training; Open Educational Resources (OER)
Link to resource
A blog about JASP to replace SPSS
Author(s): Jonas Haslbeck
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Blog, Reproducibility Knowledge
Link to resource
Nowhere Lab ( http://nowherelab.com/) is an online community for people who would like the lab meeting experience but don’t currently …
Author(s): Priya Silverstein & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Activity/Lab, Interactive
Primary user(s): Student, Teacher, Ex-academics
Subject area(s): Applied Science
Tag(s): Remote Lab; Global Lab
Link to resource
Open Science is gaining ground in all research fields, including health economics and outcomes research (HEOR). However, teaching Open …
Author(s): Xavier G. L. V. Pouwels, Hendrik Koffijberg
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Education, Life Science
Tag(s): Open Science, Health Economics and Outcomes Research (HEOR), Teaching Activity
Link to resource
Archaeology has an issue with “just-in-time” research, where insufficient attention is paid to articulating a research …
Author(s): Shawn Ross, Brian Ballsun-Stanton
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities
Tag(s): Arts and Humanities, Digital Humanities, History, Philosophy, Philosophy of Science, Archaeology, Preregistration
Link to resource
In this blog post, Dr Dermot Lynott, Assistant Professor in Psychology at Maynooth University, and Lead Investigator on the NORF-funded …
Author(s): Michelle Doran, Dermot Lynott
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Open Research Training, Open Science, Education
Link to resource
Workshop goals
Author(s): Kristina Riemer, Mine Çetinkaya-Rundel, Pat Schloss, Paul Magwene
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Organizing, Reproducibility
Link to resource
Data Carpentry lesson to learn how to work with Amazon AWS cloud computing and how to transfer data between your local computer and …
Author(s): Abigail Cabunoc Mayes, Adina Howe, Amanda Charbonneau, ammatsun, Bérénice Batut, Bob Freeman, Brittany N. Lasseigne, PhD, Caryn Johansen, Chris Fields, Darya Vanichkina, David Mawdsley, Erin Becker, François Michonneau, Greg Wilson, Jason Williams, Joseph Stachelek, Kari L. Jordan, PhD, Katrin Leinweber, Maxim Belkin, Michael R. Crusoe, Piotr Banaszkiewicz, Raniere Silva, Rémi Emonet, Renato Alves, Stephen Turner, Taylor Reiter, Thomas Morrell, Tracy Teal, vuw-ecs-kevin, William L. Close
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Cloud Computing, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Data Carpentry lesson to understand data structures and common storage and transfer formats for spatial data. The goal of this lesson …
Author(s): Anne Fouilloux, Chris Prener, Dev Paudel, Ethan P White, Joseph Stachelek, Katrin Leinweber, Lauren O'Brien, Michael Koontz, Paul Miller, Tracy Teal, Whalen
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Geospatial, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers, Spatial
Link to resource
Data Carpentry lesson to open, work with, and plot vector and raster-format spatial data in R. The episodes in this lesson cover how to …
Author(s): Ana Costa Conrado, Angela Li, Anne Fouilloux, Brett Lord-Castillo, Ethan P White, Joseph Stachelek, Juan F Fung, Katrin Leinweber, Klaus Schliep, Kristina Riemer, Lachlan Deer, Lauren O'Brien, Marchand, Punam Amratia, Sergio Marconi, Stéphane Guillou, Tracy Teal, zenobieg
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Geospatial, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers, Spatial
Link to resource
This workshop introduces the basic concepts of Git version control. Whether you’re new to version control or just need an …
Author(s): Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Open Scholarship Tools and Technologies, Research Data Management Tools, Researchers
Link to resource
This class is designed for first-time and longer-term users of Jupyter Notebooks, a workspace for writing code. The class focuses on …
Author(s): Nick Wolf, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Open Scholarship Tools and Technologies, Research Data Management Tools, Researchers
Link to resource
Explaining the fundamentals of mediation and moderation analysis, this engaging book also shows how to integrate the two using an …
Author(s): Andrew F. Hayes
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Social Science
Tag(s): Book
Link to resource
A book about meta analyses
Author(s): Borenstein, M., Hedges, L.V., Higgins, J. P. T., & Rothstein, H. R. (2009).
Type of resources: Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This series of lecture slides were used during the “Advanced Simulation for Health Economic Analysis” course at the …
Author(s): Xavier G.L.V. Pouwels
Type of resources: Lecture
Primary user(s): Teacher
Subject area(s): Life Science
Tag(s): Health Economics, Open Science, Introduction
Link to resource
This video is an introduction to power analyses to improve the reproducibility of your research.
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers, Statistics
Link to resource
This video will introduce how to calculate statistical power in R using the pwr package.
All materials shown in the video, as well as …
Author(s): Courtney Soderberg
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Analysis, Reproducibility
Link to resource
This is a recording of a 45 minute introductory webinar on preprints. With our guest speaker Philip Cohen, we’ll cover what …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
The goal of this lesson is to provide an introduction to R for learners working with geospatial data. It is intended as a pre-requisite …
Author(s): Anne Fouilloux, butterflyskip, Chris Prener, Claudia Engel, David Mawdsley, Erin Becker, François Michonneau, Ido Bar, Jeffrey Oliver, Juan Fung, Katrin Leinweber, Kevin Weitemier, Kok Ben Toh, Lachlan Deer, Marieke Frassl, Matt Clark, Miles McBain, Naupaka Zimmerman, Paula Andrea Martinez, Preethy Nair, Raniere Silva, Rayna Harris, Richard McCosh, Vicken Hillis
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Geospatial, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers
Link to resource
An introduction to the concepts and best practices of research data management.
Author(s): Nick Wolf, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Open Scholarship Guidelines, Research Data Management, Researchers, ResearchersOpen Scholarship Guidelines
Link to resource
Introduction to simulation - first of a series of short lectures given at University of Oxford in February 2021. Very basic for those …
Author(s): Professor Dorothy Bishop
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics, Social Science
Tag(s): Simulation
Link to resource
Command line interface (OS shell) and graphic user interface (GUI) are different ways of interacting with a computer’s operating …
Author(s): Andras Vereckei, Arieda Muço, Miklós Koren
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, Shell
Link to resource
Data Carpentry lesson to learn to navigate your file system, create, copy, move, and remove files and directories, and automate …
Author(s): Amanda Charbonneau, Amy E. Hodge, Anita Schürch, Bastian Greshake Tzovaras, Bérénice Batut, Colin Davenport, Diya Das, Erin Alison Becker, François Michonneau, Giulio Valentino Dalla Riva, Jessica Elizabeth Mizzi, Karen Cranston, Kari L Jordan, Mattias de Hollander, Mike Lee, Niclas Jareborg, Omar Julio Sosa, Rayna Michelle Harris, Ross Cunning, Russell Neches, Sarah Stevens, Shannon EK Joslin, Sheldon John McKay, Siva Chudalayandi, Taylor Reiter, Tobi, Tracy Teal, Tristan De Buysscher
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Genetics, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, Shell
Link to resource
Web scraping is the process of extracting data from websites. Some data that is available on the web is presented in a format that …
Author(s): Belinda Weaver, Joshua Dull, Thomas Guignard
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, Web Scraping
Link to resource
Background Open science practices are implemented across many scientific fields to improve transparency and reproducibility in …
Author(s): Jeremy Y. Ng, Brenda Lin, Tisha Parikh, Holger Cramer, David Moher
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Open Science Practices, Complementary Alternative and Integrative Medicine, Transparecnt and Openness Promotion
Link to resource
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the …
Author(s): Klein et al.
Type of resources: Primary Source, Reading, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Examines several prominent trends in the conduct of psychological research and considers how they may limit progress in the field. …
Author(s): Paul L. Wachtel
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The ability to self-correct is considered a hallmark of science. However, self-correction does not always happen to scientific evidence …
Author(s): John Ioannidis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Proponents of preregistration argue that, among other benefits, it improves the diagnosticity of statistical tests. In the strong …
Author(s): Aba Szollosi, David Kellen, Danielle J. Navarro, Richard Shiffrin, Iris van Rooij, Trisha Van Zandt
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Theory Development, Inference
Link to resource
Psychology has recently been viewed as facing a replication crisis because efforts to replicate past study findings frequently do not …
Author(s): Scott E. Maxwell, Michael Y. Lau and George S. Howard
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
There has been much debate in recent years about how open research practices, which have been promoted in efforts to improve research …
Author(s): Madeleine Pownall
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Qualitative Research, Replication, Replicability, Epistemology
Link to resource
A paper about Is the call to abandon p-values the red herring of the replicability crisis?
Author(s): Victoria Savalei and Elizabeth Dunn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
We discuss three arguments voiced by scientists who view the current outpouring of concern about replicability as overblown. The first …
Author(s): Pashler, H., & Harris, C. R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recent studies report an inability to replicate previously published research, leading some to suggest that scientific knowledge is …
Author(s): Donald D Bergh, Barton M Sharp, Herman Aguinis and Ming Li
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The field of psychology, including cognitive science, is vexed by a crisis of confidence. Although the causes and solutions are varied, …
Author(s): Jeffrey N Rouder, Richard D Morey, Josine Verhagen, Jordan M Province, Eric-Jan Wagenmakers
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
Public concerns about the perils associated with incomplete or delayed reporting of results from clinical trials has heightened …
Author(s): Deborah A. Zarin; Nicholas C. Ide; Tony Tse; William R. Harlan; Joyce C. West; Donald A. B. Lindberg
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Preregistration, Clinical Trials
Link to resource
Psychology is in the early stages of examining a crisis of replicability stemming from several high-profile failures to replicate …
Author(s): Jennifer L. Tackett et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The social sciences continue to move towards more open and transparent research practices. However, these changes have been driven by …
Author(s): Annayah Prosser, Olivia Brown, Grace L. Augustine
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Qualitative Research, Open Data, Replication
Link to resource
In the past decade, behavioral science has seen the introduction of beneficial reforms to reduce false positive results. Serving as the …
Author(s): Hanne K.Collins et al.
Type of resources: Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Kindness
Link to resource
The scientific endeavor is one in which the capacity to replicatefindings is a foundational tenant. It is unfortunate that therehave been …
Author(s): Steven K. Huprich
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Science, Levels
Link to resource
Today we are going to learn the basics of literate programming using Jupyter Notebooks, a popular tool in data science, with the R …
Author(s): Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Git, GitHub, Jupyter Notebooks, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers
Link to resource
I argue that requiring authors to post the raw data supporting their published results has the benefit, among many others, of making …
Author(s): Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science
Tag(s):
Link to resource
In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently …
Author(s): Daniel Lakens et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Materials for the Key Practices for the Language Scientist course taught from January to March 2020 at the Max Planck Institute for …
Author(s): Drs Julia Egger and Eirini Zormpa
Type of resources: Module, Syllabus
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Teaching
Link to resource
In their article ‘Self-correction in science: The diagnostic and integrative motives for replication‘, David Peterson and Aaron …
Author(s): Maarten Derksen
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Replication, Replication Types, Context-Exploratory Replication
Link to resource
Knowledge Rights 21 (KR21) is focused on bringing about changes in legislation and practice across Europe that will strengthen the …
Author(s): Pekka Heikkinen, Ignasi Labastida i Juan, Felix Reda, Ariadna, Benjamin White, Susan Reilly, Barbara Szczepanska, Barbara Stratton, Harald Müller
Type of resources: Website, initiative
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Career and Technical Education, Education, Law, Social Science
Tag(s): Knowledge Rights, Policy Change, Education, Innovation, Cultural Participation
Link to resource
La notion d’autorat est devenue incontournable dans le monde actuel de la recherche et le contexte d’évaluation principalement …
Author(s): Dony, Christophe ; Mathy, Adrien ; Bardiau, Marjorie
Type of resources: Lecture Notes, Communication
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education
Tag(s): authorship; research ethics; publication ethics; research integrity
Link to resource
Software Carpentry lección para la terminal de Unix La terminal de Unix ha existido por más tiempo que la mayoría de sus usuarios. Ha …
Author(s): Adam Huffman, Alejandra Gonzalez-Beltran, AnaBVA, Andrew Sanchez, Anja Le Blanc, Ashwin Srinath, Brian Ballsun-Stanton, Colin Morris, csqrs, Dani Ledezma, Dave Bridges, Erin Becker, Francisco Palm, François Michonneau, Gabriel A. Devenyi, Gerard Capes, Giuseppe Profiti, Gordon Rhea, Jake Cowper Szamosi, Jared Flater, Jeff Oliver, Jonah Duckles, Juan M. Barrios, Katrin Leinweber, Kelly L. Rowland, Kevin Alquicira, Kunal Marwaha, LauCIFASIS, Marisa Lim, Martha Robinson, Matias Andina, Michael Zingale, Nicolas Barral, Nohemi Huanca Nunez, Olemis Lang, Otoniel Maya, Paula Andrea Martinez, Raniere Silva, Rayna M Harris, Shirley Alquicira, Silvana Pereyra, sjnair, Stéphane Guillou, Steve Leak, Thomas Mellan, Veronica Jimenez-Jacinto, William L. Close, Yee Mey
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, Shell
Link to resource
lab.js is a free, open, online study builder for the behavioral and cognitive sciences. (it works great in the lab, too)
Author(s): Felix Henninger
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Educators, Open Source, Open Source Software, Researchers
Link to resource
LCIRT was established in 2001 to pioneer LD research, discover innovative strategies and practices, and improve teaching and learning …
Author(s): Landmark College Institute
Type of resources: Website
Primary user(s): Student, Teacher, Parent
Subject area(s): Education, Social Science
Tag(s): Diversity, Equity, Inclusion, Neurodiversity
Link to resource
Last Contact is a game is a game that is intended to inform people about the open science movement. In the game players encounter …
Author(s): Anita Eerland, Karin Fikkers, Francine Boon, Victor van Doorn
Type of resources: Activity/Lab, Game, Student Guide
Primary user(s): Student, Teacher, Librarian
Subject area(s): Arts and Humanities, Education, Social Science
Tag(s): Puzzle, Escape Room
Link to resource
A video about scientific studies
Author(s): Last Week Tonight/John Oliver
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Video
Link to resource
This book demonstrates how to conduct latent variable modeling (LVM) in R by highlighting the features of each model, their specialized …
Author(s): W. Holmes Finch, Brian F. French
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Book
Link to resource
A statistical tutorial about using Jamovi
Author(s): Danielle Navarro and David R Foxcraft
Type of resources: Data Set, Textbook, Tutorial
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Statistical Book, Tutorial
Link to resource
The book is associated with the lsr package on CRAN and GitHub. The package is probably okay for many introductory teaching purposes, …
Author(s): Danielle Navarro
Type of resources: Textbook
Primary user(s): student, teacher
Subject area(s): Statistics and Probability
Tag(s): Statistics
Link to resource
There has been much talk of psychological science undergoing a renaissance with recent years being marked by dramatic changes in …
Author(s): DB Connor
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Health Psychology
Link to resource
A paper about publishing few papers
Author(s): Leif D. Nelson, Joseph P. Simmons & Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
As Earth Day approaches, a day dedicated to both raising environmental awareness and celebrating environmental action, it can sometimes …
Author(s): Shahid Naeem, Jeremy Jackson, David Neelin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Physical Science
Tag(s): Earth Day, Open Science
Link to resource
A number of scholars recently have argued for fundamental changes in the way psychological scientists conduct and report research. The …
Author(s): Jon K. Maner
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Purpose: To introduce methods and tools in organization, documentation, automation, and dissemination of research that nudge it further …
Author(s): April Clyburne-Sherin
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Librarians, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Open source infrastructure has paved the way for mission-aligned research stakeholders to create a united vision of interoperable tools …
Author(s):
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Center for Open Science, Jupyter, Open Code, Open Infrastructure, Open Research, Open Science, Open Science Framework, Open Source, OSF, Osfr, Protocols.io, Research, Research Integration, Research Tools
Link to resource
Library Carpentry lesson: An introduction to Git. What We Will Try to Do Begin to understand and use Git/GitHub. You will not be an …
Author(s): 222064h, abracarambar, ajtag, Alexander Gary Zimmerman, Alexander Mendes, Alex Mendes, Amiya Maji, Amy Olex, Andrew Lonsdale, Annika Rockenberger, Begüm D. Topçuoğlu, Belinda Weaver, Benjamin Bolker, Bill McMillin, Brian Moore, butterflyskip, Casey Youngflesh, Christopher Erdmann, Christoph Junghans, cmjt, Dan Michael O. Heggø, David Jennings, DSTraining, Erin Alison Becker, Evan Williamson, Garrett Bachant, Grant Sayer, hdinkel, Ian Lee, Jake Lever, Jamene Brooks-Kieffer, James Baker, James E McClure, James O'Donnell, James Tocknell, Janoš Vidali, Jeffrey Oliver, Jeremy Teitelbaum, Jeyashree Krishnan, João Rodrigues, Joe Atzberger, Jonah Duckles, Jonathan Cooper, jonestoddcm, Katherine Koziar, Katrin Leinweber, Kunal Marwaha, Kurt Glaesemann, Lauren Ko, L.C. Karssen, Lex Nederbragt, Madicken Munk, Maneesha Sane, Marie-Helene Burle, Mark Woodbridge, Martino Sorbaro, Matt Critchlow, Matteo Ceschia, Matthew Bourque, Matthew Hartley, Maxim Belkin, Megan Potterbusch, Michael Torpey, Michael Zingale, Mingsheng Zhang, Nicola Soranzo, Nima Hejazi, Nora McGregor, Oscar Arbeláez, Peace Ossom Williamson, pllim, Raniere Silva, Rayna Harris, Rémi Emonet, Rene Gassmoeller, Richard Barnes, Rich McCue, Ruud Steltenpool, Ryan Wick, Samniqueka Halsey, Samuel Lelièvre, Sarah Stevens, Saskia Hiltemann, Schlauch, Tobias, Scott Bailey, Shari Laster, Simon Waldman, Stefan Siegert, Thea Atwood, Thomas Morrell, Tim Dennis, Tommy Keswick, Tracy Teal, Trevor Keller, TrevorLeeCline, Tyler Crawford Kelly, Tyler Reddy, Umihiko Hoshijima, Veronica Ikeshoji-Orlati, Wes Harrell, William Sacks, Will Usher, Wolmar Nyberg Åkerström, Yuri
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Applied Science, Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Git, Librarians, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools
Link to resource
This Library Carpentry lesson introduces librarians and others to working with data. This Library Carpentry lesson introduces people …
Author(s): Alexander Mendes, Alex Volkov, Angus Taggart, Belinda Weaver, BertrandCaron, Bianca Peterson, Christopher Edsall, Christopher Erdmann, Chuck McAndrew, Dan Michael Heggø, Dan Michael O. Heggø, Elizabeth Lisa McAulay, fdsayre, Felix Hemme, François Michonneau, James Baker, Janice Chan, Jeffrey Oliver, Jeremy Guillette, Jodi Schneider, Jonah Duckles, Katherine Koziar, Katrin Leinweber, Kunal Marwaha, lsult, Paul R. Pival, PH03N1X007, remerjohnson, Saskia Scheltjens, Shari Laster, Tim Dennis, yvonnemery
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Applied Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Librarians, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools
Link to resource
Library Carpentry lesson: an introduction to OpenRefine for Librarians This Library Carpentry lesson introduces people working in …
Author(s): Alexander Mendes, andreamcastillo, Anna Neatrour, Antonin Delpeuch, Betty Rozum, Christina Koch, Christopher Erdmann, Daniel Bangert, dnesdill, Elizabeth Lisa McAulay, Evan Williamson, hauschke, Jamene Brooks-Kieffer, James Baker, Jamie Jamison, Jeffrey Oliver, Katherine Koziar, mhidas, Naupaka Zimmerman, Paul R. Pival, Rémi Emonet, Tim Dennis, Tom Honeyman, Tracy Teal
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Applied Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Librarians, OpenRefine, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools
Link to resource
Library Carpentry, an introduction to SQL for Librarians This Library Carpentry lesson introduces librarians to relational database …
Author(s): 222064h, Anna-Maria Sichani, Belinda Weaver, Christopher Erdmann, Dan Michael Heggø, David Kane, Elaine Wong, Emanuele Lanzani, Fernando Rios, Jamene Brooks-Kieffer, James Baker, Janice Chan, Jeffrey Oliver, Katrin Leinweber, Kunal Marwaha, mdschleu, orobecca, Reid Otsuji, Ruud Steltenpool, thegsi, Tim Dennis
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Applied Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Librarians, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, SQL
Link to resource
Library Carpentry lesson to learn how to use the Shell. This Library Carpentry lesson introduces librarians to the Unix Shell. At the …
Author(s): Adam Huffman, Alexander Konovalov, Alexander Morley, Alex Kassil, Alex Mendes, Ana Costa Conrado, Andrew Reid, Andrew T. T. McRae, Ariel Rokem, Ashwin Srinath, Bagus Tris Atmaja, Belinda Weaver, Benjamin Bolker, Benjamin Gabriel, BertrandCaron, Brian Ballsun-Stanton, Christopher Erdmann, Christopher Mentzel, colinmorris, Colin Sauze, csqrs, Dan Michael Heggø, Dave Bridges, David McKain, Dmytro Lituiev, earkpr, ekaterinailin, Elena Denisenko, Eric Jankowski, Erin Alison Becker, Evan Williamson, Farah Shamma, Gabriel Devenyi, Gerard Capes, Giuseppe Profiti, Halle Burns, Hannah Burkhardt, hugolio, Ian Lessing, Ian van der Linde, Jake Cowper Szamosi, James Baker, James Guelfi, Jarno Rantaharju, Jarosław Bryk, Jason Macklin, Jeffrey Oliver, jenniferleeucalgary, John Pellman, Jonah Duckles, Jonny Williams, Katrin Leinweber, Kevin M. Buckley, Kunal Marwaha, Laurence, Marc Gouw, Marie-Helene Burle, Marisa Lim, Martha Robinson, Martin Feller, Megan Fritz, Michael Lascarides, Michael Zingale, Michele Hayslett, Mike Henry, Morgan Oneka, Murray Hoggett, Nicolas Barral, Nicola Soranzo, Noah D Brenowitz, Owen Kaluza, Patrick McCann, Peter Hoyt, Rafi Ullah, Raniere Silva, Rémi Emonet, reshama shaikh, Ruud Steltenpool, sjnair, Stéphane Guillou, Stephan Schmeing, Stephen Jones, Stephen Leak, Susan J Miller, Thomas Mellan, Tim Dennis, Tom Dowrick, Travis Lilleberg, Victor Koppejan, Vikram Chhatre, Yee Mey
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Applied Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Librarians, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Shell
Link to resource
Join us for a 30 minute guest webinar by Brandon Butler, Director of Information Policy at the University of Virginia. This webinar …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Licensing, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Background: We explore whether the number of null results in large National Heart Lung, and Blood Institute (NHLBI) funded trials has …
Author(s): Kaplan RM, Irvin VL
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
Is there a difference in citation rates between articles that were published with links to data and articles that were not? Besides …
Author(s): Alberto Accomazzi, Edwin A. Henneken
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Physical Science
Tag(s): Astrophysics, Computer Science, Data, Data Sharing, Digital Libraries, Instrumentation, Methods, Metrics
Link to resource
This recorded webinar features insights from international panelists currently nurturing culture change in research among their local …
Author(s): Brian Nosek
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Open Science, Reproducibility, Reproducible Research, Research
Link to resource
Genetics and neuroscience are two areas of science that pose particular methodological problems because they involve detecting weak …
Author(s): Grabitz, C.R. et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Featuring actual datasets as illustrative examples, this book reveals numerous ways to apply structural equation modeling (SEM) to any …
Author(s): Todd D. Little
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
Research-data availability contributes to the transparency of the research process and the credibility of educational-psychology …
Author(s): Markus Huff, Elke C. Bongartz
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education
Tag(s): Educational Psychology, Research, Data Sharing, Data Policy, FAIR Data Principles, Data Transparency Levels, Open Data
Link to resource
A combination of confirmation bias, hindsight bias, and pressure to publish may prompt the (unconscious) exploration of various …
Author(s): Mariella Paul, Gisela H. Govaart, Antonio Schettino
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Preregistration, EEG, Bias, Analytic Flexibility, ERP
Link to resource
2020 was a year of big changes for the whole world. For the academic community, it was not different. The need to rapidly switch from …
Author(s): Leticia Micheli & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Interactive, Teaching/Learning Strategy
Primary user(s): Teacher, Administrator
Subject area(s): Education
Tag(s): Remote Learning; Online Education; Higher Education; Open Access; Global Education; Academic Opportunities
Link to resource
The vast majority of health-related observational studies are not prospectively registered and the advantages of registration have not …
Author(s): Rafael Dal-Ré, John P. Ioannidis, Michael B. Bracken, Patricia A. Buffler, An-Wen Chan, Eduardo L. Franco, Carlo La Vecchia, ElisabeteWeiderpass
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This guidebook aims to give an overview of the challenges associated with making qualitative data reusable as well as providing …
Author(s): Verburg, Maaike; Braukmann, Ricarda; Mahabier, Widia
Type of resources: Primary Source, Guide
Primary user(s): Student, Librarian, Researcher
Subject area(s): Arts and Humanities, Education, English Language Arts, Social Science
Tag(s): Qualitative Data, Secondary Analysis
Link to resource
Many philosophers of science and methodologists have argued that the ability to repeat studies and obtain similar results is an …
Author(s): Rolf A. Zwaan, Alexander Etz Richard E. Lucas and M. Brent Donnellan
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Academic institutions have made significant investments to support public access to research data requirements, yet little to no data …
Author(s): Alicia Hofelich Mohr, Cynthia Hudson Vitale, Jake Carlson, Jennifer Moore, Joel Herndon, Jonathan Petters, Lizhao Ge, Shawna Taylor, Wendy Kozlowski
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Education, Life Science, Physical Science, Social Science
Tag(s): Public Access, Data Sharing, Institutional Expenses
Link to resource
Science journalists are uniquely positioned to increase the societal impact of open science by contextualizing and communicating …
Author(s): Alice Fleerackers, Natascha Chtena, Stephen Pinfield, Juan Pablo Alperin, Germana Barata, Monique Oliveira, Isabella Peters
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Science, Journalism, COVID-19
Link to resource
A class on setting up and managing research materials; caring for digital files to enable collaboration, sharing, and re-use; and …
Author(s): Nick Wolf, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Materials, Open Scholarship Tools and Technologies, Research Data Management, Researchers
Link to resource
A website with modules and lessons on qualitative research and data management
Author(s): Anon
Type of resources: Interactive, Lesson, Module
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Qualitative research
Link to resource
The university participant pool is a key resource for behavioral research, and data quality is believed to vary over the course of the …
Author(s): Charles R. Ebersole et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Map of open and internationally relevant open science capacity building and training modules to support the implementation of the …
Author(s): UNESCO
Type of resources: Collection of training modules
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Education, Life Science, Physical Science, Social Science
Tag(s): UNESCO, Open Science, Training Modules
Link to resource
Registered reports present a substantial departure from traditional publishing models with the goal of enhancing the transparency and …
Author(s): John P. A. Ioannidis, Tom E. Hardwicke
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Preregistration, Publishing, Registered Reports
Link to resource
Headlines and scholarly publications portray a crisis in biomedical and health sciences. In this webinar, you will learn what the …
Author(s): Amy Riegelman, Frank Sayre
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Librarians, Reproducibility
Link to resource
n.a.
Author(s): Dalmeet Singh Chawla
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Physical Science
Tag(s): Chemistry, Citations
Link to resource
Scientific meetings are an important venue for disseminating findings, but space and time for experimental design details is often …
Author(s): National Institute of Neurological Disorders and Stroke
Type of resources: Website
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Data Transparency, Rigor Icons, Experimental Design Details, Scientific Presentations
Link to resource
A chapter to discuss maximising the reproducibility of research
Author(s): Open Science Collaboration
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The assumption that measurement error always reduces effect sizes is false
Author(s): Loken, E., & Gelman, A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This resource list contains reading material on the topic of measurement in psychological sciences. We hope the list will be a useful …
Author(s): Eiko Fried and Jessica Flake
Type of resources: Reading
Primary user(s): Student, Researcher
Subject area(s): Social Science
Tag(s): Collection, Reproducibility Knowledge
Link to resource
Cases of clear scientific misconduct have received significant media attention recently, but less flagrantly questionable research …
Author(s): Leslie K. John, George Loewenstein, Drazen Prelec
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Patient advocacy organizations (PAOs) advance patient interests through promotion of disease awareness, engagement with policymakers, …
Author(s): Shamik Bhat, Joseph S. Ross, Reshma Ramachandran
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian, Journal Editors
Subject area(s): Life Science, Physical Science, Social Science
Tag(s): Transparency, Conflicts of Interest, Patient Advocacy Organizations, Industry
Link to resource
In the UK, the Medicines and Healthcare products Regulatory Agency consulted on proposals “to improve and strengthen the UK clinical …
Author(s): Martin Law, Dominique-Laurent Couturier, Babak Choodari-Oskooei, Phillip Crout, Carrol Gamble, Peter Jacko, Philip Pallmann, Mark Pilling, David S. Robertson, Michael Robling, Matthew R. Sydes, Sofía S. Villar, James Wason, Graham Wheeler, S. Faye Williamson, Christina Yap, & Thomas Jaki
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Consultation, Data Sharing, Legislation
Link to resource
Expectations by funders for transparent and reproducible methods are on the rise. This session covers expectations for preregistration, …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
The current system of peer review drives racial and gender disparities in publication and funding outcomes and can suppress the …
Author(s): Mariam Aly, Shahana Ansari, Eliana Colunga, M. J. Crockett, Amanda B. Diekman, Matthew Goldrick, Pablo Gomez, Franki Y. H. Kung, Paul C. McKee, Miriam Pérez & Sarah M. Stilwell
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Peer Review, Psychology, Scientific Community, Marginalized Scholars, Inclusion
Link to resource
We work to make the production, communication, and application of scientific and technical knowledge equitable globally. To advance …
Author(s): Laura Ación, Nicolás Palopoli, Laura Ascenzi, Julián Buede, María Inés Fariello, Jesica Formoso, Emmanuel Iarussi, Paola Andrea Lefer, Sabrina López, Patricia Andrea Loto, Eunice Mercado-Lara, Paz Míguez, Maria Cristina Nanton, Romina Pendino, Iván Gabriel Poggio, Mariela Rajngewerc, Irene Vazano, José Luis Villca Villegas, Luciana Benotti, Vanina Varni, Alejandra Daniela Calero, Mariá Jimena Vera, Pablo Vázquez, Vanesa Ruiz, Verónica Xhardez, Débora I. Burin, Julieta Millán, Ariel Silvio Norberto Ramos, Diego Onna, Driselda Sánchez Aguirre, Gastón Klocker, Iván Stoikoff, Juan Pablo Barreyro, Jeremías Fabiano, Julio Zetter Patino, Kevin Hernan Cabana Horqque, Karina Formoso, Laura Martínez Quijano, Luis Adolfo Ortega Granados, María Belén Allasia, Marina Compagnucci, Sergio Santamarina, Umut Pajaro Velasquez, Victoria Gisel Dumas, Zulemma Bartuzo Blacio, Mónica Alonso, Florencia Grattarola, Francisco Javier Palm Rojas, Maria Angela Petrizzo Páez, Thema Monroe-White, Malvika Sharan, Claudiano Neto, Roxana Noelia Villafane, Melissa Black, Sara Mortara, Paola Corrales, Yanina Bellini Saibene, Alejandra Bellini, Elio Campitelli, Violeta Roizman, Ailin Mandola, Alejandra Wrobel, Amit Kohli, Andrea Gomez Vargas, Beatriz Milz, Briana Morrison, Celeste Molina Favero, Francisco Etchart, Kate Hertweck, Lucio Casalla, Priscilla Minotti, Raniere Silva
Type of resources: Projects, Training, Consulting, Website
Primary user(s): Teacher
Subject area(s): Education
Tag(s): Equity, Local Perspective, Spanish-Speaking Communities, Resources
Link to resource
According to a recent meta-analysis, religious priming has a positive effect on prosocial behavior (Shariff et al., 2015). We first …
Author(s): Michiel van Elk, Dora Matzke, Quentin F. Gronau, Maime Guan, Joachim Vandekerckhove and Eric-Jan Wagenmakers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Numerous biases are believed to affect the scientific literature, but their actual prevalence across disciplines is unknown. To gain a …
Author(s): Daniele Fanelli, John P. A. Ioannidis, Rodrigo Costas
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology, Physical Science, Social Science
Tag(s): Bias, Integrity, Meta-analysis, Meta-research, Metascience, Meta-Science, Misconduct, Publishing, Reproducibility, Research Methods
Link to resource
Publication selection bias is a serious challenge to the integrity of all empirical sciences. We derive meta-regression approximations …
Author(s): TD Stanley, H Doucouliagos
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Author(s): Brian Nosek
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Reproducibiity, Research, Scientific Process
Link to resource
The results of many published studies across many scientific domains are not easily reproduced by independent laboratories. For …
Author(s): artin Schweinsberg, Neil Bearden, & Eric Luis Uhlmann, INSEAD
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
We investigated recent meta-research studies on adherence to four reporting guidelines to determine the proportion that provided (1) an …
Author(s): Tiffany Dal Santoa, Danielle B. Rice, Lara S.N. Amiria, Amina Tasleema, Kexin Lia, Jill T. Boruffe, Marie-Claude Geoffroy, Andrea Benedetti, Brett D. Thombs
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Research waste, Reproducibility, Replicability, Checklist, Checklists, Research-on-research
Link to resource
A syllabus about the methods for reliable, transparent and open science
Author(s): Jeffrey Rouder and Joachim Vandekerckhove
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Social Science
Tag(s): Syllabus
Link to resource
Millions of research papers at risk of disappearing from the Internet: An analysis of DOIs suggests that digital preservation is not …
Author(s): Sarah Wild
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science, Physical Science
Tag(s): Digital Preservation, Archiving
Link to resource
Statistical rituals largely eliminate statistical thinking in the social sciences. Rituals are indispensable for identification with …
Author(s): Gerd Gigerenzer
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
This mini course was designed to introduce Psychology undergraduate students at the University of Edinburgh (who are working on their …
Author(s): Dr Alex Mitchell (University of Edinburgh), Niamh MacSweeney (Edinburgh ReproducibiliTea) and Laura Klinkhamer (Edinburgh ReproducibiliTea)
Type of resources: Lecture
Primary user(s): Student
Subject area(s): Social Science
Tag(s): INTRODUCTION, INTRODUCTORY, REPRODUCIBLE, PRINCIPLES, UNDERGRADUATE, DISSERTATION, THESIS, LECTURE, SERIES, VIDEOS, THREE TS, THREE T'S, PSYCHOLOGY
Link to resource
We outline the need to, and provide a guide on how to, conduct a meta-analysis on one’s own studies within a manuscript. Although …
Author(s): Jin X. Goh, Judith A. Hall and Robert Rosenthal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The widespread application of mesenchymal stem cells (MSCs) in veterinary regenerative medicine highlights their promising therapeutic …
Author(s): Khan Sharun, S. Amitha Banu, A. M. Pawde, Kuldeep Dhama & Amar Pal
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Mesenchymal Stem Cells, Regenerative Medicine, Reporting Guidelines, Minimum Requirements, Characterization
Link to resource
Breaches of research integrity have gained considerable attention due to high-profile scandals involving questionable research …
Author(s): Solmaz Filiz Karabag, Christian Berggren, Jolanta Pielaszkiewicz & Bengt Gerdin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Questionable research practices, Scientific norms, Counter norms, Organizational climate, Competition, Ethics training
Link to resource
Breaches of research integrity have gained considerable attention due to high-profile scandals involving questionable research …
Author(s): Solmaz Filiz Karabag, Christian Berggren, Jolanta Pielaszkiewicz & Bengt Gerdin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Questionable Research Practices, Scientific Norms, Counter Norms, Organizational Climate, Competition, Ethics Training
Link to resource
In rodents, the first weeks of postnatal life feature remarkable changes in fear memory acquisition, retention, extinction, and …
Author(s): Hanista Premachandran, Jennifer Wilkin, Maithe Arruda-Carvalho
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Auditory Fear Conditioning, Contextual Fear Conditioning, Development, Extinction, Mice
Link to resource
Author(s): Katie Corker
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
A blog about the p-curve
Author(s): Will Gervais
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Blog
Link to resource
Like performance-enhancing drugs inflating apparent athletic achievements, several common social science practices contribute to the …
Author(s): Hunter Gehlbach, Carly D. Robinson
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Educational Research, P-Hacking, Preregistration, Replication, Research Methods
Link to resource
The COVID-19 pandemic generated tremendous interest in using real world data (RWD). Many consortia across the public and private …
Author(s): Jayson S. Marwaha, Maren Downing, John Halamka, Amy Abernethy, Joseph B. Franklin, Brian Anderson, Isaac Kohane, Kavishwar Wagholikar, John Brownstein, Melissa Haendel, Gabriel A. Brat
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Covid-19, Real World Data, Consortia, Pandemic Response, Rapid Evidence Generation
Link to resource
Survey experiments often yield intention-to-treat effects that are either statistically and/or practically “non-significant.” There has …
Author(s): John V Kane
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Law
Tag(s): Surveys, Experiments, Null Results, Significance, Bias
Link to resource
This editorial serves as a brief introduction to this special issue of Prevention Science, entitled “Transparency, Openness, and …
Author(s): Sean Grant, Frances Gardner, Catherine P. Bradshaw
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Science, Prevention Science, Transparency, Openness, Reproducibility
Link to resource
Social psychology findings have fared poorly in multi-site replication attempts. This article considers and evaluates multiple factors …
Author(s): Roy F. Baumeister, Brad J. Bushman, Dianne M. Tice
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Multi-Laboratory Replications, Replications, Replication Crisis, Social Interaction
Link to resource
The main methods, techniques and issues for carrying out multilevel modeling and analysis are covered in this book. The book is an …
Author(s): Tom A.B. Snijders, Roel Bosker
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
A central tenet of systems biology is that biological systems are greater than the sum of their component parts. Spaceflight is …
Author(s): MILLAR-WILSON, A., WARD, O., DUFFY, E., HARDIMAN, G.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Spaceflight Biology Research
Link to resource
On behalf of the Swedish government, the National Library of Sweden (Kungliga biblioteket, KB) has developed national guidelines for …
Author(s): National Library of Sweden (Kungliga biblioteket, KB)
Type of resources: Guidelines
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Education
Tag(s): Guidelines for Open Science
Link to resource
The National Open Research Forum (NORF), the Irish Research eLibrary (IReL), and OpenAIRE proudly announce the launch of the National …
Author(s): Athina Papadopoulou
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Career and Technical Education
Tag(s): Open Access, National Policy, Open Science, Monitor, Research Policy Monitoring, National Infrastructure
Link to resource
A group of researchers is taking Nature to task for publishing a paper earlier this month about Google DeepMind’s protein folding …
Author(s): Ivan Oransky
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Life Science, Physical Science
Tag(s): Code Availability, Google, DeepMind Protein Folding
Link to resource
Who we are and why is this important?
In academia, there has been much discussion about how open scholarship can benefit marginalised …
Author(s): Mahmoud Elsherif, Amelie Gourdon, Bethan Iley, Aoife OMahony, Sara Middleton, John Shaw, Magdalena Grose, Flavio Azevedo, Siu Kit Yeung, Samantha Tyler, FORRT
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Parent, Librarian
Subject area(s): Education, Social Science
Tag(s): Neurodiversity; Neurodivergent Researchers; Research Equity; Diversity in Academia; Psychology; Higher Education; Stigma Reduction; Inclusivity
Link to resource
Research Integrity (RI) is high on the agenda of both institutions and science policy. The European Union as well as national …
Author(s): Andrea Reyes Elizondo & Wolfgang Kaltenbrunner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Physical Science
Tag(s): Research Integrity, Questionable Research Practices, Epistemology, Labor, Research Culture
Link to resource
Research Integrity (RI) is high on the agenda of both institutions and science policy. The European Union as well as national …
Author(s): Andrea Reyes Elizondo, Wolfgang Kaltenbrunner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Physical Science
Tag(s): Research Integrity, Questionable Research Practices, Epistemology, Labor, Research culture
Link to resource
Concerns that the growing competition for funding and citations might distort science are frequently discussed, but have not been …
Author(s): Daniele Fanelli
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Science is often romanticised as a flawless system of knowledge building, where scientists work together to systematically find …
Author(s): Matosin, N., Frank, E., Engel, M., Lum, J. S., & Newell, K. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Daniel Glaser apprehensively revisits an article of his that saw some fallout due to a study he cited. But that study was not the only …
Author(s): Daniel Glaser
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
TRESCA – Trustworthy, Reliable and Engaging Scientific Communication Approaches – is a research project aimed at understanding how …
Author(s): Gábor Szüdi, Pamela Bartar, Gorazd Weiss, Giuseppe Pellegrini, Marina Tulin, Tessa Oomen
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Science Communication, Evidence-Informed Policy-Making, Trust, Dialogue Model, Open Science, Visualisation, Digitalisation
Link to resource
N.A.
Author(s): Science News Staff
Type of resources: Reading
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Open Science, Science Integrity
Link to resource
The goal of the NIAID Centers of Excellence for Influenza Research and Response (CEIRR) awards is to provide the federal government, …
Author(s): Centers of Excellence for Influenza Research and Response
Type of resources: Primary Source
Primary user(s): Student, Teacher, Librarian, researcher
Subject area(s): Life Science, Social Science
Tag(s): Influenza, Flu, Respiratory Illness, Data Standards
Link to resource
NWO steekt 1,3 miljoen euro in een nieuw onderzoeksprogramma dat bijdraagt aan een cultuurverandering op het gebied van …
Author(s): Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWO)
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator
Subject area(s): Career and Technical Education, Social Science
Tag(s): Diversity, Inclusion, Education
Link to resource
In January 2014, NIH launched a series of initiatives to enhance rigor and reproducibility in research. As a part of this initiative, …
Author(s): National Institutes of Health
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility, Research Administration, Research Data Management, Researchers
Link to resource
This webpage describes the NIH’s data management and sharing policies, including policies for genomic data sharing, and sharing …
Author(s): National Institutes of Health
Type of resources: Student Guide
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): data sharing, federal policy
Link to resource
Non-significant results are less likely to be reported by authors and, when submitted for peer review, are less likely to be published …
Author(s): Christian Harlos, Johan Hollander, Tim C. Edgell
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Physical Science
Tag(s): Analysis, Publication Bias, Reporting, Statistics
Link to resource
Objective: To assess the performance of novel contour enhanced funnel plots and a regression based adjustment method to detect and …
Author(s): Santiago G Moreno, Alex J Sutton, Erick H Turner, Keith R Abrams, Nicola J Cooper, Tom M Palmer, A E Ades
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The Adolescent Brain and Cognitive Development (ABCD) Study, involving over 11,000 youth and their families, is a groundbreaking …
Author(s): Sana A. Ali, Clare F. McCann, Monica K. Thieu, Lucy B. Whitmore, Angela R. Laird
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Developmental Cognitive Neuroscience, ABCD
Link to resource
Null hypothesis significance testing (NHST) is arguably the most widely used approach to hypothesis evaluation among behavioral and …
Author(s): Nickerson, R. S. (2000).
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Null hypothesis significance testing (NHST) is the researcher’s workhorse for making inductive inferences. This method has often …
Author(s): J Krueger
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Eleven countries have introduced open science policies, strategies and legislative frameworks since the adoption of the UNESCO …
Author(s): UNESCO
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): UNESCO, Open Science Policies
Link to resource
The scientific research enterprise is built on a foundation of trust. Scientists trust that the results reported by others are valid. …
Author(s): National Academy of Sciences; National Academy of Engineering; Institute of Medicine; Committee on Science, Engineering, and Public Policy
Type of resources: Reading, Textbook
Primary user(s): Student, Teacher, Beginning Researcher
Subject area(s): Career and Technical Education, Education, Life Science, Physical Science, Social Science
Tag(s): Responsible Research, Ethics
Link to resource
In this commentary on Simmons, Nelson, and Simonsohn (this issue), we examine their rationale for pre-registration within the broader …
Author(s): Michel Tuan Pham, Travis Tae Oh
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Open Science, Reproducibility Crisis, Consumer Research, Philosophy of Science
Link to resource
In recent years, researchers have attempted to provide an indication of the prevalence of inflated Type 1 error rates by analyzing the …
Author(s): Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Examination of the literature in statistics and probability that predates Fisher’s Statistical Methods for Research Workers …
Author(s): MICHAEL COWLES and CAROLINE DAVIS
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
How likely are published findings in the functional neuroimaging literature to be false? According to a recent mathematical model, the …
Author(s): Carp, J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background: Meta-analyses play an important role in cumulative science by combining information across multiple studies and attempting …
Author(s): Daniel Lakens et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Investigators from a large consortium of scientists recently performed a multi-year study in which they replicated 100 psychology …
Author(s): Valen E. Johnson, Richard D. Payne, Tianying Wang, Alex Asher &Soutrik Mandal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Scientific reproducibility has been at the forefront of many news stories and there exist numerous initiatives to help address this …
Author(s): Gregory M. LaRocca, Holly Paddock, Laura Ponting, Matthew H. Brush, Melissa A. Haendel, Nicole A. Vasilevsky, Shreejoy J. Tripathy
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology, Social Science
Tag(s): Data, Reproducibility
Link to resource
Criticisms of null-hypothesis significance tests (NHSTs) are reviewed. Used as formal, two-valued decision procedures, they often …
Author(s): Robert P. Abelson
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
In his commentary, Klonsky (2024) outlines several arguments for why preregistration mandates (PRMs) will have a negative impact on the …
Author(s): Colin Vize, Donald Lynam, Josh Miller, and Nathaniel Phillips
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Falsification, Severity, Open Science, Methodological Reform.
Link to resource
Null hypothesis testing as a tool in research is defended. Six examples are offered of situations in which, if all the researcher could …
Author(s): H. Wainer
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Online data collection methods have become increasingly popular in many domains of psychology, but their use in cognitive aging studies …
Author(s): Nathaniel R. Greene, Moshe Naveh-Benjamin
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Online Experiments, Sampling, Cognitive Aging
Link to resource
Many areas in the language sciences rely on collecting data from human participants, from grammaticality judgments to behavioural …
Author(s): Kenny Smith
Type of resources: Syllabus
Primary user(s): Student, Teacher, Researchers
Subject area(s): Social Science
Tag(s): Programming
Link to resource
Topics covered:
Understanding reproducible research Setting up a reproducible project Understanding power Preregistering your study …
Author(s): April Clyburne-Sherin, Courtney Soderberg
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Documentation, Organizing, Reproducibility, Version Control
Link to resource
The Open Access Directory is an online compendium of factual lists about open access to science and scholarship, maintained by the …
Author(s): OAD Simmons
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Governmental Policies, Institutional Policies, Open Access, Open Access Policies, Organizational Change, Preprints, Publishing Models, Research Administration, Researchers
Link to resource
Scientific progress, including in evidence-based medicine, requires all available evidence to be accessed, scrutinised, interpreted and …
Author(s): Patricia Logullo, Jennifer A de Beyer, Shona Kirtley, Michael Maia Schlüssel, Gary S Collins
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science, Social Science
Tag(s): Open Access, Health Research, Medical Research
Link to resource
There is a scarcity of novel treatments to address many unmet medical needs. Industry and academia are finally coming to terms with the …
Author(s): Wen Hwa Lee
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Acute Myeloid Leukemia, Drug Discovery, Drug Research and Development, Drug Therapy, Leukemias, Lymphomas, Open Access Publishing, Phase I Clinical Investigation
Link to resource
OATP is a crowd-sourced social-tagging project running on free software to capture new developments on open access to research. Its …
Author(s): Peter Suber
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Open Access, Researchers
Link to resource
This course will examine current controversies and new developments in research methods in psychology. The goal of the course is to …
Author(s): Simine Vazire
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Psychological research is in the midst of what has been called the “replication crisis”, in which questions have been raised about the …
Author(s): Krista Byers-Heinlein
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Transparency, Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This course is designed to be delivered to master and doctoral students at the Universidade Federaldo Rio Grande do Sul (UFRGS). The …
Author(s): Daniel Umpierre de Moraes
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
To provide educators with an example of how they can draw resources from FORRT’s educational nexus to integrate open scholarship into …
Author(s): Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Syllabus
Primary user(s): Teacher, Administrator
Subject area(s): Education
Tag(s): FAIR Data & Materials; Course Materials; Open Resources; Readings; Assignments
Link to resource
Julia Strand is Associate Professor of Psychology at Carleton College and she teaches courses such as Introduction to Psychology, The …
Author(s): Julia Strand & Framework for Open and Reproducible Research Training
Type of resources: Full Course, Interview
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Social Science
Tag(s): Pedagogy; Psychology; Credibility Revolution; WEIRD Science; Replication;
Link to resource
The Programme aim is to accelerate the uptake of high quality open research practices. The Center for Open Science theory of change …
Author(s): UKRN Open Research Programme, Tim Newton
Type of resources: Website
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Social Science
Tag(s): Open Science, Open Research, Open Science Practices
Link to resource
Open source software is often seen as a path to reproducibility in computational science. In practice there are many obstacles, even …
Author(s): Steve M. Easterbrook
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education
Tag(s): Computer Science, Code, Poor Code Quality
Link to resource
Scientific research communities pursue dual imperatives in implementing strategies to share their data. These communities attempt to …
Author(s): Alexander Bernier, Bartha M Knoppers, Patrick Bermudez, Michael J S Beauvais, Adrian Thorogood, CONP Consortium, Alan Evans
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Data Sharing, Open Science, Biomedical Data, Canadian Open Neuroscience Platform
Link to resource
The increasing adoption of open science practices in the last decade has been changing the scientific landscape across fields. However, …
Author(s): Sara Hart, Tamara Kalandadze
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s):
Link to resource
The OE Challenge is a learning resource of small doable activities you can work through at your own pace. The series is a fun way for …
Author(s): Tannis Morgan and Leva Lee
Type of resources: Activity/Lab, Interactive, Website, Teaching Guide
Primary user(s): Teacher
Subject area(s): Education
Tag(s): Activities, Open Activities, Open Pedagogy, Open Textbook, Open Educational Resources
Link to resource
I’ve started a Google Doc to share open education or social science data, research, evaluation, and policy positions. Feel free to add …
Author(s): Akisha Osei Sarfo, Ph.D.
Type of resources: Data Set, Positions
Primary user(s): Student, Job Seekers/ Candidates
Subject area(s): Career and Technical Education
Tag(s): Research; Policy; Evaluation; Open Education Data; Job; Positions
Link to resource
This resource was developed by a working group from the Iowa Open Education Action Team (Iowa OER). Our team built upon DOERS3’s …
Author(s): Abbey Elder, Anne Marie Gruber, Iowa Open Education Action Team (Iowa OER), Mahrya Burnett, Teri Koch
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s): Faculty Development, Promotion, Tenure
Link to resource
Background Open educational resources (OER) are educational materials licensed openly by authors, permitting usage, redistribution, and …
Author(s): C. V. Degen MSc., F. Schwitzing, S. Long, L. Gickel, M. Behrends, C. J. Busch, S. Steffens & M. Mikuteit
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Medical Education, Data Protection, Digital Technology, Simulation Learning, Teaching
Link to resource
This research report describes findings from a study conducted to learn students’ experiences using open educational resources (OER) in …
Author(s): Friday, Vivienne Evet; Hunt, Cynthia
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Life Science
Tag(s): Accelerated Nursing Education, Barriers to Higher Education, Higher Education Costs, Open Educational Resources, Textbooks
Link to resource
A syllabus about open science and experimental methods
Author(s): Rima Rahal
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
The field of microscopy has been empowering humankind for many centuries by enabling the observation of objects that are otherwise too …
Author(s): Johannes Hohlbein, Sanli Faez
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, researcher
Subject area(s): Life Science, Physical Science
Tag(s): Open Microscopy, Open Source, Open Science, Open Hardware, Microscopy
Link to resource
OpenIntro Statistics is a dynamic take on the traditional curriculum, being successfully used at Community Colleges to the Ivy League
Author(s): OpenIntro
Type of resources: Textbook
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Arts and Humanities, Education, Life Science, Social Science
Tag(s): Textbook, Open Textbook
Link to resource
In this article, we show how the concepts of Open Education and Open Pedagogy make learning more meaningful. We argue that the …
Author(s): Marijn Post, Ria Jacobi, Michiel de Jong, Marjon Baas
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Open Education, Open Pedagogy, Meaningful Learning
Link to resource
Education is not only about learning facts and skills but also about preparing students for active and successful participation in …
Author(s): Frederiek van Rij, Mira Buist-Zhuk & Martijn Blikmans-Middel
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Open Educational Resources, Open Science
Link to resource
Peer review is considered by many to be a fundamental component of scientific publishing. In this context, open peer review (OPR) has …
Author(s): Tania Henriquez
Type of resources: Primary Source, Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Peer Review, Early Career Researcher, Academic Life
Link to resource
The UNESCO Recommendations for Open Science define it as an inclusive framework that integrates movements and practices aimed at making …
Author(s): The UK Reproducibility Network
Type of resources: Reading, Student Guide, Primer
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education, Social Science
Tag(s): Open Qualitative Research; Qualitative Methods; Data Sharing; Participatory Research; Preregistration; Positionality; Open Data
Link to resource
The Open Research Community Accelerator (ORCA) nurtures cross-sector coalitions to tackle the systems-level challenges that are …
Author(s): Open Research Community Accelerator (ORCA)
Type of resources: Website
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Physical Science
Tag(s): Open Research Community Accelerator (ORCA), Global Challenges, Open Science, Inclusivity
Link to resource
There is a need for more nuanced and theoretically grounded analysis of the socio-political consequences of methodological reforms …
Author(s): Thomas J. Hostler
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Academic Capitalism, Open Research, Open Science, Managerialism, Neoliberalism, Administration
Link to resource
This is a document about open science across disciplines, together with resources to these disciplines.
Author(s): Emily K Farran, Priya Silverstein, Camilla Gilmore
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Open science
Link to resource
In undergraduate life sciences education, open educational resources (OERs) increase accessibility and retention for students, reduce …
Author(s): Sanah Ahmed, Tiffany Adjei-Opong, Ashley B Heim, Keenan Noyes, Kelly Schmid, Brian A Couch, MacKenzie R Stetzer, Lillian G Senn, Erin Vinson, Michelle K Smith, Kira Treibergs
Type of resources: Reading
Primary user(s): Student, Teacher, Teacher, Educator
Subject area(s): Applied Science, Education, Life Science
Tag(s): Open Educational Resources, OER, Undergraduate Biology Education, Teaching Resources, Life Sciences
Link to resource
The Open Scholarship Survey (OSS) was administered to education researchers between Fall 2020-Summer 2022.The figures below …
Author(s): Jennifer L Beaudry, Donna T Chen, Bryan G. Cook, Mirka Dirzo, Timothy M. Errington, Laura Fortunato, Lisa Given, Krystal Hahn, Malika Ihle, Lesley Markham, David Thomas Mellor, Brian A. Nosek, Nicole Pfeiffer, Marcy Reedy, Courtney K. Soderberg, Andrew Tyner, Huajin Wang, and Gizem Solmaz-Ratzlaff
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Open Scholarship Practices, Scholar's Attitudes
Link to resource
In her talk, Professor Vazire covers the role of open practices in allowing science to work the way it was intended to work—through …
Author(s):
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
In this section, you will learn more about:
Author(s): PhD on Track
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): PhD, Open Science, Open Access, Open Data, Open Access Funding, Archiving, Data Management
Link to resource
This course is an introduction to the Open Science approach to psychology. We will investigate if how the field has experienced a …
Author(s): Benjamin Le
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Inclusivity, Diversity, Equity
Link to resource
Conversations about open science have reached the mainstream, yet many open science practices such as data sharing remain uncommon. Our …
Author(s): Robert T. Thibault, Olavo B. Amaral, Felipe Argolo, Anita E. Bandrowski, Alexandra R. Davidson, Natascha I. Drude
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, editors
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Science, Ecosystems, Reproducibility, Quality Control, Clinical Trials, Science Policy, Open Data, Research Quality Assessment
Link to resource
Conversations about open science have reached the mainstream, yet many open science practices such as data sharing remain uncommon. Our …
Author(s): Robert T. Thibault, Olavo B. Amaral, Felipe Argolo, Anita E. Bandrowski, Alexandra R, Davidson, Natascha I. Drude
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Open Science, Open Data, Open Science Initiatives, Reform
Link to resource
Open Science is a global transition to making scientific research practices more open and collaborative, for greater scientific and …
Author(s): Nationaal Programma Open Science: Stan Gielen, Jet de Ranitz, Sander Bosch, Melanie Imming
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Social Science
Tag(s): Open Science, The Netherlands, Ambition Document, Guiding Principles, Strategic Goals
Link to resource
In recent years, meta-research methods issues (e.g., reproducibility, open science, etc.) have yielded provocative findings, vigorous …
Author(s): John M. Zelenski
Type of resources: Syllabus
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In 2009, the climate research community was rocked by the Climategate controversy, an email leak that allegedly provided evidence of …
Author(s): Michael J Fell, Nicole E Watson, Gesche Huebner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Physical Science
Tag(s): Open Science Practices, Energy Research, Climate Research
Link to resource
The movement towards open science is a consequence of seemingly pervasive failures to replicate previous research. This transition …
Author(s): Christopher Allen, David M. A. Mehler
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Careers, Data, Experimental Design, Neuroimaging, Open Data, Open Science, Peer Review, Reproducibility, Statistical Data
Link to resource
OSCARS brings together world-class European Research Infrastructures (RIs) in the ESFRI roadmap and beyond to foster the uptake of Open …
Author(s): Giovanni Lamanna, Friederike Schmidt-Tremmel, Jordi Bodera Sempere, Nicoletta Carboni, Sally Chambers, Romain David, Anca Hienola, Paul Millar, Gary Saunders, Andreas Petzold, Jonathan Ewbank, Jonathan Tedds, Bonnie Wolff-Boenisch, Darja Fiser, Rob Carrillo, Maud Coppel, Justine Thomas
Type of resources: Website
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): OSCARS, Research Infrastructure, Open Science, FAIR Data Management
Link to resource
Granting access to publications and data may be a step towards open science, but it’s not enough to ensure reproducibility. …
Author(s): Hey, T., Payne, M.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Physical Science
Tag(s): Computer Code
Link to resource
We are back with a very special Pedagogies, this time including also the perspectives of students on learning about Open Science (OS)! …
Author(s): Jordan Wagge & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Interview
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Social Science
Tag(s): CREP; Pedagogy
Link to resource
N.A.
Author(s): Hsing, Pen-Yuan Parker, Alison Goguichvili, Sophie Johns, Brianna He, Richard Moudgalya, Pranav Gunn, Allen
Type of resources: Reading
Primary user(s): Student
Subject area(s): Physical Science
Tag(s): Hardware, Open Source Hardware, Space Research
Link to resource
Few dementia care interventions have been translated to healthcare contexts for those who need them. Embedded pragmatic clinical trials …
Author(s): Zachary G. Baker, Allison M. Gustavson, Lauren L. Mitchell, Joseph E. Gaugler
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Embedded Pragmatic Clinical Trials, Open Science, Dementia Care
Link to resource
Note: This webinar was presented in Spanish. The slides presented during this webinar can be found here:https://osf.io/6qnse/ The …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Open science practices including open access (OA) publication, open methods, study preregistration, and open data are gaining …
Author(s): Tamminen, K.A. and Poucher, Z.A.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Various interventions – especially those related to open science – have been proposed to improve the reproducibility and replicability …
Author(s): Leonie Dudda, Eva Kormann, Magdalena Kozula, Nicholas J DeVito, Thomas Klebel, Ayu Putu Madri Dewi, René Spijker, Inge Stegeman, Veerle Van den Eynden, Tony Ross-Hellauer, and Mariska Leeflang
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Data Sharing, Ethics, Open Science, Replicability, Reporting Guidelines, Reproducibility, Research Integrity
Link to resource
Various interventions – especially those related to open science – have been proposed to improve the reproducibility and replicability …
Author(s): Leonie Dudda, Eva Kormann, Magdalena Kozula, Nicholas J DeVito, Thomas Klebel, Ayu Putu Madri Dewi, René Spijker, Inge Stegeman, Veerle Van den Eynden, Tony Ross-Hellauer, and Mariska Leeflang
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Data Sharing, Ethics, Open Science, Replicability, Reporting Guidelines, Reproducibility Research Integrity
Link to resource
In response to concerns about the replicability of published research, some disciplines have used open science practices to try to …
Author(s): Isaacowitz Derek M, Lind Majse
Type of resources: Reading
Primary user(s):
Subject area(s): Biology
Tag(s): Aging Science
Link to resource
7 steps towards transparent and reproducible research
Author(s): Felix Schönbrodt, Friederike Hendriks, Mitja Back, Network for Open Science Initiatives
Type of resources: Diagram/Illustration
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Reproducibility, Researchers
Link to resource
About This Document: This manual was assembled and is being updated by Professor Benjamin Le (@benjaminle), who is on the faculty in …
Author(s): Benjamin Le
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Data, Materials, Policy, Publishing, Reproducibility, Researchers, Students
Link to resource
Has there been meaningful movement toward open science practices within the social sciences in recent years? Discussions about changes …
Author(s): David J. Birke, Edward Miguel, Elizabeth Levy Paluck, Garret Christensen, Nicholas Swanson, Rebecca Littman, Zenan Wang
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Economics, Psychology
Tag(s): Data
Link to resource
Has there been meaningful movement toward open sci-ence practices within the social sciences in recent years? Discussions about changes …
Author(s): Christensen, Garret; Wang, Zenan; Levy Paluck, Elizabeth; Swanson, Nicholas; Birke, David; Miguel, Edward; Littman, Rebecca
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Social Sciences, Open Science, State of Social Science (S3) Survey, Attitudes towards Open Science
Link to resource
Open science ensures that research is transparently reported and freely accessible for all to assess and collaboratively build on. …
Author(s): Adrianna P. Kępińska, Jessica S Johnson, Laura M Huckins
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Equity, Methodology, Open Access, Open Science, Psychiatric Genetics, Reproducibility
Link to resource
Objective: To describe the frequency of open science practices in a contemporary sample of studies developing prognostic models using …
Author(s): Gary S. Collins, Rebecca Whittle, Garrett S. Bullock, Patricia Logullo, Paula Dhiman, Jennifer A. de Beyer, Richard D. Riley, Michael M. Schlussel
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Open Science, Prognosis, Machine Learning, Reporting, Data Sharing, Code Sharing
Link to resource
Dialogue on openness, transparency and science on communication in the digital age
Author(s): Leibniz Information Centre for Economics
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Career and Technical Education, Education, Life Science, Physical Science, Social Science
Tag(s): Open Science Retreat
Link to resource
In the last decade Open Science principles have been successfully advocated for and are being slowly adopted in different research …
Author(s): Lonni Besançon, Nathan Peiffer-Smadja, Corentin Segalas, Haiting Jiang, Paola Masuzzo, Cooper Smout, Eric Billy, Maxime Deforet & Clémence Leyrat
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Open Science, Peer Review, Methodology, COVID-19
Link to resource
In the last decade Open Science principles, such as Open Access, study preregistration, use of preprints, making available data and …
Author(s): Lonni Besançon et al.
Type of resources: Reading
Primary user(s): Student, Teacher, Policy maker
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Open science
Link to resource
Students have an overview about the “historical” developments and debates of the replication movement in the last years, …
Author(s): Felix Schönbrodt
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
Open Science Session GSA 2019
Author(s): Derek Isaacowitz
Type of resources: Lecture Notes
Primary user(s):
Subject area(s): Health, Medicine and Nursing, Social Science
Tag(s): Aging, Gerontology, Open Science
Link to resource
Data sharing, open-source designs for medical equipment, and hobbyists are all being harnessed to combat COVID-19.
Author(s): Mark Zastrow
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science
Tag(s): Open Science, COVID-19, Pandemic
Link to resource
There is a vast body of helpful tools that can be used in order to foster Open Science practices. For reasons of clarity, this toolbox …
Author(s): Lutz Heil
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Materials, Open Scholarship Guidelines, Policy, Publishing, Reproducibility, Researchers
Link to resource
Github Repository for the Open Science Training Handbook
Author(s): Fotis E. Psomopoulos, José Carvalho, Rosario Rogel-Salazar, Roberta Moscon
Type of resources: Github Repository
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): FOSTER, Open Science, Handbook, Training
Link to resource
This case study focuses on the online training activities on Open Science delivered within the H2020 project Transforming Research …
Author(s): Lottie Provost, Francesca Di Donato, Erzsébet Tóth-Czifra, Suzanne Dumouchel, Emilie Blotière, Yin Chen
Type of resources: Reading
Primary user(s): Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Social Science
Tag(s): Open Science, Training and Education, FAIR data, EOSC, Scholarly Practice, Project Management
Link to resource
Open Science workshop materials created at LMU Munich, available for everyone under a CC-BY license. Look in the README folder for more …
Author(s): Angelika Stefan Felix Schönbrodt and Lena Schiestel
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
Concerns about a crisis of mass irreplicability across scientific fields (“the replication crisis”) have stimulated a movement for open …
Author(s): Daniel J. Hicks
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science
Tag(s): Replication Crisis, Open Science, Environmental Public Health, Environmental Policy
Link to resource
The Dutch consortium of University Libraries and the National Library of the Netherlands (UKB), together with the Universities of The …
Author(s): Loek Brinkman, Elly Dijk, Hans de Jonge, Nicole Loorbach, & Daan Rutten
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Open Science, Reproducibility, Preregistration, Citizen Science, Open Access, Open Peer Review, Research Data Management, FAIR, Data Management Plan, Open Software, Open Education, Open Science Community
Link to resource
Open science has been highlighted as one of the priorities of the Dutch presidency of the European Union in 2016. Matthew Dovey …
Author(s): Jisc
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
Open Science is a collection of actions designed to make scientific processes more transparent and results more accessible. Its goal is …
Author(s): Bobbie Spellman, Elizabeth Gilbert and Katherine Corker
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This article reports on an adversarial (but friendly) collaboration examining the issues that lie at the intersection of …
Author(s): Joel, S., Eastwick, P., & Finkel, E.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Open Source Guides ( https://opensource.guide/) are a collection of resources for individuals, communities, and companies who want to …
Author(s): GitHub
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Open Source, Researchers, Software Engineers
Link to resource
A website about open statistic labs with data and activities
Author(s): Kevin P. McIntyre
Type of resources: Activity/Lab, Data Set
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Website
Link to resource
Each OSL lab is comprised of three elements: An activity, A data set and A published article. The activities guide students through the …
Author(s): Kevin P. McIntyre
Type of resources: Activity/Lab
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Data, Statistics Teaching, Statistics Activities
Link to resource
In this session we’ll do a deep dive into the history of open-source software, it’s ethical issues in the modern, …
Author(s): David Whitney, NDC
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education
Tag(s): Open-Source, History of Open Source, Ethics
Link to resource
This book starts from the premise that there is a lot we can all do to increase the benefits of research.
Let’s consider the main …
Author(s): Dallas Card, Yan Min, Stylianos Serghiou
Type of resources: Textbook
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Life Science, Social Science
Tag(s): Textbook, Open Textbook
Link to resource
The open-access.net platform provides comprehensive information on the subject of Open Access (OA) and offers practical advice on its …
Author(s): OpenAccess Germany
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Funders, Librarians, Open Access, Open Access Policies, Policy, Policy Makers, Publishers, Publishing, Research Administration, Researchers
Link to resource
Open Science being a fast-moving area, the programme of the bootcamp is revised for each iteration. The bootcamp is designed around …
Author(s): Antónia Correia, Jonathan England, Judit Éva Fazekas-Paragh, Milica Ševkušić, OpenAIRE, Helen Clare, Iryna Kuchma, Pascal Flohr, Pedro Principe, S Venkataraman
Type of resources: Lesson, Lesson Plan, Video
Primary user(s): Teacher, Trainers
Subject area(s): Education
Tag(s): Open Science, Pedagogy
Link to resource
This report investigates the current landscape of non-legislative policy practices affecting researchers and authors in the …
Author(s): Ignasi Labastida i Juan, Iva Melinščak Zlodi, Vanessa Proudman, & Jon Treadway
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian, Policymakers, Funders, Legislators, Publishers
Subject area(s): Education, Social Science
Tag(s): Knowledge Rights, Licensing, Recommendations
Link to resource
In recent years, numerous fields of research have seen a push for increased reproducibility and transparency practices. As a result, …
Author(s): Joseph Casillas, Gabriela Constantin-Dureci, Iván Rascón Andreu, Jiawei Shao, Stephanie Rodriguez, Adrija Gadamsetty, Alexandra Minetti, Krishita Laungani, John Thatcher, Rhode-Taina Gardere, Katherine Taveras, Isabelle Chang, Nicole Rodríguez, Kyle Parrish
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): English Language Arts
Tag(s): Linguistics, Open science, Positionality, Replicability, Reproducibility, Transparency
Link to resource
The Evolving Guide on How the Internet is Changing Research, Collaboration and Scholarly Publishing
Author(s): Sönke Bartling and Sascha Friesike
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recent movements towards a more open, intersectional, and inclusive academia (Birhane & Guest, 2020) focus on the need to …
Author(s): Gourdon-Kanhukamwe, Amélie Kalandadze, Tamara Yeung, Siu Kit Azevedo, Flavio Iley, Bethan Phan, Jenny Mai Ramji, Anusha V. Shaw, John J. Zaneva, Mirela Dokovova, Marie Hartmann, Helena Kapp, Steven K. Warrington, Kayleigh L. Elsherif, Mahmoud M.
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education
Tag(s): Neurodiversity; Power Imbalance; Diversity, Equity, and Inclusion (DEI); Non-WEIRD Research
Link to resource
Lesson on OpenRefine for social scientists. A part of the data workflow is preparing the data for analysis. Some of this involves data …
Author(s): Erin Becker, François Michonneau, Geoff LaFlair, Karen Word, Lachlan Deer, Peter Smyth, Tracy Teal
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science, Measurement and Data, Social Science
Tag(s): Analysis, Data, Education, OpenRefine, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Many scientific fields are facing a reproducibility crisis, revealed where replication fails to reproduce findings from previous work. …
Author(s): Jim Uttley
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Physical Science
Tag(s): Journals, P-Hacking, A Priori Power Analysis
Link to resource
In this webinar, we demonstrate the OSF tools available for contributors, labs, centers, and institutions that support stronger …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Many in the global research community are adapting to conducting work remotely while exploring the best ways to maintain collaboration …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
In this article, we present a model for determining how total research payoff depends on researchers’ choices of sample sizes, α …
Author(s): Jeff Miller and Rolf Ulrich
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Understanding the complex relationship between sleep and memory consolidation is a major challenge in cognitive neuroscience and …
Author(s): Dezső Németh, Emilie Gerbier, Jan Born, Timothy Rickard, Susanne Diekelmann, Stuart Fogel, Lisa Genzel, Alexander Prehn-Kristensen, Jessica Payne, Martin Dresler, Peter Simor, Stephanie Mazza, Kerstin Hoedlmoser, Perrine Ruby, Rebecca M. C. Spencer, Genevieve Albouy, Teodóra Vékony, Manuel Schabus & Karolina Janacsek
Type of resources: Reading
Primary user(s): Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Sleep, Memory, Consolidation, Methodology
Link to resource
This is an introductory guide for those working and considering working in the area of open research. It was drafted by members of the …
Author(s): UK Reproducibility NetworkAnna Rhiannon HughesValerie McCutcheonNick SheppardKirsty WallisAngus WhyteIlkay HoltElizabeth NewboldNeil JacobsKirsty MerrettKate Ehrig-PageHelen Clare
Type of resources: Module, Reading, Primer
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education, Life Science, Social Science
Tag(s): collaboration, data management, introductory guide, open research, outputs reproducibility research, UKRN
Link to resource
The OSF Collections repository platform supports the discoverability and reuse of research by enabling the aggregation of related …
Author(s):
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Center for Open Science, Open Science, Open Science Framework, OSF, OSF Collections, Reproducability, Reproducibility, Research, Research Best Practices, Research Tools, Research Transparency, TOP Guidelines
Link to resource
This video will introduce users of the Open Science Framework into some of the more advanced features.
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
This webinar will introduce how to use the Open Science Framework (OSF; https://osf.io) in a Classroom. The OSF is a free, open source …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Files for this webinar are available at: https://osf.io/ewhvq/ This webinar focuses on how to use the Open Science Framework (OSF) to …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Inside Your Classroom, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
This webinar walks you through the basics of creating an OSF project, structuring it to fit your research needs, adding collaborators, …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Qualitative training rarely acknowledges the role of emotions in both data collection and analysis. While bracketing emotions is an …
Author(s): Hilary Lustick
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Social Science
Tag(s): Reflexivity, Positionality, Race and Education, Whiteness, Restorative Practices
Link to resource
Recent literature hints that outcomes of clinical trials in medicine are selectively reported. If applicable to psychotic disorders, …
Author(s): C. H. Vinkers, C. M. C. Lemmens, J. J. Luykx, M. Lancee, R. S. Kahn
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Publishing, Reporting, Reporting Bias, Reproducibility
Link to resource
Getting started with open science and knowing where to go. This webinar will introduce participants to major practices in open science …
Author(s): Mellor et al.
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
This projects contains materials from lectures and workshops associated with the Oxford-Berlin Open Research Summer School 2019.
Author(s): Heise et al.
Type of resources: Module
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Open Research
Link to resource
An article about P Values and Statistical Practice
Author(s): Andrew Gelman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
P values represent a widely used, but pervasively misunderstood and fiercely contested method of scientific inference. Display items, …
Author(s): Ioana Alina Cristea, John P. A. Ioannidis
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Statistics and Probability
Tag(s): Analysis, Analysis of Variance, Bayesian Method, Bayesian Statistics, Computer Software, Data, Meta-analysis, Publishing, Scientific Publishing, Software Tools, Statistical Data, Statistics
Link to resource
An abstract about the p-curve
Author(s): Will Gervais
Type of resources: Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Blog
Link to resource
My p-curve tool now lets you show the x-axis on a log₁₀ scale, which makes it a lot easier to look at really small p-values
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Reading, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction
Link to resource
Because scientists tend to report only studies (publication bias) or analyses (p-hacking) that “work,” readers must ask, “Are these …
Author(s): Simonsohn, Uri, Nelson, Leif D., Simmons, Joseph P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
p-Hacking, the use of analytic techniques that may lead to distorted research results, is widely condemned on epistemic and practical …
Author(s): Adrian Erasmus
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): P-hacking, Research Error, Inductive Risk
Link to resource
PANGEA is the first power analysis program for general ANOVA designs (e.g., Winer, Brown, & Michels, 1991). PANGEA can handle …
Author(s): Jake Westfall
Type of resources: Reading, Simulation
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Reproducibility Knowledge, Power Analysis Tool
Link to resource
Background and Objectives Given the increase in methodological pluralism in research on brain health, cognitive aging, and …
Author(s): Laurent Reyes, Clara J Scher, Emily A Greenfield
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Aging, Dementia, Lived Experience, Participatory Research, Scoping Review
Link to resource
PathOS is a Horizon Europe project aiming to collect concrete evidence of Open Science effects, study the pathways of Open Science …
Author(s): Massimo Florio, Stefanie Haustein, Ana Persic, PathOS
Type of resources: Website
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Physical Science
Tag(s): Open Science, Open Science Impact
Link to resource
This is an archived version of a blog post on preregistration. The first half of the post argues that there is not a strong …
Author(s): Danielle Navarro
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration
Link to resource
Sport healthcare and performance support practitioners require data to inform clinical and performance decisions, identify risk factors …
Author(s): Garrett S Bullock, Patrick Ward, Stefan Kluzek, Tom Hughes, Ellen Shanley, Amelia Joanna Hanford Arundale, Craig Ranson, Sophia Nimphius, Richard D Riley, Gary S Collins, Franco M Impellizzeri
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Sport Healthcare, Performance Support, Data Sharing, Open Science, Open Data
Link to resource
This editorial note is an “action-based” follow-up to the previous PBFJ Editorial published in September 2021 … “A Declaration about …
Author(s): Robert Faff
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Finance, Business, Preregistration, Responsible Science
Link to resource
Interdisciplinary approaches are needed to understand the relationship between genetic factors and brain structure and function. Here …
Author(s): Patrycja Dzianok & Ewa Kublik
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Alzheimers Disease, Cognitive Ageing, Risk Factors
Link to resource
Journals are exploring new approaches to peer review in order to reduce bias, increase transparency and respond to author preferences. …
Author(s): Peter Rodgers
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Bias, Data, Funding Agencies, Peer Review, Publishing
Link to resource
A growing interest in and concern about the adequacy and fairness of modern peer-review practices in publication and funding are …
Author(s): Peters, D. P., & Ceci, S. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Open Science, Open Review
Link to resource
Running studies with high statistical power, while effect size estimates in psychology are often inaccurate, leads to a practical …
Author(s): Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A syllabus about open science
Author(s): Charlotte Hartwright
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Drawing on recent research and debates in social sciences, this paper situates replication in an advertising research context. We …
Author(s): Lars Bergkvist, Freya De Keyzer, Cristian Buzeta
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Methodology, Marketing, Advertising, Replication, Exact Replication, Close Replication, Constructive Replication, Conceptual Replication, Truth Value
Link to resource
P. E. Meehl did first 10 sessions (Winter Quarter, Jan–Mar 1989). In the Spring Quarter, several other department members lectured on …
Author(s): P. E. Meehl
Type of resources: Primary Source, Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Course, Video
Link to resource
Plan E for Education is my proposal that a proportion of the educational resources generated in publicly funded universities be made …
Author(s): Richard F. Heller
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Education
Tag(s): Open Access, Open Educational Resources, Open Educational Practices, Plan S, Universities, Paywall
Link to resource
Social media data enable insights into human behaviour. Researchers can access these data via platform-provided application programming …
Author(s): Brittany I. Davidson, Darja Wischerath, Daniel Racek, Douglas A. Parry, Emily Godwin, Joanne Hinds, Dirk van der Linden, Jonathan F. Roscoe, Laura Ayravainen, Alicia G. Cork
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Human Behaviour, Science, Technology, Society, Social Sciences
Link to resource
This lesson is part of Software Carpentry workshops and teach an introduction to plotting and programming using python. This lesson is …
Author(s): Adam Steer, Allen Lee, Andreas Hilboll, Ashley Champagne, Benjamin, Benjamin Roberts, CanWood, Carlos Henrique Brandt, Carlos M Ortiz Marrero, Cephalopd, Cian Wilson, Daniel W Kerchner, Dan Mønster, Daria Orlowska, Dave Lampert, David Matten, Erin Alison Becker, Florian Goth, Francisco J. Martínez, Greg Wilson, ian, Jacob Deppen, Jarno Rantaharju, Jeremy Zucker, Jonah Duckles, Kees den Heijer, Keith Gilbertson, Kyle E Niemeyer, Lex Nederbragt, Logan Cox, Louis Vernon, Lucy Dorothy Whalley, Madeleine Bonsma-Fisher, Mark Phillips, Mark Slater, Maxim Belkin, Michael Beyeler, Mike Henry, mzc9, Narayanan Raghupathy, Nigel Bosch, Olav Vahtras, Pablo Hernandez-Cerdan, Paul Anzel, Phil Tooley, Raniere Silva, Robert Woodward, Ryan Avery, Ryan Gregory James, Sarah M Brown, SBolo, Shyam Dwaraknath, Sourav Singh, Stéphane Guillou, Steven Koenig, Taylor Smith, Thor Wikfeldt, Timothy Warren, Tyler Martin, Vasu Venkateshwaran, Vikas Pejaver
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Python, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Since its inception, the concept of neurodiversity has been defined in a number of different ways, which can cause confusion among …
Author(s): Mirela Zaneva Is a corresponding author Tao Coll-MartínYseult Héjja-BrichardTamara KalandadzeAndrea KisAlicja KoperskaMarie Adrienne Robles ManaliliAdrien MathyChristopher J GrahamAnna HollisRobert M RossSiu Kit YeungVeronica AllenFlavio AzevedoEmily FriedelStephanie FullerVaitsa GiannouliBiljana GjoneskaHelena HartmannMax KorbmacherMahmoud M ElsherifAlyssa Hillary Zisk and FORRT
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Parent, Librarian
Subject area(s): Education
Tag(s): Neurodiversity; Inclusivity; Autism; ADHD; Participatory Research; Inclusive Scientific Practices
Link to resource
Open access, open data, open source and other open scholarship practices are growing in popularity and necessity. However, widespread …
Author(s): Erin C McKiernan et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Research data is optimized when it can be freely accessed and reused. To maximize research equity, transparency, and reproducibility, …
Author(s): Erin C. McKiernan, Lorena Barba, Philip E. Bourne, Caitlin Carter, Zach Chandler, Sayeed Choudhury, Stephen Jacobs, Daniel S. Katz, Stefanie Lieggi, Beth Plale, Greg Tananbaum
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian, Policymaker
Subject area(s): Applied Science, Career and Technical Education
Tag(s): research, software, open software
Link to resource
Objective To investigate the replication validity of biomedical association studies covered by newspapers. Methods We used a database …
Author(s): Andy Smith, Estelle Dumas-Mallet, François Gonon, Thomas Boraud
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): ADHD, Analysis, Bibliometrics, Biomarkers, Breast Cancer, Data, Health Risk Analysis, Mental Health and Psychiatry, Meta-analysis, Publishing, Scientific Publishing
Link to resource
The Journal of Physiology and British Journal of Pharmacology jointly published an editorial series in 2011 to improve standards in …
Author(s): Annie A. Butler, Joanna Diong, Martin E. Héroux, Simon C. Gandevia
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Bioassays and Physiological Analysis, Clinical Trials, Data, Data Processing, Drug Research and Development, Medical Journals, Pharmacology, Research Integrity, Research Reporting Guidelines, Research Validity, Scientific Publishing, Statistical Data
Link to resource
In July 2020, Journal of Women and Minorities in Science and Engineering (JWM) started requiring a positionality statement in each …
Author(s): Julie Martin, Renee Desing, Maura Borrego
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, Journal Editors
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Positionality, Author Guidelines, Reviewer Guidelines, Reflexivity, Transparency
Link to resource
The goal of this essay is to clarify positionality as an epistemological scientific concept and address related misunderstandings to …
Author(s): Veli-Matti Karhulahti
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities
Tag(s): Bias, Epistemology, Interdisciplinary, Knowledge, Methodology, Objectivity, Philosophy of Science, Subjectivity
Link to resource
Successful science needs deviant ideas that may challenge established norms. The last decade saw an unprecedented science-engineering …
Author(s): R. Hans Phaf
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Positive Deviance, Evolution of Science, Normative Methodologies, Open Theory
Link to resource
Successful science needs deviant ideas that may challenge established norms. The last decade saw an unprecedented science-engineering …
Author(s): R. Hans Phaf
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Deviance, Open Science, Evolution Of Science
Link to resource
In psychology, attempts to replicate published findings are less successful than expected. For properly powered studies replication …
Author(s): Brysbaert, M. and Stevens, M.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A study with low statistical power has a reduced chance of detecting a true effect, but it is less well appreciated that low power also …
Author(s): Katherine Button et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million …
Author(s): Joe Simmons and Uri Simonsohn
Type of resources: Reading
Primary user(s): Student
Subject area(s): Education, Social Science
Tag(s): Blog
Link to resource
Recently, evidence for endemically low statistical power has cast neuroscience findings into doubt. If low statistical power plagues …
Author(s): Camilla L. Nord, Vincent Valton, John Wood and Jonathan P. Roiser
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Practical Considerations for Navigating Registered Reports
Author(s): Albers C, Button K S, Chambers C D, Helen Wills Neuroscience Institute University Of California Berkeley Ca Usa, Jason M, Jscimeca Berkeley Edu, Kiyonaga Berkeley Edu, Lakens D, Nosek B A, Poldrack R A
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
A recently published series of open science guides help researchers in the Netherlands navigate open science. They cover topics such as …
Author(s): Giulia Trentacosti
Type of resources: Activity/Lab, Simulation
Primary user(s): Student
Subject area(s): Applied Science
Tag(s): Early Career Researcher, Preprints, Creative Commons, Open Educational Resources
Link to resource
Widespread sharing of data and materials (including displays and text- and video-based descriptions of experimental procedures) will …
Author(s): Rick O. Gilmore, Joy Lorenzo Kennedy, and Karen E. Adolph
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Open Science
Link to resource
Reproducibility, Research Management Planning, Structuring a study, Preregistration + Analysis Plan, Files and Version Control, Sharing …
Author(s): Center For Open Science, Courtney K, Ian Sullivan, Jennifer Freeman Smith, Jolene Esposito, Natalie Meyers, Nicole Pfeiffer, Sara Bowman
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
Answering the question of what fraction of a journal’s papers were previously available as a preprint is quite difficult to do. The …
Author(s): Stephen Royle
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education
Tag(s): Computing, Publishing, Science
Link to resource
The social sciences—including economics—have long called for transparency in research to counter threats to producing robust and …
Author(s): Lucas C. Coffman, Muriel Niederle
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Critique
Link to resource
The evidence-based community has championed the public registration of pre-analysis plans (PAPs) as a solution to the problem of …
Author(s): Daniel Posner, George Ofosu
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Economics
Tag(s): Analysis, Policy
Link to resource
Pre-analysis plans (PAPs) have been championed as a solution to the problem of research credibility, but without any evidence that PAPs …
Author(s): George K. Ofosu, Daniel N. Posner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Preregistration, Pre-analysis Plans
Link to resource
Amidst rising concern about publication bias, pre-registration and results-blind review have grown rapidly in use. Yet discussion of …
Author(s): Alan M. Jacobs
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Social Science
Tag(s): Preregistration, Publication Bias, Qualitative Research, Political Science, Observational Research, Results-Blind Review
Link to resource
Pre-registration of studies before they are conducted has recently become more feasible for researchers, and is encouraged by an …
Author(s): van ‘t Veer, A.E., & Giner-Sorolla, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Transparency
Link to resource
Over recent years, psychology has become increasingly concerned with reproducibility and replicability of research findings (Munafò et …
Author(s): Madeleine Pownall
Type of resources: Teaching/Learning Strategy
Primary user(s): Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Psychology, Undergraduate Students, Student Research, Teaching Methods, Research Reports, Supervision, Barriers, Role, Research Design, Foreign Countries
Link to resource
Pre-registration of clinical trials is associated with fewer positive findings
Author(s): Bill Gardner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Open Science, Reproducibility Crisis and Credibility Revolution
Link to resource
Pre-registration is a research practice where a protocol is deposited in a repository before a scientific project is performed. The …
Author(s): John P.A. Ioannidis
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Mathematical Modeling, Preregistration, Bias, Reproducibility
Link to resource
In the past decade, the social and behavioral sciences underwent a methodological revolution, offering practical prescriptions for …
Author(s): Jennifer M. Logg, Charles A. Dorison
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration
Link to resource
In this article, we (1) discuss the reasons why pre-registration is a good idea, both for the field and individual researchers, (2) …
Author(s): Joseph P. Simmons, Leif D. Nelson, Uri Simonsohn
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Consumer Psychology, Advertising
Link to resource
Hear from Andrew Foster, editor at the Journal of Development Economics, and Irenaeus Wolff, a guest editor for Experimental Economics, …
Author(s): Aleksandar Bogdanoski, Andrew Foster, Irenaeus Wolff
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Academic Publishing, Center for Open Science, Data, Publishing Formats, Registered Reports, Research, Research Methods, Research Transparency
Link to resource
A challenge when interpreting replications is determining whether the results of a replication “successfully” replicate the original …
Author(s): Jeffrey R.Spence and David J. Stanley
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The Pandemic of COVID-19, an infectious disease caused by SARS-CoV-2 motivated the scientific community to work together in order to …
Author(s): J. Homolak, I. Kodvanj & D. Virag
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): COVID-19, Open Science, Data, Bibliometric, Pandemic
Link to resource
Pre-registration promises to address some of the problems with traditional peer-review. As we publish our first Registered Report, we …
Author(s): Nonia Pariente
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Peer Review, Research Grants, Neuroscience, Research Assessment, Medical Facies, Pandemics, Publication Ethics, Research Design
Link to resource
Computational analyses are playing an increasingly central role in research. Journals, funders, and researchers are calling for …
Author(s): April Clyburne-Sherin
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Librarians, Materials, Reproducibility, Research Data Management Tools, Researchers
Link to resource
This essay makes a modest proposal: scholars who conduct fieldwork among vulnerable populations in fragile settings and who seek to …
Author(s): Jason Lyall
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Social Science
Tag(s): Preregistration, Ethical Redlines, Fieldwork, Vulnerable Populations, Responsible Engagement, Risk Assessment
Link to resource
The threat to reproducibility and awareness of current rates of research misbehavior sparked initiatives to better academic science. …
Author(s): Tamarinde L. Haven, Leonie Van Grootel
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Social Science
Tag(s): Preregistration, Qualitative Research
Link to resource
Preregistrations—records made a priori about study designs and analysis plans and placed in open repositories—are thought to strengthen …
Author(s): Tamarinde L. Haven, Timothy M. Errington, Kristian Skrede Gleditsch, Leonie van Grootel, Alan M. Jacobs, Florian G. Kern, Rafael Piñeiro, Fernando Rosenblatt, Lidwine B. Mokkink
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Social Science
Tag(s): Preregistration, Qualitative Research
Link to resource
So-called “rigor-enhancing practices” suggest behavioral science can be reliable—but not everyone is convinced.
Author(s): Cathleen O'Grady
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistering, Transparency, Replication, Rigor-Enhancing Practices
Link to resource
Preregistering study designs is broadly supported as improving scientific credibility but criticized for limiting the scope of what can …
Author(s): Cole Williams
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Information Acquisition, Verifiable Disclosure
Link to resource
Both within and outside of sociology, there are conversations about methods to reduce error and improve research quality—one such …
Author(s): Bianca Manago
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Open Science, Registered Reports, Reproducibility, Transparency
Link to resource
Many view preregistration as a promising way to improve research credibility. However, scholars have argued that using pre-analysis …
Author(s): Eirik Strømland
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Experimental Economics, Preregistration, Estimation, Reproducibility
Link to resource
This paper discusses two phenomena that threaten the credibility of scientific research and suggests an approach to limiting the extent …
Author(s): Lars Bergkvist
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Advertising, Questionable Research Practices
Link to resource
A blog about Preregistration Becoming the Norm in Psychological Science
Author(s): Brian Nosek and Stephen Lindsay
Type of resources: Reading, blog
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Blog
Link to resource
One justification for preregistering research hypotheses, methods, and analyses is that it improves the transparent evaluation of the …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Critical Rationalism, Error Statistics, P-Hacking, preregistration, Popper, severity
Link to resource
A template to use for pre-registration
Author(s): Pre-registration standards for psychology
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Transparency
Link to resource
In recent years, open science practices have become increasingly popular in psychology and related sciences. These practices aim to …
Author(s): Nathan Evans, Sophia Crüwell
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Preregistration, Publishing, Reproducibility, Researchers
Link to resource
In recent years, open science practices have become increasingly popular in psychology and related sciences. These practices aim to …
Author(s): Sophia Crüwel, Nathan J. Evans
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Reproducibility, Transparency, Open Science, Cognitive Modelling, Preregistration
Link to resource
The current publication system neither incentivizes publishing null results nor direct replication attempts, which biases the …
Author(s): Timo B. Roettger
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Confirmatory, Exploratory, Preregistration, Publication Bias, Registered Report, Researcher Degrees of Freedom
Link to resource
Preregistration, the act of specifying a research plan in advance, is becoming more common in scientific research. Infant researchers …
Author(s): Naomi Havron, Christina Bergmann, Sho Tsuji
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Infant Research, Preregistration
Link to resource
To draw informed conclusions from research studies, research consumers need full and accurate descriptions of study methods and …
Author(s): Austin H. Johnson, Bryan G. Cook
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Single Case Design
Link to resource
Preregistration clarifies the distinction between planned and unplanned research by reducing unnoticed flexibility. This improves …
Author(s): Brian A. Nosek, Emorie D. Beck, Lorne Campbell, Jessica K. Flake, Tom E. Hardwicke, David T. Mellor, Anna E. van ’t Veer, Simine Vazire
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration
Link to resource
To address widespread perceptions of a reproducibility crisis in the social sciences, a growing number of scholars recommend the …
Author(s): Michel Tuan Pham, Travis Tae Oh
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Open Science, Reproducibility Crisis, Consumer Research, Critiques
Link to resource
A viewpoint published in Tourism Management articulates the potential benefits of preregistration and ‘debunking myths’ …
Author(s): Valério Souza-Neto, Brent Moyle
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities
Tag(s): Preregistration, Pre-planning, Open Sciences, P-hacking, HARKing, Transparency
Link to resource
The preregistration of a study’s hypotheses, methods, and data-analyses steps is becoming a popular psychological research practice. To …
Author(s): Gaëtan Mertens, Angelos-Miltiadis Krypotos
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Replicability, Transparency, Open Science, Archival Data, Preregistration
Link to resource
Open, prospective registration of a study protocol can improve research rigour in a number of ways. Through preregistration, key …
Author(s): Mira van der Naald, Steven A J Chamuleau, Julia M L Menon, Wim de Leeuw, Judith de Haan, Dirk J Duncker, Kimberley Elaine Wever
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Biomedical Research, Research Design
Link to resource
The idea for the registration of observational epidemiologic studies (with their protocols, hypotheses, and analysis plans) is modeled …
Author(s): Jan P. Vandenbroucke
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science
Tag(s): Preregistration, Epidemiology
Link to resource
Professors Kogevinas and Stayner do not address the central point of my commentary but they do pursue an issue on which I welcome the …
Author(s): Michael B. Bracken
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Preregistration, Epidemiology
Link to resource
There must be something wrong when a professor of epidemiology includes the following statement in the concluding remarks of a …
Author(s): Manolis Kogevinas, Leslie Stayner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Preregistration, Epidemiology
Link to resource
It has been proposed that observational epidemiology protocols, just like those for randomized controlled trials (RCTs), should be …
Author(s): Michael B. Bracken
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Preregistration, Epidemiology
Link to resource
Preregistration of study protocols and, in particular, Registered Reports are novel publishing formats that are currently gaining …
Author(s): Ulrich Dirnagl
Type of resources: Reading
Primary user(s): Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Study Protocols, Registered Reports, Exploratory Research, Confirmatory Research
Link to resource
In this paper, we introduce the preregistration concept for experiments in the information systems (IS) discipline. Preregistration …
Author(s): Eric Bogert, Aaron Schecter, Richard T. Watson
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Business and Communication, Social Science
Tag(s): Preregistration, Information Systems
Link to resource
It is interesting to note that human intelligence thrives on what Peirce called abductive inferences (Peirce and Turrisi 1997, 241-56), …
Author(s): Mireille Hildebrandt
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Machine Learning, P-Hacking
Link to resource
This is a commentary on Lee et al.’s (2019) article encouraging preregistration of model development, fitting, and evaluation. While we …
Author(s): Steven N. MacEachern, Trisha Van Zandt
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Modeling, Replication Crisis, Open Science, Exploratory, Robust Practices
Link to resource
In this webinar, Tamarinde Haven provides an overview of the process of preregistration in qualitative research. We review the process …
Author(s): Tamarinde Haven
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Open Science, OSF, Preregistration, Qualitative Methods, Qualitative Research, Research, Research Best Practices
Link to resource
Randomized controlled trials (RCTs) are designed to answer causal questions with internal validity. However, threats to internal …
Author(s): Bryan G. Cook, Vivian C. Wong, Jesse I. Fleming, Emily J. Solari
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Randomized Experiment, Outcome Study
Link to resource
Preregistration has been lauded as one of the solutions to the so-called ‘crisis of confidence’ in the social sciences and has …
Author(s): Olmo van den Akker, Sara Weston, Lorne Campbell, Bill Chopik, Rodica Damian, Pamela Davis-Kean, Andrew Hall, Jessica Kosie, Elliott Kruse, Jerome Olsen, Stuart Ritchie, KD Valentine, Anna van 't Veer, Marjan Bakker
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Secondary Data Analysis
Link to resource
Preregistration of research plans is becoming an increasingly popular and common tool to enhance the transparency of a study’s …
Author(s): Gaëtan Mertens, Angelos-Miltiadis Krypotos
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Replicability, Transparency, Questionable Research Practices, Open Science, Existing Data, Secondary Data Analysis, Preregistration
Link to resource
A recent workshop focused on the idea that protocols for nonrandomized studies should be registered in advance of their conduct. In …
Author(s): Timothy Lash
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Epidemiology, Preregistration
Link to resource
What is Preregistration? When you preregister your research, you’re simply specifying your research plan in advance of your study …
Author(s): Center for Open Science
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Funders, Preregistration, Publishers, Reproducibility, Researchers
Link to resource
Study preregistration is one of several “open science” practices (e.g., open data, preprints) that researchers use to improve the …
Author(s): Robert Heirene, Debi LaPlante, Eric R. Louderback, Brittany Keen, Marjan Bakker, Anastasia Serafimovska, Sally Melissa Gainsbury
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Preregistration, Gambling Studies
Link to resource
In this editorial, we define the practice of “preregistration” of research and describe its motivations, explain why we believe …
Author(s): David Mellor, Katherine S Corker, Paul Whaley
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Preregistration, Preregistration Templates, Toxicology
Link to resource
In last month’s column, I worried about whether encouraging us to preregister our hypotheses and analysis plan before running studies …
Author(s): Susan Goldin-Meadow
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Longitudinal Research
Link to resource
Questionable research practices (QRPs), such as p-hacking (i.e., the inappropriate manipulation of data analysis to find statistical …
Author(s): Angelos-Miltiadis Krypotos, Gaetan Mertens, Irene Klugkist, Iris M. Engelhard
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Questionable Research Practices, Preregistration, Psychological Science, Clinical Science
Link to resource
In this webinar Professor Brian Nosek, Executive Director of the Center for Open Science ( https://cos.io), outlines the practice of …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Preregistation, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Purpose: In the last decade, psychology and other sciences have implemented numerous reforms to improve the robustness of our research, …
Author(s): Violet A. Brown, Julia F. Strand
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Speech, Language, Hearing, Preregistration
Link to resource
Preregistration is a tool to enhance the reliability of science that has been promoted as a normative requirement for the award of …
Author(s): Alain de Cheveigné
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Meta-science, Neuroscience, Social and Behavioral Sciences, Life Sciences
Link to resource
A collection of slides for virtually all presentations given by Center for Open Science staff since its founding in 2013.
Author(s): Center for Open Science
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Funders, Librarians, Materials, Open Science Policy, Policy, Policy Makers, Publishers, Publishing, Reproducibility, Research Administration, Researchers, Workflow Tools
Link to resource
Psychological science journals are increasingly adopting open science (OS) policies (e.g., Transparency and Openness Promotion) …
Author(s): Mollie Ruben, Morgan Stosic
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Social Science
Tag(s): open data, transparency and openness promotion, TOP factor, privacy
Link to resource
Achieving research reproducibility is a precarious aspect of scientific practice. However, many studies across disciplines fail to be …
Author(s): Mushfiqul Anwar Siraji, Munia Rahman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Reproducible Research, R, Version Control, Git, GitHub, Renv
Link to resource
Concerns have been raised recently about the replicability of behavioral priming effects, and calls have been issued to identify …
Author(s): Joseph Cesairo
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This article presents 10 research-based principles of instruction, along with suggestions for classroom practice. These principles come …
Author(s): Barak Rosenshine
Type of resources: Reading
Primary user(s): Teacher
Subject area(s): Education, Social Science
Tag(s): Classroom Instruction, Instruction Principles
Link to resource
The National Aeronautics and Space Administration (NASA) has recently made a long-term commitment towards fostering open science. The …
Author(s): Ethan Waisberg, Joshua Ong, Andrew G. Lee
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Microgravity, Open Science, Spaceflight, Space Medicine
Link to resource
What can we, as users of microdata, formally guarantee to the individuals (or firms) in our dataset, regarding their privacy? We retell …
Author(s): Heffetz, Ori, and Katrina Liggett.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
The idea that birth-order position has a lasting impact on personality has been discussed for the past 100 years. Recent large-scale …
Author(s): Julia M Rohrer, Boris Egloff, Stefan C Schmukle
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background. The p-curve is a plot of the distribution of p-values reported in a set of scientific studies. Comparisons between ranges …
Author(s): Bishop, D. V, & Thompson, P. A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
O profissional formado pelo Curso de Graduação em Psicologia da Unifesspa caracterizar-se-á porpossuir uma formação pluralista e …
Author(s): Caio Maximino and Lúcia Cavalcante
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
Data sharing is increasingly an expectation in health research since implementation of the National Institutes of Health Data …
Author(s): Salimah H. Meghani, Kim Mooney-Doyle, Amber Barnato, Kathryn Colborn, Riley Gillette, Krista Harrison, Pam Hinds, Dessi Kirilova, Kathleen Knafl, Dena Schulman-Green, Kathryn Pollak, Christine S. Ritchie, Jean Kutner, and Sebastian Karcher
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Data Sharing, Open Science, Palliative Care, Qualitative Data
Link to resource
Using this material, you can learn how to code in python, build experiments using OpenSesame, and do basic data preprocessing in …
Author(s): Jeshua Tromp, Henk van Steenbergen
Type of resources: Full Course
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Python, Experiments, OpenSesame
Link to resource
The best way to learn how to program is to do something useful, so this introduction to MATLAB is built around a common scientific …
Author(s): Gerard Capes
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, MATLAB, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
The best way to learn how to program is to do something useful, so this introduction to Python is built around a common scientific …
Author(s): Anne Fouilloux, Lauren Ko, Maxim Belkin, Trevor Bekolay, Valentina Staneva
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Python, Reproducibility, Research Data Management Tools, Researchers
Link to resource
The best way to learn how to program is to do something useful, so this introduction to R is built around a common scientific task: …
Author(s): Diya Das, Katrin Leinweber, Rohit Goswami
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Data Carpentry Genomics workshop lesson to learn how to structure your metadata, organize and document your genomics data and …
Author(s): Amanda Charbonneau, Bérénice Batut, Daniel O. S. Ouso, Deborah Paul, Erin Alison Becker, François Michonneau, Jason Williams, Juan A. Ugalde, Kevin Weitemier, Laura Williams, Paula Andrea Martinez, Peter R. Hoyt, Rayna Michelle Harris, Taylor Reiter, Toby Hodges, Tracy Teal
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Management, Genetics
Tag(s): Analysis, Data, Education, Genomics, Metadata, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
The Project Teaching Integrity in Empirical Research (TIER) develops methods and tools for enhancing research transparency through …
Author(s): TIER Team
Type of resources: Teaching/Learning Strategy
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Education, Educators, Open Scholarship Guidelines, Researchers, Workflow Tools
Link to resource
The purpose of this paper is to help think through the advantages and costs of rigorous pre-specification of statistical analysis plans …
Author(s): Benjamin A. Olken
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication
Tag(s): Preregistration, Pre-Analysis Plans, Economics
Link to resource
Author guidelines for journals could help to promote transparency, openness, and reproducibility
Author(s): Nosek et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The open-science movement is driven by the desire to increase research transparency, accessibility, and equity in conducting, …
Author(s): M. Darda, ClareConry-Murray, Kathlee nSchmidt, Mahmoud M. Elsherif, Matthew Peverill, Tomiko Yoneda, Katherine M. Lawson, Evan DiGregory, David Moreau, Gillian Shorter, Morton Ann Gernsbacher
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Accessibility, Equity, Inclusion, Interpersonal Civility, Open Science, Research Transparency
Link to resource
Social scientists should adopt higher transparency standards to improve the quality and credibility of research.
Author(s): Miguel, E., C. Camerer, K. Casey, J. Cohen, K. M. Esterling, A. Gerber, R. Glennerster, D. P. Green, M. Humphreys, G. Imbens, D. Laitin, T. Madon, L. Nelson, B. A. Nosek, M. Petersen, R. Sedlmayr, J. P. Simmons, U. Simonsohn, M. Van der Laan.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This repository provides resources for faculty and academic units to re-imagine faculty rewards and incentives, and in particular how …
Author(s): Michael Dougherty, Ulrich Mayr, Sanjay Srivastava, Morton Ann Gernsbacher, Junaid Salim Merchant, Megan Fitter, Russell Poldrack, Edward Bernat, L. Robert Slevc, & Conor T. McLennan
Type of resources: Case Study, Lecture, Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Incentives, Tenure, Institutional Values, Inclusion
Link to resource
This article summarizes evidence and issues associated with psychological assessment. Data from more than 125 meta-analyses on test …
Author(s): Meyer et al.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science
Tag(s):
Link to resource
Psychologists must change the way they conduct and report their research—this notion has been the topic of much debate in recent years. …
Author(s): Heather M. Fuchs, Mirjam Jenny, Susann Fiedler
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Is psychology a robust science? To answer such a question, this course will encourage you to think critically about how psychological …
Author(s): Amy Orben
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
Psychology advances knowledge by testing statistical hypotheses using empirical observations and data. The expectation is that most …
Author(s): Patrick E. Shrout and Joseph L. Rodgers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In 2010–2012, a few largely coincidental events led experimental psychologists to realize that their approach to collecting, analyzing, …
Author(s): Leif D. Nelson, Joseph Simmons, and Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The past several years have been a time for soul searching in psychology, as we have gradually come to grips with the reality that some …
Author(s): Scott O Lilienfeld
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In 2011, Daryl Bem published a paper that seemed to demonstrate evidence for extra sensory perception (ESP). Four years later, the Open …
Author(s): Julia Strand
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Materials for the University of Glasgow Institute of Neuroscience and Psychology’s undergraduate and MSc methods courses + Experiences, …
Author(s):
Type of resources: Textbook
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Curriculum Change, Education, Educators, Open Education, Open Scholarship Tools and Technologies, Reproducibility, Students
Link to resource
n.a.
Author(s): .
Type of resources: AI-search engine
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): AI
Link to resource
Background There is increasing interest to make primary data from published research publicly available. We aimed to assess the current …
Author(s): Alawi A. Alsheikh-Ali, John P. A. Ioannidis, Mouaz H. Al-Mallah, Waqas Qureshi
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Bibliometrics, Clinical Trials, Data, Data Processing, Microarrays, Policy, Public Policy, Publishing, Reproducibility, Science Policy, Scientific Publishing
Link to resource
Policies that mandate public data archiving (PDA) successfully increase accessibility to data underlying scientific publications. …
Author(s): Dominique G. Roche, Loeske E. B. Kruuk, Robert Lanfear, Sandra A. Binning
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Archives, Data, Data Processing, Evolutionary Biology, Evolutionary Genetics, Public Policy, Reproducibility, Science Policy, Scientific Publishing
Link to resource
Science is facing a “replication crisis” in which many experimental findings cannot be replicated and are likely to be false. Does this …
Author(s): Nissen, S. B., Magidson, T., Gross, K., & Bergstrom, C. T.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Few models of self-control have generated as much scientific interest as has the limited strength model. One of the entailments of this …
Author(s): Evan C. Carter and Michael E. McCullough
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In a retrospective survey, 487 research projects approved by the Central Oxford Research Ethics Committee between 1984 and 1987, were …
Author(s): P.J Easterbrook, R Gopalan, J.A Berlin, D.R Matthews
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science, Social Science
Tag(s): Publication Bias, Clinical Research
Link to resource
Background: The p value obtained from a significance test provides no information about the magnitude or importance of the underlying …
Author(s): Anton Kühberger, Astrid Fritz, Thomas Scherndl
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We studied publication bias in the social sciences by analyzing a known population of conducted studies—221 in total—in which there is …
Author(s): Annie Franco, Neil Malhotra, Gabor Simonovits
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
There is some evidence that in fields where statistical tests of significance are commonly used, research which yields nonsignificant …
Author(s): Theodore D. Sterling
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Objective To review patterns of publication of clinical trials funded by US National Institutes of Health (NIH) in peer reviewed …
Author(s): Joseph S Ross, Tony Tse, Deborah A Zarin, Hui Xu, Lei Zhou, Harlan M Krumholz
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): NIH, Clinical Research, Preregistration
Link to resource
Confirmatory bias is the tendency to emphasize and believe experiences which support one’s views and to ignore or discredit those …
Author(s): Michael J. Mahoney
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
There is increasing evidence that scientific misconduct is more common than previously thought. Strong emphasis on scientific …
Author(s): Joeri K. Tijdink, Reinout Verbeke, Yvo M. Smulders
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Objectives The ultimate goal of biomedical research is the development of new treatment options for patients. Animal models are used if …
Author(s): Mira van der Naald, Steven Wenker, Pieter A Doevendans, Kimberley E Wever, Steven A J Chamuleau
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Preregistration, Translational Research, Publication Rate, Publication Bias
Link to resource
Our research activities would be better served if they were communicated in a manner that is openly accessible to the public and all …
Author(s): Masanori Arita, Bernd Pulverer, Tadashi Uemura, Chisako Sakuma, Shigeo Hayashi
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): APC/Article Processing Charge, Open Access, Open Science, Scientific Publication, Transformative Agreement
Link to resource
This session is an intermediate-to-advanced level class that offers some ideas for how to approach the following common data wrangling …
Author(s): Nick Wolf, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Open Scholarship Tools and Technologies, Research Data Management Tools, Researchers
Link to resource
Python is a general purpose programming language that is useful for writing scripts to work effectively and reproducibly with data. …
Author(s): Iain Emsley
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Python, Reproducibility, Research Data Management Tools, Researchers
Link to resource
As part of its mission, QDR promotes the pedagogical use of published qualitative and multi-method data projects. Shared qualitative …
Author(s): Qualitative Data Repository
Type of resources: Data Set, Primary Source
Primary user(s): Student, Teacher, Librarian
Subject area(s): Arts and Humanities, Education, English Language Arts, History, Law, Social Science
Tag(s):
Link to resource
Starting with Qualitative Open Science Practices
As a person who was trained primarily in research using quantitative methods but …
Author(s): Rachel Renbarger & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education
Tag(s): Qualitative Research; Open Access; Open Materials; Educational Research; Preregistration; Ethics; Transparency
Link to resource
Qualitative research has long suffered from a lack of free tools for analysis, leaving no options for researchers without significant …
Author(s): Beth M. Duckles, Vicky Steeves
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Librarians, Open Scholarship Tools and Technologies, Qualitative, R, Research Data Management Tools, Researchers, Taguette
Link to resource
Secondary data analyses occur when new analyses are proposed for existing data. Although they are prevalent in special education …
Author(s): Allison R. Lombardi, Graham G. Rifenbark, Ashley Taconet
Type of resources: Student Guide
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Secondary Data Analysis, Special Education, Preregistration
Link to resource
When consumers of science (readers and reviewers) lack relevant details about the study design, data, and analyses, they cannot …
Author(s): S. Vazire
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recently, a reporter in the Chronicle of Higher Education wrote that “psychology is having an uneasy moment” (Zamudio-Suarez, 2016). …
Author(s): Jennifer Howell
Type of resources: Syllabus
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Discussions of how to improve research quality are predominant in a number of fields, including education. But how prevalent are the …
Author(s): Bryan G. Cook, Jaret Hodges, Jonathan Plucker, Matthew C. Makel
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Education
Tag(s): Data, Open Data, Preregistration, Research Methods
Link to resource
Metascientists have studied questionable research practices in science. The present article considers the parallel concept of …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Education, Social Science
Tag(s): Metascience, Open Science, Questionable Research Practices, Replication Crisis, Science Reform
Link to resource
A survey in the United States revealed that an alarmingly large percentage of university psychologists admitted having used …
Author(s): Coosje L. S. Veldkamp, Franca Agnoli, Jelte M. Wicherts, Paolo Albiero, Roberto Cubelli
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Analysis, Behavior, Experimental Psychology, Italian People, Metrics, Psychologists, Psychology, Psychometrics, Questionnaires, Reproducibility, Research Methods, United States
Link to resource
Questionable research practices (QRPs) among researchers have been a source of concern in many fields of study. QRPs are often used to …
Author(s): Sven Kepes, Sheila K. Keener, Michael A. McDaniel, Nathan S. Hartman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Chrysalis Effect, HARKing, Questionable Research Practices, Research Integrity
Link to resource
The credibility of psychological findings can be undermined by a history of questionable research practices (QRPs) by researchers. One …
Author(s): Ayumi Ikeda, Haoqin Xu, Naoto Fuji, Siqi Zhu, Yuki Yamada
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Social Science
Tag(s): Open Science, Preregistration, Transparency, Questionable Research Practices, Embodied Cognition
Link to resource
We surveyed 807 researchers (494 ecologists and 313 evolutionary biologists) about their use of Questionable Research Practices (QRPs), …
Author(s): Ashley Barnett, Fiona Fidler, Hannah Fraser, Shinichi Nakagawa, Tim Parker
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Life Science, Biology, Ecology
Tag(s): Analysis, Behavioral Ecology, Community Ecology, Data, Ecology and Environmental Sciences, Evolutionary Biology, Evolutionary Ecology, HARKing, Psychology, Publication Ethics, Statistical Data, Statistics
Link to resource
The current discussion of questionable research practices (QRPs) is meant to improve the quality of science. It is, however, important …
Author(s): Klaus Fiedler and Norbert Schwarz
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This lesson in part of Software Carpentry workshop and teach novice programmers to write modular code and best practices for using R …
Author(s): Adam H. Sparks, Ahsan Ali Khoja, Amy Lee, Ana Costa Conrado, Andrew Boughton, Andrew Lonsdale, Andrew MacDonald, Andris Jankevics, Andy Teucher, Antonio Berlanga-Taylor, Ashwin Srinath, Ben Bolker, Bill Mills, bippuspm, Bret Beheim, butterflyskip, Clare Sloggett, Daniel, Dave Bridges, David J. Harris, David Mawdsley, Dean Attali, Diego Rabatone Oliveira, Drew Tyre, Elise Morrison, Erin Alison Becker, Fernando Mayer, François Michonneau, Giulio Valentino Dalla Riva, Gordon McDonald, Greg Wilson, Harriet Dashnow, Ido Bar, Jaime Ashander, James Balamuta, James Mickley, Jamie McDevitt-Irwin, Jeffrey Arnold, Jeffrey Oliver, John Blischak, Jonah Duckles, Josh Quan, Julia Piaskowski, Kara Woo, Kate Hertweck, Katherine Koziar, Katrin Leinweber, Kellie Ottoboni, Kevin Weitemier, Kiana Ashley West, Kieran Samuk, Kunal Marwaha, Kyriakos Chatzidimitriou, Lachlan Deer, Lex Nederbragt, Liz Ing-Simmons, Lucy Chang, Luke W Johnston, Luke Zappia, Marc Sze, Marie-Helene Burle, Marieke Frassl, Mark Dunning, Martin John Hadley, Mary Donovan, Matt Clark, Melissa Kardish, Mike Jackson, Murray Cadzow, Narayanan Raghupathy, Naupaka Zimmerman, Nelly Sélem, Nicholas Lesniak, Nicholas Potter, Nima Hejazi, Nora Mitchell, Olivia Rata Burge, Paula Andrea Martinez, Pete Bachant, Phil Bouchet, Philipp Boersch-Supan, Piotr Banaszkiewicz, Raniere Silva, Rayna Michelle Harris, Remi Daigle, Rémi Emonet, Research Bazaar, Richard Barnes, Robert Bagchi, Sam Penrose, Sandra Brosda, Sarah Munro, Sasha Lavrentovich, Scott Allen Funkhouser, Scott Ritchie, Sebastien Renaut, Thea Van Rossum, Timothy Eoin Moore, Timothy Rice, Tobin Magle, Trevor Bekolay, Tyler Crawford Kelly, Vicken Hillis, waiteb5, Yuka Takemon
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Data Carpentry lesson part of the Social Sciences curriculum. This lesson teaches how to analyse and visualise data used by social …
Author(s): Angela Li, Ben Marwick, Christina Maimone, Danielle Quinn, Erin Alison Becker, Francois Michonneau, Geoffrey LaFlair, Hao Ye, Jake Kaupp, Juan Fung, Katrin Leinweber, Martin Olmos, Murray Cadzow
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science, Measurement and Data, Social Science
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers, RStudio
Link to resource
This practical guide provides more than 150 recipes to help you generate high-quality graphs quickly, without having to comb through …
Author(s): Winston Chang
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Book, Software, R
Link to resource
Una introducción a R utilizando los datos de Gapminder. El objetivo de esta lección es enseñar a las programadoras principiantes a …
Author(s): 0xgc, Alejandra Gonzalez-Beltran, Ana Beatriz Villaseñor Altamirano, Antonio, AntonioJBT, A. s, Belinda Weaver, Claudia Engel, Cynthia Monastirsky, Daniel Beiter, David Mawdsley, David Pérez-Suárez, Erin Becker, EuniceML, François Michonneau, Gordon McDonald, Guillermina Actis, Guillermo Movia, Hely Salgado, Ido Bar, Ivan Ogasawara, Ivonne Lujano, James J Balamuta, Jamie McDevitt-Irwin, Jeff Oliver, Jonah Duckles, Juan M. Barrios, juli arancio, Katrin Leinweber, Kevin Alquicira, Kevin Martínez-Folgar, Laura Angelone, Laura-Gomez, Leticia Vega, Marcela Alfaro Córdoba, Marceline Abadeer, Maria Florencia D'Andrea, Marie-Helene Burle, Marieke Frassl, Matias Andina, Murray Cadzow, Narayanan Raghupathy, Naupaka Zimmerman, Paola Prieto, Paula Andrea Martinez, Raniere Silva, raynamharris, Rayna M Harris, Richard Barnes, Richard McCosh, Romualdo Zayas-Lagunas, Sandra Brosda, Sasha Lavrentovich, saynomoregrl, Shirley Alquicira Hernandez, Silvana Pereyra, Tobin Magle, Veronica Jimenez
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Measurement and Data
Tag(s): Analysis, Data, Education, Gapminder, Open Scholarship Tools and Technologies, R, Reproducibility, Research Data Management Tools, Researchers
Link to resource
This paper investigates how competition to publish first and thereby establish priority impacts the quality of scientific research. We …
Author(s): Ryan Hill and Caroline Stein
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Publish or perish culture, Quality of publication
Link to resource
Hypothesizing after the results are known (HARK) has been disparaged as data dredging, and safeguards including hypothesis …
Author(s): Iain E. Buchan, James S. Koopman, Jiang Bian, Matthew Sperrin, Mattia Prosperi, Mo Wang
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Analysis, Data, HARKing, Reproducibility
Link to resource
C. Glenn Begley and Lee M. Ellis propose how methods, publications and incentives must change if patients are to benefit.
Author(s): C. Glenn Begley and Lee M. Ellis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Throughout their education and when reading the scientific literature, students may get the impression that there is a unique and …
Author(s): Maximilian M. Mandl, Sabine Hoffmann, Sebastian Bieringer, Anna E. Jacob, Marie Kraft, Simon Lemster, Anne-Laure Boulesteix
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Education, Data Analysis, Replicability
Link to resource
According to R.A. Fisher, randomization “relieves the experimenter from the anxiety of considering innumerable causes by which the data …
Author(s): Uwe Saint-Mont
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
The recent replication crisis has caused several scientific disciplines to self-reflect on the frequency with which they replicate …
Author(s): Clint D. Kelly
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology, Ecology
Tag(s): Reproducibility
Link to resource
Pre-analysis plans (PAPs) are a potential remedy to the publication of spurious findings in empirical research, but they have been …
Author(s): Maximilian Kasy, Jann Spiess
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Implementability, Pre-Analysis Plans, Statistical Decisions, Economics
Link to resource
Scientific code is different from production software. Scientific code, by producing results that are then analyzed and interpreted, …
Author(s): Fabien C. Y. Benureau, Nicolas P. Rougier
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science, Social Science
Tag(s): Best Practices, Computational Science, Replicability, Reproducibility of Results, Reproducible Research, Reproducible Science, Software Development
Link to resource
Early career researchers (ECRs) are important stakeholders leading efforts to catalyze systemic change in research culture and …
Author(s): Brianne A. Kent, Constance Holman, Emmanuella Amoako, Alberto Antonietti, James M. Azam, Hanne Ballhausen, Yaw Bediako, Anat M. Belasen, Clarissa F. D. Carneiro, Yen-Chung Chen, Ewoud B. Compeer, Chelsea A. C. Connor, Sophia Crüwell, Humberto Debat, Emma Dorris, Hedyeh Ebrahimi, Jeffrey C. Erlich, Florencia Fernández-Chiappe, Felix Fischer, Małgorzata Anna Gazda, Toivo Glatz, Peter Grabitz, Verena Heise, David G. Kent, Hung Lo, Gary McDowell, Devang Mehta, Wolf-Julian Neumann, Kleber Neves, Mark Patterson, Naomi C. Penfold, Sophie K. Piper, Iratxe Puebla, Peter K. Quashie, Carolina Paz Quezada, Julia L. Riley, Jessica L. Rohmann, Shyam Saladi, Benjamin Schwessinger, Bob Siegerink, Paulina Stehlik, Alexandra Tzilivaki, Kate D. L. Umbers, Aalok Varma, Kaivalya Walavalkar, Charlotte M. de Winde, Cecilia Zaza, Tracey L. Weissgerber
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Early Career Researchers, Research Culture, Science Improvement, Recommendations
Link to resource
Replicability of findings is at the heart of any empirical science. The aim of this article is to move the current replicability debate …
Author(s): Jens B. Asendorpf, Mark Conner, Filip De Fruyt, Jan De Houwer, Jaap J. A. Denissen, Klaus Fiedler, Susann Fiedler, David C. Funder, Reinhold Kliegl, Brian A. Nosek, Marco Perugini, Brent W. Roberts, Manfred Schmitt, Marcel A. G. van Aken, Hannelore Weber, Jelte M. Wicherts
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
In contrast to the truncated view that replications have only a little to offer beyond what is already known, we suggest a broader …
Author(s): Joachim Hüffmeier, Jens Mazei and Thomas Schultze
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
We propose to change the default P-value threshold for statistical signifcance from 0.05 to 0.005 for claims of new discoveries.
Author(s): Daniel J. Benjamin
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Flexibility in the design, analysis and interpretation of scientific studies creates a multiplicity of possible research outcomes. …
Author(s): Tom E. Hardwicke & Eric-Jan Wagenmakers
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Science, Technology, Society, Preregistration, Scientific Community
Link to resource
Many journals are moving towards a ‘Mandatory Inclusion of Raw Data’ (MIRD) model of data sharing, where it is expected that raw data …
Author(s): Annayah MB Prosser, Ralph Bagnall, and Nina Higson-Sweeney
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Ethics, Mandatory Inclusion Of Raw Data, Open Data, Open Research, Open Science, Qualitative Methods
Link to resource
Clinical trials are routinely preregistered. In psychology and the social sciences, however, only a small percentage of studies are …
Author(s): Robert T. Thibault, Charlotte R. Pennington, and Marcus R. Munafò
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Badges, Blind Data Analysis, Open Science, Prospective Registration, Preregistration
Link to resource
n.a.
Author(s): Sarahanne Field, Noah van Dongen, Leo Tiokhin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Metascience, science reform, methodology, philosophy of science
Link to resource
The scientific community has entered a challenging era, as originally noted by Wagenmakers . High-profile instances of fraud, failures …
Author(s): Sarahanne Field, Noah van Dongen, Leo Tiokhin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Social Science
Tag(s): Metascience, Science Reform, Methodology, Philosophy of Science
Link to resource
Language can be viewed as a complex set of cues that shape people’s mental representations of situations. For example, people think of …
Author(s): Eerland, A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Open Science, Registered Reports
Link to resource
In an anonymous 4-person economic game, participants contributed more money to a common project (i.e., cooperated) when required to …
Author(s): Bouwmeester, S., Verkoeijen, P. P., Aczel, B., Barbosa, F., Bègue, L., Brañas-Garza, P., ... & Evans, A. M.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Trying to remember something now typically improves your ability to remember it later. However, after watching a video of a simulated …
Author(s): Alogna, V. K et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Open Science, Registered Reports
Link to resource
According to the facial feedback hypothesis, people’s affective responses can be influenced by their own facial expression (e.g., …
Author(s): Wagenmakers et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Finkel, Rusbult, Kumashiro, and Hannon (2002, Study 1) demonstrated a causal link between subjective commitment to a relationship and …
Author(s): Cheung, I., Campbell, L., LeBel, E. P., Ackerman, R. A., Aykutoğlu, B., Bahník, Š., ... & Carcedo, R. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background: Registered Reports are an emerging publication format, which emphasizes methodological rigor over results. Integrating this …
Author(s): Steven Verheyen
Type of resources: Activity/Lab, Case Study, Full Course, Homework/Assignment, Interactive, Lesson Plan, Syllabus, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Open Science, Open Educational Resources, Pre-registration, Replication, Paper-in-a-day
Link to resource
Although the number of journals that have adopted the registered report format has increased rapidly in recent years, they still …
Author(s): Ting-Yu Lin, Hao-Chien Cheng, Li-Fu Cheng, Tsung-Min Hung
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Life Science, Social Science
Tag(s): Registered Report, Replication, Researcher Degrees of Freedom, Research Method, Publication Bias
Link to resource
Background Preregistration, the open science practice of specifying and registering details of a planned study prior to knowing the …
Author(s): Lisa Spitzer, Stefanie Mueller
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Psychological Attitudes, Psychology, Behavior, Surveys, Open Science, Motivation, Pilot Studies, Psychometrics
Link to resource
This Registered Report collaborative template aims to address the growing prevalence of Registered Reports. Registered Reports ( …
Author(s): Gilad Feldman
Type of resources: Template Registered Report
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Social Science
Tag(s): Registered Reports, Pre-Registration Template, Manuscript Template
Link to resource
Recent psychological research suggests that many published studies cannot be replicated (e.g., Open Science Collaboration, 2015). The …
Author(s): Jeffrey P Braden
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Replications, Registered Reports, Report Preregistration, School Psychology
Link to resource
Registered Reports Factsheet for Editors
Author(s): Center For Open Science
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
Registered Reports FAQ
Author(s): Center For Open Science
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
This webinar addresses questions related to writing, reviewing, editing, or funding a study using the Registered Report format, …
Author(s): Chris Chambers, david mellor
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Open Science, Peer Review, Publishing, Registered Reports, Research, Research Best Practices
Link to resource
Registered reports a Method to Increase the Credibility of Published Results
Author(s): Brian Nosek and Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
An article about registered Reports: A new publishing initiative at Cortex
Author(s): Christopher Chambers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The recent ‘replication crisis’ in psychology has focused attention on ways of increasing methodological rigor within the behavioral …
Author(s): Caroline Watt, Diana Kornbrot, Richard Wiseman
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Information Science, Psychology
Tag(s): Data, Preregistation, Publishing, Registered Reports
Link to resource
The traditional peer review process in medicine faces a crisis marked by publication delays, potential bias, and a lack of …
Author(s): Carmine Zoccali & Francesca Mallamaci
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, researcher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Medical Publishing, Peer Community In Research Reports, Peer Review, Referees, Publication
Link to resource
Preprints in biology are becoming more popular, but only a small fraction of the articles published in peer-reviewed journals have …
Author(s): Darwin Y Fu, Jacob J Hughey
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Preprints, Publishing
Link to resource
In response to various perceived crises in science, changes to the organization, conduct and publication of science have been proposed …
Author(s): Bart Penders
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Big Science, Big Team Science, Colaboration, Credibility, ManyLabs, Persuasion, Scientific Reform
Link to resource
This article is motivated by the ‘reproducibility crisis’ that is being discussed intensely in fields such as Psychology or Biology but …
Author(s): Christof Schöch
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics, Physical Science, Social Science
Tag(s): Replication, Reproduction, Revision, Reanalyssis, Reuse, Terminology, Computational Literary Studies, Open Science
Link to resource
A blog post about choosing Bayes Factor over p-value
Author(s): Ulrich Schimmack
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
A video about replicability and reproducibility debate
Author(s): BPSOfficial/Nick Brown
Type of resources: Video
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Video, Replication Research
Link to resource
Replicability and Reproducibility in Comparative Psychology Psychology faces a replication crisis. The Reproducibility Project: …
Author(s): Jeffrey R. Stevens
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Economics, Psychology
Tag(s): Animal Research, Comparative Psychology, Pre-registration, Replication, Reproducibility, Reproducible Research
Link to resource
A syllabus about replicability seminar
Author(s): Simine Vazire
Type of resources: Syllabus
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This course will examine current controversies and new developments in research methods in psychology. The goal of the course is to …
Author(s): Simine Vazire
Type of resources: Syllabus
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In a direct replication, the typical goal is to reproduce a prior experimental result with a new but comparable sample of participants …
Author(s): Jacob Westfall, Charles M. Judd, David A. Kenny
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution
Link to resource
This is a clearinghouse for resources related to open science in Special Education. If you find a good resource that has not been …
Author(s): OSKB Admin
Type of resources: Reading
Primary user(s):
Subject area(s): education
Tag(s): Open Practices, Replication, Research, Special Education
Link to resource
Blog post going over the replication crisis and how it has led to the open science movement.
Author(s): David Funder
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Open Science, Reproducibility Crisis and Credibility Revolution
Link to resource
Replications and robustness checks are key elements of the scientific method and a staple in many disciplines. However, leading …
Author(s): Greg J Duncan, Mimi Engel, Amy Claessens, Chantelle J Dowsett
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The field of replication studies remains a controversial, misunderstood, and unappreciated piñata of 18 replication typologies spanning …
Author(s): Fernando Martel García
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Replication has received increasing attention over the last decade. This comes on the heels of prominent instances of data fabrication …
Author(s): Matthew C. Makel, Melanie S. Meyer, Mary A. Simonsen, Anne M. Roberts, Jonathan A. Plucker
Type of resources: Reading
Primary user(s): Student, Parent, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Social Science
Tag(s): Replication, Qualitative Research
Link to resource
Many published research results are false (Ioannidis, 2005), and controversy continues over the roles of replication and publication …
Author(s): Richard McElreath, Paul E. Smaldino
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recent controversies in psychology have spurred conversations about the nature and quality of psychological research. One topic …
Author(s): Matthew C. Makel, Jonathan A. Plucker, and Boyd Hegarty
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This seminar will address issues relevant to the current controversy over the reliability of psychological research, a controversy …
Author(s): Richard Ball, Sara Bowman, Garret Christensen, Michael C. Frank, David Funder, Konrad Hinsen, Nicole Janz, Norm Medeiros, Edward Miguel, Brian A. Nosek, Russell Poldrack, Simine Vazire, Felix Schönbrodt, Eric-Jan Wagenmakers, Lorne Campbell, Eric Luis Uhlmann, Martin Schweinsberg, Neil Bearden, John M. Zelenski, Daniel J. Simons, Gustav Nilsonne, Michael J. Kane, Joseph Hilgard, Jennifer Howell, Michèle B. Nuijten, , Rodica I. Damian, Sean Mackinnon, Henrik Danielsson, Brent Roberts, Heather L. Urry, Katherine S. Corker, Edouard Machery, Caio Maximino, David Thomas Mellor, Jon Grahe, Timothy H. Parker, Don A. Moore, Flavio Azevedo, Charlotte Hartwright, Benjamin Le, Julia Strand, Maia Salholz-Hillel, Amy Orben, Moin Syed, Ana P. Herrmann, Argiro Vatakis, Rima-Maria Rahal, Simon Schwab, Lisa DeBruine, Daniel Umpierre, Krista Byers-Heinlein, Melanie Soderstrom, and Nate Breznau
Type of resources: Syllabus
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Ledgerwood (1) argues that there are two independent uses of preregistration that are conflated in Nosek et al. (2) and elsewhere: …
Author(s): Brian A. Nosek, Charles R. Ebersole, Alexander C. DeHaven, David T. Mellor
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Preregistration, Reply, Prediction, Analyses
Link to resource
Statistical practice in psychological science is undergoing reform which is reflected in part by strong recommendations for reporting …
Author(s): Jolynn Pek and David B Flora
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Recent replication crises in psychology and other fields have led to intense reflection about the validity of common research …
Author(s): Andrea Polonioli, Brittany Blankinship, David Carmel, Mariana Vega-Mendoza
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Reproducibility
Link to resource
The major aim of Pediatric Normal Tissue Effects in the Clinic (PENTEC) was to synthesize quantitative published dose/-volume/toxicity …
Author(s): Andrew Jackson, Chia-Ho Hua, Arthur Olch, Ellen D. Yorke, Tiziana Rancati, Michael T. Milano, Louis S. Constine, Lawrence B. Marks, Soren M. Bentzen
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Radio Therapy, Open Data
Link to resource
An Open-Access repository of psychological measures, scales, tests, and other research instruments in Serbian. Documented are …
Author(s): Laboratory for Research of Individual Differences (LIRA) at the University of Belgrade
Type of resources: Research Material
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Social Science
Tag(s): Digital Repository, Research Data, Psychological Measures, Open Repository, Scales, Translation, Adaptation
Link to resource
On 10 February 2024, I gave a lightning talk at FOSDEM 2024’s Open Research Online Devroom titled “Representing epistemological …
Author(s): naclscrg
Type of resources: Lecture Notes, Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Education, Life Science
Tag(s): Epistemic and Disciplinary Diversity in Open Research
Link to resource
Serving mugs of Reproducibili☕️: Blends include transparency, openness and robustness + a spoonful of science.
Author(s): Sophia Cruwell, Amy Orben and Sam Parsons
Type of resources: Student Guide, Unit of Study
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The integrative review presented here examines how reproducibility and replicability are conceptualized and discussed in relation to …
Author(s): Cole, N. L., Ulpts, S., Bochynska, A., Kormann, E., Good, M., Leitner, B., & Ross-Hellauer, T.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Research, Open Science, Qualitative Research, Replicability, Reproducibility
Link to resource
The United Kingdom is experiencing the largest-ever increase in public investment in research and development, with the Government …
Author(s): House of Commons Science, Innocation and Technology Committee: Greg Clark, Aaron Bell, Dawn Butler, Chris Clarkson, Tracey Crouch, Katherine Fletcher, Rebecca Long-Bailey, Stephen Metcalfe, Carol Monaghan, Graham Stringer, Christian Wakeford
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator
Subject area(s): Career and Technical Education, Education, Social Science
Tag(s): Reproducibility, Research Integrity, Government, Reproducibility Challenges
Link to resource
Reproducibility for Everyone produces resources to help grow researchers’ awareness of and ability to do reproducible research.
Author(s): April Clyburne-Sherin
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility, Research Data Management Tools, Researchers
Link to resource
Various fields in the natural and social sciences face a ‘crisis of confidence’. Broadly, this crisis amounts to a pervasiveness of …
Author(s): Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Git, GitHub, GitLab, Jupyter Notebooks, Open Scholarship Tools and Technologies, Open Science Framework, R, Reproducibility, ReproZip, Research Data Management Tools, Researchers, RStudio, Version Control
Link to resource
Interpreting the first results from the Reproducibility Project: Cancer Biology requires a highly nuanced approach. Reproducibility is …
Author(s): eLife Editors
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Metascience, Methodology, Open Science, Replication, Reproducibility, Reproducibility Project: Cancer Biology
Link to resource
Psychological science has been going through a crisis of confidence concerning theveracity of the findings that serve as the foundation …
Author(s): Brent Roberts and Dan Simons
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
Science is undergoing a paradigm shift in the way research is conducted and what is considered evidence. Psychology is leading other …
Author(s): Jon Grahe
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
As research across domains of study has become increasingly reliant on digital tools (librarianship included), the challenges in …
Author(s): Birgit Schmidt, Vicky Steeves
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Institutional Policies, Librarians, Librarianship, Reproducibility
Link to resource
The adoption of reproducibility remains low, despite incentives becoming increasingly common in different domains, conferences, and …
Author(s): Fernando Chirigati, Rémi Rampin, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers
Link to resource
A reading list for reproducibility in clinical psychology
Author(s): Cody Christopherson
Type of resources: Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Clinical psychology
Link to resource
Background There is wide agreement in the biomedical research community that research data sharing is a primary ingredient for ensuring …
Author(s): Jessica Minnier, Melissa A. Haendel, Nicole A. Vasilevsky, Robin E. Champieux
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology
Tag(s): Data, Inside Your Classroom, Reproducibility
Link to resource
The objective of this study was to evaluate the nature and extent of reproducible and transparent research practices in neurology …
Author(s): Austin L. Johnson, Daniel Tritz, Jonathan Pollard, Matt Vassar, Shelby Rauh, Trevor Torgerson
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology, Social Science
Tag(s): Data, Inside Your Classroom, Reproducibility
Link to resource
Modern scientific research takes advantage of programs such as Python and R that are open source. As such, they can be modified and …
Author(s): Christopher Ahern
Type of resources: Full Course
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Analysis, Literate Programming, Reproducibility, Version Control
Link to resource
Objectives: We aim to introduce the discussion on the crisis of confidence to sport and exercise psychology. We focus on an important …
Author(s): Schweizer, G., & Furley, P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
This is the website for the Autumn 2014 course “Reproducible Research Methods” taught by Eric C. Anderson at NOAA’s Southwest Fisheries …
Author(s): Eric C. Anderson
Type of resources: Full Course
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Analysis, Literate Programming, Reproducibility, Version Control
Link to resource
Currently, there is a growing interest in ensuring the transparency and reproducibility of the published scientific literature. …
Author(s): John P. A. Ioannidis, Joshua D. Wallach, Kevin W. Boyack
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Conflicts of Interest, Data, Medical Journals, Open Access Publishing, Open Science, PublishingGovernment Funding of Science, Replication Studies, Reproducibility, Scientific Publishing, Sequence Databases, Systematic Reviews
Link to resource
A video detailing whether reproducible research is true or false
Author(s): John Ioannidis
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video
Link to resource
Description
This hands-on tutorial will train reproducible research warriors on the practices and tools that make experimental …
Author(s): Matt McCormick
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Analysis, Organizing, Report Writing, Reproducibility, Version Control
Link to resource
Workshop goals
Author(s): François Michonneau, Kim Gilbert, Matt Pennell
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Analysis, Report Writing, Reproducibility
Link to resource
Workshop goals
Author(s): Ciera Martinez, Courtney Soderberg, Hilmar Lapp, Jennifer Bryan, Kristina Riemer, Naupaka Zimmerman
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Literate Programming, Reproducibility
Link to resource
Workshop goals
Author(s): Ciera Martinez, Courtney Soderberg, Hilmar Lapp, Jennifer Bryan, Kristina Riemer, Naupaka Zimmerman
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Organizing, Reproducibility
Link to resource
Workshop goals
Author(s): Dave Clements, Hilmar Lapp, Karen Cranston
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Report Writing, Reproducibility
Link to resource
Workshop goals
Author(s): Ciera Martinez, Hilmar Lapp, Karen Cranston
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Reproducibility, Version Control
Link to resource
Workshop goals
Author(s): Dan Leehr
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Documentation, Organizing, Reproducibility
Link to resource
This is a series of labs/tutorials currently under development (2020-2021) for a two-semester graduate-level statistics sequence in …
Author(s): Matthew C.Crump
Type of resources: Reading, Simulation, Textbook
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Statistics
Link to resource
Practicing open science can have benefits for the career prospects of individual researchers or labs through higher quality work and …
Author(s): Maximilian Linde, Merle-Marie Pittelkow, Nina R. Schwarzbach, and Don van Ravenzwaaij
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Social Science
Tag(s): Computational Model, Cultural Evolution, Metascience, Open Science, Reform
Link to resource
It’s been one year after leaving academia and starting to work for a charity organisation. For a bit of context, I did my PhD in …
Author(s): Karolina Urbanska & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Reading, Article
Primary user(s): Student
Subject area(s): Career and Technical Education
Tag(s): Non-academic
Link to resource
Gärtner et al. (2022) propose a system for quantitatively scoring the methodological rigour of papers during the hiring and promotion …
Author(s): Tom Hostler
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Open Research, Research Assessment, Epistemology, Metrics, Qualitative
Link to resource
After the increasingly toxic environment of modern research culture forced her to nearly abandon her career, astrophysicist Dr Rachael …
Author(s): Rachael Ainsworth
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Physical Science, Social Science
Tag(s): Open Science, Science Culture
Link to resource
Manual for a mandatory course for PhD candidates enrolled in the Graduate School for Social Sciences and Master students in the Social …
Author(s): Rene Bekkers
Type of resources: Full Course
Primary user(s): Student
Subject area(s): Social Science
Tag(s): ETHICS REVIEW, DATA MANAGEMENT, RESEARCH INTEGRITY
Link to resource
Research integrity is guided by a set of principles to ensure research reliability and rigor. It serves as a pillar to uphold society’s …
Author(s): Anna Catharina V Armond, Kelly D Cobey, David Moher
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Research Integrity, Reproducibility, Misconduct, Responsible Conduct of Research, Questionable Research Practices, Biomedical Sciences
Link to resource
Broad-based philosophical and methodological perspectives on conducting and interpreting psychological research; considers basic, …
Author(s): Michael Kane
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Broad-based philosophical and methodological perspectives on conducting and interpreting psychological research; considers basic, …
Author(s): Michael Kane
Type of resources: Syllabus
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This course will acquaint students with the major research designs and procedures in social psychology, as well as explore recent …
Author(s): Lorne Campbell
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A syllabus about evaluating research methods
Author(s): Morton-Ann Gernsbacher
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Applied Science, Education, Social Science
Tag(s): Syllabus
Link to resource
A compilation of articles regarding Research Misconduct issues. This page offers news-worthy topics for the Responsible Conduct of …
Author(s): University of Kentucky Research
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Business and Communication, Education, Life Science, Physical Science, Social Science
Tag(s): Research Misconduct, Responsible Conduct of Research
Link to resource
The replicability of research findings has recently been disputed across multiple scientific disciplines. In constructive reaction, the …
Author(s): Erich Kirchler, Jerome Olsen, Johanna Mosen, Martin Voracek
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Reproducibility
Link to resource
This first issue of 2022 marks the transition of Psychology and Aging in adopting a transparency and openness promotion (TOP) …
Author(s): Elizabeth A. L. Stine-Morrow
Type of resources: Reading
Primary user(s): Teacher, Librarian
Subject area(s): Life Science, Social Science
Tag(s): TOP Factor
Link to resource
Recent studies have indicated that research practices in psychology may be susceptible to factors that increase false-positive rates, …
Author(s): Kou Murayama, Reinhard Pekrun and Klaus Fiedler
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog about pre-registration
Author(s): Lindsay, D.S., Simons, D.J., Lilienfeld, S.O.
Type of resources: Blog
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Blog
Link to resource
The preregistration of research plans and hypotheses may prevent publication bias and questionable research practices. We incorporated …
Author(s): Sarai Blincoe, Stephanie Buchert
Type of resources: Lesson Plan, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Questionable Research Practices, Undergraduate Preregistration Assignment
Link to resource
This article describes the current debate on the practice of preregistration in political science—that is, publicly releasing a …
Author(s): James E. Monogan III
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Political Science, Preregistration
Link to resource
Workshop goals
Author(s): Hilmar Lapp
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Organizing, Reproducibility
Link to resource
An introduction to managing, annotating, organizing, archiving, and publishing research data using the Open Science Framework.
Author(s): Nick Wolf, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Materials, Open Scholarship Tools and Technologies, Research Data Management Tools, Researchers
Link to resource
The purpose of this document is to provide an aggregated list of games and game-related resources that are relevant to research support …
Author(s): George Bray and Valerie McCutcheon
Type of resources: Game, Teaching/Learning Strategy
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Research Support, Open Access, Open Data, Research Data Management, Open Research, Copyright
Link to resource
Many psychology studies are statistically underpowered. In part, this may be because many researchers rely on intuition, rules of …
Author(s): Bakker et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Minoritized doctoral students are subject to cultural taxation — disproportionate expectations and obligations based on their race or …
Author(s): Adrelys Mateo Santana, Emily N. Satinsky & Chardée A. Galán
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Minoritized Doctoral Students, Cultural Taxation, Culture, Psychology
Link to resource
Confirmation through competent replication is a founding principle of modern science. However, biomedical researchers are rewarded for …
Author(s): Ulrich Dirnagl
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): False Negative, False Positive, Preclinical Randomized Controlled Trial, Replication, Reproducibility, Statistics
Link to resource
The guidelines in this Library Guide give an in-depth, but limited first look at how you can find and engage with Open Educational …
Author(s): University of Groningen
Type of resources: Library Guide
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Open Educational Resources, OER, Resource List
Link to resource
A website about moderation and mediation
Author(s): Kristopher J. Preacher
Type of resources: Lesson
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Website
Link to resource
This list of resources consists of resources for researchers, editors, and reviewers interested in practicing open science principles, …
Author(s): Rachel Renbarger, Crystal N. Steltenpohl
Type of resources: Reading, Student Guide
Primary user(s):
Subject area(s): education, social-science, political-science, psychology
Tag(s): Data Sharing, Education Research, Methodology, Open Science, Open Science Training, Posititionality, Qualitative, Research, Transparency
Link to resource
Gilbert et al. conclude that evidence from the Open Science Collaboration’s Reproducibility Project: Psychology indicates high …
Author(s): Christopher J. Anderson et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Schönbrodt et al. (2022) and Gärtner et al. (2022) aim to outline in the target articles why and how research assessment could be …
Author(s): Sven Ulpts
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Responsible Research Assessment, Epistemic Injustice, Epistemic Diversity, Epistemic (Intellectual) Humility
Link to resource
Open data collected from humans creates a tension between scholarly values of transparency and sharing on the one hand, and privacy and …
Author(s): Kirsten Morehouse, Benedek Kurdi, and Brian A. Nosek
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Data Anonymity, Open Science, Privacy, Re-Identification, Research Integrity
Link to resource
We appreciate the initiative to seek for ways to improve academic assessment by broadening the range of relevant research contributions …
Author(s): Hannah Dames, Philipp Musfeld, Vencislav Popov, Klaus Oberauer, Gidon T. Frischkorn
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Research assessment, Open Science, Theory Building
Link to resource
Here we provide information on the ways through which the Institute of Psychology aims to foster responsible scholarship practices: …
Author(s): Anna van 't Veer, Eiko Fried
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Responsible Scholarship, Integrity, Psychology
Link to resource
In our final installment we get into how incumbent processes and perceptions have the advantage.
Author(s): Ruth Schmidt
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Diversity, Equity and Inclusion
Link to resource
Discussions around transparency in open science focus primarily on sharing data, materials, and coding schemes, especially as these …
Author(s): Crystal N. Steltenpohl, Hilary Lustick, Melanie S. Meyer, Lindsay Ellis Lee, Sondra M. Stegenga, Laurel Standiford Reyes, Rachel L. Renbarger
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Science, Transparency, Rigor, Qualitative, Quantitative
Link to resource
Discussions around transparency in open science focus primarily on sharing data, materials, and coding schemes, especially as these …
Author(s): Crystal N. Steltenpohl, Hilary Lustick, Melanie S. Meyer, Lindsay Ellis Lee, Sondra M. Stegenga, Laurel Standiford Reyes, and Rachel L. Renbarger
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Open Science, Transparency, Rigor, Qualitative, Quantitative
Link to resource
The recent so-called crisis of replication continues to dominate psychology’s methodological landscape. It is argued here that the …
Author(s): Robert Archer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Context, Critical Realism, Essentialism, Falsificationism, Popper, Replication
Link to resource
How easy is it to change people’s minds? In 2014, a Science study suggested that a short conversation could have a lasting impact on …
Author(s): Alison McCook
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Math & Statistics, Physical Science, Social Science
Tag(s): Blog
Link to resource
Preregistration involves researchers publicly registering key study elements before conducting a study to increase the transparency of …
Author(s): Jesse I. Fleming, Alan S. McLucas, Bryan G. Cook
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Change, Innovation, Legal Issues, Policy Issues, Research Methodology
Link to resource
Social science journal reviewers (N=8) responded to questionnaires regarding their reviewing history, and attitudes towards and …
Author(s): Neuliep, J W; Crandall, R.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Efforts to replicate portions of the scientific literature have lead to widely varying and often low rates of replicability. This has …
Author(s): Joseph Bak-Coleman, Richard Mann, Carl Bergstrom, Kevin Gross, Jevin West
Type of resources: Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Meta-Scientific Models, Metascience, Replication, Reproducibility, Statistics.
Link to resource
Although replications are vital to scientific progress, psychologists rarely engage in systematic replication efforts. In this article, …
Author(s): Sander L Koole, Daniël Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A series of youtube videos about his book on statistical rethinking and Bayesian statistics
Author(s): Richard McElreath
Type of resources: Videos
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Bayesian statistics
Link to resource
The information provided on this website is designed to assist the extramural community in addressing rigor and transparency in NIH …
Author(s): NIH
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Policy, Reproducibility
Link to resource
Efforts to Instill the Fundamental Principles of Rigorous ResearchRigorous experimental procedures and transparent reporting of …
Author(s): National Institutes of Health
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility, Research Administration, Research Integrity, Rigor
Link to resource
How do you know whether the quantitative research you’re consuming and producing is rigorous and reproducible? This course will draw on …
Author(s): Heather Urry
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Ethics
Link to resource
Urgent attention is needed to address generalizability problems in psychology. However, the current dominant paradigm centered on …
Author(s): Berna Devezer and Erkan O. Buzbas
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Generalizability, Modeling, Model-Centric, Result-Centric, Exploration
Link to resource
A videos that discusses world-leading open science
Author(s): RIOT
Type of resources: Video
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Social Science
Tag(s): Open science
Link to resource
Lack of reproducibility is an ongoing problem in some areas of the biomedical sciences. Poor experimental design and a failure to …
Author(s): Masca et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The reliability of experimental findings depends on the rigour of experimental design. Here we show limited reporting of measures to …
Author(s): Aaron Lawson McLean, Aikaterini Kyriakopoulou, Andrew Thomson, Aparna Potluru, Arno de Wilde, Cristina Nunes-Fonseca, David W. Howells, Emily S. Sena, Gillian L. Currie, Hanna Vesterinen, Julija Baginskitae, Kieren Egan, Leonid Churilov, Malcolm R. Macleod, Nicki Sherratt, Rachel Hemblade, Stylianos Serghiou, Theo Hirst, Zsanett Bahor
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Bibliometrics, Experimental Design, Publishing, Research Assessment, Research Quality Assessment, Research Validity, Scientific Publishing, Scientists, Systematic Reviews
Link to resource
These past two years have shown us the increased need and demand for investments in openness across all areas of research and …
Author(s): Kaitlin Thaney
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Open Science, Research Infrastructure
Link to resource
In an attempt to increase the reliability of empirical findings, psychological scientists have recently proposed a number of changes in …
Author(s): Michael D. Lee, Amy H. Criss, Berna Devezer, Christopher Donkin, Alexander Etz, Fábio P. Leite, Dora Matzke, Jeffrey N. Rouder, Jennifer S. Trueblood, Corey N. White & Joachim Vandekerckhove
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Robustness, Cognitive Modeling, Open Science, Reproducibility
Link to resource
Head fixation allows the recording and presentation of controlled stimuli and is used to study neural processes underlying spatial …
Author(s): Xavier Cano-Ferrer, Alexandra Tran-Van-Minh, Ede Rancz
Type of resources: Interactive
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Vestibular, Virtual Reality, Navigation, Sensory Processing, Sensorimotor Processing, Eye Movements, Open Science, Open Hardware
Link to resource
RStudio Cheatsheets
The cheatsheets below make it easy to use some of our favorite packages. Cheatsheets include the following topics: …
Author(s): RStudio
Type of resources: Student Guide
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Inside Your Classroom, Open Scholarship Tools and Technologies, R, Reproducibility, Researchers, RStudio, Workflow Tools
Link to resource
An essential first step in planning a confirmatory or a replication study is to determine the sample size necessary to draw …
Author(s): Marco Perugini, Marcello Gallucci, and Giulio Costantini
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Recent events have led psychologists to acknowledge that the inherent uncertainty encapsulated in an inductive science is amplified by …
Author(s): Daniel Lakens and Ellen R K Evers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The American Psychological Association (APA) Task Force on Statistical Inference was formed in 1996 in response to a growing body of …
Author(s): Jacob M Marszalek, Carolyn Barber, Julie Kohlhart, Cooper B Holmes
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This Shiny app accompanies the paper ‘Sample Size Justification’ by Daniël Lakens. You can download the pre-print of this …
Author(s): Daniël Lakens
Type of resources: Interactive
Primary user(s): Student, Teacher, researcher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Social Science
Tag(s): Sample Size Justification, Study Planning
Link to resource
This review examines recent advances in sample size planning, not only from the perspective of an individual researcher, but also with …
Author(s): Scott E. Maxwell, Ken Kelley and Joseph R. Rausch
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Methods for planning sample size (SS) for the standardized mean difference so that a narrow confidence interval (CI) can be obtained …
Author(s): Ken Kelley 1, Joseph R Rausch
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
The sample size necessary to obtain a desired level of statistical power depends in part on the population value of the effect size, …
Author(s): Anderson, S. F., Kelley, K., & Maxwell, S. E.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This perspective explores the Scientific Reform Movement and its links to scandalized claims, such as ‘science is broken’. It delves …
Author(s): Bart Penders
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science
Tag(s): Scandal, Scientific Reform, Repair, Moral Economy
Link to resource
Functional neuroimaging techniques have transformed our ability to probe the neurobiological basis of behaviour and are increasingly …
Author(s): Russell A. Poldrack, Chris I. Baker, Joke Durnez, Krzysztof J. Gorgolewski, Paul M. Matthews, Marcus R. Munafò, Thomas E. Nichols, Jean-Baptiste Poline, Edward Vul & Tal Yarkoni
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Each year, the Public Knowledge Project* (PKP) posts a very large, and rather dry, dataset at the Harvard Dataverse Project. This open …
Author(s): Mark Huskisson
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Social Science
Tag(s): Diversity, Equity, Inclusion and Accessibility, Infrastructure, Open Access, Technology, Tools
Link to resource
School Psychology is an outlet for research on children, youth, educators, and families that has scientific, practice, and policy …
Author(s): Robin S Codding
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Journal Operations, Equity, Diveristy, Inclusion, Open Science
Link to resource
Cambridge scholar says that lessons on identifying and debunking fake news should be on the national curriculum.
Author(s): Catherine Lough
Type of resources: Reading
Primary user(s): Student
Subject area(s): Education, Social Science
Tag(s): Education, Conspiracy Theories
Link to resource
A podcast about science and pseudoscience
Author(s): London School of Economics and Political Science
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
The Science for Progress Initiative (SfPI) is designed to catalyze scientific research on the scientific process. SfPI’s purpose …
Author(s): Paul Niehaus, Heidi Williams, J-PAL
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Science for Progress Initiative, Scientific Process
Link to resource
If you follow the headlines, your confidence in science may have taken a hit lately. Peer review? More like self-review. An …
Author(s): Christie Aschwanden
Type of resources: Interactive, Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Metascience, Scientific Method, P-values, Science, Health
Link to resource
Fake news or good science? In a world where we have access to unlimited information, it is hard to sift through the echo chamber of …
Author(s): University of Alberta
Type of resources: Full Course
Primary user(s): Student, Parent, Laypeople
Subject area(s): Applied Science, Social Science
Tag(s): Scientific communication
Link to resource
There is no crisis of replication and generalizability in psychological science, only misunderstanding or forgetting the fundamental …
Author(s): Iso-Ahola, S. E.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Crisis, Variability, Generalizability, Replication
Link to resource
The current crisis in psychological research involves issues of fraud, replication, publication bias, and false positive results. I …
Author(s): Giner-Sorolla, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This article uses distributional matching and posterior predictive checks to estimate the extent of false and inflated findings in …
Author(s): BRENT GOLDFARB and ANDREW A. KING
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
n.a.
Author(s): Berna Devezer, Bart Penders
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science
Tag(s): Citation Politics, Oblivion, Preregistration, Replication, Research Quality
Link to resource
An academic scientist’s professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, …
Author(s): Nosek, B. A., Spies, J. R., & Motyl, M.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Existing norms for scientific communication are rooted in anachronistic practices of bygone eras making them needlessly inefficient. We …
Author(s): Brian A. Nosek & Yoav Bar-Anan
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
An academic scientist’s professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, …
Author(s): Brian A. Nosek, Jeffrey R. Spies, Matt Motyl
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Policy, Reproducibility
Link to resource
Replication is vital for increasing precision and accuracy of scientific claims. However, when replications “succeed” or “fail,” they …
Author(s): Charles R. Ebersole, Jordan R. Axt, Brian A. Nosek
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Preregistration is the process of specifying project details, such as hypotheses, data collection procedures, and analytical decisions, …
Author(s): Alexander C. DeHaven, Andrew Hall, Brian Brown, Charles R. Ebersole, Courtney K. Soderberg, David Thomas Mellor, Elliott Kruse, Jerome Olsen, Jessica Kosie, K. D. Valentine, Lorne Campbell, Marjan Bakker, Olmo van den Akker, Pamela Davis-Kean, Rodica I. Damian, Sara J. Weston, Stuart J. Ritchie, Thuy-vy Ngugen, William J. Chopik
Type of resources: Reading
Primary user(s):
Subject area(s): Applied Science
Tag(s): Aging Science, Open Science, Secondary Data Preregistration
Link to resource
Research data sharing has become an expected component of scientific research and scholarly publishing practice over the last few …
Author(s): Lisa R. Johnston, Alicia Hofelich Mohr, Joel Herndon, Shawna Taylor, Jake R. Carlson, Lizhao Ge, Jennifer Moore, Jonathan Petters, Wendy Kozlowski, Cynthia Hudson Vitale
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education
Tag(s): Data Sharing, Data Access, Data Repositiories
Link to resource
We assess statistical power and excess statistical significance among 31 leading economics general interest and field journals using …
Author(s): Zohid Askarov, Anthony Doucouliagos, Hristos Doucouliagos, T D Stanley
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Math & Statistics
Tag(s): Credibility, Economic Journals, Excess Statistical Significance, Experimental Economics, Statistical Power
Link to resource
Objective To evaluate the use of reporting checklists and quality scoring tools for self-reporting purposes in radiomics literature. …
Author(s): Burak Kocak, Tugba Akinci D’Antonoli, Ece Ates Kus, Ali Keles, Ahmet Kala, Fadime Kose, Mehmet Kadioglu, Sila Solak, Seyma Sunman, Zisan Hayriye Temiz
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Radiomics, Research Quality, Self-Reporting, Reporting Checklists, Scoring Tools, Literature Review
Link to resource
Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of …
Author(s): Stefan Schmidt
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The sharing of human neuroimaging data has great potential to accelerate the development of imaging biomarkers in neurological and …
Author(s): Kathrin Giehl, PhD ∙ Henk-Jan Mutsaerts, PhD ∙ Kristien Aarts, PhD ∙ Prof Frederik Barkhof, MD ∙ Prof Svenja Caspers, PhDd ∙ Gaël Chetelat, PhD ∙ Marie-Elisabeth Colin, MSc ∙ Prof Emrah Düzel, MD ∙ Prof Giovanni B Frisoni, MD ∙ Prof M Arfan Ikram, PhD ∙ Prof Jorge Jovicich, PhD ∙ Prof Silvia Morbelli, PhD, ∙ Prof Wolfgang Oertel, MD ∙ Christian Paret, PhD ∙ Prof Daniela Perani, MD ∙ Prof Petra Ritter, PhD ∙ Bàrbara Segura, PhD∙ Laura E M Wisse, PhD ∙ Elke De Witte, PhD ∙ Prof Stefano F Cappa, MD∙ Prof Thilo van Eimeren, MD
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Brain imaging, data sharing
Link to resource
Background Sharing research data provides benefit to the general scientific community, but the benefit is less obvious for the …
Author(s): Douglas B. Fridsma, Heather A. Piwowar, Roger S. Day
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Bibliometrics, Cancers and Neoplasms, Citation Analysis, Clinical Trials (cancer Treatment), Data, Internet, Linear Regression Analysis, Microarrays, Open Data, Scientific Publishing
Link to resource
Medical education has undergone a transformative shift along with the integration of open educational resources (OERs) in recent years. …
Author(s): Stijn A Bos
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Life Science
Tag(s): Medical Education, Open Educational Resources (OER), Project Tulip, Accessibility, Collaboration
Link to resource
Reviewer Zero is a collective founded in 2020 to take concrete, data-driven, anti-racist action to improve the culture of scientific …
Author(s): Framework for Open and Reproducible Research Training
Type of resources: Reading
Primary user(s): Researchers
Subject area(s): Education, Social Science
Tag(s): Peer Review; Publishing; Bias in Peer Review; Diversity, Equity & Inclusion (DEI); Academic Culture Change; Early Career Researchers; Transparency
Link to resource
This blog describes how to plot effect sizes (Cohen’s d) and shade overlapping area with R scripts
Author(s): Kristoffer Magnusson
Type of resources: Reading, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Tutorial
Link to resource
Our field has witnessed a rapid increase in the appeal and prevalence of the short report format over the last two decades. In this …
Author(s): Alison Ledgerwood, Jeffrey W. Sherman
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
There is an ongoing debate regarding preregistration of epidemiologic study protocols. We examine the basic idea that preregistration …
Author(s): Timothy L. Lash, Jan P. Vandenbroucke
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science
Tag(s): Epidemiology, Preregistration
Link to resource
Trust in science increases when scientists and the outlets certifying their work honor science’s norms. Scientists often fail to signal …
Author(s): Kathleen Hall Jamieson, Marcia McNutt, Richard Sever, Veronique Kiermer
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Life Science, Social Science
Tag(s): OSKB
Link to resource
Visual comics about significance testing
Author(s): Randall Munroe
Type of resources: Diagram/Illustration
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Comic
Link to resource
Null-hypothesis significance tests (NHST), properly used, tell us whether we have sufficient evidence to be confident of the sign of …
Author(s): Richard J. Harris
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Collaboration between researchers has become increasingly common, enabling a level of discovery and innovation that is difficult if not …
Author(s): Gerd Gigerenzer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Heuristics, Leadership, Max Plack Institutes, Research Culture, Research Group, Trust
Link to resource
Slides for a talk given at SIPS 2016
Author(s): Sanjay Srivastava
Type of resources: Lecture Slides
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Education, Social Science
Tag(s): Diversity, Open Science, SIPS 2016
Link to resource
This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, …
Author(s): Uri Simonsohn
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This checklist is intended to help scientists, reviewers, and editors prepare and assess manuscripts for inclusion of critical details …
Author(s): ISSCR Task Force for Basic Research Standards
Type of resources: Primary Source, Reading
Primary user(s): Student, Teacher, Librarian, Researcher
Subject area(s): Life Science
Tag(s): Pluripotent Stem Cells, Tissue Stem Cells, Metadata, Culture, Genomic Characterization, Molecular Characterization, Experiment, Data
Link to resource
We report evidence of an undocumented method to manipulate citation counts involving ‘sneaked’ references. Sneaked …
Author(s): Lonni Besançon, Guillaume Cabanac, Cyril Labbé, Alexander Magazinov
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Career and Technical Education
Tag(s): Sneaked References, Undue Citations, Citation Manipulation, Metadata Registration, Bibliometrics, Research Evaluation
Link to resource
I believe that higher education should be focused on developing passionate, critical, independent and creative thought, and the …
Author(s): Jay Van Bavel
Type of resources: Module, Reading
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Materials, Mentoring
Link to resource
Workshop overview for the Data Carpentry Social Sciences curriculum. Data Carpentry’s aim is to teach researchers basic concepts, …
Author(s): Angela Li, Erin Alison Becker, Francois Michonneau, Maneesha Sane, Sarah Brown, Tracy Teal
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Information Science, Measurement and Data, Social Science
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Python, R, Reproducibility, Research Data Management Tools, Researchers, SQL
Link to resource
This workshop will introduce students to the process of reproducing published work. Replicating other scholars’ work is an essential …
Author(s): Nicole Janz
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A paper about social, behavioural economic perspective on reproducible science
Author(s): Cacioppo, J. T., Kaplan, R. M., Krosnick, J. A., Olds, J. L., & Dean, H.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Since 1998, Software Carpentry has been teaching researchers the computing skills they need to get more done in less time and with less …
Author(s): Software Carpentry Community
Type of resources: Full Course
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Analysis, Open Source Software, Reproducibility, Researchers, Version Control, Workflow Tools
Link to resource
Open science is an increasingly important topic for research, politics and funding agencies. However, the discourse on open science is …
Author(s): Jürgen Schneider
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education
Tag(s): Open Science Practices, Profiles, Applicability, Metascience
Link to resource
The older adult population in the U.S. is becoming increasingly diverse across a constellation of factors including ethnoracial group, …
Author(s): Ian M.McDonough, Erin R. Harrell, Sheila R. Black, Rebecca S. Allen, Patricia A. Parmelee
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Health Disparities, Nonreplicability, Replicability, Replication, Subgroup Analyses, Aging, Biases
Link to resource
SPARC is a global coalition committed to making Open the default for research and education. SPARC empowers people to solve big …
Author(s): Nick Shockey
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Funders, Governmental Policies, Librarians, Open Access, Publishers, Publishing, Researchers
Link to resource
Special Issue: Innovation in Aging
Author(s): OSKB Admin
Type of resources: Reading
Primary user(s):
Subject area(s): life-science
Tag(s): Aging Science
Link to resource
SPECIAL ISSUE: PREREGISTERED STUDIES OF PERSONALITY DEVELOPMENT AND AGING USING EXISTING DATA (Volume 76, Issue 1, January 2021)
Author(s): OSKB Admin
Type of resources: Reading
Primary user(s):
Subject area(s): life-science
Tag(s): Aging Science, Research
Link to resource
Phenotyping of model organisms grown on Petri plates is often carried out manually, despite the procedures being time-consuming and …
Author(s): Jonas A. Ohlsson, Jia Xuan Leong, Pernilla H. Elander, Florentine Ballhaus, Sanjana Holla, Adrian N. Dauphinee, Johan Johansson, Mark Lommel, Gero Hofmann, Staffan Betnér, Mats Sandgren, Karin Schumacher, Peter V. Bozhkov, Elena A. Minina
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science
Tag(s): Time-Lapse Imaging, Phenotyping, Arabidopsis Thaliana, Root Growth, Seed Germination, Automated Imaging, Automated Image Analysis, ImageJ Macro, R, Raspberry Pi, 3D Printing, Open Science Hardware, Laboratory Automation, Plant Authophagy, Seed Dormancy, Technical Advance
Link to resource
Springer Nature has introduced a new unified open code policy for its books and journals portfolios. The policy compliments the …
Author(s):
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Physical Science
Tag(s): Springer Nature, Open Science, Open Code Policy
Link to resource
A video about open science, pre-registration etc.
Author(s): Society for Social and Personality Psychology
Type of resources: Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video, Reproducibility Knowledge
Link to resource
A website detailing spurious correlations
Author(s): Tyler Vigen
Type of resources: Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Math & Statistics, Social Science
Tag(s): Website
Link to resource
Across the social sciences, growing concerns about research transparency have led to calls for pre-analysis plans (PAPs) that specify …
Author(s): Winston Lin and Donald P.Green
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Using 50,000 tests published in the AER, JPE, and QJE, we identify a residual in the distribution of tests that cannot be explained …
Author(s): Sangnier, M., & Zylberberg, Y.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This site is about everything that comes up during data analysis except for statistical modelling and inference. This might strike you …
Author(s): Jenny Bryan
Type of resources: Reading, Student Guide, Tutorial
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Tutorial
Link to resource
statcheck is a program that checks for errors in statistical reporting in APA-formatted documents. It was originally written in the R …
Author(s): Michele B. Nuijten, Sacha Epskamp
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility, Researchers, Software, Workflow Tools
Link to resource
Purpose This study has been focused on assessing the Open Science scenario of cancer research during the period 2011–2021, in terms of …
Author(s): Cristina Rius, Yiming Liu, Andrea Sixto-Costoya, Juan Carlos Valderrama-Zurián & Rut Lucas-Dominguez
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Cancer Research, Open Science, Open Access, Data Sharing, Scientific Impact
Link to resource
This article attempts to practicalise Open Science (OS) to promote ideas and enhance efforts for the Sustainable Development Goals …
Author(s): Boon-How Chew, Lauren Maxwell, Felix Emeka Anyiam, Aziza Menouni, Tonni Agustiono Kurniawan, Kangbéni Dimobe, Til Prasad Pangali Sharma, Gomaa A. M. Ali, Ram Devi Tachamo Shah, Rabia Saleem, Mohamed Majeed Mashroofa, Maha Nasr, Babar Abbas, Anjana J. Atapattu, Mohamed Mahmoud, Nidhi Singh, Mizanur Rahman Sarker
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Life Science, Physical Science
Tag(s): Open Science, Sustainable Development Goals, Policymaking, Research, Innovations, Public Engagement
Link to resource
P values, the ‘gold standard’ of statistical validity, are not as reliable as many scientists assume.
Author(s): Nuzzo, R.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Interpreting statistical data as evidence, Statistical Evidence: A Likelihood Paradigm focuses on the law of likelihood, fundamental to …
Author(s): Richard Royall
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Book
Link to resource
A statistics book and tutorial about statistics
Author(s): Dr Matt Crump
Type of resources: Data Set, Full Course, Lecture, Lecture Notes, Lesson, Lesson Plan, Module, Reading, Student Guide, Syllabus, Teaching/Learning Strategy, Tutorial, Textbook
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Statistical Book, Tutorial
Link to resource
In the light of continuing debate over the applications of significance testing in psychology journals and following the publication of …
Author(s): Wilkinson, L., & Task Force on Statistical Inference, American Psychological Association, Science Directorate.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A blog about statistics and open science
Author(s): Andrew Gelman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Reproducibility Knowledge
Link to resource
A paper about statistical power
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Researchers designing experiments in which a sample of participants responds to a sample of stimuli are faced with difficult questions …
Author(s): Jacob Westfall, David A Kenny, Charles M Judd
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The purpose of this study is to determine how well contemporary management research fares on the issue of statistical power with regard …
Author(s): Luke H. Cashen, Scott W. Geiger
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This paper discusses the need and importance of statistical power analysis in field-based empirical research in Production and …
Author(s): Rohit Verma and John C. Goodale
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Power was calculated for 6,155 statistical tests in 221 journal articles published in the 1982 volumes of the Journal of Abnormal …
Author(s): J S Rossi
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Due to the increasing importance of moderating (i.e., interaction) effects, the use of moderated multiple regression (MMR) has become …
Author(s): Herman Aguinis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Objective. —To describe the pattern over time in the level of statistical power and the reporting of sample size calculations in …
Author(s): David Moher, MSc; Corinne S. Dulberg, PhD, MPH; George A. Wells, PhD
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Justification, in the vernacular language of philosophy of science, refers to the evaluation, defense, and confirmation of claims of …
Author(s): Rosnow, R.L., & Rosenthal, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Statistical analysis is error prone. A best practice for researchers using statistics would therefore be to share data among …
Author(s): Coosje L. S. Veldkamp, 1, * Michèle B. Nuijten, Linda Dominguez-Alvarez, Marcel A. L. M. van Assen, and Jelte M. Wicherts
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
A video about Statistical Rethinking: A Bayesian Course with R
Author(s): Richard McElreath
Type of resources: Lecture, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Video, Bayesian
Link to resource
In light of recent concerns about reproducibility and replicability, the ASA issued a Statement on Statistical Significance and …
Author(s): Blakeley B. McShane & David Gal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
MOST THEORIES IN THE AREAS OF PERSONALITY, CLINICAL, AND SOCIAL PSYCHOLOGY PREDICT ONLY THE DIRECTION OF A CORRELATION, GROUP …
Author(s): Lykken
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Data analysis methods in psychology still emphasize statistical significance testing, despite numerous articles demonstrating its …
Author(s): F.L. Schmidt
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Misinterpretation and abuse of statistical tests, confidence intervals, and statistical power have been decried for decades, yet remain …
Author(s): Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The goal of this repository is to index and host short videos that can be used to supplement the teaching of introductory statistics …
Author(s): Jessica Kay Flake
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Quantitative Methods, Statistics
Link to resource
About Stats of DOOM
Support Statistics of DOOM! This page and the YouTube channel to help people learn statistics by including …
Author(s): Erin M. Buchanan
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Educators, Open Education, Researchers, Statistics
Link to resource
This webinar will introduce the integration of JASP Statistical Software ( https://jasp-stats.org/) with the Open Science Framework …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, JASP, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers, Statistics
Link to resource
A podcast about stereotype threat and replication
Author(s): Simon Adler, Amanda Aronczyk and Dan Engber
Type of resources: Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
certain systematic methods of scientific thinking may produce much more rapid progress than others.
Author(s): John R Platt
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Study preregistration promotes transparency in scientific research by making a clear distinction between a priori and post hoc …
Author(s): Allison A. Toth, George C. Banks, David Mellor, Ernest H. O’Boyle, Ashleigh Dickson, Daniel J. Davis, Alex DeHaven, Jaime Bochantin & Jared Borns
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Preregistration, Open Science, Reproducibility, Questionable Research Practices, Methodology
Link to resource
Openness in research can lead to greater reproducibility, an accelerated pace of discovery, and decreased redundancy of effort. In …
Author(s):
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Reproducability, Research
Link to resource
A criterion for high quality science is to produce findings that are robust and replicable across studies. A potential hinderance to …
Author(s): Tabea Springstein, Claire M. Growney, Tammy English
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Robustness, Adult Emotional Development, Context, Sociocultural, Socioeconomic
Link to resource
An estimated 82–89% of ecological research and 85% of medical research has limited or no value to the end user because of various …
Author(s): Marija Purgar, Paul Glasziou, Tin Klanjscek, Shinichi Nakagawa, Antica Culina
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Ecology, Registration
Link to resource
Research suffers from many inefficiencies. These lead to much research being avoidably wasted, with no or limited value to the end user …
Author(s): Marija Purgar, Paul Glasziou, Tin Klanjscek, Shinichi Nakagawa, Antica Culina
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Ecology, Preregistration
Link to resource
This month, we launch a new collection of pieces that highlight ways to improve doctoral education and support graduate student …
Author(s): Editors Nature Reviews Psychology
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Psychology, Scientific Community
Link to resource
The application of statistics to science is not a neutral act. Statistical tools have shaped and were also shaped by its objects. In …
Author(s): Gerd Gigerenzer and Julian N. Marewski
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Swirl teaches you R programming and data science interactively, at your own pace, and right in the R console!
Author(s): Anon
Type of resources: Activity/Lab, Homework/Assignment, Student Guide, Teaching/Learning Strategy, Tutorial
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics
Tag(s): Tutorial
Link to resource
The Qualitative Open Science symposium, organised on the 28th of March 2025 at the Vrije Universiteit Amsterdam featured plenaries and …
Author(s): Bogdana Huma
Type of resources: Lecture
Primary user(s): Researcher
Subject area(s): Arts and Humanities, Social Science
Tag(s): Qualitative, FAIR, Symposium, Data Sharing, Transparency
Link to resource
Background The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias …
Author(s): Carrol Gamble, Jamie J. Kirkham, Kerry Dwan, Paula R. Williamson
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Clinical Trials, Drug Discovery, Meta-analysis, Peer Review, Publication Ethics, Publishing, Questionnaires, Research Funding, Scientific Publishing
Link to resource
When used together, systematic review methods and meta-analysis can produce comprehensive, accurate, and useful summaries of empirical …
Author(s): Valentine, J. C., Littell, J. H., & Young, S.
Type of resources: Full Course
Primary user(s): Student
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Systematic Review, Meta-Analysis
Link to resource
A book about the credibility revolution
Author(s): Gilad Feldman
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Credibility revolution
Link to resource
Objetivo: revisar as terminologias e aplicações da taxonomia de Ciência Aberta para a construção de uma versão mais abrangente, que …
Author(s): Lúcia da Silveira, Nivaldo Calixto Ribeiro, Remedios Melero, Andrea Mora-Campos, Daniel Fernando Piraquive-Piraquive, Alejandro Uribe-Tirado, Priscila Machado Borges Sena, Jorge Polanco-Cortés, Julio Santillán-Aldana, Fabiano Couto Corrêa da Silva, Ronaldo Ferreira Araújo, Andrés Mauricio Enciso-Betancourt, Juliana Fachin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Math & Statistics, Physical Science
Tag(s): Ciência Aberta - Taxonomia, Comunicação Científica, Representação do Conhecimento, Unesco
Link to resource
A syllabi about mentoring and teaching open science
Author(s): Matthew Kim, Adrienne D. Woods, Alexa Ellis and Pamela Davis-Kean
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, …
Author(s): Madeleine Pownall, Flávio Azevedo, Laura M. König, Hannah R. Slack, Thomas Rhys Evans, Zoe Flack, Sandra Grinschgl, Mahmoud M. Elsherif, Katie A. Gilligan-Lee, Catia M. F. de Oliveira, Biljana Gjoneska, Tamara Kalandadze, Katherine Button, Sarah Ashcroft-Jones, Jenny Terry, Nihan Albayrak-Aydemir, Filip Děchtěrenko, Shilaan Alzahawi, Bradley J. Baker, Merle-Marie Pittelkow, Lydia Riedl, Kathleen Schmidt, Charlotte R. Pennington, John J. Shaw, Timo Lüke, Matthew C. Makel, Helena Hartmann, Mirela Zaneva, Daniel Walker, Steven Verheyen, Daniel Cox, Jennifer Mattschey, Tom Gallagher-Mitchell, Peter Branney, Yanna Weisberg, Kamil Izydorczak, Ali H. Al-Hoorie, Ann-Marie Creaven, Suzanne L. K. Stewart, Kai Krautter, Karen Matvienko-Sikar, Samuel J. Westwood, Patrícia Arriaga, Meng Liu, Myriam A. Baum, Tobias Wingen, Robert M. Ross, Aoife O'Mahony, Agata Bochynska, Michelle Jamieson, Myrthe Vel Tromp, Siu Kit Yeung, Martin R. Vasilev, Amélie Gourdon-Kanhukamwe, Leticia Micheli, Markus Konkol, David Moreau, James E. Bartlett, Kait Clark, Gwen Brekelmans, Theofilos Gkinopoulos, Samantha L. Tyler, Jan Philipp Röer, Zlatomira G. Ilchovska, Christopher R. Madan, Olly Robertson, Bethan J. Iley, Samuel Guay, Martina Sladekova, Shanu Sadhwani and FORRT
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education
Tag(s): Pedagogy; Higher Education; Graduate Education; Teaching Practices; Open Scholarship; Reproducible Scholarship
Link to resource
A collection of activities to teach APA writing and statistics
Author(s): Lewandowski, Jr., Ciarocco and Strohmetz
Type of resources: Activity/Lab, Asssessment
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
Participants will develop materials for teaching replicability and reproducible science. Possible materials to be generated include …
Author(s): Kirsten Lane et al.
Type of resources: Module, Teaching/Learning Strategy
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Teaching
Link to resource
Replication is held as the gold standard for ensuring the reliability of published scientific literature. But conducting direct …
Author(s): Michael C. Frank and Rebecca Saxe
Type of resources: Primary Source, Reading, Paper
Primary user(s): Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution
Link to resource
This symposium explores the “replication crisis” from the perspective of teachers and students. Presenters will describe the major …
Author(s): Bradford Wiggins
Type of resources: Lecture, Lecture Notes, Syllabus
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): OSF Project
Link to resource
Replicating published studies promotes active learning of quantitative research skills. Drawing on experiences from a replication …
Author(s): Dragana Stojmenovska, Thijs Bol, and Thomas Leopold
Type of resources: Case Study, Reading, Teaching/Learning Strategy
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Teaching, Mentoring, Quantitative
Link to resource
An excel spreadsheet about collection of open science items
Author(s): Courtney Soderberg
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Knowledge
Link to resource
Psychological science is in the midst of a “credibility crisis” in which its practitioners re-examine their practices and re-define …
Author(s): Patrick Forscher & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Full Course, Lecture, Lesson, Module, Reading, Syllabus, Teaching/Learning Strategy, Unit of Study, Workshop
Primary user(s): Teacher
Subject area(s): Education, Social Science
Tag(s): Replication; Credibility Crisis; Psychology; Research Methods; Resource Planning; Preregistration; Teaching; Workshop
Link to resource
This team is responsible for discussing how open scholarship can be used to support the neurodiversity movement and enhance connections …
Author(s): Framework for Open and Reproducible Research Training
Type of resources: Reading, Research Team
Primary user(s): Student, Teacher, Administrator, Parent, Librarian
Subject area(s): Applied Science
Tag(s): Neurodiversity
Link to resource
If you can answer these TEN questions you will have built the engine of a Stage 1 Registered Report.
Author(s): Chris Chambers
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Funders, Librarians, Open Scholarship Guidelines, Publishers, Publishing, Researchers
Link to resource
Research data is accumulating rapidly and with it the challenge of fully reproducible science. As a consequence, implementation of …
Author(s): Casper de Visser, Lennart F. Johansson, Purva Kulkarni, Hailiang Mei, Pieter Neerincx, K. Joeri van der Velde, Péter Horvatovich, Alain J. van Gool, Morris A. Swertz, Peter A. C. ‘t Hoen, Anna Niehues
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian, researcher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Computer Software, Metadata, Source Code, Programming Languages, Reproducibility, Data Management, Research Design, Software Tools
Link to resource
A paper about Ten Simple Rules for Effective Statistical Practice
Author(s): Robert E.Kass et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Inclusion at academic events is facing increased scrutiny as the communities these events serve raise their expectations for who can …
Author(s): Siobhan Mackenzie Hall, Daniel Kochin, Carmel Carne, Patricia Herterich, Kristen Lenay Lewers, Mohamed Abdelhack, Arun Ramasubramanian, Juno Felecia Michael Alphonse, Visotheary Ung, Sara El-Gebali, Christopher Brian Currin, Esther Plomp, Rachel Thompson, Malvika Sharan
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Inclusion, Academic Events, Diversity, Equity
Link to resource
Replication is the cornerstone of a cumulative science. However, new tools and technologies, massive amounts of data, interdisciplinary …
Author(s): Anton Nekrutenko, Eivind Hovig, Geir Kjetil Sandve, James Taylor
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Archives, Computer and Information Sciences, Computer Applications, Data, Habits, Replication Studies, Reproducibility, Sequence Analysis, Source Code
Link to resource
A paper about ten Simple Rules for the Care and Feeding of Scientific Data
Author(s): Goodman, Alyssa, et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The scientific community has long recognized the benefits of open science. Today, governments and research agencies worldwide are …
Author(s): Nicolás Alessandroni & Krista Byers-Heinlein
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Science, Research Practices, Research Policies, Research Culture, Reproducibility
Link to resource
The scientific community has long recognized the benefits of open science. Today, governments and research agencies worldwide are …
Author(s): Nicolás Alessandroni, Krista Byers-Heinlein
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Science, Research Practices, Research Policies, Research Culture, Reproducibility
Link to resource
The scientific community has long recognized the benefits of open science. Today, governments and research agencies worldwide are …
Author(s): Nicolás Alessandroni, Krista Byers-Heinlein and Katie Corker
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Science, Research Practices, Research Policies, Research Culture, Reproducibility
Link to resource
A core problem that has been addressed in the scientific reform movement so far is the low rates of reproducibility of research …
Author(s): Erkan O. Buzbas and Berna Devezer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Social Science
Tag(s): Formal Theory, Replication, Reproducibility, Meta-Hypothesis, Multi-site Replications, Sceintific Reform
Link to resource
A core problem that has been addressed in the scientific reform movement so far is the low rates of reproducibility of research …
Author(s): Erkan O. Buzbas and Berna Devezer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science
Tag(s): Formal theory, Replication, Reproducibility, Meta-hypothesis, Multi-site replications, Scientific Reform
Link to resource
In order to study the prevalence, nature (direction), and causes of reporting errors in psychology, we checked the consistency of …
Author(s): Marjan Bakker & Jelte M. Wicherts
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
Depression severity is assessed in numerous research disciplines, ranging from the social sciences to genetics, and used as a dependent …
Author(s): Eiko I.Fried
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Open Science seeks to make research processes and outputs more accessible, transparent, and inclusive, ensuring that scientific …
Author(s): Thomas Klebel, Vincent Traag, Ioanna Grypari, Lennart Stoy, and Tony Ross-Hellauer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Career and Technical Education, Education, Social Science
Tag(s): Open Science, Scoping Review, Open Science Aims
Link to resource
A post that describes significance values
Author(s): Dorothy Bishop
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Education, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Reproducibility Crisis and Credibility Revolution
Link to resource
The many criticisms of null hypothesis testing suggest when it is not useful and what is should not be used for. This article explores …
Author(s): R.W. Frick
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics
Tag(s):
Link to resource
An editorial about p value
Author(s): Ronald L. Wasserstein & Nicole A. Lazar
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Science studies scholars have shown that the management of natural complexity in lab settings is accomplished through a mixture of …
Author(s): David Peterson
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In this episode JP and Alex interview Zoltan Dienes. They discuss Zoltan’s passion for the martial arts, why Bayesian inference …
Author(s): Prof. JP De Ruiter
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Podcast
Link to resource
Blog about Bayesfactor and statistics
Author(s): Richard Morey
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
An abstract about bayesian reproducibility project
Author(s): Alexander Etz
Type of resources: Data Set, Reading, Simulation, R code
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Blog, R code
Link to resource
Practices that introduce systematic bias are common in most scientific disciplines, including toxicology. Selective reporting of …
Author(s): Daniel Lakens, Cristian Mesquida, Sajedeh Rasti, and Massimiliano Ditroilo
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Preregistration, Registered Reports, Severity
Link to resource
Preregistration is an open science practice that requires the specification of research hypotheses and analysis plans before the data …
Author(s): Daniela Mertzen, Sol Lago, Shravan Vasishth
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Preregistration, Open Science, Bilingualism, Psycholinguistics, Confirmatory Analysis, Exploratory Analysis
Link to resource
Three psychologists talk about doing science. Hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire.
Author(s): Sanjay Srivastava, Alexa Tullett, and Simine Vazire
Type of resources: Student Guide, Unit of Study, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
We have written about a few of the open science practices, some of which are becoming the norm, such as preregistration (and whether it …
Author(s): Christina Bergmann
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Advice, Buffet Approach, Open Science
Link to resource
In recent years the use of traditional statistical methods in educational research has increasingly come under attack. In this article, …
Author(s): Ronald P Carver
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Current attempts at methodological reform in sciences come in response to an overall lack of rigor in methodological and scientific …
Author(s): Berna Devezer, Danielle J. Navarro, Joachim Vandekerckhove, Erkan Ozge Buzbas
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Double-dipping, Exploratory Research, Replication, Scientific Reform, Reproducibility
Link to resource
Peer review is broken. Reviewer comments often lack constructiveness, clarity, and consistency. For decades, educational scholarship …
Author(s): Madeleine Pownall
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Peer Review, Open Science
Link to resource
‘Open Science’ advocates for open access to scientific research, as well as sharing data, analysis plans and code in order to enable …
Author(s): Danielle Lamb, Amy Russel, Nicola Morant, Fiona Stevenson
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Epistemology, Methodology, Open Science, Qualitative Methods, Quantitative Methods
Link to resource
‘Open Science’ advocates for open access to scientific research, as well as sharing data, analysis plans and code in order to enable …
Author(s): Danielle Lamb, Amy Russell, Nicola Morant, and Fiona Stevenson
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Epistemology, Methodology, Open Science, Qualitative Methods, Quantitative Methods
Link to resource
Open Science is becoming a mainstream scientific ideology in psychology and related fields. However, researchers, especially …
Author(s): Haiyang Jin, Qing Wang, Yu-Fang Yang, Han Zhang, Mengyu (Miranda) Gao, Shuxian Jin, Yanxiu (Sharon) Chen, Ting Xu, Yuan-Rui Zheng, Ji Chen, Qinyu Xiao, Jinbiao Yang, Xindi Wang, Haiyang Geng, Jianqiao Ge, Wei-Wei Wang, Xi Chen, Lei Zhang, Xi-Nian Zuo, Hu Chuan-Peng
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Open Science, Grassroots Network, Non-WEIRD, Chinese, Equity-Diversity-Inclusion (EDI)
Link to resource
The issue of a published literature not representative of the population of research is most often discussed in terms of entire studies …
Author(s): Ernest Hugh O’Boyle, Jr., George Christopher Banks, Erik Gonzalez-Mulé
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Efforts to make research results open and reproducible are increasingly reflected by journal policies encouraging or mandating authors …
Author(s): Barbara McGillivray, Giovanni Colavizza, Iain Hrynaszkiewicz, Isla Staden, Kirstie Whitaker
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Life Science, Social Science
Tag(s): Computer Science, Data, Data Sharing, Digital Libraries, Policy, Publishing, Reproducibility
Link to resource
BACKGROUND The ClinicalTrials.gov trial registry was expanded in 2008 to include a database for reporting summary results. We summarize …
Author(s): Deborah A. Zarin, Tony Tse, Rebecca J. Williams, Robert M. Califf, Nicholas C. Ide
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Clinical Trials, Registry, Clinical Research
Link to resource
Research funding systems fundamentally influence how science operates. This paper aims to analyze the allocation of competitive …
Author(s): Gerald Schweiger, Adrian Barnett, Peter van den Besselaar, Lutz Bornmann, Andreas De Block, John P. A. Ioannidis, Ulf Sandström, Stijn Conix
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Career and Technical Education, Education, Social Science
Tag(s): Science of Science, Research Funding, Funding Decision Processes, Competitive Funding
Link to resource
Kerr ([1998]) coined the term ‘HARKing’ to refer to the practice of ‘hypothesizing after the results are known’. This questionable …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration
Link to resource
Notes that social psychologists’ early enthusiasm has been replaced by serious doubts about the future of their field. …
Author(s): A.C. Elms
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Evidence-based medicine is the cornerstone of clinical practice, but it is dependent on the quality of evidence upon which it is based. …
Author(s): A. M. Roest, J. A. Bastiaansen, M. R. Munafò, P. Cuijpers, P. de Jonge, Y. A. de Vries
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Antidepressants, Bias, Citation Bias, Depression, Psychotherapy, Reporting Bias
Link to resource
When considering any statistical tool I think it is useful to answer the following two practical questions: 1. “Does it give …
Author(s): Uri Simonsohn
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog
Link to resource
The widespread use of ‘statistical significance’ as a license for making a claim of a scientific finding leads to considerable …
Author(s): Fränzi Korner-Nievergelt, Tobias Roth, Valentin Amrhein
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Statistics and Probability
Tag(s): Analysis, Data, Reproducibility, Statistics
Link to resource
After 4 decades of severe criticism, the ritual of null hypothesis significance testing (mechanical dichotomous decisions around a …
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Low reproducibility rates within life science research undermine cumulative knowledge production and contribute to both delays and …
Author(s): Iain M. Cockburn, Leonard P. Freedman, Timothy S. Simcoe
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Drug Discovery, Drug Research and Development, Drug Therapy, Economics, Finance, Internet, Peer Review, Reproducibility
Link to resource
A growing body of research has suggested that horizontal saccadic eye movements facilitate the retrieval of episodic memories in free …
Author(s): Matzke et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
The crisis of confidence has undermined the trust that researchers place in the findings of their peers. In order to increase trust in …
Author(s): Sarahanne M. Field, E.-J. Wagenmakers, Henk A. L. Kiers, Rink Hoekstra, Anja F. Ernst, Don van Ravenzwaaij
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Registered Reporting, Trustworthiness, Questionable Research Practice
Link to resource
To increase transparency in science, some scholarly journals are publishing peer review reports. But it is unclear how this practice …
Author(s): Bahar Mehmani, Emilia López-Iñesta, Flaminio Squazzoni, Francisco Grimaldo, Giangiacomo Bravo
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Peer Review, Publishing
Link to resource
Most discussions of rigor and replication focus on empirical practices (methods used to collect and analyze data). Typically overlooked …
Author(s): Mark Schaller
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Psychology has been criticized recently for a range of research quality issues. The current article organizes these problems around the …
Author(s): Matthew Makel
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Publication bias is the tendency on the parts of investigators, reviewers, and editors to submit or accept manuscripts for publication …
Author(s): Kay Dickersin
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A few years back, a famous psychologist published a series of studies that found people could predict the future — not all the time, …
Author(s): Planet Money
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
A focus on novel, confirmatory, and statistically significant results leads to substantial bias in the scientific literature. One type …
Author(s): Head, M. L., Holman, L., Lanfear, R., Kahn, A. T., & Jennions, M. D.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
The reliability and reproducibility of science are under scrutiny. However, a major cause of this lack of repeatability is not being …
Author(s): Lewis G Halsey, Douglas Curran-Everett, Sarah L Vowler & Gordon B Drummond
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
For any given research area, one cannot tell how many studies have been conducted but never reported. The extreme view of the …
Author(s): R.Rosenthal
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Recent controversies have questioned the quality of scientific practice in the field of psychology, but these concerns are often based …
Author(s): Gregory Francis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Data-dependent analysis—a “garden of forking paths”— explains why many statistically significant comparisons don’t hold up.
Author(s): Andrew Gelman and Eric Loken
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A syllabi used for general linear model
Author(s): Patrick S. Forscher
Type of resources: Syllabus
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Statistics
Link to resource
Survey experiments have become a central methodology across the social sciences. Researchers can combine experiments’ causal power with …
Author(s): Kevin J. Mullinix et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The GO FAIR Foundation’s FAIR Capacity Building Programme provides professional and qualified training for data stewards who …
Author(s): Schultes, Erik Magagna, Barbara
Type of resources: Reading
Primary user(s): Administrator, Librarian
Subject area(s): Career and Technical Education
Tag(s): FAIR, data, metadata
Link to resource
We present a simple mathematical technique that we call granularity-related inconsistency of means (GRIM) for verifying the summary …
Author(s): Nicholas J. L. Brown, James A. J. Heathers
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Blogposts about psychology, reproducibility, replication etc.
Author(s): Sanjay Srivastava
Type of resources: Reading
Primary user(s): Student, Researcher
Subject area(s): Math & Statistics, Social Science
Tag(s): Blog, Reproducibility Knowledge
Link to resource
Three historical episodes in which the application of null hypothesis significance testing (NHST) led to the mis-interpretation of data …
Author(s): Ezra Hauer
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s):
Link to resource
From January 2014, Psychological Science introduced new submission guidelines that encouraged the use of effect sizes, estimation, and …
Author(s): David Giofrè, Geoff Cumming, Ingrid Boedker, Luca Fresc, Patrizio Tressoldi
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Data, Data Management, Experimental Psychology, Meta-analysis, Open Data, Open Science, Peer Review, Publishing, Research Reporting Guidelines, Scientific Publishing
Link to resource
It is acknowledged that conducting open research requires additional time and effort compared to conducting ‘closed’ research. However, …
Author(s): Thomas J. Hostler
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Academic Capitalism, Workload, Burnout, Administrative Burden, Open Research
Link to resource
It is acknowledged that conducting open research requires additional time and effort compared to conducting ‘closed’ research. However, …
Author(s): Thomas J. Hostler
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science
Tag(s): Academic Capitalism, Workload, Burnout, Administrative Burden, Open Research
Link to resource
Cohen (1962) pointed out the importance of statistical power for psychology as a science, but statistical power of studies has not …
Author(s): Schimmack U
Type of resources: Primary Source, Reading, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Open science refers to a set of practices that aim to make scientific research more transparent, accessible, and reproducible, …
Author(s): Charlotte Eben, Beáta Böthe, Damien Brevers, Luke Clark, Joshua B Grubbs, Robert Heirene, Anja Kräplin, Karol Lewczuk, Lucas Palmer, José C Perales, Jan Peters, Ruth van Holst, Joël Billieux
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Behavioural Addiction, Open Science, Reproducibility, Gambling, Gaming
Link to resource
The scientific reform movement has proposed openness as a potential remedy to the putative reproducibility or replication crisis. …
Author(s): Erkan O. Buzbas, Berna Devezer and Bert Baumgaertner
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science
Tag(s): Reproducibility, Replication, Open Science, Metascience, Experiment, Statistical Theory
Link to resource
Adrianus Dingeman de Groot (1914-2006) was one of the most influential Dutch psychologists. He became famous for his work …
Author(s): De Groot, A. D. translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han LJ van der Maas
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
Effect sizes are the currency of psychological research. They quantify the results of a study to answer the research question and are …
Author(s): Marcus A. Schwarz, Thomas Schäfer
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Cohen, Effect Size, Power, Publication Bias, Replicability, Replication, Sample Size
Link to resource
Course on computer sciences skills needed for all scientific research
Author(s): MIT
Type of resources: Full Course
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Career and Technical Education, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Computer Sciences
Link to resource
The authors evaluate the quality of research reported in major journals in social-personality psychology by ranking those journals with …
Author(s): R. Chris Fraley, Simine Vazire
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Poor research design and data analysis encourage false-positive findings. Such poor methods persist despite perennial calls for …
Author(s): Smaldino, P. E., & McElreath, R.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Survey researchers take great care to measure respondents’ answers in an unbiased way; but, how successful are we as a field at …
Author(s): Sebastian Lundmark, John Protzko, Marcus Weissenbilder
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Replication, Public Opinion
Link to resource
The relevance of science diplomacy and open science in today’s world is undeniable. Science diplomacy enables countries to …
Author(s): Reina Camacho Toro, Luz M. Cumba Garcia, Laura A. Galvis, Luisa F. Echeverría-King, , Branislav Pantović, Claudia Alarcn-Lpez, Vernica Rossana Suarez, Pedro Figueroa, Ivonne Torres-Atencio, Claudia Widmaier, Tatiana Rodrigues Fraga, Susan Benavides
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science
Tag(s): Open science, science diplomacy
Link to resource
A video about Confidence Intervals, NHST, and p Values
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Video
Link to resource
A video about effect sizes and confidence intervals
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics, Social Science
Tag(s): Video
Link to resource
A video about meta analysis and meta-analytical thinking
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s): Video
Link to resource
A video about power analysis and precision
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics
Tag(s): Video
Link to resource
A video about Research Integrity & the New Statistics
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Video, Reproducibility Knowledge
Link to resource
A video about New statistics in action
Author(s): Psychological Science/Geoff Cumming
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video
Link to resource
We need to make substantial changes to how we conduct research. First, in response to heightened concern that our published research …
Author(s): Geoff Cumming
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
A chapter about null hypothesis significance testing in personality research
Author(s): R. Chris Fraley and Michael J. Marks
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A chapter about significance testing
Author(s): Gerd Gigerenzer, Stefan Krauss, and Oliver Vitouch
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
Curated resources that support scientific research often go out of date or become inaccessible. This can happen for several reasons …
Author(s): Charles Tapley Hoyt & Benjamin M. Gyori
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Curated Resources, Funding, Guidelines
Link to resource
Open science reduces waste and accelerates the discovery of knowledge, solutions, and cures for the world’s most pressing needs. …
Author(s):
Type of resources: Lecture
Primary user(s):
Subject area(s): Education
Tag(s): Center for Open Science, Open Science, Open Science Framework, Open Science Research Lifecycle, OSF, Reproducibility, Research, Research Best Practices, Research Integrity, Research Lifecycle, Research Rigor, Research Transparency
Link to resource
I have been the Data Curation Librarian at University of Tennessee, Knoxville, Libraries since 2013. During this time, I have helped …
Author(s): Christopher Eaker & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Full Course, Lecture, Module, Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education
Tag(s): Open Research; FAIR Data Principles; Open Access; Reproducibility; Open Educational Resources (OER); Data & Software; Citizen Science; Open Peer Review; Open Policies
Link to resource
A collection about open science
Author(s): Sonja Bezjak, Philipp Conzett, Pedro L. Fernandes, Edit Görögh, Kerstin Helbig, Bianca Kramer, Ignasi Labastida, Kyle Niemeyer, Fotis Psomopoulos, Tony Ross-Hellauer, René Schneider, Jon Tennant, Ellen Verbakel
Type of resources: Activity/Lab, Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
A group of fourteen authors came together in February 2018 at the TIB (German National Library of Science and Technology) in Hannover …
Author(s): Sonja Bezjak, Philipp Conzett, Pedro L. Fernandes, Edit Görögh, Kerstin Helbig, Bianca Kramer, Ignasi, Labastida, Kyle Niemeyer, Fotis Psomopoulos, Tony Ross-Hellauer, René Schneider, Jon Tennant, Ellen Verbakel, April Clyburne-Sherin, Helene Brinken, Lambert Heller
Type of resources: Reading, Handbook
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Education, Social Science
Tag(s): Open Science Handbook
Link to resource
If you have educational material that you think will do a better job at preventing p-value misconceptions than the material in my MOOC, …
Author(s): Daniel Lakens
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Teaching
Link to resource
PaPOR TRaIL is a freely available online course that was developed with students and research supervisors and funded by a National …
Author(s): Karen Matvienko-Sikar & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Full Course
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education
Tag(s): Open Educational Resources (OER); Research Training; Higher Education; Undergraduate Research; Graduate Research; Research Integrity; Pre-registration; Data Management; Reproducibility; Open Reporting; Knowledge Dissemination
Link to resource
Registered Reports are a form of empirical publication in which study proposals are peer reviewed and pre-accepted before research is …
Author(s): Christopher D. Chambers, Loukia Tzavella
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Culture, Publishing
Link to resource
Openness is one of the central values of science. Open scientific practices such as sharing data, materials and analysis scripts …
Author(s): Richard Morey et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Transparency, Peer-Review
Link to resource
Underpowered studies persist in the psychological literature. This article examines reasons for their persistence and the effects on …
Author(s): S.E. Maxwell
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which …
Author(s): Martin Schweinsberg et al.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The origin of the present comment lies in a failed attempt to obtain, through e-mailed requests, data reported in 141 empirical …
Author(s): Wicherts, Jelte M., Borsboom, Denny, Kats, Judith, Molenaar, Dylan
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The syntax or codes used to fit Structural Equation Models (SEMs) convey valuable information on model specifications and the manner in …
Author(s): Jelte M. Wicherts and Elise A. V. Crompvoets
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Many studies show that open access (OA) articles—articles from scholarly journals made freely available to readers without requiring …
Author(s): Jim Ottaviani
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Careers, Citation Analysis, Institutional Repositories, Medicine and Health Sciences, Open Access Publishing, Peer Review, Physical Sciences, Scientific Publishing
Link to resource
Recent advances in open neuroimaging data are enhancing our comprehension of neuropsychiatric disorders. By pooling images from various …
Author(s): Bin Lu, Xiao Chen, Francisco Xavier Castellanos, Paul M Thompson, Xi-Nian Zuo, Yu-Feng Zang, Chao-Gan Yan
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Magnetic Resonance Imaging, Neuropsychiatric Disorders, Big Data, Open Science, Artificial Intelligence
Link to resource
This video shows interested researchers how to get started on their own preregistration as part of the Preregistration Challenge. Learn …
Author(s):
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Analysis Plan, Arnold Foundation, Bias, Center for Open Science, Cos, Data, OSF, Preregistration, Preregistration Challenge, Reproducibility, Research, Research Planning
Link to resource
I discuss Van Drimmelen’s (2023) Metascience2023 presentation on researchers’ decision making during the research process. In …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Metaresearch, Metascience, Open Science, Preregistration, Questionable Metascience Practices, Researcher Degrees of Freedom, Researcher Discretion, Unknown Unknowns
Link to resource
Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. …
Author(s): Brian A. Nosek, Charles R. Ebersole, Alexander C. DeHaven, and David T. Mellor
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
Nosek et al. (1) recently joined others in advocating for “widespread adoption of preregistration” as a tool for advancing science. The …
Author(s): Alison Ledgerwood
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Preregistration, Predictions, Analyses
Link to resource
This study documents reporting errors in a sample of over 250,000 p-values reported in eight major psychology journals from 1985 until …
Author(s): Michèle B. Nuijten, Chris H. J. Hartgerink, Marcel A. L. M. van Assen, Sacha Epskamp & Jelte M. Wicherts
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian …
Author(s): Hitzig Zoë, Stegenga Jacob
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities, Social Science
Tag(s): Bayesian Confirmation Theory, Pre-Analysis Plans, Replication Crisis, Predictivism, P-hacking, Philosophy
Link to resource
The promises and pitfalls of preregistration
Author(s): The Royal Society
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Physical Science, Social Science
Tag(s): Preregistration
Link to resource
The promises and pitfalls of preregistration
Author(s): The Royal Society
Type of resources: Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Education, Life Science, Physical Science, Social Science
Tag(s): Preregistration
Link to resource
The .05 boundary within Null Hypothesis Statistical Testing (NHST) “has made a lot of people very angry and been widely regarded as a …
Author(s): V. N. Vimal Rao, Jeffrey K. Bye & Sashank Varma
Type of resources: Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): P-values, Statistical Thinking, Categorical Perception, Meta-science Replication crisis
Link to resource
The .05 boundary within Null Hypothesis Statistical Testing (NHST) “has made a lot of people very angry and been widely regarded as a …
Author(s): V. N. Vimal Rao, Jeffrey K. Bye & Sashank Varma
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics, Social Science
Tag(s): p-values, Statistical Thinking, Categorial Perception, Meta-Science, Replication Crisis
Link to resource
Like many other areas of science, experimental psychology is affected by a “replication crisis” that is causing concern in many fields …
Author(s): Dorothy VM Bishop
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Psychology
Tag(s): Reproducibility
Link to resource
Many suggestions for dealing with the so-called replication crisis in psychology revolve around the idea that better and more complex …
Author(s): Roland Mayrhofer, Isabel C. Büchner, Judit Hevesi
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Replication Crisis, Quantitative Psychology, Human Mind, Epistemology, Ontology
Link to resource
At present, academia is a site of colonial production of knowledge where the subject of knowledge, represented by the white European …
Author(s): The Race in Academia Collective
Type of resources: Initiative
Primary user(s): Student, Teacher, Librarian
Subject area(s): Arts and Humanities, Education, Social Science
Tag(s): Race, Equity, Inclusion, Justice, Racialised Academics, Decolonialisation
Link to resource
Statistically underpowered studies can result in experimental failure even when all other experimental considerations have been …
Author(s): Cremers, H. R., Wager, T. D., & Yarkoni, T.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science, Math & Statistics
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In science, replication is the process of repeating research to determine the extent to which findings generalize across time and …
Author(s): Edward Diener and Robert Biswas-Diener
Type of resources: Primary Source, Reading, Blog
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Popper’s (1983, 2002) philosophy of science has enjoyed something of a renaissance in the wake of the replication crisis, offering a …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Metascience, Popper, Philosophy Of Science, Lakatos, Replication Crisis, Theory Testing
Link to resource
Popper’s (1983, 2002) philosophy of science has enjoyed something of a renaissance in the wake of the replication crisis, offering a …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher, researcher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Lakatos, Popper, Metaresearch, Metascience, Philosophy of Science, Replication Crisis, Theory Testing, Theory
Link to resource
In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is …
Author(s): Röseler, L., Kaiser, L., Doetsch, C., Klett, N., Seida, C., Schütz, A., Aczel, B., Adelina, N., Agostini, V., Alarie, S., Albayrak-Aydemir, N., Aldoh, A., Al-Hoorie, A. H., Azevedo, F., Baker, B. J., Barth, C. L., Beitner, J., Brick, C., Brohmer, H., Chandrashekar, S. P., Chung, K. L., Cockcroft, J. P., Cummins, J., Diveica, V., Dumbalska, T., Efendic, E., Elsherif, M., Evans, T., Feldman, G., Fillon, A., Förster, N., Frese, J., Genschow, O., Giannouli, V., Gjoneska, B., Gnambs, T., Gourdon-Kanhukamwe, A., Graham, C. J., Hartmann, H., Haviva, C., Herderich, A., Hilbert, L. P., Holgado, D., Hussey, I., Ilchovska, Z. G., Kalandadze, T., Karhulahti, V.-M., Kasseckert, L., Klingelhöfer-Jens, M., Koppold, A., Korbmacher, M., Kulke, L., Kuper, N., LaPlume, A., Leech, G., Lohkamp, F., Lou, N. M., Lynott, D., Maier, M., Meier, M., Montefinese, M., Moreau, D., Mrkva, K., Nemcova, M., Oomen, D., Packheiser, J., Pandey, S., Papenmeier, F., Paruzel-Czachura, M., Pavlov, Y. G., Pavlović, Z., Pennington, C. R., Pittelkow, M.-M., Plomp, W., Plonski, P. E., Pronizius, E., Pua, A. A., Pypno-Blajda, K., Rausch, M., Rebholz, T. R., Richert, E., Röer, J. P., Ross, R., Schmidt, K., Skvortsova, A., Sperl, M. F. J., Tan, A. W. M., Thürmer, J. L., Tołopiło, A., Vanpaemel, W., Vaughn, L. A., Verheyen, S., Wallrich, L., Weber, L., Wolska, J. K., Zaneva, M., & Zhang, Y.
Type of resources: Primary Source, Reading
Primary user(s): Student, Teacher, Librarian, Researchers
Subject area(s): Education, Social Science
Tag(s): Replicability; Replication Studies; Reproducibility; Replication Database; Replication Data; Psychological Research
Link to resource
Psychological scientists have recently started to reconsider the importance of close replications in building a cumulative knowledge …
Author(s): Brandt et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Objectives To conduct a methodological overview of reviews to evaluate the reporting completeness and transparency of systematic …
Author(s): Persefoni Talimtzia, Antonios Ntolkerasb, Georgios Kostopoulosc, Konstantinos I Bougioukasa, Eirini Pagkalidoua, Andreas Ouranidisd, Athanasia Patakae, Anna-Bettina Haidich
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Prognostic Prediction Model, Overview of Systematic Review, COVID-19, Reporting Completeness, Transparency, ROBIS Assessment
Link to resource
Scientists are dedicating more attention to replication efforts. While the scientific utility of replications is unquestionable, the …
Author(s): Adam K. Fetterman and Kai Sassenberg
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A lighting talk at csv,conf,4 about how libraries and librarians are helping researchers with reproducibility.
Author(s): Gabriele Hayden, Vicky Steeves
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Librarians, Organizational Change, Reproducibility, Researchers
Link to resource
The analysis of longitudinal observational data can take many forms and requires many decisions, with research findings and conclusions …
Author(s): Hofer S M
Type of resources: Reading
Primary user(s):
Subject area(s): Life Science, Social Science
Tag(s): Aging Research, Longitudinal Studies, Replication
Link to resource
If science were a game, a dominant rule would probably be to collect results that are statistically significant. Several reviews of the …
Author(s): Marjan Bakker, Annette van Dijk, Jelte M. Wicherts
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Use a real NASA proposal as a roadmap and follow these tips for clearly presenting your research ideas. I’m a 100% soft money-funded …
Author(s): Chelle Gentemann
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian, researcher
Subject area(s): Applied Science, Math & Statistics, Physical Science
Tag(s): NASA, Grant Writing
Link to resource
Open Science (OS) aims, in part, to drive greater societal impact of academic research. Government, funder and institutional policies …
Author(s): Nicki Lisa Cole, Eva Kormann, Thomas Klebel, Simon Apartis, and Tony Ross-Hellauer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Social Science
Tag(s): Citizen Science, Open Access, Open Data, Open Science, Social Impact, Societal Impact
Link to resource
Open Science (OS) aims, in part, to drive greater societal impact of academic research. Government, funder and institutional policies …
Author(s): Nicki Lisa Cole, Eva Kormann, Thomas Klebel, Simon Apartis and Tony Ross-Hellauer
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Career and Technical Education, Education, Social Science
Tag(s): Societal Impact, Social Impact, Open Science, Citizen Science, Participatory Research, Open Access
Link to resource
Reproducibility, the ability to reproduce the results of published papers or studies using their computer code and data, is a …
Author(s): Xin Xiong & Ivor Cribben
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Math & Statistics, Physical Science
Tag(s): Computer Code Access, Data Access, Open Science, Replicability, Reproducibility, Reproducibility Policy
Link to resource
The scientific quality of social and personality psychology has been debated at great length in recent years. Despite research on the …
Author(s): Motyl et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The first State of the Science address explores how U.S. science and innovation are positioned to respond to rising global competition …
Author(s): Marcia McNutt, Harvey V. Fineberg, Christie Aschwanden, Stephanie Diem, James Manyika, E. Albert Reece, James Marschall Shepherd, Grace Wang.
Type of resources: Lecture
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): -
Link to resource
An article about statistical power of abnormal and social psychology
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Life Science, Social Science
Tag(s):
Link to resource
OSF-specific screenshots and walk-throughs are very helpful, preregistration also discusses qualitative preregistration
Author(s): Alexander C, Bryan G, Center For Open Science, David Thomas Mellor, Marcy Reedy, Zachary Loomas
Type of resources: Lecture Notes
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
Statistical reasoning is an art and so demands both mathematical knowledge and informed judgment. When it is mechanized, as with the …
Author(s): Gerd Gigerenzer
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
I just published a new interactive visualization in my series of basic statistical concepts and techniques. This time I am trying to …
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
It has been known for decades that published results tend to be biased (Sterling, 1959). For most of the past decades this inconvenient …
Author(s): Ulrich Schimmack
Type of resources: Reading, Student Guide
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
In the replication crisis in psychology, a “tone debate” has developed. It concerns the question of how to conduct scientific debate …
Author(s): Maarten Derksen, Sarahanne Field
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Social Science
Tag(s): Tone Debate, Replication Crisis, Psychology, Social Media, Code of Conduct, Debate
Link to resource
Background: Scientists are increasingly concerned with making their work easy to verify and build upon. Associated practices include …
Author(s): Jason Chin, Kathryn Zeiler, Natali Dilevski, Alex Holcombe, Rosemary Gatfield-Jeffries, Ruby Bishop, Simine Vazire, Sarah Schiavone
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Law, Social Science
Tag(s): Metaresearch, Open Science, Transparency, Credibility, Empirical Legal Research
Link to resource
The goal of industrial/organizational (IO) psychology, is to build and organize trustworthy knowledge about people-related phenomena in …
Author(s): Sheila K. Keener, Sven Kepes, Ann-Kathrin Torka
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Social Science
Tag(s): Reproducibility, Replicability, Scientific Misconduct, Questionable Research Practices, Trustworthiness of our Scientific Knowledge, Open Science Practices
Link to resource
Software Carpentry lesson on how to use the shell to navigate the filesystem and write simple loops and scripts. The Unix shell has …
Author(s): Adam Huffman, Adam James Orr, Adam Richie-Halford, AidaMirsalehi, Alexander Konovalov, Alexander Morley, Alex Kassil, Alex Mac, Alix Keener, Amy Brown, Andrea Bedini, Andrew Boughton, Andrew Reid, Andrew T. T. McRae, Andrew Walker, Ariel Rokem, Armin Sobhani, Ashwin Srinath, Bagus Tris Atmaja, Bartosz Telenczuk, Ben Bolker, Benjamin Gabriel, Bertie Seyffert, Bill Mills, Brian Ballsun-Stanton, BrianBill, Camille Marini, Chris Mentzel, Christina Koch, Colin Morris, Colin Sauze, csqrs, Damien Irving, Dana Brunson, Daniel Baird, Danielle M. Nielsen, Daniel McCloy, Daniel Standage, Dan Jones, Dave Bridges, David Eyers, David McKain, David Vollmer, Dean Attali, Devinsuit, Dmytro Lituiev, Donny Winston, Doug Latornell, Dustin Lang, earkpr, ekaterinailin, Elena Denisenko, Emily Dolson, Emily Jane McTavish, Eric Jankowski, Erin Alison Becker, Ethan P White, Evgenij Belikov, Farah Shamma, Fatma Deniz, Filipe Fernandes, Francis Gacenga, François Michonneau, Gabriel A. Devenyi, Gerard Capes, Giuseppe Profiti, Greg Wilson, Halle Burns, Hannah Burkhardt, Harriet Alexander, Hugues Fontenelle, Ian van der Linde, Inigo Aldazabal Mensa, Jackie Milhans, Jake Cowper Szamosi, James Guelfi, Jan T. Kim, Jarek Bryk, Jarno Rantaharju, Jason Macklin, Jay van Schyndel, Jens vdL, John Blischak, John Pellman, John Simpson, Jonah Duckles, Jonny Williams, Joshua Madin, Kai Blin, Kathy Chung, Katrin Leinweber, Kevin M. Buckley, Kirill Palamartchouk, Klemens Noga, Kristopher Keipert, Kunal Marwaha, Laurence, Lee Zamparo, Lex Nederbragt, Mahdi Sadjadi, Marcel Stimberg, Marc Rajeev Gouw, Maria Doyle, Marie-Helene Burle, Marisa Lim, Mark Mandel, Martha Robinson, Martin Feller, Matthew Gidden, Matthew Peterson, M Carlise, Megan Fritz, Michael Zingale, Mike Henry, Mike Jackson, Morgan Oneka, Murray Hoggett, Nicolas Barral, Nicola Soranzo, Noah D Brenowitz, Noam Ross, Norman Gray, nther, Orion Buske, Owen Kaluza, Patrick McCann, Paul Gardner, Pauline Barmby, Peter R. Hoyt, Peter Steinbach, Philip Lijnzaad, Phillip Doehle, Piotr Banaszkiewicz, Rafi Ullah, Raniere Silva, Rémi Emonet, reshama shaikh, Robert A Beagrie, Ruud Steltenpool, Ry4an Brase, Sarah Mount, Sarah Simpkin, s-boardman, Scott Ritchie, sjnair, Stéphane Guillou, Stephan Schmeing, Stephen Jones, Stephen Turner, Steve Leak, Susan Miller, Thomas Mellan, Tim Keighley, Tobin Magle, Tom Dowrick, Trevor Bekolay, Varda F. Hagh, Victor Koppejan, Vikram Chhatre, Yee Mey
Type of resources: Module
Primary user(s): student, teacher
Subject area(s): Computer Science, Measurement and Data
Tag(s): Analysis, Data, Education, Open Scholarship Tools and Technologies, Reproducibility, Research Data Management Tools, Researchers, Shell
Link to resource
Reproducibility is the cornerstone of science. If an effect is reliable, any competent researcher should be able to obtain it when …
Author(s): Daniel Simons
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Open science is good for both epistemic and social reasons, but in nonobvious ways, it can have detrimental epistemic side effects. …
Author(s): Carlos Santana
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Arts and Humanities
Tag(s): Open Science, Values In Science, Applied Epistemology, Data Infrastructures, Science Policy
Link to resource
For over two centuries researchers have been criticized for using research practices that makes it easier to present data in line with …
Author(s): Daniël Lakens
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Registered Reports, Severity, Hypothesis Testing, Metascience
Link to resource
Science is humanity’s most important long-term investment. It is worth constant effort to improve science as a social system to …
Author(s): Brian Nosek
Type of resources: Reading
Primary user(s): Student, Teacher, Parent
Subject area(s): Applied Science, Education, Social Science
Tag(s): Open Science, Scientific Improvement, Science as a Social System
Link to resource
In this review, the author discusses several of the weak spots in contemporary science, including scientific misconduct, the problems …
Author(s): Jelte M. Wicherts
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Meta-research, Questionable Research Practices, Replicability, Reproducibility, Validity
Link to resource
Although many researchers agree that scientific data should be open to scrutiny to ferret out poor analyses and outright fraud, most …
Author(s): Jeffrey N. Rouder
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s):
Link to resource
More researchers are preregistering their studies as a way to combat publication bias and improve the credibility of research findings. …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Preregistation, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
Theories in “soft” areas of psychology (e.g., clinical, counseling, social, personality, school, and community) lack the …
Author(s): Meehl, P. E
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Meeting a crucial need for graduate students and newly minted researchers, this innovative text provides hands-on tools for generating …
Author(s): James Jaccard, Jacob Jacoby
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Book
Link to resource
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and …
Author(s): Paul E.Meehl
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Numerous scholars believe that there is a crisis in psychology because of the “poor quality” of our theories. However, we believe that …
Author(s): David M. Sanbonmatsu, Becky Neufeld, Steven S. Posavac
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Theory Crisis, Theory Development, Modeling, Problem Of Generality, Cumulative Research
Link to resource
This is an account of what I have learned (so far) about the application of statistics to psychology and the other sociobiomedical …
Author(s): Jacob Cohen
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics, Social Science
Tag(s):
Link to resource
From designing studies and translating science to technical services, the work of support staff is highly diverse — and it needs merit …
Author(s): Linda Nordling
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Education, Social Science
Tag(s): Careers, Research Management, Research Support Staff
Link to resource
In this short article, I want to provide some of my thoughts on these developments from the perspective of someone who writes PAPs and …
Author(s): Daniel Rubenson
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Preregistration, Political Science
Link to resource
Psychology journals rarely publish nonsignificant results. At the same time, it is often very unlikely (or “too good to be true”) that …
Author(s): Lakens, D., & Etz, A. J.
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Colleges and universities largely exist to advance knowledge for the public good through research, teaching, and public service. Yet, …
Author(s): Michael R Dougherty, Caitlin Carter, Erin McKiernan, Greg Tananbaum, Zac Parker, and Carolina Garcia
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s):
Link to resource
Course summary A minimal standard for data analysis and other scientific computations is that they be reproducible: that the code and …
Author(s): Karl Broman
Type of resources: Full Course
Primary user(s): student, teacher
Subject area(s): Information Science
Tag(s): Documentation, Literate Programming, Reproducibility, Version Control
Link to resource
The Transparency and Openness Promotion guidelines include eight modular standards, each with three levels of increasing stringency. …
Author(s): Open Science Collaboration
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Funders, Open Scholarship Policy, Open Standards, Policy, Policy Makers, Publishers, Publishing
Link to resource
We summarize our career advice on everything from writing effectively and giving a stellar presentation to writing a CV and negotiating …
Author(s): Sarah Mughal, Jay van Bavel
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education
Tag(s): Career Advice, Academia, Hidden Curriculum
Link to resource
A crise de confiança na ciência. Práticas e condutas questionáveis na pesquisa. Delineamento experimental adequado. Definição de …
Author(s): Caio Maximino and Monica Gomes Lima-Maximino
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This seminar class will focus on the theme of Reproducibility in Social Psychology. We will discuss issues surrounding open science as …
Author(s): Sean Mackinnon
Type of resources: Syllabus
Primary user(s): Teacher
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Protecting privacy and ensuring confidentiality in data is a critical component of modernizing our national data infrastructure. The …
Author(s): National Academies of Sciences, Engineering, and Medicine
Type of resources: Textbook
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Life Science, Physical Science
Tag(s): Blended Data, Data Infrastructure
Link to resource
The paper analyzes the notion of exploration that can be found in the distinction between exploratory and confirmatory research, which …
Author(s): Feest, Uljana and Devezer, Berna
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science
Tag(s): Exploratory Hypotheses, Assumptions, Modeling, Experimentation
Link to resource
We discuss a relatively new meta-scientific research design: many-analyst studies that attempt to assess the replicability and …
Author(s): Katrin Auspurg and Josef Brüderl
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Meta-scientific Research Design, Meta Analyst
Link to resource
Journal policy on research data and code availability is an important part of the ongoing shift toward publishing reproducible …
Author(s): Peixuan Guo, Victoria Stodden, Zhaokun Ma
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Bibliometrics, Computational Biology, Data, Data Management, Open Access Publishing, Open Data, Policy, Publishing, Reproducibility, Science Policy, Scientific Publishing
Link to resource
The UK House of Commons Science and Technology Committee has called for evidence on the roles that different stakeholders play in …
Author(s): Azevedo, F., Liu, M., Pennington, C. R., Pownall, M., Evans, T. R., Parsons, S., Elsherif, M. M., Micheli, L., Westwood, S., & FORRT.
Type of resources: Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Education
Tag(s): Open Scholarship; Higher Education; Pedagogy; Mentorship; Policy; Sustainable Change
Link to resource
When the scientific dataset evolves or is reused in workflows creating derived datasets, the integrity of the dataset with its metadata …
Author(s): S Sivagnanam, S Yeu, K Lin, S Sakai, F Garzon, K Yoshimoto, K Prantzalos, D P Upadhyaya, A Majumdar, S S Sahoo, W W Lytton
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Data Sharing, Metadata, Neuroscience, Data Security
Link to resource
Securing research funding is a challenge faced by most scientists in academic institutions worldwide. Funding success rates for all …
Author(s): Charlotte de Winde
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Funding
Link to resource
Mentoring is a core part of training the next generation of psychologists. Recognizing how culture and social identities inform …
Author(s): Philip Cheng
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Careers, Culture, Education, Mentoring, Diversity
Link to resource
Mentoring is a core part of training the next generation of psychologists. Recognizing how culture and social identities inform …
Author(s): Philip Cheng
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Education, Social Science
Tag(s): Careers, Culture, Education
Link to resource
Objectives To investigate the model-, code-, and data-sharing practices in the current radiomics research landscape and to introduce a …
Author(s): Tugba Akinci D’Antonoli, Renato Cuocolo, Bettina Baessler & Daniel Pinto dos Santos
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Multiomics, Radiomics, Artificial intelligence, Reproducibility of results
Link to resource
Recent reports have suggested that many published results are unreliable. To increase the reliability and accuracy of published papers, …
Author(s): Hartshorne, J. K., & Schachner, A.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Central location housing curriculum materials and planning tools for trainers of the COS Introduction to Open and Reproducible Research …
Author(s): Courtney K. Soderberg, Ian Sullivan, Jennifer Freeman Smith, Jolene Esposito, Matthew Spitzer, Natalie Meyers
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Education, Librarians, Reproducibility, Research Data Management Tools, Researchers
Link to resource
The past decade has seen rapid growth in conversations around and progress towards fostering a more transparent, open, and cumulative …
Author(s): Eileen K Graham, Gabrielle N, Jennifer Lodi-smith, Kendra Leigh Seaman, Rita M
Type of resources: Reading
Primary user(s):
Subject area(s): Life Science, Social Science
Tag(s): Aging, Aging Science, Gerontology, Open Science
Link to resource
Several fields of science are experiencing a “replication crisis” that has negatively impacted their credibility. Assessing …
Author(s): Chatchavan Wacharamanotham, Florian Echtler, Lukas Eisenring, Steve Haroz
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Life Science, Social Science
Tag(s): Data, Reproducibility
Link to resource
Healthy aging is associated with deficits in performance on episodic memory tasks. Popular verbal theories of the mechanisms underlying …
Author(s): Kevin P. Darby, Per B. Sederberg
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Social Science
Tag(s): Transparency, Replicability, Discovery, Cognitive Aging, Computational Modeling
Link to resource
Demand is growing for evidence-based policy making, but there is also growing recognition in the social science community that limited …
Author(s): Berkeley Initiative for Transparency in the Social Sciences
Type of resources: Full Course, Lecture, Module, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Course, Video, Reproducibility Knowledge
Link to resource
This is an exciting time to be a psychological scientist. There is a major new movement that seeks to promote the credibility and …
Author(s): David Mellor, Simine Vazire and D. Lindsay
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Background: Reproducible research is a foundational component for scientific advancements, yet little is known regarding the extent of …
Author(s): Andrew Niemann, Austin L. Johnson, Courtney Cook, Daniel Tritz, J. Michael Anderson, Matt Vassar
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Biology, Genetics
Tag(s): Data, Dermatology, Reproducibility
Link to resource
Background ClinicalTrials.gov is a publicly accessible, Internet-based registry of clinical trials managed by the US National Library …
Author(s): Joseph S. Ross, Gregory K. Mulvey, Elizabeth M. Hines, Steven E. Nissen, Harlan M. Krumholz
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Clinical Trials, Citation Analysis, Lung and Intrathoracic Tumors, United States, Phase I Clinical Investigation, Safety Studies, Drug Administration, Medical Journals
Link to resource
This month marks the tenth anniversary of the landmark decision by the International Committee of Medical Journal Editors to make …
Author(s): Wim E J Weber, José G Merino, Elizabeth Loder
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Clinical Research, Preregistration
Link to resource
A paper about Open Your Data and Code
Author(s): Victoria Stodden
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Meta-analyses are often accompanied by two popular forms of data visualization: forest plots and funnel plots. In this post, I’ll show …
Author(s): John K. Sakaluk
Type of resources: Reading, R code
Primary user(s): Student, Teacher
Subject area(s): Life Science, Math & Statistics, Social Science
Tag(s): Blog, Tutorial
Link to resource
ggplot2, as I’ve already made clear, is one of my favourite packages for R. And since that original post about ggplot2 remains one of …
Author(s): John K. Sakaluk
Type of resources: Reading, R code
Primary user(s): Student, Teacher
Subject area(s): Life Science, Math & Statistics, Social Science
Tag(s): Blog, Tutorial
Link to resource
With this post, I’m going to be showing how you can use the psych package in conjunction with ggplot2 in order to create a prettier …
Author(s): John K Sakaluk
Type of resources: Reading, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Tutorial
Link to resource
A study by David Baker and colleagues reveals poor quality of reporting in pre-clinical animal research and a failure of journals to …
Author(s): Ana Sottomayor, David Baker, Katie Lidster, Sandra Amor
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Life Science
Tag(s): Analysis, Animal Models, Animal Studies, Data, Experimental Design, Publication Ethics, Publishing, Research Laboratories, Research Reporting Guidelines, Scientific Publishing, Statistical Data, Statistics
Link to resource
The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): False Positives, Questionable Research Practices, Replication Crisis, Significance Testing, Type I Error Rate Inflation
Link to resource
The UKRN primer series is designed to introduce a broad audience to important topics in open and reproducible scholarship. Each primer …
Author(s): Emma Henderson, Jackie Thompson
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility, Research Administration, Researchers
Link to resource
Open Research Action Plan, Data Sharing, Open Access, Open Code & Software, Open Resarch Awards, Preprints, Preregistration & …
Author(s): UKRN
Type of resources: Reading
Primary user(s):
Subject area(s): Education
Tag(s): Research
Link to resource
Economists have recently adopted pre-analysis plans in response to concerns about robustness and transparency in research. The …
Author(s): Sarah A. Janzen, Jeffrey D. Michler
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Hypothesis Registry, Pre-Analysis Plan, Preregistration, Research Ethics, Transparency
Link to resource
Inspiration, creativity, discovery—all of these things start from a place of not knowing, and these researchers know how to navigate …
Author(s): Christie Aschwanden, Jeffery Delvisco
Type of resources: Podcast and transcript
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Uncertainty, Science, Researchers
Link to resource
Many scholars have raised concerns about the credibility of empirical findings in psychology, arguing that the proportion of false …
Author(s): Annie Franco, Neil Malhotra, and Gabor Simonovits
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A blog about bayesian statistics
Author(s): Alexander Etz
Type of resources: Reading
Primary user(s): Student
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Blog
Link to resource
An abstract about Understanding Bayes and visualising Bayes Factor
Author(s): Alexander Etz
Type of resources: Diagram/Illustration, Reading, Student Guide, Teaching/Learning Strategy, R code
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, R code
Link to resource
How can we objectively define categories of truth in scientific thinking? How can we reliably measure the results of research? In this …
Author(s): Zoltan Dienes
Type of resources: Textbook
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Life Science, Math & Statistics, Social Science
Tag(s): Book
Link to resource
Much has been said about significance testing – most of it negative. Methodologists constantly point out that researchers misinterpret …
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interaction, Simulation, Tutorial
Link to resource
Data availability and reusability are critical to open research. The FAIR principles provide a minimal set of guiding principles for …
Author(s): Tracey L. Weissgerber, Małgorzata Anna Gazda, Gustav Nilsonne, Gerben ter Riet, Kelly D. Cobey, Julia Prieß-Buchheit, Jorge Noro, Robert Schulz, Joeri K. Tijdink, Evgeny Bobrov, Alexandra Bannach-Brown, Delwen L. Franzen, Ugo Moschini, Florian Naudet, Ulrich Mansmann, Maia Salholz-Hillel, Anita Bandrowski & Malcolm R. Macleod
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science, Physical Science
Tag(s): Publishing, Research Data
Link to resource
Data curators play an important role in assessing data quality and take actions that may ultimately lead to better, more valuable data …
Author(s): Lisa R. Johnston, Renata Curty, Susan M. Braxton, Jake Carlson, Hannah Hadley, Sophia Lafferty-Hess, Hoa Luong, Jonathan L. Petters, Wendy A. Kozlowski
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science
Tag(s): Biology, Data repository, Data curation
Link to resource
Plan E for Education is my proposal that a proportion of the educational resources generated in publicly funded universities be made …
Author(s): Richard F. Heller
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Education
Tag(s): Plan E, Open Educational Resources, Open Educational Practices
Link to resource
Why most published scientific research is probably false
Author(s): The Economist
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Math & Statistics, Social Science
Tag(s): Video
Link to resource
OBJECTIVE: To investigate open science practices in research published in the top five sports medicine journals from 01 May 2022 and 01 …
Author(s): Garrett S. Bullock, Patrick Ward, Franco M. Impellizzeri, Stefan Kluzek, Tom Hughes, Charles Hillman, Brian R. Waterman, Kerry Danelson, Kaitlin Henry, Emily Barr, Kelsey Healey, Anu M. Räisänen, Christina Gomez, Garrett Fernandez, Jakob Wolf, Kristen F. Nicholson, Tim Sell, Ryan Zerega, Paula Dhiman, Richard D. Riley, Gary S Collins
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Open Access, Open Code, Study Protocol, Reporting Guidelines
Link to resource
The CONsolidated Standards Of Reporting Trials (CONSORT) Statement provides a minimum standard set of items to be reported in published …
Author(s): David Moher, Douglas G. Altman, Kenneth F. Schulz, Larissa Shamseer, Sally Hopewell
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Data, Publishing, Reporting Guidelines
Link to resource
Laws and policies to establish a global trial reporting system have greatly increased the transparency and accountability of the …
Author(s): Deborah A. Zarin, Tony Tse, Rebecca J. Williams, Thiyagu Rajakannan
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Trial Registration, Medicine, Preregistration
Link to resource
Retracted papers continue to be cited because notices are unclear and hard to spot. Information scientist Jodi Schneider explains how …
Author(s): Dalmeet Singh Chawla
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Life Science
Tag(s): Information Science, Research Retractions, Citations, Publication, Publishing Recommendations, Retraction Notifications
Link to resource
The Journal Impact Factor (JIF) was originally designed to aid libraries in deciding which journals to index and purchase for their …
Author(s): Carol Muñoz Nieves, Erin C. McKiernan, Juan Pablo Alperin, Lesley A. Schimanski, Lisa Matthias, Meredith T. Niles
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing, Information Science, Life Science, Social Science
Tag(s): And Tenure, Journal Impact Factor, Promotion, Publishing, Review
Link to resource
Introduction Medical case vignettes play a crucial role in medical education, yet they often fail to authentically represent diverse …
Author(s): Michiel J. Bakkum, Mariëlle G. Hartjes, Joost D. Piët, Erik M. Donker, Robert Likic, Emilio Sanz, Fabrizio de Ponti, Petra Verdonk, Milan C. Richir, Michiel A. van Agtmael, Jelle Tichelaar
Type of resources: Reading
Primary user(s): Teacher, Librarian
Subject area(s): Applied Science, Life Science, Social Science
Tag(s): Artificial Intelligence, chatGPT, Diversity, Inclusivity
Link to resource
Sharing data, materials, and analysis scripts with reviewers and readers is valued in psychological science. To facilitate this …
Author(s): Courtney K. Soderberg
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
In the last decade, there has been a significant push for greater transparency in the social sciences. For example, epistemological and …
Author(s): Verónica Pérez Bentancur, Rafael Piñeiro Rodríguez, Fernando Rosenblattv
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Social Science
Tag(s): Pre-Analysis Plan, Preregistration, Qualitative Research
Link to resource
Concerns about a lack of reproducibility of statistically significant results have recently been raised in many fields, and it has been …
Author(s): Anna Drebner et al.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
I often get asked how to fit different multilevel models (or individual growth models, hierarchical linear models or linear …
Author(s): Kristoffer Magnusson
Type of resources: Reading, R code
Primary user(s): Student, Teacher, Researcher
Subject area(s): Education, Life Science, Math & Statistics, Social Science
Tag(s): Blog, Tutorial
Link to resource
Here I outline some of what science can tell us about the problems in psychological publishing and how to best address those problems. …
Author(s): Brett T. Buttliere
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
As an educational tool, the Checklist can be used to teach and improve the standards of transparency and credibility in research …
Author(s): Balazs Aczel & Framework for Open and Reproducible Research Training (FORRT)
Type of resources: Lesson, Module, Reading, Teaching/Learning Strategy, Unit of Study
Primary user(s): Teacher
Subject area(s): Education
Tag(s): Research Transparency; Transparency Checklist; Student Assignments; Higher Education; Undergraduate Training; Pedagogy; Supervision; Reproducibility; Teaching
Link to resource
Background The US Department of Veterans Affairs (VA) enterprise approach to research (VA Research) has built a data-sharing framework …
Author(s): Yinong Young-Xu, Victoria Davey, Vincent C Marconi, Francesca E Cunningham
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Life Science
Tag(s): Veteran Affairs, Data Sharing, Covid-19, Medical Research, Healthcare
Link to resource
This webinar will introduce the concept of version control and the version control features that are built into the Open Science …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
A blog post and tutorial on visualizing one-way ANOVA
Author(s): Kristoffer Magnusson
Type of resources: Interactive, Reading, Simulation, Student Guide, Teaching/Learning Strategy
Primary user(s): Student, Teacher
Subject area(s): Math & Statistics
Tag(s): Blog, Interactive, Tutorial
Link to resource
I have volunteered for many initiatives and was always happy to do so. Recently I started to realize that being able to volunteer is a …
Author(s): Heidi Seibold
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator
Subject area(s): Education, Social Science
Tag(s): Volunteering, Academia
Link to resource
Researchers and policymakers often exist in different worlds and speak different languages. Here are three ways to bridge the divide.
Author(s): Matt Clancy, Dan Correa, Jordan Dworkin, Paul Niehaus, Caleb Watney & Heidi Williams
Type of resources: Primary Source, Reading
Primary user(s): Teacher, Administrator, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Policy, Funding, Scientific Communication
Link to resource
Calls for culture change abound. Headlines regularly feature calls to change the “broken” or “toxic” cultures of institutions and …
Author(s): MarYam G. Hamedani, Hazel Rose Markus, Rebecca C. Hetey. Jennifer L. Eberhardt
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Culture Change, Social Change, Inequality
Link to resource
Three mostly positive developments in academic psychology—the cognitive revolution, the virtual requirement for multiple study reports …
Author(s): Robert B. Cialdini
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
A critique about Daryl Bem’s (2011) paper and reproducibility
Author(s): Arina K Bones
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The self-correcting nature of psychological and educational science has been seriously questioned. Recent special issues of …
Author(s): Matthew T. McBee, Michael S. Matthews
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Educational technology (EdTech) research should champion the values of open science in order to be robust, methodologically rigorous, …
Author(s): Madeleine Pownall, Sakshi Ghai, Luisa Fassi, Gillian Hayes, Mirijam Schaaf, Cortney Chin, Amanda Ferguson, Maria Concepcion Valdez Gastelum, Giovanni Ramos, Jasmin Breitwieser, Colleen Russo Johnson, Isabela Figueira, Sebastian Kurten, Sabrina Shajeen Alam, Aehong Min, Soheyon Park, Emani Dotch, Anamara Ritt-Olson, Georgia Turner, Y. Anthony Chen, Adrian Wilson, Angela Y Lee, Lea Nobbe, Chimezie O. Amaefule, Benjamin Kaveladze, Flavio Azevedo, Candice Odgers, and Amy Orben
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Career and Technical Education, Education
Tag(s): Educational Technology, Open Science, Open Science Practices
Link to resource
The language and conceptual framework of “research reproducibility” are nonstandard and unsettled across the sciences. In this …
Author(s): Goodman, S. N., Fanelli, D., & Ioannidis, J. P.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
The foundation of health and medical research is data. Data sharing facilitates the progress of research and strengthens science. Data …
Author(s): Adrian G. Barnett, Anisa Rowhani-Farid, Michelle Allen
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Health, Medicine and Nursing
Tag(s): Data, Data Sharing, Open Data
Link to resource
Blog post going over the p value, misnomers and what p < .05 means
Author(s): Daniel Lakens
Type of resources: Reading, R Code
Primary user(s): Student, Teacher, Researcher
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Blog, Code, Reproducibility Crisis and Credibility Revolution
Link to resource
Replications are inevitably different from the original studies. How do we decide whether something is a replication? The answer shifts …
Author(s): Brian A. Nosek, Timothy M. Errington
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Reproducibility, Researchers
Link to resource
This video is the first in a series of videos related to the basics of power analyses. All materials shown in the video, as well as …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Power, Publishing, Reproducibility, Research Data Management Tools, Researchers, Statistics
Link to resource
In recent debates about the replication crisis, two positions have been dominant: one that focuses on methodological reforms and one …
Author(s): Feest, U.
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Social Science
Tag(s): Theory Building, Replication, Methodological Reforms
Link to resource
A general introduction to open scholarship.
Author(s): Tom Hardwicke
Type of resources: Lesson
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Funders, History of Science, Metascience, Open Data, Open Scholarship Policy, Policy, Policy Makers, Publishing, Publishing Models, Reproducibility, Research Administration, Researcher Degrees of Freedom, Researchers, Research Integrity, Statistics, Transparency
Link to resource
Universal Design for Learning (UDL) is a way of thinking about teaching and learning that helps give all students an equal opportunity …
Author(s): Amanda Morin and Ace Parsi
Type of resources: Reading
Primary user(s): Student, Teacher, Parent
Subject area(s): Career and Technical Education, Education, Social Science
Tag(s): Diversity, Equity, Inclusion, Neurodiversity
Link to resource
I present an ontology of criteria for evaluating theory to answer the titular question from the perspective of a scientist …
Author(s): Olivia Guest
Type of resources: Reading
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Theory, Metatheory, Metatheoretical Calculcus, Theoretical Virtue, Metascience
Link to resource
A large amount of variation exists in beliefs about the purpose and benefits of preregistration, making it difficult to implement and …
Author(s): Jonathon McPhetres
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Hypothesis Testing, Metascience, Open Science, Planning, Preregistration, Research Methods. Transparency
Link to resource
We review the literature on evidence-based best practices on how to enhance methodological transparency, which is the degree of detail …
Author(s): Herman Aguinis, Ravi S. Ramani and Nawaf Alabduljader
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
This chapter considers various factors that have been responsible for the comparatively slow development of psychology into a …
Author(s): David T. Lykken
Type of resources: Primary Source, Reading
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Transparency
Link to resource
This chapter considers problems with null hypothesis significance testing (NHST). The literature in this area is quite large. D. …
Author(s): R.B. Kline
Type of resources: Primary Source, Reading, Chapter
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
Hypothesizing after the results are known, or HARKing, occurs when researchers check their research results and then add or remove …
Author(s): Mark Rubin
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Accommodation, Falsification, HARKing, Prediction, Replication Crisis
Link to resource
A podcast about replication crisis
Author(s): Shankar Vedantam and Maggie Penman
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Knowledge, Reproducibility Crisis and Credibility Revolution
Link to resource
In this course, we will explore the so‐called “reproducibility crisis” that has struck fields from psychology and economics to ecology …
Author(s): Tim Parker and Tom Armstrong
Type of resources: Syllabus
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science, Conceptual and statistical knowledge
Link to resource
When designing a study, the planned sample size is often based on power analyses. One way to choose an effect size for power analyses …
Author(s): Casper Albers and Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
This paper explains how to select the correct statistical test for a research project, clinical trial, or other investigation. The …
Author(s): Evie McCrum-Gardner
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
Open data is receiving increased attention and support in academic environments, with one justification being that shared data may be …
Author(s): Geoff Krause, Madelaine Hare, Mike Smit, Philippe Mongeon
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Open Data, Citations
Link to resource
About two months ago, I published an interview with Richard Poynder in which he discussed his recent announcement that he was “signing …
Author(s): Rick Anderson
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication
Tag(s): Authors, Business Models, Commerce, Controversial Topics, Economics, Experimentation, Open Access
Link to resource
A video about psychology being trouble
Author(s): SciShow/Michael Aranda
Type of resources: Student Guide, Teaching/Learning Strategy, Video
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Video
Link to resource
We describe what is a pre-analysis plan (PAP) and why you should use one. We emphasize the potential political uses of PAPs and, in …
Author(s): David Yokum, Jake Bowers
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Pre-analysis plans, Preregistration, Open Science, Motivated Reasoning, Policy
Link to resource
For almost half a century, Paul Meehl educated psychologists about how the mindless use of null-hypothesis significance tests made …
Author(s): Anne M. Scheel, Leonid Tiokhin, Peder M. Isager, Daniël Lakens
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Education, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Exploratory Research, Hypothesis Testing, Replication Crisis
Link to resource
Newly discovered true (non-null) associations often have inflated effects compared with the true effect sizes. I discuss here the main …
Author(s): John P A Ioannidis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Low power in experimental psychology is an oft-discussed problem. We show in the context of the Replicability Project: Psychology (Open …
Author(s): Richard Morey and Daniel Lakens
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s):
Link to resource
There is increasing concern that most current published research findings are false. The probability that a research claim is true may …
Author(s): John Ioannidis
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
I’m thrilled to be the Transform to Open Science lead for NASA, which has a 60-year legacy of pushing the limits of how science is used …
Author(s): Chelle Gentemann
Type of resources: Reading
Primary user(s): Student, Teacher, Administrator, Librarian, researcher
Subject area(s): Applied Science, Math & Statistics, Physical Science
Tag(s): Year of Open Science, NASA, Federal Research
Link to resource
This post discusses the why p value around .048 should be rare
Author(s): Simine Vazire
Type of resources: Reading
Primary user(s): Student, Teacher, Researcher
Subject area(s): Math & Statistics
Tag(s): Blog
Link to resource
I must admit that when I first heard of the effort to get psychological scientists to preregister their studies (that is, to submit to …
Author(s): Susan Goldin-Meadow
Type of resources: Reading
Primary user(s): Student, Teacher, Librarian
Subject area(s): Applied Science, Arts and Humanities, Business and Communication, Career and Technical Education, Education, English Language Arts, History, Law, Life Science, Math & Statistics, Physical Science, Social Science
Tag(s): Preregistration, Badges
Link to resource
Does psi exist? D. J. Bem (2011) conducted 9 studies with over 1,000 participants in an attempt to demonstrate that future events …
Author(s): Wagenmakers, E.-J., Wetzels, R., Borsboom, D., & van der Maas, H. L. J.
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
“Important findings” haven’t been replicated, and science may have to change its ways.
Author(s): Michelle N.Meyer and Christopher Chabris
Type of resources: Blog
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Blog, Open Science, Reproducibility Crisis and Credibility Revolution
Link to resource
Null hypothesis testing of correlational predictions from weak substantive theories in soft psychology is subject to the influence of …
Author(s): Paul Meehl
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Social Science
Tag(s): Reproducibility Crisis and Credibility Revolution, Open Science
Link to resource
Open data is a vital pillar of open science and a key enabler for reproducibility, data reuse, and novel discoveries. Enforcement of …
Author(s): Bill Howe, Hoifung Poon, Maxim Grechkin
Type of resources: Reading
Primary user(s): student, teacher
Subject area(s): Biology
Tag(s): Archives, Biotechnology, Data, Data Mining, Gene Expression, Open Data, Sequence Databases, Text Mining, Web-based Applications
Link to resource
Discussions about metascience are frequently not about science, but about money. From reforming grantmaking regimes to new frameworks …
Author(s): Tim Hwang
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Business and Communication, Social Science
Tag(s): Metascience, Funding, Grants, Funder Behaviour
Link to resource
Background: The widespread reluctance to share published research data is often hypothesized to be due to the authors’ fear that …
Author(s): Jelte M. Wicherts, Marjan Bakker, Dylan Molenaar
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Applied Science, Life Science, Social Science
Tag(s):
Link to resource
Researchers should be motivated to adequately power statistical tests because tests with low power have a low probability of detecting …
Author(s): Lukas L. Lengersdorff and Claus Lamm
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Social Science
Tag(s): Inference Questionable Research Practices, Power
Link to resource
Badges are a great way to signal that a journal values transparent research practices. Readers see the papers that have underlying data …
Author(s): Center for Open Science
Type of resources: Lecture
Primary user(s): student, teacher
Subject area(s): Computer Science, Information Science
Tag(s): Analysis, Data, Education, Materials, Open Scholarship Tools and Technologies, OSF, Publishing, Reproducibility, Research Data Management Tools, Researchers
Link to resource
A class covering the basics of writing a successful data management plan for federal funding agencies such as the NEH, NSF, NIH, NASA, …
Author(s): Nick Wolf, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Applied Science, Life Science, Physical Science, Social Science
Tag(s): Data, Open Scholarship Guidelines, Research Data Management, Researchers
Link to resource
Reproducibility is unquestionably at the heart of science. Scientists face numerous challenges in this context, not least the lack of …
Author(s): Daniel Nüst, Edzer Pebesma, Markus Konkol, Rémi Rampin, Vicky Steeves
Type of resources: Activity/Lab
Primary user(s): student, teacher
Subject area(s): Physical Science
Tag(s): Analysis, Docker, Geosciences, GitLab, Open Scholarship Tools and Technologies, Publishing, R, Reproducibility, Research Data Management Tools, Researchers, RMarkdown, RStudio
Link to resource
Psychology is working on the hardest problems in all of science. Physics, astronomy, geology — those are easy, by comparison. …
Author(s): David McRaney
Type of resources: Student Guide, Teaching/Learning Strategy, Podcast
Primary user(s): Student, Teacher
Subject area(s): Applied Science, Social Science
Tag(s): Podcast, Reproducibility Crisis and Credibility Revolution
Link to resource
Statistical power depends on the size of the effect of interest. However, effect sizes are rarely fixed in psychological research: …
Author(s): Blakeley B McShane, Ulf Böckenholt
Type of resources: Primary Source, Reading, Paper
Primary user(s): Student
Subject area(s): Math & Statistics
Tag(s):
Link to resource
In this webinar, a panel discusses licensing options, fundamentals in choosing a license for your research, and answers questions about …
Author(s): Joanna Schimizzi, Brandon Butler, and Becca Neel
Type of resources: Lesson
Primary user(s):
Subject area(s): Education
Tag(s): Licensing, Open Science, OSF, Scholarly Communication, Scholarship
Link to resource
Animal trait data are scattered across several datasets, making it challenging to compile and compare trait information across …
Author(s): Thiago Gonçalves‐Souza, Beatriz Milz, Nathan J Sanders, Peter B Reich, Brian Maitner, Leonardo S Chaves, Gabriel X Boldorini, Natália Ferreira, Reginaldo A F Gusmão, Phamela Bernardes Perônico, Fabrício B Teresa, María Natalia Umaña
Type of resources: Reading
Primary user(s): Student, Teacher
Subject area(s): Life Science, Physical Science
Tag(s): Animal Trait Database, Open Science, Raunkiæran Shortfall, Trait-Based Ecology
Link to resource
Fill out the form below or here is the direct link to open the Google form in a new window