External scholarly reference · 2021Third-party work
Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé III, Kate Crawford
Communications of the ACM Vol. 64(12), pp. 86-92(2021). DOI: 10.1145/3458723
Introduces a documentation framework for recording the motivation, composition, collection process, recommended uses, and limitations of datasets used in machine learning.
External scholarly reference · 2021Third-party work
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, Shmargaret Shmitchell
Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, pp. 610-623(2021). DOI: 10.1145/3442188.3445922
Examines environmental costs, training-data risks, bias, and limits of large language models without grounded understanding.
External scholarly reference · 2021Third-party work
Matthew J. Page, Joanne E. McKenzie, Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, Larissa Shamseer, Jennifer M. Tetzlaff, Elie A. Akl, Sue E. Brennan, Roger Chou, Julie Glanville, Jeremy M. Grimshaw, Asbjørn Hróbjartsson, Manoj M. Lalu, Tianjing Li, Elizabeth W. Loder, Evan Mayo-Wilson, Steve McDonald, Luke A. McGuinness, Lesley A. Stewart, James Thomas, Andrea C. Tricco, Vivian A. Welch, Penny Whiting, David Moher
BMJ Vol. 372, pp. n71(2021). DOI: 10.1136/bmj.n71
Provides an updated checklist and flow diagram for transparent reporting of systematic reviews and meta-analyses.
External scholarly reference · 2019Third-party work
Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, Timnit Gebru
Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 220-229(2019). DOI: 10.1145/3287560.3287596
Proposes standardized model documentation covering intended use, performance characteristics, evaluation conditions, and limitations.
External scholarly reference · 2017Third-party work
Marcus R. Munafò, Brian A. Nosek, Dorothy V. M. Bishop, Katherine S. Button, Christopher D. Chambers, Nathalie Percie du Sert, Uri Simonsohn, Eric-Jan Wagenmakers, Jennifer J. Ware, John P. A. Ioannidis
Nature Human Behaviour Vol. 1, pp. 0021(2017). DOI: 10.1038/s41562-016-0021
Sets out practical measures to improve the reliability and efficiency of scientific research through stronger methods, transparency, and incentives.
External scholarly reference · 2016Third-party work
Mark D. Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, Jan-Willem Boiten, Luiz Bonino da Silva Santos, Philip E. Bourne, Jildau Bouwman, Anthony J. Brookes, Tim Clark, Mercè Crosas, Ingrid Dillo, Olivier Dumon, Scott Edmunds, Chris T. Evelo, Richard Finkers, Alejandra Gonzalez-Beltran, Alasdair J. G. Gray, Paul Groth, Carole Goble, Jeffrey S. Grethe, Jaap Heringa, Peter A. C. 't Hoen, Rob Hooft, Tobias Kuhn, Ruben Kok, Joost Kok, Scott J. Lusher, Maryann E. Martone, Albert Mons, Abel L. Packer, Bengt Persson, Philippe Rocca-Serra, Marco Roos, Rene van Schaik, Susanna-Assunta Sansone, Erik Schultes, Thierry Sengstag, Ted Slater, George Strawn, Morris A. Swertz, Mark Thompson, Johan van der Lei, Erik van Mulligen, Jan Velterop, Andra Waagmeester, Peter Wittenburg, Katherine Wolstencroft, Jun Zhao, Barend Mons
Scientific Data Vol. 3, pp. 160018(2016). DOI: 10.1038/sdata.2016.18
Defines the principles that digital research objects should be Findable, Accessible, Interoperable, and Reusable for people and machines.
External scholarly reference · 2015Third-party work
Open Science Collaboration
Science Vol. 349(6251), pp. aac4716(2015). DOI: 10.1126/science.aac4716
Reports a large collaborative effort to replicate 100 experimental and correlational studies and compare replication rates and effect sizes.
External scholarly reference · 2015Third-party work
Brian A. Nosek, George Alter, George C. Banks, Denny Borsboom, Sara D. Bowman, Steven J. Breckler, Stuart Buck, Christopher D. Chambers, Gilbert Chin, Garry Christensen, Morgan Contestabile, Allan Dafoe, Eric Eich, Jeremy Freese, Robert Glennerster, Daniel Goroff, David P. Green, Ben Hesse, Macartan Humphreys, John Ishiyama, Dean Karlan, Alan Kraut, Ann Mabry, Partha Madon, Thomas Mayo-Wilson, Marcia McNutt, Elizabeth Miguel, Elizabeth Levy Paluck, Uri Simonsohn, Courtney Soderberg, Barbara A. Spellman, Jennifer Turitto, Gary VandenBos, Simine Vazire, Eric J. Wagenmakers, Richard Wilson, Tal Yarkoni
Science Vol. 348(6242), pp. 1422-1425(2015). DOI: 10.1126/science.aab2374
Introduces modular Transparency and Openness Promotion guidelines for journals and funders to strengthen openness and reproducibility.