{"id":102622,"date":"2021-01-23T01:02:40","date_gmt":"2021-01-23T01:02:40","guid":{"rendered":"http:\/\/ahay.org\/blog\/?p=102622"},"modified":"2021-01-23T01:02:40","modified_gmt":"2021-01-23T01:02:40","slug":"legislating-reproducibility","status":"publish","type":"post","link":"https:\/\/ahay.org\/blog\/2021\/01\/23\/legislating-reproducibility\/","title":{"rendered":"Legislating reproducibility"},"content":{"rendered":"<p><img decoding=\"async\" src=\"\/blog\/wp-content\/uploads\/2021\/01\/Screen-Shot-2021-01-22-at-6.23.10-PM.png\" alt=\"\" title=\"\" \/><\/p>\n<p><a href=\"https:\/\/en.wikipedia.org\/wiki\/American_Innovation_and_Competitiveness_Act\">American Innovation and Competitiveness Act<\/a> was adopted unanimously by the U.S. Congress and signed into law by president Obama in January 2017. <\/p>\n<p>The law contains a section called <em>Research Reproducibility and Replication<\/em>, which asked the Director of the National Science Foundation in agreement with the National Research Council to prepare a report on issues related to research reproducibility and &#8220;to make recommendations for improving rigor and transparency in scientific research&#8221;.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/assets.pubpub.org\/k7iivg3i\/41603808582523.jpg\" alt=\"\" title=\"\" \/><\/p>\n<p>To fulfill this requirement, a <a href=\"https:\/\/www.nap.edu\/catalog\/25303\/reproducibility-and-replicability-in-science\">consensus report<\/a> of the National Academies of Sciences, Engineering, and Medicine was published in 2019. The report is summarized in the <a href=\"https:\/\/hdsr.mitpress.mit.edu\/volume2issue4\">special issue<\/a> of <em>Harvard Data Science Review<\/em> in December 2020.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/assets.pubpub.org\/fd9yoz6l\/71607043176148.png\" alt=\"\" title=\"\" \/><\/p>\n<p>Among the <a href=\"https:\/\/hdsr.mitpress.mit.edu\/pub\/nas-report-highlights\/release\/1\">recommendations<\/a>:<\/p>\n<p><strong>All researchers<\/strong> should include a clear, specific, and complete description of how the reported results were reached. Reports should include details appropriate for the type of research, including:<\/p>\n<ul>\n<li>a clear description of all methods, instruments, materials, procedures, measurements, and other variables involved in the study;<\/li>\n<li>a clear description of the analysis of data and decisions for exclusion of some data or inclusion of other;<\/li>\n<li>for results that depend on statistical inference, a description of the analytic decisions and when these decisions were made and whether the study is exploratory or confirmatory;<\/li>\n<li>a discussion of the expected constraints on generality, such as which methodological features the authors think could be varied without affecting the result and which must remain constant;<\/li>\n<li>reporting of precision or statistical power; and<\/li>\n<li>discussion of the uncertainty of the measurements, results, and inferences.<\/li>\n<\/ul>\n<p><strong>Funding agencies and organizations<\/strong> should consider investing in research and development of open-source, usable tools and infrastructure that support reproducibility for a broad range of studies across different domains in a seamless fashion. Concurrently, investments would be helpful in outreach to inform and train researchers on best practices and how to use these tools.<\/p>\n<p><strong>Journals<\/strong> should consider ways to ensure computational reproducibility for publications that make claims based on computations, to the extent ethically and legally possible.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>American Innovation and Competitiveness Act was adopted unanimously by the U.S. Congress and signed into law by president Obama in January 2017. The law contains a section called Research Reproducibility and Replication, which asked the Director of the National Science Foundation in agreement with the National Research Council to prepare a report on issues related [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_import_markdown_pro_load_document_selector":0,"_import_markdown_pro_submit_text_textarea":"","activitypub_content_warning":"","activitypub_content_visibility":"local","activitypub_max_image_attachments":4,"activitypub_interaction_policy_quote":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-102622","post","type-post","status-publish","format-standard","hentry","category-celebration"],"_links":{"self":[{"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/posts\/102622","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/comments?post=102622"}],"version-history":[{"count":4,"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/posts\/102622\/revisions"}],"predecessor-version":[{"id":102653,"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/posts\/102622\/revisions\/102653"}],"wp:attachment":[{"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/media?parent=102622"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/categories?post=102622"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ahay.org\/blog\/wp-json\/wp\/v2\/tags?post=102622"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}