{"id":7044,"date":"2017-04-17T22:00:06","date_gmt":"2017-04-17T16:30:06","guid":{"rendered":"https:\/\/www.enago.com\/academy\/?p=7044"},"modified":"2019-07-19T19:40:20","modified_gmt":"2019-07-19T13:40:20","slug":"the-importance-of-scientific-transparency-and-reproducibility","status":"publish","type":"post","link":"https:\/\/www.enago.com\/academy\/the-importance-of-scientific-transparency-and-reproducibility\/","title":{"rendered":"The Importance of Scientific Transparency and Reproducibility"},"content":{"rendered":"<p>In scientific research, credibility is of utmost importance. Data documentation and storage, and the \u201crigor, transparency, and attention we invest in designing, conducting, and reporting experiments\u201d are part of ensuring sound credibility. Science can only progress if there is corroboration among colleagues, and reproducing research results can be difficult when the original study is lacking in areas such as unsound scientific methods, misinterpretation of results, or other issues that might have been purposely ignored to achieve the desired results.<\/p>\n<p>According to <em>Nature<\/em>, \u201cthere is growing alarm about results that cannot be reproduced.\u201d With more scrutiny, more complex studies, advanced statistics, and the constant pressure on researchers to publish, nearly everyone involved is concerned about scientific transparency and the challenges with irreproducible research.<\/p>\n<h2>What Scientists Are Saying<\/h2>\n<p>In 2016, <a href=\"http:\/\/www.nature.com\/news\/1-500-scientists-lift-the-lid-on-reproducibility-1.19970\" target=\"_blank\" rel=\"noopener\"><em>Nature<\/em> published the results of an online questionnaire<\/a> from 1,576 respondents on the reproducibility crisis. Only 52% agreed that a crisis does exist, although 70% had attempted to reproduce a study but were unsuccessful. About one-third of respondents believed that this failure meant that the study was not valid, and 73% trusted the validity of at least one-half of the papers published in their fields. Respondent attitudes appeared to be somewhat disconnected with respect to scientific transparency, reproducibility in research, and their importance.<\/p>\n<p>From 60% to more than 80% of respondents had failed to duplicate others\u2019 results, the highest being in the field of chemistry. About 24% of successful replications were accepted by publishers versus about 13% of unsuccessful attempts. Given these results, incentives to duplicate another\u2019s experiment are most likely not very high. Close to 90% of respondents chose \u201cmore robust experimental design, better statistics, and better mentorship\u201d as the most important elements in <a href=\"https:\/\/www.enago.com\/academy\/importance-of-research-ethics\/\" target=\"_blank\" rel=\"noopener\">research transparency<\/a> and reproducibility.<\/p>\n<div id=\"om-krnbd2hdx2gat81dd6i8-holder\"><\/div>\n<p><script type=\"text\/javascript\" src=\"https:\/\/a.opmnstr.com\/app\/js\/api.min.js\" data-campaign=\"krnbd2hdx2gat81dd6i8\" data-user=\"41855\" async><\/script><\/p>\n<h2>Why Replicate a Study?<\/h2>\n<p><em>So with the lack of consensus, why should we care?<\/em><\/p>\n<p>According to Nature, \u201c<a href=\"http:\/\/www.nature.com\/news\/replication-studies-offer-much-more-than-technical-details-1.21311\" target=\"_blank\" rel=\"noopener\">Replication studies offer much more than technical details<\/a>. They demonstrate the practice of science at its best.\u201d The decision to replicate a study can reveal whether the hypothesis has been truly tested, and can identify problems and offer resolutions. Research findings can help initiate clinical trials on new medications, such as cancer drugs.<\/p>\n<p>But what if the findings cannot be reproduced, or if the problems with duplication have to do with the lack of transparency in the research?<\/p>\n<p>The Center for Open Science and Science Exchange has attempted to address these issues by creating The Reproducibility Project: Cancer Biology to <a href=\"http:\/\/blogs.nature.com\/news\/2013\/10\/initiative-gets-1-3-million-to-verify-findings-of-50-high-profile-cancer-papers.html\" target=\"_blank\" rel=\"noopener\" class=\"broken_link\">\u201cexpressly to replicate important research results.\u201d<\/a> The <a href=\"https:\/\/en.wikipedia.org\/wiki\/Laura_and_John_Arnold_Foundation\" target=\"_blank\" rel=\"noopener\">Laura and John Arnold Foundation<\/a> provided $1.3 million as part of its mission to improve reproducibility in science. \u201cThe project was to validate 50 of the highest-impact cancer findings published between 2010 and 2012 in <em>Nature<\/em>, <em>Science<\/em>, <em>Cell<\/em> and other high-impact journals.\u201d According to <a href=\"https:\/\/elifesciences.org\/collections\/reproducibility-project-cancer-biology\" target=\"_blank\" rel=\"noopener\">eLIFE<\/a>, \u201cThe project will provide evidence about reproducibility in cancer biology, and an opportunity to identify factors that influence reproducibility more generally.\u201d<\/p>\n<h2>Some Interesting Findings<\/h2>\n<p><em>Erkki Ruoslahti<\/em>, a cancer biologist at the Sanford Burnham Prebys Medical Discovery Institute, planned to conduct <a href=\"http:\/\/www.nature.com\/news\/cancer-reproducibility-project-releases-first-results-1.21304\" target=\"_blank\" rel=\"noopener\">clinical trials on a new cancer drug<\/a> based on his research findings. When tested using five attempts, his results either could not be duplicated or were unclear. Of the five, one failed, two were successful but not statistically significant, and two produced results that could not be interpreted.<\/p>\n<p>Does this mean that Ruoslahti\u2019s research is invalid? According to Tim Errington, project manager, \u201cA single failure to replicate results does not prove that initial findings were wrong\u2014and shouldn\u2019t put a stain on individual papers.\u201d Simple details, such as a minor temperature change or incorrect reagent mixture, might cause these failures and should not negate the original research. The project noted that the main issue with reproducibility is that many papers include too few details, such as lack of sufficient data, lack of clear methods, or incorrect <a href=\"https:\/\/www.enago.com\/publication-support-services\/statistical-analysis.htm\" data-internallinksmanager029f6b8e52c=\"121\" title=\"Statistical Analysis\" target=\"_blank\" rel=\"noopener\">statistical analysis<\/a>.<\/p>\n<p>An editorial published in Nature stated (in reference to duplicate studies) that \u201cresearchers must make more of them, funders must encourage them and journals must publish them.\u201d Researchers are willing to discuss and share their experiences and regularly do so using multiple forums. F1000 recently launched its <a href=\"https:\/\/f1000research.com\/channels\/PRR\/about-this-channel\" target=\"_blank\" rel=\"noopener\">Preclinical Reproducibility and Robustness<\/a> channel to encourage openness among researchers. Scientific Data and the American Journal of Gastroenterology encourage attempts to replicate studies and even solicit negative results. Nature Biotechnology has also become receptive to publishing replication studies, especially when important research questions are ultimately raised.<\/p>\n<h2>More Collaboration Is Needed<\/h2>\n<p>Current concerns focus on the \u201crigor of the experimental design (inclusion of all appropriate controls, blinded experimental conditions, gender balance in experimental populations, a priori determination of n&#8217;s and statistical power, appropriate statistical analyses, etc.) and on complete transparency in reporting of these parameters and all collected data.\u201d The psychology community has led the way to encouraging collaboration by inviting the original authors to offer suggestions on how to reproduce their studies. The protocols are then published in a registered replication report (RRR), and although conventions and even vocabulary are still progressing, editors of these reports are careful to avoid such terms as <a href=\"http:\/\/www.nature.com\/news\/go-forth-and-replicate-1.20473\" target=\"_blank\" rel=\"noopener\">\u201csuccessful\u201d or \u201cfailed\u201d replications<\/a>.<\/p>\n<p>The trend to maximize <a href=\"https:\/\/www.elsevier.com\/connect\/scientific-credibility-and-reproducibility\" target=\"_blank\" rel=\"noopener\">reproducibility and transparency in science<\/a> involves not only researchers, but stakeholders and funding organizations, \u201cuniversities, journals, pharmaceutical and biotech companies, patient advocacy groups, and society at large.\u201d New guidelines are needed and details must be provided on how experiments were performed. Because data are such a large part of whether a study is valid, standards on how they were collected and what was used and how to analyze them must be followed. As more studies are replicated and the results more widely accepted, the scientific community will help to foster better relationships among researchers who strive for the same goals and will establish \u201creasonable standards of conduct.\u201d<\/p>\n<div style=\"display:flex; gap:10px;justify-content:\" class=\"wps-pgfw-pdf-generate-icon__wrapper-frontend\">\n\t\t<a  href=\"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/7044?action=genpdf&amp;id=7044\" class=\"pgfw-single-pdf-download-button\" ><img data-src=\"https:\/\/www.enago.com\/academy\/wp-content\/plugins\/pdf-generator-for-wp\/admin\/src\/images\/PDF_Tray.svg\" title=\"Generate PDF\" style=\"width:auto; height:45px;\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\"><\/a>\n\t\t<\/div>","protected":false},"excerpt":{"rendered":"<p>In scientific research, credibility is of utmost importance. Data documentation and storage, and the \u201crigor,&hellip;<\/p>\n","protected":false},"author":6,"featured_media":7051,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"footnotes":""},"categories":[751,754],"tags":[1495],"ppma_author":[1894],"class_list":["post-7044","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-publication-stages","category-publication-ethics","tag-scientific-transparency"],"better_featured_image":{"id":7051,"alt_text":"","caption":"","description":"","media_type":"image","media_details":{"width":930,"height":300,"hwstring_small":"height='41' width='128'","file":"2017\/04\/bannertwo.jpg","sizes":{"thumbnail":{"file":"bannertwo-170x150.jpg","width":170,"height":150,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-170x150.jpg"},"medium":{"file":"bannertwo-470x152.jpg","width":470,"height":152,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-470x152.jpg"},"medium_large":{"file":"bannertwo-768x248.jpg","width":768,"height":248,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-768x248.jpg"},"better-amp-small":{"file":"bannertwo-100x100.jpg","width":100,"height":100,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-100x100.jpg"},"better-amp-normal":{"file":"bannertwo-260x200.jpg","width":260,"height":200,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-260x200.jpg"},"better-amp-large":{"file":"bannertwo-450x300.jpg","width":450,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-450x300.jpg"},"publisher-tb1":{"file":"bannertwo-86x64.jpg","width":86,"height":64,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-86x64.jpg"},"publisher-sm":{"file":"bannertwo-210x136.jpg","width":210,"height":136,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-210x136.jpg"},"publisher-mg2":{"file":"bannertwo-279x220.jpg","width":279,"height":220,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-279x220.jpg"},"publisher-md":{"file":"bannertwo-357x210.jpg","width":357,"height":210,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-357x210.jpg"},"publisher-lg":{"file":"bannertwo-750x300.jpg","width":750,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-750x300.jpg"},"publisher-tall-sm":{"file":"bannertwo-180x217.jpg","width":180,"height":217,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-180x217.jpg"},"publisher-tall-lg":{"file":"bannertwo-267x300.jpg","width":267,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-267x300.jpg"},"publisher-tall-big":{"file":"bannertwo-368x300.jpg","width":368,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo-368x300.jpg"}},"image_meta":{"aperture":"0","credit":"","camera":"","caption":"","created_timestamp":"0","copyright":"","focal_length":"0","iso":"0","shutter_speed":"0","title":"","orientation":"0","keywords":[]}},"post":7044,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/bannertwo.jpg"},"acf":{"faq_main_heading":"","faq_heading_one":"","faq_heading_two":"","faq_heading_three":"","faq_heading_four":"","faq_heading_five":"","faq_heading_six":"","faq_description_one":"","faq_description_two":"","faq_description_three":"","faq_description_four":"","faq_description_five":"","faq_description_six":""},"views":1876,"single_webinar_page_date":null,"single_webinar_page_time":null,"session_agenda":null,"who_should_attend_this_session":null,"about_the_speaker_field":null,"co-webinar-sec":null,"co_webinar_sec_one":null,"speaker-name":null,"webinar-date":null,"webinar-time":null,"webinar-s-image":null,"custum_webinar_category":null,"authors":[{"term_id":1894,"user_id":6,"is_guest":0,"slug":"daveishan","display_name":"Enago Academy","avatar_url":{"url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/03\/cropped-favicon-192x192-1.png","url2x":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/03\/cropped-favicon-192x192-1.png"},"author_category":"","user_url":"","last_name":"","first_name":"","job_title":"","description":"Enago Academy, the knowledge arm of Enago, offers comprehensive and up-to-date resources on academic research and scholarly publishing to all levels of scholarly professionals: students, researchers, editors, publishers, and academic societies. It is also a popular platform for networking, allowing researchers to learn, share, and discuss their experiences within their network and community. The team, which comprises subject matter experts, academicians, trainers, and technical project managers, are passionate about helping researchers at all levels establish a successful career, both within and outside academia."}],"_links":{"self":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/7044","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/comments?post=7044"}],"version-history":[{"count":0,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/7044\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media\/7051"}],"wp:attachment":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media?parent=7044"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/categories?post=7044"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/tags?post=7044"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/ppma_author?post=7044"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}