{"id":2904,"date":"2015-08-11T10:26:42","date_gmt":"2015-08-11T04:56:42","guid":{"rendered":"https:\/\/www.enago.com\/academy\/?p=2904"},"modified":"2018-05-24T17:09:22","modified_gmt":"2018-05-24T11:39:22","slug":"can-metrics-center-save-science","status":"publish","type":"post","link":"https:\/\/www.enago.com\/academy\/can-metrics-center-save-science\/","title":{"rendered":"Can the METRICS Center Save Science?"},"content":{"rendered":"<h2>METRICS: A Little Backdrop<\/h2>\n<p>In 2005, the <i>Public Library of Science<\/i> (PLoS) Medicine journal published a paper by Greek researcher Dr. John Ioannidis entitled \u201cWhy most published research findings are false.\u201d The paper went on to become the most downloaded article in <i>PLoS<\/i> history, with over 1 million views to date. It addressed research concerns that have dominated Ioannidis\u2019 work for most of his career\u2014poorly designed studies with questionable <a title=\"Why You Should Subject Your Manuscript to Statistics Review?\" href=\"https:\/\/www.enago.com\/academy\/review-for-statistical-analysis\/\" target=\"_blank\" rel=\"noopener\">statistical inferences<\/a> from small population samples, and the inability to reproduce study results across multiple disciplines.<\/p>\n<p>In April 2014, Stanford University announced that Dr. Ioannidis\u2019 work would have a new home as he agreed to become co-director with Dr. Steven Goodman of the new <i>Meta-Research Innovation Center at Stanford<\/i> (METRICS).<\/p>\n<p>Funded with a $6 million grant from the Laura and John Arnold Foundation (LJAF), the METRICS center \u201caims to <a title=\"Organic Change in Academic Research\" href=\"https:\/\/www.enago.com\/academy\/organic-change-in-academic-research\/\" target=\"_blank\" rel=\"noopener\">transform research practices<\/a> to improve the reproducibility, efficiency, and quality of scientific investigations.\u201d<\/p>\n<h2>Waging War on Sloppy Science<\/h2>\n<p>Questionable methodologies notwithstanding, the goal of improved efficiencies has the potential to impact research funding significantly. A 2014 <i>Economist<\/i> article quoted the medical journal <i>Lancet<\/i> as estimating that \u201cIn 2010, about $200 billion (an astonishing 85% of the world\u2019s spending on medical research) was squandered on <a href=\"https:\/\/www.enago.com\/academy\/consequences-of-flawed-research\/\" target=\"_blank\" rel=\"noopener\">studies that were flawed in design<\/a>, redundant, never published or poorly reported.\u201d Improved research practices can certainly help to address such poor fiscal stewardship but attending to issues with redundancy and publishing may be beyond the purview of a medical research center.<\/p>\n<h2>Meta-Research: Research on Research<\/h2>\n<p>By definition, meta-research analysis will examine multiple studies to identify commonalities that will become the top priorities of the METRICS center. The interest in reproducibility of research drew the attention of the LJAF, and concerns over the perceived publication bias of journals skewing articles towards more <a title=\"Has Research Become Too Competitive?\" href=\"https:\/\/www.enago.com\/academy\/has-research-become-too-competitive\/\" target=\"_blank\" rel=\"noopener\">counterintuitive studies<\/a> and results remains a major concern for METRICS. The leadership of both Ioannidis and Goodman in this area may prove to be something of a mixed blessing. Their ideas will no doubt be well received by scientific colleagues, but policymakers and <a title=\"The Near-Term Future Of Academic Publishing\" href=\"https:\/\/www.enago.com\/academy\/near-term-future-of-academic-publishing\/\" target=\"_blank\" rel=\"noopener\">publishers<\/a> may prove somewhat less receptive to dramatic change. In addition, METRICS itself will be under scrutiny to ensure that all research studies practice what they preach in terms of recommended methodologies.<\/p>\n<h2>A Return to Reliability<\/h2>\n<p>There appear to be very high expectations of the work of this center. Concerns within the academic community about journal retractions, questionable <a title=\"Is the peer review process a scam?\" href=\"https:\/\/www.enago.com\/academy\/is-peer-review-process-a-scam\/\" target=\"_blank\" rel=\"noopener\">peer review<\/a> practices, <a title=\"How Disruptive Is Open Access?\" href=\"http:\/\/www.enago.com\/academy\/how-disruptive-is-open-access-publishing\/\" target=\"_blank\" rel=\"noopener\">open access<\/a> models, and other examples of <a title=\"10 Types Of Scientific Misconduct\" href=\"https:\/\/www.enago.com\/academy\/10-types-of-scientific-misconduct\/\" target=\"_blank\" rel=\"noopener\">scientific misconduct<\/a> have created a general malaise about the perceived reliability of scientific research at a time when competitive funding bids cannot afford the risk of being overshadowed by <a title=\"Scientific Misconduct: What Causes Scientists To Cheat\" href=\"https:\/\/www.enago.com\/academy\/scientific-misconduct-why-do-researchers-cheat\/\" target=\"_blank\" rel=\"noopener\">questions of integrity<\/a>. Since no generally accepted solutions have been presented yet, there is clearly room for discussion of both improved methodologies and models but much of that work remains to be seen.<\/p>\n<div style=\"display:flex; gap:10px;justify-content:\" class=\"wps-pgfw-pdf-generate-icon__wrapper-frontend\">\n\t\t<a  href=\"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/2904?action=genpdf&amp;id=2904\" class=\"pgfw-single-pdf-download-button\" ><img data-src=\"https:\/\/www.enago.com\/academy\/wp-content\/plugins\/pdf-generator-for-wp\/admin\/src\/images\/PDF_Tray.svg\" title=\"Generate PDF\" style=\"width:auto; height:45px;\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\"><\/a>\n\t\t<\/div>","protected":false},"excerpt":{"rendered":"<p>METRICS: A Little Backdrop In 2005, the Public Library of Science (PLoS) Medicine journal published&hellip;<\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"footnotes":""},"categories":[757,758],"tags":[515],"ppma_author":[1894],"class_list":["post-2904","post","type-post","status-publish","format-standard","hentry","category-industry-news","category-publishing-hot-topics","tag-big-data"],"better_featured_image":null,"acf":{"faq_main_heading":"","faq_heading_one":"","faq_heading_two":"","faq_heading_three":"","faq_heading_four":"","faq_heading_five":"","faq_heading_six":"","faq_description_one":"","faq_description_two":"","faq_description_three":"","faq_description_four":"","faq_description_five":"","faq_description_six":""},"views":157,"single_webinar_page_date":null,"single_webinar_page_time":null,"session_agenda":null,"who_should_attend_this_session":null,"about_the_speaker_field":null,"co-webinar-sec":null,"co_webinar_sec_one":null,"speaker-name":null,"webinar-date":null,"webinar-time":null,"webinar-s-image":null,"custum_webinar_category":null,"authors":[{"term_id":1894,"user_id":6,"is_guest":0,"slug":"daveishan","display_name":"Enago Academy","avatar_url":{"url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/03\/cropped-favicon-192x192-1.png","url2x":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/03\/cropped-favicon-192x192-1.png"},"author_category":"","user_url":"","last_name":"","first_name":"","job_title":"","description":"Enago Academy, the knowledge arm of Enago, offers comprehensive and up-to-date resources on academic research and scholarly publishing to all levels of scholarly professionals: students, researchers, editors, publishers, and academic societies. It is also a popular platform for networking, allowing researchers to learn, share, and discuss their experiences within their network and community. The team, which comprises subject matter experts, academicians, trainers, and technical project managers, are passionate about helping researchers at all levels establish a successful career, both within and outside academia."}],"_links":{"self":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/2904","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/comments?post=2904"}],"version-history":[{"count":0,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/2904\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media?parent=2904"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/categories?post=2904"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/tags?post=2904"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/ppma_author?post=2904"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}