{"id":49339,"date":"2024-11-18T13:23:54","date_gmt":"2024-11-18T07:23:54","guid":{"rendered":"https:\/\/www.enago.com\/academy\/?p=49339"},"modified":"2025-03-04T10:24:44","modified_gmt":"2025-03-04T04:24:44","slug":"upholding-the-integrity-of-open-science","status":"publish","type":"post","link":"https:\/\/www.enago.com\/academy\/upholding-the-integrity-of-open-science\/","title":{"rendered":"Upholding the Integrity of Open Science"},"content":{"rendered":"

Open Access Week 2024<\/a>\u00a0is a good time to reflect on the challenges faced by an important component in the open access ecosystem \u2014 preprint servers.<\/p>\n

Open Access and Preprints<\/h2>\n

The\u00a0open access movement emerged in the early 1990s<\/a>\u00a0with the rise of the internet. Online scholarly publishing became a reality, rooted in the vision of providing universal online access to academic works without financial or legal barriers. Interestingly, preprints predate the open access movement. Offline preprints, in the form of physical mailed copies,\u00a0have existed since at least the 1960s<\/a>. The establishment of arXiv in 1991 ushered in the online preprint server movement, which created a new and easy way of sharing and discovering pre-peer review<\/a> records.<\/p>\n

Yin and Yang<\/h2>\n

Preprints neatly align with the principles of open access. They allow researchers the opportunity to share their findings almost instantly, offering a space to accelerate the pace of scientific discovery and dissemination. Technically, preprint servers offer researchers a chance to get quick feedback from the academic community and subsequently improve their work before formal peer review. Unfortunately, the scientific community has yet to fully embrace this promise of engagement, with\u00a0community commentary present in only a minority of submitted preprints<\/a>.<\/p>\n

Preprints serve as early publications that allow the academic community to engage with research before a potentially lengthy delay in publication after peer review. However, the absence of vetting in preprints\u00a0raises concerns<\/a>\u00a0about potentially\u00a0flawed papers slipping through the cracks<\/a>. This duality highlights the need for a balanced approach to leveraging the benefits of preprints while mitigating their inherent risks. The downside is that there is much potential for poor-quality science to be disseminated and circulated. The consequence of such dissemination is compounded by the fact that preprints are often picked up by news media, which then publicizes unvalidated results.<\/p>\n

The COVID-19 pandemic is a good example of both\u00a0the benefits and drawbacks<\/a>\u00a0of preprint servers (see also here<\/a>). Preprint servers helped disseminate the latest findings quickly but also sparked controversy regarding the quality and reliability of the information shared. As researchers rapidly uploaded findings to preprint platforms, submissions were sometimes misinterpreted or misrepresented, leading to misinformation and conspiracy theories. This prompted widespread discussion on social media despite the papers being withdrawn shortly after publication due to scientific concerns.<\/p>\n

New Threats & Solutions<\/h2>\n

So far, we have assumed that submissions are from honest, well-meaning researchers. However, we now live in a world where paper mills \u2014\u00a0nefarious for-profit entities producing legitimate-looking content<\/a>\u00a0\u2014 can produce submissions in large volumes, crossing ethical, legal, and moral boundaries.\u00a0These entities can flood the preprint server ecosystem<\/a>\u00a0with bogus studies,\u00a0making it harder to find genuine research<\/a>.<\/p>\n

Initiatives like\u00a0Plan S<\/a>\u00a0and\u00a0Plan U<\/a>\u00a0are shaking up the traditional publishing landscape by advocating for full and immediate open access to scholarly publications\u00a0funded by public and private grants<\/a>. They promote the use of preprints as a standard practice, which could further complicate matters in terms of submission volumes.<\/p>\n

Publishers and journals\u00a0are stepping up their game<\/a>\u00a0by adopting automated screening and integrity checks, which can screen submissions for aspects such as plagiarism, ethics and integrity, language quality, and metadata. It\u2019s a significant step forward in maintaining high standards in academic publishing, helping to weed out the sub-par submissions before peer review.<\/p>\n

Preprint servers\u00a0also implement screening processes<\/a>\u00a0to ensure that submissions are within scope and free from offensive or non-scientific content. The screening typically involves two main steps: an initial review by in-house staff to verify submission details and a subsequent evaluation by volunteer experts who assess the potential public health implications of the research (at least for biomedical preprint servers). While this process is not as rigorous as traditional peer review, it does help to maintain a level of quality and safety in the content shared.<\/p>\n

There are many players in\u00a0the field of automated screening and research integrity checks for publishers and journals<\/a>, and more are emerging. So why not implement similar checks for preprint servers? These systems could help the staff and volunteer teams screen submissions in a faster, more efficient way, improving the quality of submissions that make it onto preprint platforms. Taking it a step further, preprints that have undergone screening could even be awarded a \u201cgreen channel\u201d for faster submission to traditional publishers, speeding up the publication process without compromising on quality. This would not only enhance the reliability of preprints but also lighten the load for publishers, allowing them to focus on what sets them apart from preprints: peer review.<\/p>\n

The Way Forward<\/h2>\n

To make this vision a reality, industry-wide collaboration is necessary. Researchers, publishers, and policymakers need to work hand in hand to integrate automated screening and integrity checks across all preprint platforms. Funding agencies should back initiatives that develop and fine-tune such tools, ensuring they are both effective and fair.\u00a0Universities and research institutions also have a role to play<\/a>\u00a0by educating their researchers about\u00a0the importance of maintaining integrity in preprints<\/a>\u00a0and encouraging the use of reputable and \u201cverified\u201d preprint servers.<\/p>\n

Of course, these checks aren\u2019t a silver bullet. These systems will have problems associated with technology and automation. They may carry biases from their training data, lack applicability across different research fields, and exhibit suboptimal levels of accuracy. To address these issues, a balanced approach that combines automated checks with human oversight is essential. This way, the bulk of the screening workload is managed efficiently, while nuanced cases receive the attention they deserve from experienced reviewers.<\/p>\n

Implementing automated checks also requires substantial financial and technical resources. The\u00a0financial sustainability of preprint servers is evidently precarious<\/a>, as many rely on temporary funding from philanthropic organizations and commercial partnerships. Implementing these checks with human oversight can increase the operational burden on servers, necessitating a balance between ensuring quality and maintaining rapid research dissemination. Potential solutions to address this include endowment funding from funders and support from the state for sustaining open research infrastructure. Smaller preprint servers may struggle even more with the costs, potentially leading to unequal standards across platforms. Preprint platforms could collaborate to share technical expertise and resources, reducing the burden on individual servers.<\/p>\n

The Gates Foundation has taken the first steps toward this future with the launch of\u00a0Verixiv, their new preprint server<\/a>\u00a0that runs submissions through a lengthy list of pre-publication checks. Currently, however, it is only accepting research funded by the foundation. It remains to be seen whether such initiatives can be scaled up for broader coverage and whether the necessary funding to do so will be available.<\/p>\n

Despite these challenges, the integration of automated screening and integrity checks is likely the only scalable solution for the long term. Ideally, these measures will help operators uphold higher standards of research quality and integrity, and as the technology behind these checks advances, the screening workload for preprint server operators should also diminish.<\/p>\n

Conclusion<\/h2>\n

To conclude, as preprints become an increasingly integral part of scholarly communication, it is imperative to bolster their screening processes with automation. Embracing such measures will ensure that the quest for open access and rapid dissemination does not come at the expense of integrity and trust. With these improvements, preprint servers can continue to thrive and serve their functions without succumbing to the deluge resulting from bad actors.<\/p>\n

 <\/p>\n

This article, “Upholding the Integrity of Open Science<\/a>” was published by The Scholarly Kitchen.<\/em><\/p>\n

\n\t\t<\/a>\n\t\t<\/div>","protected":false},"excerpt":{"rendered":"

Open Access Week 2024\u00a0is a good time to reflect on the challenges faced by an…<\/p>\n","protected":false},"author":9584,"featured_media":49343,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"footnotes":""},"categories":[1926],"tags":[159,1343,1623],"ppma_author":[1957],"class_list":["post-49339","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-thought-leadership","tag-open-access","tag-open-peer-review","tag-open-science"],"better_featured_image":{"id":49343,"alt_text":"","caption":"","description":"","media_type":"image","media_details":{"width":910,"height":340,"file":"2024\/11\/168.png","filesize":339868,"sizes":{"medium":{"file":"168-470x176.png","width":470,"height":176,"mime-type":"image\/png","filesize":119288,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-470x176.png"},"large":{"file":"168-750x280.png","width":750,"height":280,"mime-type":"image\/png","filesize":260009,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-750x280.png"},"thumbnail":{"file":"168-170x150.png","width":170,"height":150,"mime-type":"image\/png","filesize":44023,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-170x150.png"},"medium_large":{"file":"168-768x287.png","width":768,"height":287,"mime-type":"image\/png","filesize":270797,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-768x287.png"},"tf-client-image-size":{"file":"168-120x120.png","width":120,"height":120,"mime-type":"image\/png","filesize":26271,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-120x120.png"},"publisher-tb1":{"file":"168-86x64.png","width":86,"height":64,"mime-type":"image\/png","filesize":11476,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-86x64.png"},"publisher-sm":{"file":"168-210x136.png","width":210,"height":136,"mime-type":"image\/png","filesize":49769,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-210x136.png"},"publisher-mg2":{"file":"168-279x220.png","width":279,"height":220,"mime-type":"image\/png","filesize":94893,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-279x220.png"},"publisher-md":{"file":"168-357x210.png","width":357,"height":210,"mime-type":"image\/png","filesize":113392,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-357x210.png"},"publisher-lg":{"file":"168-750x340.png","width":750,"height":340,"mime-type":"image\/png","filesize":297125,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-750x340.png"},"publisher-tall-sm":{"file":"168-180x217.png","width":180,"height":217,"mime-type":"image\/png","filesize":59646,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-180x217.png"},"publisher-tall-lg":{"file":"168-267x322.png","width":267,"height":322,"mime-type":"image\/png","filesize":113798,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-267x322.png"},"publisher-tall-big":{"file":"168-368x340.png","width":368,"height":340,"mime-type":"image\/png","filesize":160815,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-368x340.png"},"rpwe-thumbnail":{"file":"168-45x45.png","width":45,"height":45,"mime-type":"image\/png","filesize":4532,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-45x45.png"},"web-stories-poster-portrait":{"file":"168-640x340.png","width":640,"height":340,"mime-type":"image\/png","filesize":265817,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-640x340.png"},"web-stories-publisher-logo":{"file":"168-96x96.png","width":96,"height":96,"mime-type":"image\/png","filesize":17859,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-96x96.png"},"web-stories-thumbnail":{"file":"168-150x56.png","width":150,"height":56,"mime-type":"image\/png","filesize":16384,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168-150x56.png"}},"image_meta":{"aperture":"0","credit":"","camera":"","caption":"","created_timestamp":"0","copyright":"","focal_length":"0","iso":"0","shutter_speed":"0","title":"","orientation":"0","keywords":[]}},"post":null,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/11\/168.png"},"acf":{"faq_main_heading":"","faq_heading_one":"","faq_heading_two":"","faq_heading_three":"","faq_heading_four":"","faq_heading_five":"","faq_heading_six":"","faq_description_one":"","faq_description_two":"","faq_description_three":"","faq_description_four":"","faq_description_five":"","faq_description_six":""},"views":401,"single_webinar_page_date":null,"single_webinar_page_time":null,"session_agenda":null,"who_should_attend_this_session":null,"about_the_speaker_field":null,"co-webinar-sec":null,"co_webinar_sec_one":null,"speaker-name":null,"webinar-date":null,"webinar-time":null,"webinar-s-image":null,"custum_webinar_category":null,"authors":[{"term_id":1957,"user_id":9584,"is_guest":0,"slug":"krishna_kumar","display_name":"Dr. Krishna Kumar (KK)","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/816815794e4a673328d125420a1e4f5746a13ffeb5c9248b31676be310a9e8da?s=96&d=identicon&r=g","author_category":"","user_url":"","last_name":"Kumar","first_name":"Krishna","job_title":"","description":"Dr. Krishna Kumar (KK) is passionate about science communication and dissemination of research findings and technological innovation. Coming from the field of orthopedic surgery, he has 15 years of experience as a manuscript editor\/writer, publications consultant, and trainer. As an ardent teacher, he conducts interactive training workshops on scholarly publishing and manuscript writing for researchers, scientists, and manuscript editors. In his current role at Enago, he is involved in developing and deploying innovative solutions, in terms of both products and services, catered to every stage of the academic publication workflow.\r\n\r\nDr. KK has a MS Orthopedic Surgery from King Edward's Medical College Mumbai. He is a published author of academic publications and has been active as a writer\/blogger for over two decades."}],"_links":{"self":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/49339","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/users\/9584"}],"replies":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/comments?post=49339"}],"version-history":[{"count":5,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/49339\/revisions"}],"predecessor-version":[{"id":49378,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/49339\/revisions\/49378"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media\/49343"}],"wp:attachment":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media?parent=49339"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/categories?post=49339"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/tags?post=49339"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/ppma_author?post=49339"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}