{"id":8074,"date":"2017-06-22T10:00:34","date_gmt":"2017-06-22T04:30:34","guid":{"rendered":"https:\/\/www.enago.com\/academy\/?p=8074"},"modified":"2022-10-26T09:34:05","modified_gmt":"2022-10-26T03:34:05","slug":"intelligent-crowd-peer-review-successfully-tested","status":"publish","type":"post","link":"https:\/\/www.enago.com\/academy\/intelligent-crowd-peer-review-successfully-tested\/","title":{"rendered":"Intelligent Crowd Peer Review Successfully Tested"},"content":{"rendered":"<p><a href=\"https:\/\/www.thieme.de\/de\/synlett\/journal-information-55964.htm\" target=\"_blank\" rel=\"noopener\"><em>Synlett<\/em><\/a>, an international chemistry journal published by <a href=\"http:\/\/www.thieme.com\/\" target=\"_blank\" rel=\"noopener\">Thieme<\/a>, has successfully tried a new form of <a href=\"https:\/\/www.enago.com\/publication-support-services\/peer-review-process\" data-internallinksmanager029f6b8e52c=\"115\" title=\"Peer Review\" target=\"_blank\" rel=\"noopener\">peer review<\/a> aimed to make manuscript assessment faster and fairer. The journal\u2019s editor in chief, Benjamin List of the Max Planck Institute for Coal Research in Germany, and his PhD student Denis H\u00f6fler have called the new method \u201cintelligent crowd\u201d peer review. This method allows a large number of approved referees to comment on manuscripts online.<\/p>\n<p>The researchers developed this as an alternative to the <a href=\"https:\/\/www.enago.com\/academy\/peer-review-process-evaluation-criteria\/\" target=\"_blank\" rel=\"noopener\">traditional peer review<\/a> system, used by most academic journals. According to List, the <a href=\"https:\/\/www.chemistryworld.com\/news\/chemistry-journal-introduces-intelligent-crowd-peer-review-\/3007534.article\" target=\"_blank\" rel=\"noopener\">current procedure<\/a> is sloppy and slow; one of his main criticisms is the limited number of referees\u2014usually two or three\u2014to evaluate the quality of a paper.<\/p>\n<p><a href=\"https:\/\/app.monstercampaigns.com\/c\/ns4wtb6hhz83c4fl5ucr\/\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-40065 lazyload\" data-src=\"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/PRW_Infographic_Banner_900-\u00d7-270px.png\" alt=\"Peer review\" width=\"900\" height=\"270\" data-srcset=\"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/PRW_Infographic_Banner_900-\u00d7-270px.png 900w, https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/PRW_Infographic_Banner_900-\u00d7-270px-470x141.png 470w, https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/PRW_Infographic_Banner_900-\u00d7-270px-750x225.png 750w, https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/PRW_Infographic_Banner_900-\u00d7-270px-768x230.png 768w, https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/04\/PRW_Infographic_Banner_900-\u00d7-270px-150x45.png 150w\" data-sizes=\"(max-width: 900px) 100vw, 900px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 900px; --smush-placeholder-aspect-ratio: 900\/270;\" \/><\/a><\/p>\n<p>In the new approach, many <a href=\"https:\/\/phys.org\/news\/2017-06-intelligent-crowd-scientific-papers.html\" target=\"_blank\" rel=\"noopener\" class=\"broken_link\">peers can access and comment<\/a> on manuscripts online within a short period, which makes the method potentially faster and more reliable. In the test case with <em>Synlett<\/em>, the editors selected 100 reviewers based on the recommendation from the editorial board and the researchers who volunteered to participate. These referees were then allowed to comment on ten submitted papers.<\/p>\n<p>The <em>Synlett<\/em> team believes that the new system is more effective and can remove biased refereeing. The trial took place in 2016, with all the participating manuscripts attracting qualified comments and discussions from the crowd within a few days. This helped the editors to make faster and fairer decisions. All the comments were anonymous. This was important to ensure that the reports were straightforward and critical whenever necessary. Although this can be true, <a href=\"https:\/\/www.enago.com\/academy\/open-vs-blind-peer-review\/\" target=\"_blank\" rel=\"noopener\">blind peer review<\/a> and <a href=\"https:\/\/www.enago.com\/academy\/why-is-double-blind-peer-review-bad-for-publishing\/\" target=\"_blank\" rel=\"noopener\">double-blind peer review<\/a> also have disadvantages.<\/p>\n<p>Other online approaches, such as <a href=\"https:\/\/blogs.scientificamerican.com\/information-culture\/post-publication-peer-review-everything-changes-and-everything-stays-the-same\/\" target=\"_blank\" rel=\"noopener\">post-publication peer review<\/a>, work in a similar way. However, in those cases, anybody from the public can anonymously post a comment on a given manuscript. In that case, abusive and unqualified reviews cannot be completely excluded. Whereas, in intelligent crowd peer review, the editors know all the referees, so above mentioned problem can be avoided.<\/p>\n<p>The publisher and <em>Synlett<\/em>\u2019s editorial team are happy with the outcome of the trial. According to the editors of the chemistry journal, both referees and authors are satisfied with the results. Nine out of the ten manuscripts taking part in the study were finally accepted for publication. The journal would like to extend the <a href=\"https:\/\/www.read.enago.com\" target=\"_blank\" rel=\"noopener\">new peer review system<\/a> to all the papers it handles.<\/p>\n<p>&nbsp;<\/p>\n<div style=\"display:flex; gap:10px;justify-content:\" class=\"wps-pgfw-pdf-generate-icon__wrapper-frontend\">\n\t\t<a  href=\"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/8074?action=genpdf&amp;id=8074\" class=\"pgfw-single-pdf-download-button\" ><img data-src=\"https:\/\/www.enago.com\/academy\/wp-content\/plugins\/pdf-generator-for-wp\/admin\/src\/images\/PDF_Tray.svg\" title=\"Generate PDF\" style=\"width:auto; height:45px;\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\"><\/a>\n\t\t<\/div>","protected":false},"excerpt":{"rendered":"<p>Synlett, an international chemistry journal published by Thieme, has successfully tried a new form of&hellip;<\/p>\n","protected":false},"author":6,"featured_media":8106,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"footnotes":""},"categories":[757,758],"tags":[44],"ppma_author":[1894],"class_list":["post-8074","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-industry-news","category-publishing-hot-topics","tag-peer-review"],"better_featured_image":{"id":8106,"alt_text":"Crowd Peer Review","caption":"","description":"","media_type":"image","media_details":{"width":930,"height":300,"hwstring_small":"height='41' width='128'","file":"2017\/06\/CrowdPeerReview.jpg","sizes":{"thumbnail":{"file":"CrowdPeerReview-170x150.jpg","width":170,"height":150,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-170x150.jpg"},"medium":{"file":"CrowdPeerReview-470x152.jpg","width":470,"height":152,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-470x152.jpg"},"medium_large":{"file":"CrowdPeerReview-768x248.jpg","width":768,"height":248,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-768x248.jpg"},"better-amp-small":{"file":"CrowdPeerReview-100x100.jpg","width":100,"height":100,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-100x100.jpg"},"better-amp-normal":{"file":"CrowdPeerReview-260x200.jpg","width":260,"height":200,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-260x200.jpg"},"better-amp-large":{"file":"CrowdPeerReview-450x300.jpg","width":450,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-450x300.jpg"},"publisher-tb1":{"file":"CrowdPeerReview-86x64.jpg","width":86,"height":64,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-86x64.jpg"},"publisher-sm":{"file":"CrowdPeerReview-210x136.jpg","width":210,"height":136,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-210x136.jpg"},"publisher-mg2":{"file":"CrowdPeerReview-279x220.jpg","width":279,"height":220,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-279x220.jpg"},"publisher-md":{"file":"CrowdPeerReview-357x210.jpg","width":357,"height":210,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-357x210.jpg"},"publisher-lg":{"file":"CrowdPeerReview-750x300.jpg","width":750,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-750x300.jpg"},"publisher-tall-sm":{"file":"CrowdPeerReview-180x217.jpg","width":180,"height":217,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-180x217.jpg"},"publisher-tall-lg":{"file":"CrowdPeerReview-267x300.jpg","width":267,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-267x300.jpg"},"publisher-tall-big":{"file":"CrowdPeerReview-368x300.jpg","width":368,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview-368x300.jpg"}},"image_meta":{"aperture":"0","credit":"","camera":"","caption":"","created_timestamp":"0","copyright":"","focal_length":"0","iso":"0","shutter_speed":"0","title":"","orientation":"0","keywords":[]}},"post":8074,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2017\/06\/CrowdPeerReview.jpg"},"acf":{"faq_main_heading":"","faq_heading_one":"","faq_heading_two":"","faq_heading_three":"","faq_heading_four":"","faq_heading_five":"","faq_heading_six":"","faq_description_one":"","faq_description_two":"","faq_description_three":"","faq_description_four":"","faq_description_five":"","faq_description_six":""},"views":344,"single_webinar_page_date":null,"single_webinar_page_time":null,"session_agenda":null,"who_should_attend_this_session":null,"about_the_speaker_field":null,"co-webinar-sec":null,"co_webinar_sec_one":null,"speaker-name":null,"webinar-date":null,"webinar-time":null,"webinar-s-image":null,"custum_webinar_category":null,"authors":[{"term_id":1894,"user_id":6,"is_guest":0,"slug":"daveishan","display_name":"Enago Academy","avatar_url":{"url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/03\/cropped-favicon-192x192-1.png","url2x":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2024\/03\/cropped-favicon-192x192-1.png"},"author_category":"","user_url":"","last_name":"","first_name":"","job_title":"","description":"Enago Academy, the knowledge arm of Enago, offers comprehensive and up-to-date resources on academic research and scholarly publishing to all levels of scholarly professionals: students, researchers, editors, publishers, and academic societies. It is also a popular platform for networking, allowing researchers to learn, share, and discuss their experiences within their network and community. The team, which comprises subject matter experts, academicians, trainers, and technical project managers, are passionate about helping researchers at all levels establish a successful career, both within and outside academia."}],"_links":{"self":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/8074","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/comments?post=8074"}],"version-history":[{"count":0,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/8074\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media\/8106"}],"wp:attachment":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media?parent=8074"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/categories?post=8074"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/tags?post=8074"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/ppma_author?post=8074"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}