{"id":21105,"date":"2020-01-30T10:00:29","date_gmt":"2020-01-30T04:00:29","guid":{"rendered":"https:\/\/www.enago.com\/academy\/?p=21105"},"modified":"2022-10-26T08:30:36","modified_gmt":"2022-10-26T02:30:36","slug":"publishing-peer-review-reports-does-it-affect-reviewer-behavior","status":"publish","type":"post","link":"https:\/\/www.enago.com\/academy\/publishing-peer-review-reports-does-it-affect-reviewer-behavior\/","title":{"rendered":"Publishing Peer Review Reports \u2013 Does It Affect Reviewer&#8217;s Behavior?"},"content":{"rendered":"<p>As an academic, you rely on publications to secure and further your career. However, publishing a research is not easy. For decades, academics have questioned the way journals select and review the articles that are published. Some journals have responded with publishing the <a href=\"https:\/\/www.enago.com\/publication-support-services\/peer-review-process\" data-internallinksmanager029f6b8e52c=\"115\" title=\"Peer Review\" target=\"_blank\" rel=\"noopener\">peer review<\/a> reports they receive from referees. This has raised another concern: will an open peer review system affect the way referees write a review? Researchers <a href=\"https:\/\/www.enago.com\/academy\/are-published-peer-review-reports-beneficial\/\" target=\"_blank\" rel=\"noopener\">performed a pilot study<\/a> to assess this. Let us find out more about this study.<\/p>\n<p><a href=\"https:\/\/app.monstercampaigns.com\/c\/dfuovyfhrxpj5ownvf2z\/\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-40304 lazyload\" data-src=\"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2020\/12\/PRW_E-book2022-900-\u00d7-270-px-1.jpg\" alt=\"\" width=\"900\" height=\"270\" data-srcset=\"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2020\/12\/PRW_E-book2022-900-\u00d7-270-px-1.jpg 900w, https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2020\/12\/PRW_E-book2022-900-\u00d7-270-px-1-470x141.jpg 470w, https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2020\/12\/PRW_E-book2022-900-\u00d7-270-px-1-750x225.jpg 750w, https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2020\/12\/PRW_E-book2022-900-\u00d7-270-px-1-768x230.jpg 768w, https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2020\/12\/PRW_E-book2022-900-\u00d7-270-px-1-150x45.jpg 150w\" data-sizes=\"(max-width: 900px) 100vw, 900px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 900px; --smush-placeholder-aspect-ratio: 900\/270;\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<div id=\"om-krnbd2hdx2gat81dd6i8-holder\"><\/div>\n<h2>Pilot Study of an Open Peer Review System<\/h2>\n<p>A pilot study was conducted involving five top journals to evaluate whether publishing peer review reports <a href=\"https:\/\/www.nature.com\/articles\/s41467-018-08250-2\" target=\"_blank\" rel=\"noopener\">would affect a referee\u2019s behavior<\/a>. Following factors were considered:<\/p>\n<ol>\n<li>Reviewer\u2019s <strong>willingness<\/strong> to review articles.<\/li>\n<li>The type of <strong>recommendations<\/strong> the reviewers made.<\/li>\n<li>Reviewer review turn-around <strong>times<\/strong>.<\/li>\n<li>The <strong>tone<\/strong> of the report.<\/li>\n<\/ol>\n<p>Following these criteria minimized the bias:<\/p>\n<ul>\n<li>Journals selected had similar impact factors, number of submissions and submission dynamics.<\/li>\n<li>Comparison of reviewer behavior for reviews <a href=\"https:\/\/blogs.royalsociety.org\/publishing\/publication-of-peer-review-reports\/\" target=\"_blank\" rel=\"noopener\">conducted before and during the study<\/a>. In addition, the control group for the same used the closed peer review system.<\/li>\n<li>Well-informed authors and reviewers.<\/li>\n<li>Reviewers <a href=\"https:\/\/www.enago.com\/academy\/new-portable-peer-review-policy-and-its-effect-on-academia\/\" target=\"_blank\" rel=\"noopener\">agreed to publish their reviews<\/a>.<\/li>\n<li>Reviewers had the option of remaining anonymous.<\/li>\n<li>The results included only first round reviews to minimize the effect of reviewer learning.<\/li>\n<li>The study included both open-access and subscription-based journals.<\/li>\n<\/ul>\n<h2>Pilot Study Findings<\/h2>\n<p><a href=\"https:\/\/www.enago.com\/publication-support-services\/statistical-analysis.htm\" data-internallinksmanager029f6b8e52c=\"121\" title=\"Statistical Analysis\" target=\"_blank\" rel=\"noopener\">Statistical analysis<\/a> of comparison of reviewer reports before and during the pilot study gave the following outcomes:<\/p>\n<ul>\n<li><strong>Willingness to Review<\/strong>: Knowing that their review would be published did not put referees off reviewing papers. Although the referee\u2019s acceptance rates to review a paper decreased from 43.6% to 30.9%, even the control group showed similar results. Therefore, there was a general decline of review acceptance, not influenced by the trial.<\/li>\n<li><strong>Recommendations<\/strong>: Overall, <a href=\"https:\/\/www.enago.com\/academy\/ten-senior-editors-resign-peer-review-process-in-danger\/\" target=\"_blank\" rel=\"noopener\">making review reports public<\/a> did not bias recommendations made by reviewers. The only differences noted were within referees of different status. Younger and non-academic referees tend to be more positive than professors and PhDs.<\/li>\n<li><strong>Review time<\/strong>: Previously, reviewers did not pay much attention while writing their reports. With their review reports published laters, referees may spend more time on the language and structure of the report.<\/li>\n<li><strong>Tone of the report<\/strong>:\u00a0As the review reports will be reaching a wider audience \u2013 not just the editorial board of the journal \u2013 the tone of their report was expected to be different. The tone of the report observed was slightly more positive tone, but the differences were minimal.<\/li>\n<\/ul>\n<h2>Open Peer Review System Considerations<\/h2>\n<p>Publishing peer review reports <a href=\"https:\/\/www.enago.com\/academy\/sharing-peer-review-data-helps-counter-scientific-misconduct\/\" target=\"_blank\" rel=\"noopener\">seems a workable solution<\/a> to improve the transparency of the peer review process. A few points to think about are:<\/p>\n<ol>\n<li>This was a pilot study and further research across all disciplines needs to be performed.<\/li>\n<li>This method of transparency could be more effective than pre-publication interaction between referees, editors and authors.<\/li>\n<li>Anonymity emerged as an important factor. Reviewers were far more comfortable with their reports being published if their identity was not revealed.<\/li>\n<li>Identifying reviewers protects journals from accusations of conflicts of interest.<\/li>\n<\/ol>\n<h2>Benefits of Publishing Peer Review Reports<\/h2>\n<p>Publishing peer review reports could be a great tool for everyone in the research community. In addition to the benefits mentioned above, it could help researchers improve the quality of their papers by learning from review reports. Consequently, journals could benefit from receiving submissions of a higher quality. The entire research community should welcome the move to publish peer review reports. Do you agree? Let us know in the comments section below.<\/p>\n<div style=\"display:flex; gap:10px;justify-content:\" class=\"wps-pgfw-pdf-generate-icon__wrapper-frontend\">\n\t\t<a  href=\"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/21105?action=genpdf&amp;id=21105\" class=\"pgfw-single-pdf-download-button\" ><img data-src=\"https:\/\/www.enago.com\/academy\/wp-content\/plugins\/pdf-generator-for-wp\/admin\/src\/images\/PDF_Tray.svg\" title=\"Generate PDF\" style=\"width:auto; height:45px;\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\"><\/a>\n\t\t<\/div>","protected":false},"excerpt":{"rendered":"<p>As an academic, you rely on publications to secure and further your career. However, publishing&hellip;<\/p>\n","protected":false},"author":8169,"featured_media":21109,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"footnotes":""},"categories":[751,756],"tags":[44,1483,1103],"ppma_author":[1908],"class_list":["post-21105","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-publication-stages","category-peer-technical-review","tag-peer-review","tag-peer-review-reports","tag-peer-reviewers"],"better_featured_image":{"id":21109,"alt_text":"peer review reports","caption":"","description":"Peer review reports have been published over a long time. But does the referee's behavior change with his review report being known to a wider audience.","media_type":"image","media_details":{"width":750,"height":430,"file":"2019\/02\/pexels-photo-1851446-1.jpeg","sizes":{"thumbnail":{"file":"pexels-photo-1851446-1-170x150.jpeg","width":170,"height":150,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-170x150.jpeg"},"medium":{"file":"pexels-photo-1851446-1-401x230.jpeg","width":401,"height":230,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-401x230.jpeg"},"large":{"file":"pexels-photo-1851446-1-750x430.jpeg","width":750,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-750x430.jpeg"},"better-amp-small":{"file":"pexels-photo-1851446-1-100x100.jpeg","width":100,"height":100,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-100x100.jpeg"},"better-amp-normal":{"file":"pexels-photo-1851446-1-260x200.jpeg","width":260,"height":200,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-260x200.jpeg"},"better-amp-large":{"file":"pexels-photo-1851446-1-450x300.jpeg","width":450,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-450x300.jpeg"},"publisher-tb1":{"file":"pexels-photo-1851446-1-86x64.jpeg","width":86,"height":64,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-86x64.jpeg"},"publisher-sm":{"file":"pexels-photo-1851446-1-210x136.jpeg","width":210,"height":136,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-210x136.jpeg"},"publisher-mg2":{"file":"pexels-photo-1851446-1-279x220.jpeg","width":279,"height":220,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-279x220.jpeg"},"publisher-md":{"file":"pexels-photo-1851446-1-357x210.jpeg","width":357,"height":210,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-357x210.jpeg"},"publisher-tall-sm":{"file":"pexels-photo-1851446-1-180x217.jpeg","width":180,"height":217,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-180x217.jpeg"},"publisher-tall-lg":{"file":"pexels-photo-1851446-1-267x322.jpeg","width":267,"height":322,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-267x322.jpeg"},"publisher-tall-big":{"file":"pexels-photo-1851446-1-368x430.jpeg","width":368,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-368x430.jpeg"},"Book Review":{"file":"pexels-photo-1851446-1-320x430.jpeg","width":320,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1-320x430.jpeg"}},"image_meta":{"aperture":"0","credit":"","camera":"","caption":"","created_timestamp":"0","copyright":"","focal_length":"0","iso":"0","shutter_speed":"0","title":"","orientation":"0","keywords":[]}},"post":21105,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/02\/pexels-photo-1851446-1.jpeg"},"acf":{"faq_main_heading":"","faq_heading_one":"","faq_heading_two":"","faq_heading_three":"","faq_heading_four":"","faq_heading_five":"","faq_heading_six":"","faq_description_one":"","faq_description_two":"","faq_description_three":"","faq_description_four":"","faq_description_five":"","faq_description_six":""},"views":736,"single_webinar_page_date":null,"single_webinar_page_time":null,"session_agenda":null,"who_should_attend_this_session":null,"about_the_speaker_field":null,"co-webinar-sec":null,"co_webinar_sec_one":null,"speaker-name":null,"webinar-date":null,"webinar-time":null,"webinar-s-image":null,"custum_webinar_category":null,"authors":[{"term_id":1908,"user_id":8169,"is_guest":0,"slug":"eneditor","display_name":"Enago Academy","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/046a0ceeb5c38172654db93f9919593bc2e4e1391702eb8b7248865941ddbe18?s=96&d=identicon&r=g","author_category":"","user_url":"","last_name":"Academy","first_name":"Enago","job_title":"","description":"Enago Academy, the knowledge arm of Enago, offers comprehensive and up-to-date resources on academic research and scholarly publishing to all levels of scholarly professionals: students, researchers, editors, publishers, and academic societies. It is also a popular platform for networking, allowing researchers to learn, share, and discuss their experiences within their network and community. The team, which comprises subject matter experts, academicians, trainers, and technical project managers, are passionate about helping researchers at all levels establish a successful career, both within and outside academia."}],"_links":{"self":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/21105","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/users\/8169"}],"replies":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/comments?post=21105"}],"version-history":[{"count":0,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/21105\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media\/21109"}],"wp:attachment":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media?parent=21105"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/categories?post=21105"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/tags?post=21105"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/ppma_author?post=21105"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}