{"id":24380,"date":"2019-08-11T17:30:05","date_gmt":"2019-08-11T11:30:05","guid":{"rendered":"https:\/\/www.enago.com\/academy\/?p=24380"},"modified":"2020-03-06T22:15:12","modified_gmt":"2020-03-06T16:15:12","slug":"investigation-of-clinical-trials-unveils-data-fabrication","status":"publish","type":"post","link":"https:\/\/www.enago.com\/academy\/investigation-of-clinical-trials-unveils-data-fabrication\/","title":{"rendered":"Investigation of Clinical Trials Unveils Data Fabrication"},"content":{"rendered":"

The work that scientists do is vital in many ways. It helps society progress in the fields of medicine, climate change, physics, and beyond. Unfortunately, scientific misconduct is on the rise<\/a>. So, the issues of scientific fraud and data fabrication need serious consideration.\u00a0 To prevent a negative impact on future generations, it is crucial to address the issue of data falsification.<\/p>\n

John Carlisle\u2019s Fight Against Data Fabrication<\/h2>\n

Some may feel that this fight against scientific fraud is too daunting. However, not to John Carlisle. He has single-handedly made it his goal to uncover data fabrication and expose the harm that it does. Carlisle, an anesthetist working for the National Health Service in England, began his work to uncover fraud about a decade ago.<\/p>\n

Carlise\u2019s work has got much attention in the scientific community<\/a>. Over the past decade, he has investigated scientific studies on a wide range of topics. His work has uncovered scientific misconduct in hundreds of papers, leading many to be corrected or retracted. Most significantly, Carlise\u2019s work has helped to expose some of the world\u2019s leading scientific frauds. This includes the end of the careers of three of the six scientists worldwide who have the most retractions. This is a significant step toward protecting the integrity of scientific work.<\/p>\n

One example is Japanese researcher Yoshitaka Fujii, who worked at Toho University in Tokyo. He published studies on the impact of various medicines on preventing vomiting and nausea in patients after surgery. To Carlisle and others, however, the data in these studies looked too clean to be true. After some in-depth investigation, Carlisle concluded that the likelihood of these data patterns occurring was \u201cinfinitesimally small.\u201d As a result, Fujii was soon under investigation. Ultimately, he had 183 of his papers retracted and was fired from Toho University. Four years after his investigation of Fujii, Carlisle co-published an analysis of the publications of another Japanese anaesthesiologist, Yuhji Saitoh. Carlisle and his team deemed this data to be extremely suspicious, as well. As a result, 53 of Saitoh\u2019s works have been retracted.<\/p>\n

John Carlisle\u2019s Methods<\/h2>\n

So, why is Carlisle\u2019s work so effective? The answer is in his methodology. His investigations rely on the idea that real-life data have natural patterns that simulated data struggle to replicate. He focuses on inconsistencies and suspicious data to unearth a more significant trend of fabrication.<\/p>\n

One example is his investigation of anesthesia studies by Italian surgeon Mario Schietroma (University of L\u2019Aquila). This investigation gained the attention of the World Health Organization (WHO), which had used Schietroma\u2019s work as the basis for its recommendations for using anesthesia. In five of the studies that Carlisle looked at, he noticed that the raw data for control and patient groups showed some suspicious similarities. His conclusion stated that Schietroma\u2019s studies were not a reliable basis for clinical practice. Once the WHO read Carlisle\u2019s research and the support it received, the organization quickly downgraded support for Schietroma.<\/p>\n

Two Leaders in Detection: Grim and Statcheck<\/h2>\n

GRIM<\/h3>\n

GRIM<\/a> (Granularity-Related Inconsistency of Means) was developed by Nick Brown, a graduate student in psychology at the University of Groningen, the Netherlands, and James Heathers, a student who studies scientific methods at Northeastern University in Boston, Massachusetts, It is a technique used to verify the summary statistics of research reports. It checks the calculation of statistical means, using this information to flag suspicious data. GRIM relies on precise, mathematical analysis. For example, the test will look at the mean and sample size of an experiment and analyze whether the results are mathematically possible.<\/p>\n

Statcheck<\/h3>\n

Mich\u00e8le Nuijten, a student of analytical methods at Tilburg University in the Netherlands, developed Statcheck<\/a>, which she refers to as a \u201cspellcheck for statistics.\u201d \u00a0Statcheck scans journal articles to check whether the statistics and conclusions are internally consistent. It is a popular program in use by journal editors for decades.<\/p>\n

Both programs have limitations. For instance, the GRIM test only works when data are integers, such as the number of choices found in questionnaires. Statcheck is limiting in its format, it is also the data-presentation format used by the American Psychological Association. Regardless, Brown, Nuijten, and Carlisle see their programs as a tool for highlighting issues. According to John Ioannidis, a scientific methods researcher, and statistician at Stanford University in California, \u201cIt\u2019s a completely different landscape if we\u2019re talking about fraud versus if we\u2019re talking about some typo.\u201d The process to detect scientific fraud or data fabrication is long. These programs are a valid starting point.<\/p>\n

How a South Korean Study Almost Beat the System<\/h2>\n

Studies<\/a> have shown that 1.9% of scientists have admitted to fabricating data. Up to 33.7% acknowledged using questionable research practices. When it comes to admission rates, the percentages are even higher: 14.2% admit to falsification, while 72% acknowledge using questionable research practices. Among the many reasons for this are the desire to gain fame, increase publications and readership, gain a professional or academic position, and secure funding.<\/p>\n

One example of beating the system is a case where South Korean researchers were able to submit a paper even after Carlisle rejection owing to serious flaws in the data. In 2012, South Korean researchers submitted a study to Anesthesia & Analgesia<\/em>. This study looked at how facial muscle tone could indicate the best time to insert breathing tubes into a patient\u2019s throat. Inconsistencies in the study led to rejection. However, it was then submitted to Carlisle\u2019s journal Anaesthesia, but with different patient data. He remembered the paper and rejected it again. However, this was not the end. Surprisingly, Carlisle soon saw the study published in in the European Journal of Anaesthesiology. The data was the same. The results were the same. So, Carlisle contacted the journal\u2019s editor and told them about the study\u2019s past rejections. This led to the retraction of the study due to inconsistencies in the data and misrepresentation of results.<\/p>\n

With scientific misconduct still an issue<\/a>, the work of Carlisle, Nuijten, and Brown is more important than ever. It puts a system of checks on the scientific community, while also protecting the integrity of scientific work.<\/p>\n

What are your experiences with scientific misconduct? Have you encountered any cases of data fabrication? Please share your thoughts with us in the comments.<\/p>\n

\n\t\t<\/a>\n\t\t<\/div>","protected":false},"excerpt":{"rendered":"

The work that scientists do is vital in many ways. It helps society progress in…<\/p>\n","protected":false},"author":8169,"featured_media":24381,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"footnotes":""},"categories":[751,754],"tags":[1492],"ppma_author":[1908],"class_list":["post-24380","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-publication-stages","category-publication-ethics","tag-ethics-misconduct"],"better_featured_image":{"id":24381,"alt_text":"data falsification","caption":"","description":"Data Falsification is serious scientific misconduct. Whenever a scientist uses unethical means to publish his data the science community suffers. Hence it is necessary to stay away from misconduct and follow research ethics.","media_type":"image","media_details":{"width":750,"height":430,"file":"2019\/08\/clinicaltrials.jpg","sizes":{"thumbnail":{"file":"clinicaltrials-170x150.jpg","width":170,"height":150,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-170x150.jpg"},"medium":{"file":"clinicaltrials-401x230.jpg","width":401,"height":230,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-401x230.jpg"},"large":{"file":"clinicaltrials-750x430.jpg","width":750,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-750x430.jpg"},"better-amp-small":{"file":"clinicaltrials-100x100.jpg","width":100,"height":100,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-100x100.jpg"},"better-amp-normal":{"file":"clinicaltrials-260x200.jpg","width":260,"height":200,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-260x200.jpg"},"better-amp-large":{"file":"clinicaltrials-450x300.jpg","width":450,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-450x300.jpg"},"publisher-tb1":{"file":"clinicaltrials-86x64.jpg","width":86,"height":64,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-86x64.jpg"},"publisher-sm":{"file":"clinicaltrials-210x136.jpg","width":210,"height":136,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-210x136.jpg"},"publisher-mg2":{"file":"clinicaltrials-279x220.jpg","width":279,"height":220,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-279x220.jpg"},"publisher-md":{"file":"clinicaltrials-357x210.jpg","width":357,"height":210,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-357x210.jpg"},"publisher-tall-sm":{"file":"clinicaltrials-180x217.jpg","width":180,"height":217,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-180x217.jpg"},"publisher-tall-lg":{"file":"clinicaltrials-267x322.jpg","width":267,"height":322,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-267x322.jpg"},"publisher-tall-big":{"file":"clinicaltrials-368x430.jpg","width":368,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-368x430.jpg"},"Book Review":{"file":"clinicaltrials-320x430.jpg","width":320,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials-320x430.jpg"}},"image_meta":{"aperture":"0","credit":"","camera":"","caption":"","created_timestamp":"0","copyright":"","focal_length":"0","iso":"0","shutter_speed":"0","title":"","orientation":"0","keywords":[]}},"post":24380,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/08\/clinicaltrials.jpg"},"acf":{"faq_main_heading":"","faq_heading_one":"","faq_heading_two":"","faq_heading_three":"","faq_heading_four":"","faq_heading_five":"","faq_heading_six":"","faq_description_one":"","faq_description_two":"","faq_description_three":"","faq_description_four":"","faq_description_five":"","faq_description_six":""},"views":1038,"single_webinar_page_date":null,"single_webinar_page_time":null,"session_agenda":null,"who_should_attend_this_session":null,"about_the_speaker_field":null,"co-webinar-sec":null,"co_webinar_sec_one":null,"speaker-name":"","webinar-date":"","webinar-time":"","webinar-s-image":false,"custum_webinar_category":"","authors":[{"term_id":1908,"user_id":8169,"is_guest":0,"slug":"eneditor","display_name":"Enago Academy","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/046a0ceeb5c38172654db93f9919593bc2e4e1391702eb8b7248865941ddbe18?s=96&d=identicon&r=g","author_category":"","user_url":"","last_name":"Academy","first_name":"Enago","job_title":"","description":"Enago Academy, the knowledge arm of Enago, offers comprehensive and up-to-date resources on academic research and scholarly publishing to all levels of scholarly professionals: students, researchers, editors, publishers, and academic societies. It is also a popular platform for networking, allowing researchers to learn, share, and discuss their experiences within their network and community. The team, which comprises subject matter experts, academicians, trainers, and technical project managers, are passionate about helping researchers at all levels establish a successful career, both within and outside academia."}],"_links":{"self":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/24380","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/users\/8169"}],"replies":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/comments?post=24380"}],"version-history":[{"count":0,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/24380\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media\/24381"}],"wp:attachment":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media?parent=24380"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/categories?post=24380"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/tags?post=24380"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/ppma_author?post=24380"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}