{"id":21991,"date":"2020-02-06T16:55:11","date_gmt":"2020-02-06T10:55:11","guid":{"rendered":"https:\/\/www.enago.com\/academy\/?p=21991"},"modified":"2022-04-29T22:10:47","modified_gmt":"2022-04-29T16:10:47","slug":"statistical-significance-a-term-of-the-past","status":"publish","type":"post","link":"https:\/\/www.enago.com\/academy\/statistical-significance-a-term-of-the-past\/","title":{"rendered":"\u201cStatistical Significance\u201d – A Term of the Past?"},"content":{"rendered":"

You can also listen to this article as an audio recording.<\/p>\n\n

What do you do when you are trying to decide if your treatment is effective?
\nIn your research study, there are two groups \u00a0(or more),\u00a0 where one group (or the test group) of subjects receives specific treatment for a condition, and the other group does not. The control group receives a placebo or \u201cblank.\u201d Next, you run your data of the test and the control group through statistical analysis<\/a> to prove that your treatment is more effective than your control group and that this is decided by p-value and termed \u201cstatistically significant.<\/p>\n

Not every subject will react the same way to treatment, and one can never be 100% certain of an effect. This is where I come in. I am the \u2018p-value<\/strong>,\u2019 I am used to deciding whether a treatment is effective in most cases. Scientists decided that if my value was less than 0.05 (p < 0.05), the results were \u201cstatistically significant.\u201d I rose to fame quickly. Scientists all over the world calculated my value. My numbers were cherished and relied upon to make decisions and even policies. I was the gold standard. I was quoted in just about every paper and at every conference.<\/p>\n

Don\u2019t use or trust \u201cstatistically significant\u201d<\/h2>\n

Now my glorious reputation is under threat. It turns out I have been overused and manipulated, and my future as a reputable statistical standard<\/a> is threatened. The American Statistical Association<\/a> (ASA) has told researchers that they should use me cautiously. They are offering alternative ways to verify differences in treatment groups.<\/p>\n

Statisticians claim that calculating statistical significance does not \u201cprove<\/a>\u201d the null hypothesis. Furthermore, my p-value has resulted in many false conclusions. For example, two studies analyzing the same side effect of an anti-inflammatory drug made two different conclusions. One paper claimed the drugs did not cause atrial fibrillation in patients (p-value = 0.091) and another group found that they did (p value= 0.0003). Both studies were supported by me, the p-value. Cases such as these decrease my credibility. I am supposed to be the magic number that proves an effect is reproducible.<\/p>\n

Then there is p-hacking. Researchers have discovered my Achilles heel. They can manipulate the data to shift the p-value towards the result they want. This is especially relevant to large sample groups. The larger the sample size, the more data they collect and the more likely their desired p-value will be achieved.<\/p>\n

Post-P-Value Era<\/h2>\n

Is there room for me in a \u2018\u2019post-p-value era\u2019\u2019<\/em>? Nicole Lazar from the University of Georgia said the time has come to a stop using \u201cstatistically significance<\/a>\u201d. The reproducibility crisis and lack of trust from the public can largely be attributed to scientists misusing me. Unfortunately, there is no magic number or one statistical method that can be used to make decisions about hypotheses.<\/p>\n

Can we still quantify the likelihood of a hypothesis?<\/h2>\n

How can researchers make a decision when sometimes a treatment has an effect and sometimes it does not? A hypothesis is not likely to be proven 100%. I may need to retire (or semi-retire) and share my glory with some of my statistical cousins including \u201cconfidence index\u201d or \u201cBayesian measures.\u201d<\/p>\n

Alternatives to \u201cstatistically significant\u201d?<\/h2>\n

There is no straight forward substitute for the words \u201cstatistically significant.\u201d The ASA proposes that scientists change the way they communicate their observations by including the probability<\/em><\/a> of an effect occurring. One such statistical calculation is the false positive risk (FPR). This tells your audience the degree of impact of the study has occurred by chance.<\/p>\n

Organizations such as the Food and Drug Administration (FDA) need to be careful when they report their research. They must err on the side of caution to avoid legal action.<\/p>\n

Have you found a better way to prove your hypothesis? Let us know in the comments section below?<\/p>\n

\n\t\t<\/a>\n\t\t<\/div>","protected":false},"excerpt":{"rendered":"

What do you do when you are trying to decide if your treatment is effective?
\nIn your research study, there are two groups \u00a0(or more),\u00a0 where one group (or the test group) of subjects receives specific treatment for a condition, and the other group does not. <\/p>\n","protected":false},"author":8169,"featured_media":21993,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"footnotes":""},"categories":[747,2],"tags":[1452],"ppma_author":[1908],"class_list":["post-21991","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-content-structure","category-academic-writing","tag-manuscript-drafting-tips"],"better_featured_image":{"id":21993,"alt_text":"Statistical significance","caption":"","description":" A few years ago, the American Statistical Association (ASA) recommended stopping the use of statistical significance or the p-value to assert the feasibility of research study.","media_type":"image","media_details":{"width":750,"height":430,"file":"2019\/04\/Statistical-analysis.jpg","sizes":{"thumbnail":{"file":"Statistical-analysis-170x150.jpg","width":170,"height":150,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-170x150.jpg"},"medium":{"file":"Statistical-analysis-401x230.jpg","width":401,"height":230,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-401x230.jpg"},"large":{"file":"Statistical-analysis-750x430.jpg","width":750,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-750x430.jpg"},"better-amp-small":{"file":"Statistical-analysis-100x100.jpg","width":100,"height":100,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-100x100.jpg"},"better-amp-normal":{"file":"Statistical-analysis-260x200.jpg","width":260,"height":200,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-260x200.jpg"},"better-amp-large":{"file":"Statistical-analysis-450x300.jpg","width":450,"height":300,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-450x300.jpg"},"publisher-tb1":{"file":"Statistical-analysis-86x64.jpg","width":86,"height":64,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-86x64.jpg"},"publisher-sm":{"file":"Statistical-analysis-210x136.jpg","width":210,"height":136,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-210x136.jpg"},"publisher-mg2":{"file":"Statistical-analysis-279x220.jpg","width":279,"height":220,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-279x220.jpg"},"publisher-md":{"file":"Statistical-analysis-357x210.jpg","width":357,"height":210,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-357x210.jpg"},"publisher-tall-sm":{"file":"Statistical-analysis-180x217.jpg","width":180,"height":217,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-180x217.jpg"},"publisher-tall-lg":{"file":"Statistical-analysis-267x322.jpg","width":267,"height":322,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-267x322.jpg"},"publisher-tall-big":{"file":"Statistical-analysis-368x430.jpg","width":368,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-368x430.jpg"},"Book Review":{"file":"Statistical-analysis-320x430.jpg","width":320,"height":430,"mime-type":"image\/jpeg","source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis-320x430.jpg"}},"image_meta":{"aperture":"0","credit":"","camera":"","caption":"","created_timestamp":"0","copyright":"","focal_length":"0","iso":"0","shutter_speed":"0","title":"","orientation":"0","keywords":[]}},"post":21991,"source_url":"https:\/\/www.enago.com\/academy\/wp-content\/uploads\/2019\/04\/Statistical-analysis.jpg"},"acf":{"faq_main_heading":"","faq_heading_one":"","faq_heading_two":"","faq_heading_three":"","faq_heading_four":"","faq_heading_five":"","faq_heading_six":"","faq_description_one":"","faq_description_two":"","faq_description_three":"","faq_description_four":"","faq_description_five":"","faq_description_six":""},"views":514,"single_webinar_page_date":null,"single_webinar_page_time":null,"session_agenda":null,"who_should_attend_this_session":null,"about_the_speaker_field":null,"co-webinar-sec":null,"co_webinar_sec_one":null,"speaker-name":null,"webinar-date":null,"webinar-time":null,"webinar-s-image":null,"custum_webinar_category":null,"authors":[{"term_id":1908,"user_id":8169,"is_guest":0,"slug":"eneditor","display_name":"Enago Academy","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/046a0ceeb5c38172654db93f9919593bc2e4e1391702eb8b7248865941ddbe18?s=96&d=identicon&r=g","author_category":"","user_url":"","last_name":"Academy","first_name":"Enago","job_title":"","description":"Enago Academy, the knowledge arm of Enago, offers comprehensive and up-to-date resources on academic research and scholarly publishing to all levels of scholarly professionals: students, researchers, editors, publishers, and academic societies. It is also a popular platform for networking, allowing researchers to learn, share, and discuss their experiences within their network and community. The team, which comprises subject matter experts, academicians, trainers, and technical project managers, are passionate about helping researchers at all levels establish a successful career, both within and outside academia."}],"_links":{"self":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/21991","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/users\/8169"}],"replies":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/comments?post=21991"}],"version-history":[{"count":0,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/posts\/21991\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media\/21993"}],"wp:attachment":[{"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/media?parent=21991"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/categories?post=21991"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/tags?post=21991"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.enago.com\/academy\/wp-json\/wp\/v2\/ppma_author?post=21991"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}