Open science is an effort that aims to make scientific research, data, and its distribution accessible to all, not just to other scientists. Practices that involve publishing open research, campaigning for open access, encouraging scientists to have an open notebook policy and making it less cumbersome to publish and convey scientific knowledge are all part of open science. Open science embodies an innovative way to conduct research, collaborate with other scientists and share information with a wider audience. The push towards open science is fueled by both digital technology and social changes. Everyone around the world is vastly affected by these changes, and therefore, this affects the accumulation and dissemination of scientific knowledge.
As one can imagine, if scientific knowledge is being dispersed in an open manner then the there has to be a new way to evaluate science because the traditional metrics will no longer hold up. As such, the European Commission established an Expert Group on Altmetrics and they produced a report that describes what is known as next-generation metrics. Here, we provide a summary of that report.
Current Metrics are Outdated
It is not surprising that considering the increasing numbers of applicants, especially for government grants and federal grants, review committees are gradually turning to numerical approaches or metrics to assess scientific work. For instance, a very simple approach is to just count the number of first or corresponding author publications; this is considered a bibliometric approach. Additionally, these decision makers also use the impact factor of the journals in which the publications appear, and another approach entails computing the h-index. The impact factor of an academic journal is a metric that is determined every year and is centered on the average number of citations that journal receives. Often the impact factor is associated with the relative importance of a journal within its field. The h-index is a metric that assesses the authors of the articles. It is based on personal productivity and the citation impact of the scientist and is calculated based on a set of the most cited papers by the scientist and the total number of citations they receive in other publications. In general, journals with higher impact factors are often thought of as more important than those with lower impact factors. When these conventional bibliometric indicators are used properly they provide useful information about the scientific impact of research publications. However, with the changes that are taking place in open science, many feel that there is a need for a new set of metrics for evaluating science and research studies.
Emergence of Altmetrics
With a growing need for the development of new metrics came the idea of developing next-generation metrics to assess scientific and scholarly publishing. This brought about the emergence of altmetrics in 2010. This new form of assessment is proposed as an alternative metric compared to the traditional citation impact metrics, such as impact factor and the h-index, which were discussed above. Altmetrics is not for just assessing the “impact” of scientific publications, but is also a means for measuring the broader societal impacts of scientific research.
Overall, metrics are going to play an essential role in the successful transition to open science. Altmetrics are meant to be novel indicators for web-based and network research. The questions that statisticians face now are what are the prospects for altmetrics? And will they replace or supplement the traditional indicators of research quality and impact?
Currently, there are three major altmetric trackers. These include Altmetric.com, PlumX, and ImpactStory. Each of these collects a slightly different set of indicators from primary sources and capitalize on the fact that open science and altmetrics both rely primarily on open web-based platforms and encourage user input. Thus, altmetrics are both the drivers and outcomes of open science practices. Indeed, altmetrics can inspire the adoption of open science principles, such as collaboration, sharing, and networking. Altmetrics can also assess interdisciplinary research and the impact of the results on society as a whole.
Future of Altmetrics
Altmetrics are beneficial because they are broad, diverse, and multifaceted and appear faster than conventional metrics. However, there are still some limitations to these metrics. As of now, we do not know the meaning of these metrics, and this is needed in order to integrate them into traditional metrics and peer review. It is suggested that altmetrics should not be the end for assessing open science. In fact, there should be an “open metrics” that makes up the idea that next-generation metrics should continue to evolve and improve.