Key Points
-
Highlights Altmetric data of the most recent 25,000 dental articles.
-
Shows that Twitter is the most common Altmetric resources, followed by Facebook and news outlets.
-
Reveals that the British Dental Journal had the first rank, followed by Journal of Dental Research and Journal of Craniofacial Surgery.
Abstract
Aim
To analyse the Altmetric data of all dental literature and to find the most important and effective Altmetric factors.
Method
PubMed was searched to find all types of dental articles. To discover the most important and effective Altmetric factors in contemporary dental literature, multi-layered perceptron artificial neural network was used.
Results
A total of 582,227 PubMed records were found. The mean Altmetric scores were 3.7 ± 18, 4.1 ± 16 and 3.2 ± 14 for clinical trials, reviews and free full-text articles, respectively. Sensitivity analysis showed that news outlets, tweeters and scientific bloggers were the most important and influential Altmetric data resources. Among 150 analysed dental journals the British Dental Journal acquired the first rank. Twitter was the most popular Altmetric resource among dental journals.
Conclusion
Dental researchers, journal editors, publishers and research funders should pay more attention to Altmetrics as a newly-emerging scholarly tool measuring the social impact of research findings.
Introduction
New internet technologies such as social media have opened up new ways of measuring the impact of scientific research outputs. The term Altmetrics was introduced in 2010 as a supplement to traditional citation-based bibliometrics. Altmetrics can catalogue links to a journal article from social media channels (such as Twitter, Facebook, Google+, Reddit, Weibo and Pinterest), scholarly blog posts, discussions on peer review sites (such as Faculty of 1000 Prime, Publons or Pubpeer), coverage in news outlets, public policy, Wikipedia, YouTube, sites running Stack Exchange (Q&A), and others.1,2,3,4,5
It has been reported that Altmetrics are significantly correlated with citation and download.6 The findings of a large-scale investigation showed robust evidence that six of the Altmetric data resources (tweets, Facebook wall posts, research highlights, blog mentions, mainstream media mentions and forum posts) were associated with the number of citations, particularly in medical and biological sciences.7
Of more interest, medical research funders and charities (for example, the Wellcome Trust and John Templeton Foundation) were drawn to Altmetric data.8,9,10 A Google trend analysis shows that the popularity of Altmetrics has increased dramatically since 2012 in comparison with bibliometrics (Fig. 1).
The Altmetric data for 2014 and 2015 dental literature have been analysed previously, with the mean Altmetric score of 50 top dental articles in 2014 reported as 69.5 ± 73.3 The British Dental Journal (48%) and the Journal of Dental Research (16%) had the maximum number of top articles among dental journals. In 2015, all published dental literature was analysed, and the British Dental Journal gained the first rank again, followed by the Journal of Dental Research.4 In this study, we aimed to describe and analyse the Altmetric data of all dental literature to find the most important and effective Altmetric factors.
Methods
On 16 June 2017, PubMed was searched using the following queries to find all types of dental articles, dental clinical trials, review articles, and free full-text dental articles:
“1800/1/1”[PDAT]: “2017/12/31”[PDAT] AND jsubsetd[text]
“1800/1/1”[PDAT]: “2017/12/31”[PDAT] AND jsubsetd[text] AND Clinical Trial[ptyp]
“1800/1/1”[PDAT]: “2017/12/31”[PDAT] AND jsubsetd[text] AND Review[ptyp]
“1800/1/1”[PDAT]: “2017/12/31”[PDAT] AND jsubsetd[text] AND “loattrfree full text”[sb]
For each query, only the most recent 25,000 results were considered in this study. The source of Altmetric data was the Altmetric database (Altmetric LLP, London, UK).
To discover the most important and effective Altmetric factors in contemporary dental literature, a multi-layered perceptron artificial neural network was used, owing to the huge amount and complexity of data.11,12 The architecture of the proposed feed-forward artificial neural network involved two hidden layers: 70% of the data were chosen randomly for supervised batch network training and the remaining 30% of the data were used for network testing. The hidden layer activation function is hyperbolic tangent and the output layer activation function is identity. Scaled conjugate gradient was used to estimate the synaptic weights. Artificial neural network analyses were carried out by SPSS 23 (IBM SPSS Statistics for Windows, Version 23.0. Armonk, NY: IBM Corp.). Graphs were drawn by Microsoft Office Excel 2016.
Results
A total of 582,227 PubMed records were found. The most recent 25,000 results were considered in this investigation, of which 9,038 (36%) had Altmetric data (Fig. 2). The mean Altmetric score for all types of dental articles was 3.5 ± 21. The mean Altmetric scores for clinical trials, reviews, and free full-text articles were 3.7 ± 18, 4.1 ± 16 and 3.2 ± 14, respectively. Twitter and Facebook were the most popular social media (Fig. 3). The United States and the United Kingdom had the highest number of tweets and unique tweeters (Table 1). To decline the convolution of the artificial neural network, only the top eight potentially significant Altmetric resources were included in sensitivity analyses, which showed that news outlets, tweeters and scientific bloggers were the most important and influential Altmetric data resources in contemporary dental literature (Fig. 4).
At a journal level, 150 dental journals were analysed. The mean total number of mentions was 203.5 ± 607 and the mean number of mentioned outputs was 59.5 ± 109. The British Dental Journal acquired the first rank (Fig. 5). Twitter was the most popular Altmetric resource among dental journals (Fig. 6). Readers should note that the Altmetric score is a dynamic measure and may alter over time.
Discussion
In this cross-sectional survey, the Altmetric data of contemporary dental literature were analysed. The mean Altmetric score was 3.5; review articles had a higher mean Altmetric score. Twitter was the most popular Altmetric resource, and tweets were mainly from U.S and U.K. The number of tweets related to dental articles has apparently increased since 2015.13 The British Dental Journal had the first rank among the dental journals, followed by the Journal of Dental Research (replicating the findings of 2014 and 2015).3,4 An interesting point is that these two journals, which have Impact Factors that are far apart (the Journal of Dental Research has an Impact Factor of 4.755 while the British Dental Journal has an Impact Factor of 1.009), are close together on Altmetrics. According to the results of previous reports13,14 and those of the present study, Twitter and Facebook were popular social media among dental scientists. The British Dental Journal has its own Twitter account, @The_BDJ, with 20.2k followers and 22.7k tweets, while the Journal of Dental Research has no Twitter account and refers to the account of The International Association for Dental Research, @IADR, with 2.9k followers and 391 tweets. The situation with Facebook is similar: the British Dental Journal has its own Facebook account, @britishdentaljournal, with 5.3k followers, while the Journal of Dental Research has no Facebook account and refers to the account of The International Association for Dental Research, @DentalResearch, with 4.4k followers.
We can examine the size of the journals' online social influence via their Klout scores. A total of 400 signals from eight different social networks are used to calculate the Klout Score every day, which ranges from 1 to 100.15,16 On 22 December 2017, the Klout Score for @The_BDJ was 52, while for @IADR it was 44. It seems logical to postulate that the British Dental Journal is more active in social media than the Journal of Dental Research; hence, it achieved better Altmetric results.
As in previous reports,3,4 the present study showed that Twitter was the most common social media among dental researchers. In society as a whole, Facebook (2061 million users) and YouTube (1500 million users) were more popular networks than Twitter (328 million users) worldwide in 2017.17
One of the principles of evidence-based policymaking is use of the best available research findings at all stages of the policymaking process in government.18,19 The U.K. government policy document on the cost-effectiveness of interventions to improve the oral health of children is a good example.20 However, the results of the present study confirmed the previous report21 that contemporary dental research output has rarely been used for health policymaking, signifying the necessity of more collaborations between dental research community and policymakers to bridge the current gap between dental research and policy.
Altmetrics is growing very quickly.22,23 Recent analysis of the top 100 dental articles (according to Altmetric score) has shown no correlation between Altmetric score and citations.24 Similar results have been reported regarding orthodontic articles.25 A meta-analysis showed a weak correlation (ranging from 0.08 to 0.5) between Altmetrics and citation counts.26 In contrast, the results of a large-scale study showed an association between Altmetric data and citation amounts.7 A moderate correlation was found between citation counts and Altmetric scores for the top papers in emergency medicine and other biomedical journals.27 The results of a recent systematic review pointed to the positive correlation between Altmetrics and traditional citations.28 Of more interest, Twitter can be used to predict the citation rate of a scientific article.29,30 Also, the number of Mendeley readers was associated with the number of citations.31,32 Alongside these controversies, we must keep in mind that Altmetrics does truly measure a different kind of research impact, performing as a complement to, rather than as a substitute for, traditional citation-based metrics33 while Altmetric resources such as Twitter and post-publication peer review are growing quickly and becoming more popular among scientists.
Twitter has recently allowed expanded 280-character tweets for all its users,34 and can also be a useful tool for scientists. It allows scientists to communicate with a global network of peers, generating ideas and fostering interdisciplinary research and to both educate and learn from a Twitter community of advisors and collaborators. Scientists can also ensure they are on the cutting edge of science by following leading research institutions and scientists; they can communicate scientific and research findings directly to a public audience, or to companies and organisations that may be interested in their findings and their applications, and can benefit from conferences that they are not able to attend in person. (To examine the power of Twitter, try searching for the hashtag #aaasmtg, intended for the American Association for the Advancement of Science (AAAS) Annual Meeting.)
Post-publication peer review is a relatively novel scholarly concept, principally found in the field of dental research.36 PubMed Commons and PubPeer are two well-known resources. PubPeer allows academics to engage anonymously in post-publication peer review, which can highlight scientific shortcomings and misconduct.37. For example, in 2014, two high-profile papers on 'Stimulus-Triggered Acquisition of Pluripotency' (STAP) published in Nature claimed that putting differentiated cells under stress can re-programme them and make them pluripotent, meaning that they can mature into any kind of tissue. Before long, 134 critical post-publication peer reviews appeared on PubPeer,38 errors were found, and ultimately the papers were retracted.39
It is forecast that there will be 2.9 billion social media users around the world in 2020.40 We cannot turn a blind eye to these newly emerging technologies and rely only on traditional citation-based metrics. Dental researchers, journal editors, publishers and research funders must go beyond the boundaries of traditional bibliometrics and pay more attention to Altmetrics as a newly emerging scholarly tool measuring the real-time social impact of research findings.
References
Warren H R, Raison N, Dasgupta P . The Rise of Altmetrics. JAMA 2017; 317: 131–132.
Kolahi J . Altmetrics: A new emerging issue for dental research scientists. Dent Hypotheses 2015; 6: 1.
Kolahi J, Khazaei S . Altmetric: Top 50 dental articles in 2014. Br Dent J 2016; 220: 569–574.
Kolahi J, Iranmanesh P, Khazaei S . Altmetric analysis of 2015 dental literature: a cross sectional survey. Br Dent J 2017; 222: 695–699.
Konkiel S . What can altmetrics tell us about interest in dental clinical trials? Dent Hypotheses 2017; 8: 31.
Liu C L, Xu Y Q, Wu H, Chen S S, Guo J J . Correlation and interaction visualization of Altmetric indicators extracted from scholarly social network activities: dimensions and structure. J Med Internet Res 2013; 15: e259.
Thelwall M, Haustein S, Larivière V, Sugimoto C R . Do altmetrics work? Twitter and ten other social web services. PLoS One 2013; 8: e64841.
Woolston C . Funders drawn to alternative metrics. Nature 2014; 516: 147–147.
Dinsmore A, Allen L, Dolby K . Alternative perspectives on impact: the potential of ALMs and altmetrics to inform funders about research impact. PLoS Biol 2014; 12: e1002003.
Altmetric case study: The John Templeton Foundation. Available at https://www.altmetric.com/case-studies/the-john-templeton-foundation/ (accessed 6 July 2017).
Gardner M, Dorling S . Artificial neural networks (the multilayer perceptron) – a review of applications in the atmospheric sciences. Atmos Environ 1998; 32: 2627–2636.
Basheer I, Hajmeer M . Artificial neural networks: fundamentals, computing, design, and application. J Microbiol Methods 2000; 43: 3–31.
Kolahi. Dental research output in twittersphere. Dent Hypotheses 2017; 8: 1.
Kolahi J . Facebook and contemporary dental researches. Dent Hypotheses 2017; 8: 85.
Rao A, Spasojevic N, Li Z, Dsouza T . Klout score: Measuring influence across multiple social networks. In 2015 IEEE International Conference on Big Data (Big Data). 2282–2289. IEEE, 2015.
Klout. Klout Score. Available at https://klout.com/corp/score (accessed 29 December 2017).
Statista. Global social networks ranked by number of users. Available at https://www.statista.com/statistics/272014/global-social-networks-ranked-by-number-of-users/ (accessed 29 September 2017).
Evidence-Based Policymaking Collaborative. Principles of Evidence-Based Policymaking. 2016. Available at http://www.evidencecollaborative.org/principles-evidence-based-policymaking (accessed 3 June 2017).
Vanlandingham G, Silloway T, Chang V et al. Evidence-Based Policymaking. Pew-MacArthur Results First Initiative, 2014. Available at http://www.pewtrusts.org/∼/media/assets/2014/11/evidencebasedpolicymakingaguideforeffectivegovernment.pdf (accessed 30 November 2016).
York Health Economics Consortium. A rapid review of evidence on the cost-effectiveness of interventions to improve the oral health of children aged 0–5 years. Public Health England, 2016. Available at https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/560972/Rapid_review_ROI_oral_health_5_year_old.pdf (accessed 27 December 2017).
Kolahi J . Evidence-based policymaking and contemporary dental researches. Dent Hypotheses 2017; 8: 55.
Bean J R . Altmetrics in Scientific Research: Flash in the Pan or Transformative Innovation? World Neurosurg 2017; 104: 993–995.
Baheti A D, Bhargava P . Altmetrics: A Measure of Social Attention Toward Scientific Research. Curr Probl Diagn Radiol 2017; 46: 391–392
Delli K, Livas C, Spijkervet F K L, Vissink A . Measuring the social impact of dental research: An insight into the most influential articles on the Web. Oral Dis 2017; 23: 1155–1161.
Livas C, Delli K . Looking Beyond Traditional Metrics in Orthodontics: An Altmetric Study on the Most Discussed Articles on the Web. Eur J Orthod 2017; 33: 438–447.
Erdt M, Nagarajan A, Sin S - C J, Theng Y-L . Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media. Scientometrics 2016; 109: 1117–1166.
Barbic D, Tubman M, Lam H, Barbic S . An Analysis of Altmetrics in Emergency Medicine. Acad Emerg Med 2016; 23: 251–268.
Patthi B, Prasad M, Gupta R et al. Altmetrics – A Collated Adjunct Beyond Citations for Scholarly Impact: A Systematic Review. J Clin Diagn Res 2017; 11: ZE16–ZE20.
Peoples B K, Midway S R, Sackett D, Lynch A, Cooney P B . Twitter Predicts Citation Rates of Ecological Research. PLoS One 2016; 11: e0166570.
Eysenbach G . Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. J Med Internet Res 2011; 13: e123.
Batooli Z, Ravandi S N, Bidgoli M S . Evaluation of Scientific Outputs of Kashan University of Medical Sciences in Scopus Citation Database based on Scopus, ResearchGate, and Mendeley Scientometric Measures. Electron Physician 2016; 8: 2048–2056.
De Gregori M, Scotti V, De Silvestri A et al. Does a research group increase impact on the scientific community or general public discussion? Alternative metric-based evaluation. J Pain Res 2016; 9: 391–395.
Melero R . Altmetrics – a complement to conventional metrics. Biochem medica 2015; 25: 152–60.
Busby, M . Twitter to introduce expanded 280-character tweets for all its users. The Guardian 2017. Available at https://www.theguardian.com/technology/2017/nov/08/twitter-to-roll-out-280-character-tweets-to-everyone (accessed 22 December 2017).
LTER Network. Twitter for scientists: the tool you never knew you needed. LTER Network Communications Office, 2017. Available at https://nco.lternet.edu/twitter-for-scientists/ (accessed 22 December 2017).
Kolahi J, Khazaei S . Post-publication peer review: A fresh perspective on dentistry publications. Dent Hypotheses 2016; 7: 29.
Knoepfler P . Reviewing post-publication peer review. Trends Genet 2015; 31: 221–223.
Pubpeer. Stimulus-triggered fate conversion of somatic cells into pluripotency. Available at https://pubpeer.com/publications/8B755710BADFE6FB0A848A44B70F7D# (accessed 6 November 2017).
Nature News. STAP retracted. Nature 2014; 511: 5–6.
Statista. Number of social media users worldwide 2010–2021. Available at https://www.statista.com/statistics/278414/number-of-worldwide-social-network-users/ (accessed 29 December 2017).
Acknowledgements
We would like to thank Altmetric LLP (London, U.K), particularly Mrs Stacy Konkiel.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kolahi, J., Khazaei, S. Altmetric analysis of contemporary dental literature. Br Dent J 225, 68–72 (2018). https://doi.org/10.1038/sj.bdj.2018.521
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/sj.bdj.2018.521
This article is cited by
-
Cochrane systematic reviews in dentistry: an Altmetric and network analysis
British Dental Journal (2024)
-
The online attention to orthodontic research: an Altmetric analysis of the orthodontic journals indexed in the journal citation reports from 2014 to 2018
Progress in Orthodontics (2020)
-
Analysis of highly tweeted dental journals and articles: a science mapping approach
British Dental Journal (2019)