The Middle East respiratory syndrome coronavirus (MERS-CoV) was exported to Korea in 2015, resulting in a threat to neighboring nations. We evaluated the possibility of using a digital surveillance system based on web searches and social media data to monitor this MERS outbreak. We collected the number of daily laboratory-confirmed MERS cases and quarantined cases from May 11, 2015 to June 26, 2015 using the Korean government MERS portal. The daily trends observed via Google search and Twitter during the same time period were also ascertained using Google Trends and Topsy. Correlations among the data were then examined using Spearman correlation analysis. We found high correlations (>0.7) between Google search and Twitter results and the number of confirmed MERS cases for the previous three days using only four simple keywords: “MERS”, “” (“MERS (in Korean)”), “” (“MERS symptoms (in Korean)”), and “” (“MERS hospital (in Korean)”). Additionally, we found high correlations between the Google search and Twitter results and the number of quarantined cases using the above keywords. This study demonstrates the possibility of using a digital surveillance system to monitor the outbreak of MERS.
The new millennium began with the emergence of communicable diseases. In 2002, Severe Acute Respiratory Syndrome (SARS) was found in mainland China and spread throughout the world in a matter of months, with locations of incidence including Hong Kong, Taiwan, Singapore, Canada and many other countries1. A 2009 pandemic of H1N1spread from Mexico and was subsequently identified in the United States, Canada and globally2.
Middle East Respiratory Syndrome (MERS) was first reported in a patient who presented with severe respiratory illness in a hospital in Jeddah, Saudi Arabia, on June 13, 2012 and died 11 days later3. The virus was later isolated as a new coronavirus and named Human Coronavirus-Erasmus Medical Center (HCoV-EMC) and subsequently renamed MERS-CoV according to a global consensus4. Dromedaries are hosts for this virus, and there is some evidence of direct or indirect zoonotic transmission to humans. MERS is a highly fatal respiratory disease: a total of 1,782 cases and 634 deaths were reported in 27 countries as of July 20165.
The outbreak in South Korea was triggered by one imported case. This outbreak caused 186 laboratory-confirmed infections, including 38 (20%) deaths as of December 22 2015, which resulted in a global threat to neighboring nations, such as China, Hong Kong, Taiwan, and Japan6. MERS is listed as one of the top emerging diseases likely to cause a major epidemic7. Importantly, MERS is considered a healthcare-associated infection; however, the exact mode of transmission remains unknown. Therefore, it is important to develop a surveillance system for detecting, tracking, reporting, and responding to MERS8. To enable the earlier identification of an outbreak of an emerging communicable disease such as MERS, a syndrome surveillance method that uses real-time data, including both health-related and non-health-related data, has been proposed9. Recently, digital surveillance approaches using non-healthcare sources, such as search engines, were developed and confirmed as a valid and useful means for identifying influenza outbreaks in real time based on several studies in the United States, European countries, Canada, New Zealand and Korea10,11,12,13,14,15,16.
The present study examines the correlations among social media and search engine data and the number of confirmed MERS cases and quarantined cases to evaluate the possibility of digital surveillance using a search engine and Twitter data for monitoring the outbreak of MERS.
The overall trends are shown in Fig. 1, including the representative keywords “” (“MERS (in Korean)”) obtained via Google search and Twitter, the number of new laboratory-confirmed cases, and the number of quarantined cases. Peaks on Google search and Twitter with regard to use of the “MERS (in Korean)” search term are shown for June 2. New confirmed cases peaked 5 days later (i.e., June 7) and quarantined cases peaked 15 days later (i.e., June 17). In addition, overall graph patterns among them were similar. The raw data in Fig. 1 are shown in Supplementary Table 1.
Figure 2 and Table 1 show high lag correlations between the laboratory-confirmed cases of MERS-CoV and the Google search results (Fig. 2a) and tweets on Twitter (Fig. 2b). Three days earlier, the results obtained using the three keywords “MERS”, “MERS (in Korean)”, and “” (“MERS hospital (in Korean)”) in Google search showed high correlations (r > 0.7). These three keywords maintained high correlations until the four day time-lag; however, “” (“MERS symptoms (in Korean)”) had the highest correlation (r = 0.786, p < 0.05) at a zero day time-lag, and this high correlation was preserved for two days. The trends for the comparisons with Twitter data were similar to those of the Google search data with high correlations and maintenance. “MERS symptoms (in Korean)” was high, but the correlation of “MERS” began decreasing from the start, similar to the results of “MERS symptoms (in Korean)” in the Google search data.
Figure 3 and Table 1 also show the high lag correlations between the number of quarantined cases and Google search results or Twitter tweets. However, there were some differences in the trends of the results of the quarantined cases. Contrary to the results of the new laboratory-confirmed cases, the lag correlation coefficients of all keywords continuously increased for both the Google search and Twitter results. The highest correlation coefficients of these keywords were approximately 0.9 for seven days, and they were higher than those of the new laboratory-confirmed cases. The rank of correlation for the keywords was different according to the type of cases (refer to Figs 2 and 3) and the Google/Twitter results (refer to a) and b) in Fig. 3). For example, “MERS symptoms (in Korean)” had the highest correlation coefficient with new laboratory-confirmed cases on Twitter (Fig. 2b) and with quarantined cases on Google search (Fig. 3a) but the lowest correlation coefficient for new laboratory-confirmed cases on Google (Fig. 2a) and quarantined cases on Twitter (Fig. 3b). The raw data for Figs 2 and 3 are shown in Table 1.
The subgroup analyses focusing on the new laboratory-confirmed cases of the acceleration and deceleration period are shown in Fig. 4. Most correlation coefficients are higher than 0.7 and are maintained highly during this time lag. The ranking of correlation coefficients of the keywords during this period was similar to that of the entire study period. The results of the other subgroup analyses are provided in Supplementary Figures 1–3.
Correlation coefficients between the search keywords and tweets were high but peaks among them were somewhat different. Among the search keywords in Google, correlation coefficients were higher than 0.8, but the correlation coefficient between “MERS symptoms (in Korean)” and “MERS hospital (in Korean)” was 0.792 (Supplementary Table 2). The peak of “MERS symptoms (in Korean)” was on June 2 but the other keywords had peaks on June 2 or 3 (Supplementary Table 1). In Twitter, all correlation coefficients were higher than 0.9 except for that between “MERS” and “MERS symptoms (in Korean)” (r = 0.871, p < 0.05). The peaks of “MERS” and “MERS (in Korean)” are shown on June 2 but peaks of “MERS symptoms (in Korean)” and “MERS hospital (in Korean)” on June 7.
This study showed high correlations between the results obtained by searching for MERS-related keywords using Google search and Twitter and the number of confirmed MERS cases. These high correlations occurred four days before case confirmation and provide evidence that digital surveillance using a search engine and Twitter data is useful for monitoring the outbreak of an emerging infectious disease.
Because MERS is a healthcare-associated infection, it is interesting that digital surveillance using Google search and Twitter, which operate via input from the general public, may also work well for surveillance. In fact, most digital surveillance has been used to detect community-based transmitted diseases10,16,17,18,19,20. It may be related to the fact that MERS also infects the general population, such as patient family members and caregivers.
The digital surveillance methodology used in this study found increases in searches or tweets three days prior to laboratory confirmations. Generally, because a confirmatory laboratory test takes one or two days6,21,22, the real lag time could be one or two days. Social media and search engine data may reflect the actual disease outbreak earlier than conventional surveillance because many people use Internet searches to obtain health information before visiting a doctor10,23,24. The World Health Organization suggests that various factors, including lack of awareness among people and suboptimal infection and control measures, could contribute to the outbreak of MERS in Korea25. Given uncertain conditions associated with emerging diseases, this availability of earlier information for monitoring infectious disease will be helpful for making decisions related to disease control. Moreover, it is worth noting that important epidemiological data regarding the Korea MERS outbreak were published based on media data using digital surveillance systems by scientists in other countries. The preliminary epidemiologic assessment of the MERS outbreak in Korea was performed by Hong Kong scientists26, the probable transmission chains were determined by Hong Kong scientists27, the estimated fatality rate was determined by Japanese scientists28, and the risk factors for mortality were assessed by US scientists29. These studies emphasize the importance of rapid communication and analysis in emerging infectious diseases, and epidemiologic analyses based on media data may be a useful tool to elucidate the characteristics of ongoing outbreaks. Subgroup analyses show that a digital surveillance system could be more helpful for monitoring the spread of an emerging infectious disease than for detecting its outbreak because the correlation coefficients of the acceleration and deceleration period were higher than those of the initiation (pre-acceleration) period and all other periods. In addition, these correlations were highly maintained during the time lag. This suggests that monitoring is effective during disease spread.
Interestingly, the ranking of keywords was different according to the type of cases and Google/Twitter results. These differences may be due to various user behaviors associated with social network services versus web searches. Generally, a web search is performed to find information, whereas Twitter is used to share information with people. If people experience MERS-like symptoms, such as fever, cough, or sputum, they generally want to determine whether they have MERS; therefore, they used a web search engine, such as Google. Thus, the correlation coefficient of “MERS symptoms (in Korean)” in the quarantined cases was highest in the results from the Google search because those people may be searching “what are MERS symptoms?” However, in using Twitter, people may be attempting to deliver this information to other people. In addition, in an early phase such as the acceleration period of an unknown emerging disease like MERS, people may want to know “what is a MERS?”. Therefore, terms such as “MERS” or “MERS (in Korean)” might have early peaks. Later, people may hope to learn more specific information such as symptoms or hospitals because they might want to know whether they suffer from disease-associated morbidities or inform people what places to avoid.
Based on the present study, it may be sufficient to monitor case confirmations using simple keywords, such as the name of a disease like MERS in English or Korean; the symptoms of the disease; or a particular hospital where patients with the disease are being treated. The advantages of digital surveillance using a search engine and Twitter data are that the data can be obtained earlier, more easily and at a lower cost than via conventional surveillance techniques10,11,12,13,14,15. To improve the performance of disease surveillance, consideration of a digital surveillance system is essential.
The data used, such as Twitter tweets and Google search data, might be biased. Although all Korean public tweets were considered, Twitter is not a major social network service in Korea30. Additionally, Google is not one of the most used search engines in Korea31,32. However, because previous studies of influenza surveillance in Korea demonstrated the possibility of digital surveillance systems using non-dominant local search engine data or Google search14,15, the proposed digital surveillance system may be sufficient. Most digital surveillance systems using a search engine and Twitter data require the choice of specific keywords. Therefore, the keywords used by the surveillance system should be updated frequently to enable accurate monitoring of the emerging disease. For example, the term “MERS” was not generally used in Korea before the MERS outbreak (Fig. 1). However, “MERS” is one of the key terms used to detect the outbreak in this study. The promptness with which new keywords are added/searched for can significantly affect the accuracy of digital surveillance methods. Therefore, as in most studies in this field, noise, such as news reports, outbreak briefs, and health information posted on the Internet, may have affected the outcomes of this study.
Study period and keywords
The study period was from May 11, 2015 to Jun 26, 2015. May 11, 2015 is the symptom onset day of the first laboratory-confirmed patient6. Nationally acquired statistical data for MERS in Korea6, web-search results from Google Trends33, and Twitter data34 were compared. Based on expectations regarding public interest in this topic, the top four MERS-associated keywords used in the Google search were selected. These four keywords were “MERS”, “MERS (in Korean)”, “MERS symptoms (in Korean)”, and “MERS hospital (in Korean)”. In this study, we first included the most basic keywords, “MERS” and “MERS (in Korean)”. Next, we extended the keywords such as “MERS symptoms (in Korean)” and “MERS hospital (in Korean)”, which had a value of more than 90 among correlated queries with two basic keywords (“MERS” and “MERS (in Korean)”) in Google Trends. We also conducted a subgroup analysis focusing on the acceleration and deceleration period (June 3 - June 26, 2015) by adapting the CDC intervals35. CDC intervals are defined as the acceleration period indicated by a consistently increasing rate of pandemic influenza cases, indicating established transmission, and the deceleration interval indicated by a consistently decreasing rate of pandemic influenza cases.
National MERS statistical data for Korea
Statistics data for MERS in Korea are updated daily in the MERS portal by the Korean government6. Daily data pertaining to new laboratory-confirmed MERS cases and quarantined cases were collected from this website. Laboratory confirmation of MERS was defined as either positive real-time reverse-transcriptase polymerase chain reaction (RT-PCR) results for at least two specific genomic targets or a single positive target with the sequencing of a second target6,21,22. In quarantined cases, people who were exposed to a contagious disease are separated and their movements restricted in case they become sick36.
Google search and Twitter data
Daily trend data associated with the selected keywords were obtained from Google Trends by setting the location parameter to “South Korea” and the time parameter to “May to Jun, 2015.” The output was provided in a csv format. Because the data obtained using Google Trends are normalized to the total Google search volume, these data are relative33. The total number of searches for a given term was not provided in Google Trends. We also normalized the other data such as Twitter data and national MERS statistical data to have the same value (0 to 100) by the maximum value of each data. All data are provided in the supplementary file.
The number of tweets containing one of the predefined keywords was collected through Topsy, which is a certified partner of Twitter that offers social searching and social analytics34. Topsy indexes every public tweet and allows users to search these from 2013 using specific keywords. This range indicates that our analysis is based on the entire set of Korean public tweets rather than small sample sizes. Spam tweets are automatically removed by Topsy. The number of tweets, including tweets with URL links, tweets without URL links, and retweets, were collected.
Spearman correlation analyses were used to examine the correlations among social-media, search engine data, the numbers of confirmed MERS cases, and quarantined cases using the IBM SPSS Statistics software, version 20 (IBM Corp). We used lag correlation analyses to assess the temporal relationships between these data for up to 7 days. The data on new laboratory-confirmed cases and quarantine cases were moved to the right (i.e., direction to decrease gaps of date between Google search or Twitter data and new laboratory-confirmed cases or quarantined cases). Subgroup analyses for the period were conducted along the same lines. The significance level was set at p < 0.05.
How to cite this article: Shin, S.-Y. et al. High correlation of Middle East respiratory syndrome spread with Google search and Twitter trends in Korea. Sci. Rep. 6, 32920; doi: 10.1038/srep32920 (2016).
Peiris, J. S., Guan, Y. & Yuen, K. Y. Severe acute respiratory syndrome. Nat. Med. 10, S88–S97 (2004).
Novel swine-origin influenza A (H1N1) virus investigation team. Emergence of a novel swine-origin influenza A (H1N1) virus in humans. N. Engl. J. Med. 360, 2605–2615 (2009).
Zaki, A. M., van Boheemen, S., Bestebroer, T. M., Osterhaus, A. D. M. E. & Fouchier, R. A. M. Isolation of a Novel Coronavirus from a Man with Pneumonia in Saudi Arabia. New Engl. J. Med. 367, 1814–1820 (2012).
de Groot, R. J. et al. Middle East respiratory syndrome coronavirus (MERS-CoV): announcement of the Coronavirus Study Group. J. Virol. 87, 7790–7792 (2013).
World Health Organization. WHO Middle East respiratory syndrome coronavirus (MERS-CoV). Available at: http://www.who.int/emergencies/mers-cov/en/. (Accessed: 20th July 2016).
Ministry of Health and Welfare, Korea. Official MERS portal by Korean government. Available at: http://mers.go.kr/mers/html/jsp/main.jsp. (Accessed: 5th July 2015).
World Health Organization. WHO publishes list of top emerging diseases likely to cause major epidemics. Available at: http://www.who.int/medicines/ebola-treatment/WHO-list-of-top-emerging-diseases/en/. (Accessed: 20th December 2015).
Assiri, A. et al. Hospital outbreak of Middle East respiratory syndrome coronavirus. N. Engl. J. Med. 369, 407–416 (2013).
Henning, K. J. What is syndromic surveillance? Morb. Mortal. Weekly Rep. 53 Suppl, 5–11 (2004).
Ginsberg, J. et al. Detecting influenza epidemics using search engine query data. Nature 457, 1012–1014 (2009).
Ortiz, J. R. et al. Monitoring influenza activity in the United States: a comparison of traditional surveillance systems with Google Flu Trends. Plos One 6, e18687 (2011).
Eurosurveillance editorial team. Google Flu Trends includes 14 European countries. Euro Surveill. 14, pii: 19352 (2009).
Valdivia, A. et al. Monitoring influenza activity in Europe with Google Flu Trends: comparison with the findings of sentinel physician networks - results for 2009–10. Euro Surveill. 15, pii: 19621 (2010).
Seo, D. W. et al. Cumulative Query Method for Influenza Surveillance Using Search Engine Data. J. Med. Internet Res. 16, e289 (2014).
Cho, S. et al. Correlation between national influenza surveillance data and google trends in South Korea. Plos One 8, e81422 (2013).
Milinovich, G. J., Williams, G. M., Clements, A. C. A. & Hu, W. Internet-based surveillance systems for monitoring emerging infectious diseases. Lancet Infect. Dis. 14, 160–168 (2014).
Brownstein, J. S. et al. Information technology and global surveillance of cases of 2009 H1N1 influenza. N. Engl. J. Med. 362, 1731–1735 (2010).
Desai, R. et al. Norovirus disease surveillance using Google Internet query share data. Clinical infectious diseases: an official publication of the Infectious Diseases Society of America 55, e75–78 (2012).
Desai, R. et al. Use of Internet search data to monitor impact of rotavirus vaccination in the United States. Clinical infectious diseases: an official publication of the Infectious Diseases Society of America 54, e115–118 (2012).
Gluskin, R. T., Johansson, M. A. & Santillana, M. Evaluation of Internet-Based Dengue Query Data: Google Dengue Trends. PLoS Negl. Trop. Dis. 8, e2713 (2014).
World Health Organization. Middle East respiratory syndrome coronavirus: Case definition for reporting to WHO. Available at: http://www.who.int/csr/disease/coronavirus_infections/case_definition/en/. (Accessed: 5th July 2015).
Assiri, A. et al. Epidemiological, demographic, and clinical characteristics of 47 cases of Middle East respiratory syndrome coronavirus disease from Saudi Arabia: a descriptive study. Lancet Infect. Dis. 13, 752–761 (2013).
Bernardo, T. M. et al. Scoping review on search queries and social media for disease surveillance: a chronology of innovation. J. Med. Internet Res. 15, e147 (2013).
Eysenbach, G. Infodemiology and infoveillance tracking online health information and cyberbehavior for public health. Am. J. Prev. Med. 40, S154–158 (2011).
World Health Organization. WHO statement on the ninth meeting of the IHR Emergency Committee regarding MERS-CoV. Available at: http://www.who.int/mediacentre/news/statements/2015/ihr-ec-mers/en/. (Accessed: 9th July 2015)
Cowling, B. J. et al. Preliminary epidemiological assessment of MERS-CoV outbreak in South Korea, May to June 2015. Euro Surveill. 20, 7–13 (2015).
Lee, S. S. & Wong, N. S. Probable transmission chains of Middle East respiratory syndrome coronavirus and the multiple generations of secondary infection in South Korea. Int. J. Infect. Dis. 38, 65–67 (2015).
Mizumoto, K., Saitoh, M., Chowell, G., Miyamatsu, Y. & Nishiura, H. Estimating the risk of Middle East respiratory syndrome (MERS) death during the course of the outbreak in the Republic of Korea, 2015. Int. J. Infect. Dis. 39, 7–9 (2015).
Majumder, M. S., Kluberg, S. A., Mekaru, S. R. & Brownstein, J. S. Mortality Risk Factors for Middle East Respiratory Syndrome Outbreak, South Korea, 2015. Emerging Infect. Dis. 21, 2088–2090 (2015).
Nam, J. Y. KakaoStory most popular SNS in S. Korea: poll. Available at: http://kckoreanjournal.com/kakaostory-most-popular-sns-in-s-korea-poll/. (Accessed: 9th July 2015).
Nguyen C. Search engine market share in APAC September 2015. Available at: http://www.chandlernguyen.com/blog/2015/09/22/search-engine-market-share-in-apac-september-2015/ (Accessed: 8th August 2016).
Cho, J. Y. Struggle For Control, Will Korea be Another Country to Relinquish Control of Mobile Search Engine to Google? Available at: http://businesskorea.co.kr/article/10865/struggle-control-will-korea-be-another-country-relinquish-control-mobile-search-engine. (Accessed: 9th July 2015).
Google. Google Trends. Available at: https://www.google.com/trends/. (Accessed: 5th July 2015).
Topsy. Topsy homepage. Available at: http://topsy.com/. (Accessed: 5th July 2015).
Holloway, R., Rasmussen, S. A., Zaza, S., Cox, N. J. & Jernigan, D. B. Updated preparedness and response framework for influenza pandemics. MMWR. Recommendations and reports: Morbidity and mortality weekly report. Recommendations and reports/Centers for Disease Control 63, 1–18 (2014).
Centers for Disease Control and Prevention. Quarantine and Isolation. Available at: http://www.cdc.gov/quarantine/. (Accessed: 7th Jan 2016).
The authors declare no competing financial interests.
Electronic supplementary material
Rights and permissions
This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
About this article
Cite this article
Shin, SY., Seo, DW., An, J. et al. High correlation of Middle East respiratory syndrome spread with Google search and Twitter trends in Korea. Sci Rep 6, 32920 (2016). https://doi.org/10.1038/srep32920
This article is cited by
The national burden of scabies in Germany: a population-based approach using Internet search engine data
A Transformer-Based Model for Evaluation of Information Relevance in Online Social-Media: A Case Study of Covid-19 Media Posts
New Generation Computing (2022)
Understanding internal migration in the UK before and during the COVID-19 pandemic using twitter data
Urban Informatics (2022)
Psychometric Testing of Three COVID-19-Related Scales Among People with Mental Illness
International Journal of Mental Health and Addiction (2022)
A longitudinal and geospatial analysis of COVID-19 tweets during the early outbreak period in the United States
BMC Public Health (2021)
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.