The ongoing COVID-19 pandemic has stretched health-care systems, disrupted economies and frayed the fabric of societies around the globe. Nation states have responded differently to the crisis, and only a few countries have managed to achieve continued control of coronavirus transmission. Writing in Nature, Pullano et al.1 report their study of SARS-COV-2 infections in France during late spring and early summer of 2020. Their analysis came after the peak of the first wave of COVID-19 cases there, but before the increase again in the autumn, which led to a higher second wave of cases. The results offer some important lessons.
Three key characteristics of the SARS-CoV-2 coronavirus have made it particularly challenging and disruptive. First, it is a newly emerged virus to which most people have little or no pre-existing immunity. Second, most infections are not documented by health-care systems; many individuals with these undocumented infections have no or only mild symptoms and can unknowingly spread the virus2. Moreover, the individuals with infections that are eventually documented typically become contagious before symptoms appear2,3. As a result, most of the viral transmission within and between communities is driven by a combination of pre-symptomatic individuals who will later develop symptoms, those who never develop symptoms (asymptomatic individuals) and those with mild symptoms who do not seek medical attention. Third, despite the preponderance of undocumented infections, the total number of global infections (documented and undocumented) is so high — with hundreds of millions infected so far — that the relatively small fraction of infections that result in severe outcomes or death4 already numbers in the millions.
To understand and control the pandemic, it is crucial to estimate how widespread the disease is within communities. One means of determining infection prevalence is provided by a measurement called the ascertainment rate — the fraction of all infections that are documented in the health-care system as confirmed cases. A higher ascertainment rate signifies a greater capacity to identify infections and thus possibly control the onward spread of the virus through the isolation of infected individuals, along with other interventions. Pullano and colleagues present two independently generated estimates of new COVID-19 symptomatic cases in France during a seven-week period from mid-May to June (generating both these estimates using data and inference approaches), to quantify the ascertainment rate for symptomatic infections. They find a substantial discrepancy between their estimate of the number of detected symptomatic cases and of the total number of detected and undetected symptomatic cases (Fig. 1), revealing a low ascertainment rate. The findings suggest that the overall testing and control system in place was inadequate to contain the virus successfully in this country of around 65 million people.
Pullano and colleagues derived their first estimate of confirmed symptomatic cases of COVID-19 from a nationwide database, which was designed to track and record SARS-CoV-2 test results. This database was launched in May 2020, at the end of the spring lockdown in France. The information it contains includes routine virological testing and symptom reports for: health-care personnel; elderly individuals in nursing homes; residents of long-term care facilities; and patients hospitalized for any reason, as well as data on the tracing and testing of contacts of confirmed COVID-19 cases. In addition to these surveillance measures, any individual who showed COVID-19 symptoms could obtain diagnostic testing if referred by their doctor. By accounting for asymptomatic and pre-symptomatic cases, as well as for delays from symptom onset to testing, Pullano et al. obtained an estimate of the number of people with confirmed COVID-19 in whom symptoms developed during the seven-week study period.
For their second estimate, Pullano and colleagues used a mathematical model, hospitalization records and a maximum-likelihood estimation method to infer all incidences of SARS-CoV-2 (both documented and undocumented) in which symptom onset in infected individuals occurred during the study period. Their model-inference approach enables the estimation of a broad suite of epidemiological conditions, including the total number of symptomatic infections. Such estimates have uncertainties depending on the quality of the data available and whether the assumptions and form of the model truly represent the dynamics of SARS-CoV-2 transmission. By systematically testing the sensitivity of their findings to the assumptions they made, Pullano et al. provide extra confidence in their inferences and constrain the boundaries of the uncertainty for their estimated value for the total number of symptomatic infections.
Using the surveillance database, Pullano et al. estimate that there were more than 14,000 confirmed symptomatic cases with symptom onset during the study period. However, using the model-inference approach, the authors instead suggest a much higher estimate — of just under 104,000 symptomatic infections in total (both confirmed and those never documented). This finding paints a worrying overall picture. The estimate from the model-inference approach suggests that 86% of symptomatic infections were undetected, despite the low infection levels that followed the spring lockdown and a centralized, coordinated testing and tracing programme. Pullano et al. rightly note that although the detection rate rose during the course of the seven-week period studied, the vast majority of symptomatic infections were nevertheless undetected.
Pullano and colleagues did not include asymptomatic infections when making their calculation of the ascertainment rate. If the authors’ estimated asymptomatic infection rate is included, making the corresponding calculation suggests that only approximately 1 in 12 SARS-CoV-2 infections was identified during the study period. Other studies2,5 have similarly estimated a substantial under-counting of total infections and symptomatic infections. Pullano et al. also use their findings to consider what the data reveal about shortcomings in COVID-19 surveillance efforts.
The testing and tracing systems implemented around the world vary, but they begin with ‘index’ cases, individuals without known infectious contacts who are tested because of their work or living circumstances, the presentation of symptoms, or in some instances simply because of a desire to be tested. By requiring that most of the population tested obtain a referral from their physician, France might have disadvantaged communities that have more-limited access to health care, and reduced testing rates. Pullano and colleagues also report that surveillance data suggest that less than one-third of individuals in France who had symptoms of COVID-19 consulted a physician.
In such circumstances, the prospects for continued viral control were probably compromised. France subsequently experienced a particularly devastating wave of COVID-19 cases beginning in August and peaking in early November. The policies and behaviours that limited virus spread during early summer were insufficient to control the virus during late summer and autumn, when some people went on holiday or grew tired of social distancing, schools and universities opened, and the weather turned colder. This last factor resulted in greater virus survival6,7 and people spending more time indoors and in closer proximity to others, compared with during the summer8.
Some countries, such as South Korea, Thailand and Vietnam, have managed to use testing and tracing in conjunction with other control strategies to keep ascertainment rates high and the virus largely in check (see go.nature.com/3qkm2bz). These successes indicate that testing and tracing programmes can be effective, provided that the prevalence of infections does not exceed the capacity to test for and document infections, to identify and trace contacts extensively, and to isolate and quarantine contagious and potentially contagious individuals. However, testing and tracing alone are probably insufficient to achieve sustained COVID-19 control9. Instead, political and public effort is also needed to ensure continued compliance with interventions to limit infections, including the wearing of face masks, social distancing and the restriction of large gatherings10. Many countries, as a result of leadership failures, cultural or institutional barriers, or simple fatigue, have failed in their efforts to achieve or maintain control of the virus.
As COVID-19 continues to spread in France and elsewhere, it is imperative that ascertainment rates be monitored, either using model-inference approaches2 or by widespread testing of individuals for antibodies to SARS-CoV-2, which provides an estimate of the proportion of a population previously infected with the virus11. Pullano and colleagues’ findings support the idea that efforts should be made to track rates of under-detection and to better quantify the overall number of infections. Such information is crucial for accurately evaluating control measures, so that the need for stepped-up or alternative interventions can be identified, and for developing vaccine-deployment strategies. (For example, understanding the infection profile of a region provides useful information if planning a cluster-busting vaccination approach.) This latter issue will be particularly crucial given the timescales of vaccine production and distribution, and the time needed after vaccination for a protective immune response to develop.
Pullano et al. use the ascertainment rate to quantify under-detection in France, and their results highlight how such under-detection, if recognized, could be used as a motivation for implementing better pandemic surveillance and control measures. The authors also show the value of mathematical modelling for assessing both population-scale disease prevalence and the effectiveness of disease-control policies.
Competing Financial Interests
J.S. and Columbia University disclose partial ownership of SK Analytics. J.S. discloses consulting for BNI and Merck.