Abstract
COVID19 is affecting healthcare resources worldwide, with lower and middleincome countries being particularly disadvantaged to mitigate the challenges imposed by the disease, including the availability of a sufficient number of infirmary/ICU hospital beds, ventilators, and medical supplies. Here, we use mathematical modelling to study the dynamics of COVID19 in Bahia, a state in northeastern Brazil, considering the influences of asymptomatic/nondetected cases, hospitalizations, and mortality. The impacts of policies on the transmission rate were also examined. Our results underscore the difficulties in maintaining a fully operational health infrastructure amidst the pandemic. Lowering the transmission rate is paramount to this objective, but current local efforts, leading to a 36% decrease, remain insufficient to prevent systemic collapse at peak demand, which could be accomplished using periodic interventions. Nondetected cases contribute to a ∽55% increase in R_{0}. Finally, we discuss our results in light of epidemiological data that became available after the initial analyses.
Introduction
In December 2019, clusters of a respiratory disease attributed to a potentially novel coronavirus were identified. This hypothesis was rapidly confirmed, and the virus was named as severe acute respiratory syndrome coronavirus 2 (SARSCoV2), the causal agent of coronavirus disease 2019 (COVID19). This novel coronavirus rapidly spread across Asia, Europe, and other continents, achieving pandemic status, as determined by the World Health Organization, on March 11, 2020. As of October 2020, all parts of the world were, to varying degrees, impacted by the COVID19 epidemic, with more than 40 million cases and 1.1 million deaths reported globally^{1}, in what can be construed as the worst pandemic since the Spanish flu (1918–1920).
A prominent feature of the current pandemic is the high persontoperson transmissibility of the virus, with a basic reproduction number (R_{0}) estimated at 2.2–2.5 in Wuhan, China, where initial cases were detected^{2,3}. Other worrying aspects are the severity of clinical complications and the lack of vaccines or effective drugs to, respectively, prevent disease and accelerate the patient’s recovery. Consequently, the only effective mechanisms currently available to dampen viral spread are nonpharmaceutical interventions (NPI), and the population’s adherence thereof. Among these are social isolation and distancing, quarantine, travel restrictions, and changes in individual behavior, such as the widespread usage of face masks and heightened preoccupation with hygiene^{4}.
The sudden increase in demand for hospitalization during the pandemic, leading to collapse in health systems due to insufficient medical infrastructure and healthcare resources, has particularly impacted countries with limited healthcare infrastructure, such as those in Latin America. Brazil, the largest country in this region, provides a cautionary example of the profound impacts of COVID19 on health systems. The first confirmed case of COVID19 in Brazil occurred on February 26, 2020, in the state of São Paulo, although multiple independent introductions have occurred, fueled by returning international travelers^{5}, and nationwide community transmission was declared on March 20. As of October, 2020, the number of confirmed COVID19 cases exceeded 5.2 million nationally, with over 150,000 deaths reported. Bahia, located in northeast Brazil, has a population of 14.8 million throughout its 417 municipalities, with a territorial extension of 567,295 km^{2}, comparable to that of France. In spite of its economic importance (with the sixth highest gross domestic product among all Brazilian states), the state of Bahia presents marked intraregional disparities in terms of access to health, with hospitals and healthcare investments unequally distributed around the state^{6}. Thus, Bahia is a representative example of how COVID19 impacts health resources in low and middleincome countries, and the effects of measures implemented in an attempt to mitigate damaging consequences.
Mathematical models are proving instrumental in studying the current COVID19 pandemic^{7}, as well as in driving governmental policy. A hallmark of the latter was the radical shift in actions of some governments defending “herd immunity” strategies, as models produced by the Imperial College London projected massive death tolls before reaching this objective^{8}. Substantial insights into the dynamics of disease spread can be gained by using compartmentalized models, such as 3compartment SIR (susceptibleinfectedrecovered)^{9}. Models that build on these principles have flourished in the recent literature, even extending the number of compartments to study other key aspects of COVID19, including the role of asymptomatic transmission^{10,11}, social distancing, and quarantine strategies^{3,12,13,14,15}, as well as postepidemic scenarios, e.g. the probability of novel outbreaks^{16,17}. The need for hospitalization under various conditions has also been evaluated using mathematical modeling^{18,19,20}.
In this work, we further explore hospitalization needs in a lowresource state during the COVID19 pandemic, with particular emphasis given to hospital ward (throughout the text referred to as clinical) and intensive care unit (ICU) bed requirements. Particularly, we describe an 8compartment model with variable disease transmissibility over time, considering transmission by asymptomatic/mild cases, which usually go undetected, hospitalization of severe cases (requiring clinical/ICU beds) and mortality. The parameters of this model are partially locally informed using data from hospitals dedicated to treating COVID19 patients in the region, and partly calibrated against the data (cases, deaths) provided by local health authorities, with optimal parameters identified using particle swarm optimization metaheuristics. This model was applied to study the ongoing COVID19 outbreak in the state of Bahia, Brazil, an example of a lowresource setting with pronounced inequalities in healthcare access, but could be extended and is directly applicable to other regions, offering the potential to aid in setting targets that may guide to the analysis of the evolving COVID19 pandemic, in addition to informing the extent of governmental measures required. Finally, we performed an expost evaluation of the COVID19 epidemic in Bahia using data that became available after the initial analysis, focusing on the actual clinical/ICU beds usage during the period, the number of COVID19 cases and deaths, and the utility of the proposed model to describe the epidemic in realtime.
Results
Model sensitivity analysis
We first conducted a sensitivity analysis to evaluate the most influential parameters of the model. Of note, the variancebased method used accounts for interactions among the model variables. These results revealed the factor that reduces the infectivity of the asymptomatic/nondetected, δ, to be among the most influential parameters to every model output during the whole period evaluated. Also, the transmission rate β was identified as exerting an important role in the model dynamics, as expected. Particularly, during the first 30 days β_{0} is the most important parameter in the system, as indicated by higher values of the total effect index (S_{T}). After this period, the importance of β_{0} decreases as that of β_{1} increases, eventually superseding the former as the most important parameter in the system. For H, U, and D, the most influential parameter during the initial stages of the simulation (before day 15) is the proportion of symptomatic needing hospitalization or ICU, h, together with the transmission rate (Supplementary Figs. 1, 2). The full analysis is presented in Supplementary Note 2.
Effects of social distancing and governmental interventions on disease transmissibility were observable shortly after onset
We started our analyzes by assessing the effects in disease transmissibility that local nonpharmaceutical interventions (NPI) have produced in the Bahia state, in its capital Salvador, as well as in the remaining cities (all municipalities in the state except the capital). For this, the model was fitted using the number of confirmed cases as declared by local authorities (Fig. 1) and we estimated parameters related to the transmission rate (β_{0}, β_{1}), the time point when it changes, and the factor that reduce the infectivity of the asymptomatic/nondetected, δ. We observed that the initial (preintervention) transmission rate was β_{0} = 1.28 ([1.26–1.30] 95% CI). A reduction of 36% on the transmission rate, yielding β_{1} = 0.92 ([0.91, 0.93] 95% CI), is evidenced around April 2 (27 days after the first confirmed case in the state). In Salvador (with a population of 2.6 million people), this reduction was of 54.7% (on March 26), while the remaining cities displayed a decrease of approximately 40.6% (on April 3, 2020). The factor that reduces the infectivity of the asymptomatic/nondetected was determined to be δ = 0.34 ([0.33, 0.35] 95% CI) at the state level, δ = 0.71 ([0.69, 0.72] 95% CI) in the capital and δ = 0.62 ([0.60, 0.64] 95% CI) in the remaining cities. The basic reproduction numbers for Bahia, Salvador and the other 416 municipalities were, respectively, of R_{0} = 2.25 ([2.19–2.31] 95% CI), 3.56 ([3.44–3.69] 95% CI) and 2.45 ([2.36–2.55] 95% CI).
These results show that the combined effects of changes in human behavior with the governmental policies of movement restriction resulted in significant decreases of the transmission rate, as measured by the β parameter. However, these efforts are still insufficient to curb the epidemic in the state, as the basic effective reproduction number still exceeds 1 (see Fig. 2), indicating a scenario of continuing growth. Next, we present the results of the consequence of this growth in local health resources.
Projecting hospitalization requirements in Bahia, Brazil: challenges for lowresource settings
We evaluated the burden on hospitalization needs imposed by the COVID19 epidemic at the state level, as well as the effects of NPI strategies on these requirements. We also estimated the total number of deaths projected by the model in the absence and during the enforcement of distancing measures. Our results, presented in Fig. 3, show that, in the absence of interventions, the state level availability of clinical beds would be exhausted by April 24, 2020. With the maintenance of the current level of interventions, this depletion is shifted in time and would occur by May 9. Analogously, the demand for ICU beds would exceed the installed capacity by April 26 in the absence of interventions, and by May 13 with the current rate of interventions.
The realworld, statelevel data obtained for May 4, the last day with available bed occupancy observations, shows that 240 (51.5%) clinical beds were occupied, while 176 (41.7%) ICU beds were in use. Our modelbased analysis yields an increase in these numbers by 6.5 (1581 beds) and 6.4 (1131 beds) times for clinical and ICU beds, respectively, if interventions had not been adopted in the state. On the other hand, measures enforced decreased the number of cases and deaths by 7 and 4 times, respectively, compared to the scenario where no measures are in place.
These results underscore the impact that the ongoing COVID19 epidemic imposes on hospital resources and mortality, and particularly explicit the challenges faced by countries with more limited healthcare systems. Even if we consider overestimation of the prediction results, the simple doubling of the current realworld bed occupancy data would already result in exceeding the current availability of clinical and ICU beds in the state.
The obtained \({{\mathcal{R}}}_{0}\) is as before and the effective reproduction number is presented in Fig. 2. We can notice a trend of reduction on the effective reproduction number, although \({\mathcal{R}}(t)\) is above one throughout most of the time series for the state of Bahia. Interestingly, our analysis of how nondetected cases (asymptomatic/mild infections) influence the course and dynamic of transmission revealed that these individuals contribute to an increase of 55.03% on the basic reproduction number.
A modelinformed strategy of periodic interventions to reduce COVID19 transmissibility in an effort to protect health systems
The previous results revealed the favorable effects that interventions resulting in decreased transmission rate have on shifting the peak of hospitalization saturation (complete occupancy of available beds), and in decreasing the number of cases and deaths. However, these results showed that complete saturation is inevitable under our local conditions. We next evaluated to what extent more vigorous restriction policies, and their duration/periodicity, would be useful in order to prevent the complete collapse of the statelevel health system. To address this question, we used the SEIIHURD model to study the epidemic dynamics under various scenarios.
Initially, and in order to assert that disease transmissibility is the driving factor leading to increased hospitalization requirements, we considered a scenario where the transmission rate of asymptomatic/nondetected individuals was increased by 50% starting in May 5 (Fig. 4). After 20 days, we noticed an increase of cumulative cases and deaths of, respectively, 50%, and 37%. Accordingly, clinical and ICU bed requirements increase by 75% and 87.5%, respectively. This scenario is illustrative of a situation where the movement restriction of individuals asymptomatic or having only mild symptoms (nondetected infections) is eased.
By accounting for nondetected cases, our modelingbased approach allowed the estimation of the infection fatality ratio (IFR), which considers deaths as a proportion of the total number of cases irrespective of severity or symptomatology. Our simulations of the SEIIHURD model yielded an overall IFR of 0.69% ([0.67, 0.71] 95% CI) for the state of Bahia, in line with preliminary findings from a literature metaanalysis that reported an estimated IFR of 0.68% ([0.52, 0.82] 95% CI), characterized by extensive heterogeneity across countries^{21,22}. In addition, modeling allows the estimation of the overall fraction of infected in the population exposed to the virus, allowing to investigate whether decreases in the transmission rate are driven more by a decreased pool of susceptibles or as a result of effective control policies. We estimated that, by May 4, 2020, around 0.1% of the population had been infected (either symptomatic or asymptomatic/nondetected) (Supplementary Fig. 3), in line with seroprevalence studies for the region^{23}, reinforcing the benefits of control policies to contain the viral spread, at least in the initial epidemic phase.
The previous results confirmed the importance of controlling disease transmissibility. Then, we turned to set targets that would allow for an increase in the protection of the healthcare system. These scenarios are illustrated in Table 1. We show that an intervention that reduces the transmission rate by 25%, enforced on May 2, 2020 (7 days before the predicted collapse of the system), for 30 days, would not yield significant improvements, resulting in a gain of only 2 days until clinical beds collapse, and 8 days until ICU bed capacity is exhausted. Similar results can be achieved by a more punctual (7 days period), but more vigorous intervention reducing transmission rate by 50% (Table 1). More interestingly, a delay of about 40 days for clinical and ICU bed exhaustion can be achieved in a scenario where a 50% reduction on the transmission is sustained for 30 days, or when a 75% reduction is endured for 14 days (Supplementary Fig. 4).
The timing of interventions is also crucial under our model. If a vigorous intervention is only adopted on the day when clinical bed occupancy reaches its maximum availability (on May 9), a time lag will be needed in order to allow for patient turnover in hospitals. Once occupancy is below the total availability, interventions can be continued or suspended. In the latter case, hospitalization requirements recommence to rise until reaching the health system’s capacity once again. Under this scenario, an intervention that reduces the transmission rate by 25% will not be enough to protect health resources, even if policies are maintained for long periods of time (Supplementary Fig. 5). Similar results are seen when we consider the reduction of the transmission rate by 50%, as shown in Table 2. Thus, harsher efforts to contain disease transmissibility, and for more extended periods, are necessary to allow for a full recovery of the healthcare system.
The previous results, combined, show that intense efforts to decrease COVID19 transmissibility are needed in order to overcome a complete collapse of the healthcare system in a lowresource setting such as that encountered in Bahia, Brazil. Of note, under some of the presented scenarios full reestablishment of the hospitalization capacity may not be achieved if the timing to enforce more strict measures to decrease the transmission rate is not optimal. Accordingly, periodic interventions may be needed to control secondary waves of the outbreak. In Fig. 5 we illustrate the behavior of the spread dynamics of COVID19 in Bahia if measures are periodically adopted. We present the behavior of implementing measures for a period of 30 days, followed by an easing of 30 days, and this being repeated periodically. These results show that even a reduction of 50% of the current transmission rate is insufficient to remain below the actual availability of health resources. Nevertheless, this implementation may be combined with the expanding of health capacities, limiting the need of more intense interventions.
Realtime modeling
The previous analyses comprised data available up to May 4, 2020. By leveraging the most current epidemiological data available for the ongoing epidemic, we were able to juxtapose the original predictions of the SEIIHURD model with the COVID19 epidemic unfolded in Bahia up to September 13, 2020. For this expost assessment, we first compared 30 days predictions of the original model (calibrated on May 4) with actual data for the period (Fig. 6), reasoning that homogeneous models, such as ours, have a limited longterm prediction capacity for the state as a whole, and in a realworld situation where the model is used for predicting the allocation of healthcare resources, recalibration with more current data would improve the accuracy of predictions while providing a reasonable timeframe for the management of resources by policymakers.
The 30 days prediction of the original model (calibrated on May 4, 2020) was able to satisfactorily predict the number of reported cases, deaths, and ICU requirements, with realworld values falling within our predicted confidence intervals (Fig. 6). Confirming our original predictions, under a scenario where interventions were maintained, the ICU bed availability would be exhausted by May 13, while this capacity was actually reached on May 24, 2020 (11 days later) as indicated by the data, also within the range of the estimated confidence interval. A less accurate result is shown for the hospitalization requirements. With a collapse estimated to occur on May 9, the data related to clinical beds occupations only reached its capacity on May 29. It is possible that hospitalization parameters may have changed during the period, however, we were not able to obtain updated data of the hospitalization dynamics in ICM to confirm whether this actually occurred.
Lastly, to describe the most uptodate transmission dynamics in Bahia, we reestimated our model with data available up to September 13, 2020 (Fig. 7). We maintained the parameters conditions as described in “Methods”, while allowing for a new transmission rate variability. The new estimates showed a reduction of the transmission rate on June 11, hinting on an increased control of the epidemic in Bahia.
Discussion
The COVID19 pandemic poses unprecedented challenges to healthcare resources worldwide. Our results based on actual epidemic data and on the generalization of the SEIR model, taking into account nondetected infections, hospitalization demands, and mortality, highlight some relevant scenarios for COVID19 in Bahia, a Brazilian state with exacerbated inequalities in health coverage and access. The trajectory of the epidemic can be characterized by the basic reproduction number (\({{\mathcal{R}}}_{0}> 1\)), which reflected the exponential growth of cases at the beginning of the epidemic in Salvador, the capital of Bahia, as well as its remaining 416 municipalities. We show that a reduction in disease transmission rate, as a result of nonpharmaceutical governmental interventions initiated on March 17, led to decreases in the number of cases, hospitalization demands and mortality up to May 4, which is represented in the model by a step function of transmission rate. We further show a reduction of 36% in the transmission rate in the 2 months since the first case was confirmed in Bahia. This may be partly attributed to population adherence to social distancing recommendations and convergent actions taken by local government authorities at the state and municipal levels. The effect of social distancing also became apparent in the time series modeling of the effective reproduction number, \({\mathcal{R}}(t)\), which continued to be greater than 1 (\({\mathcal{R}}(t) \,> \,1\)), despite the implementation of governmental measures.
Several measures to control the spread of the disease have been enforced by local governments, some of them even before the notification of the first cases of community spread, on March 19. From 17–28 March, measures were gradually applied and included the ban of public gatherings of over 50 people, closure of schools, mandatory home isolation for people with respiratory symptoms, adoption of teleworking for individuals of risk groups, and the reduction of circulation of interstate buses and intercity transportation between places where SARSCoV2 community transmission was declared. Concerning the latter, it is possible that the transmission rate decrease observed for the capital led to a corresponding reduction in the remaining municipalities due to decreased transportation flux of individuals.
Given the extent of measures adopted from March 17 onward, our results show that the reduction of the demand for clinical and ICU beds possibly avoided an immediate surge in hospitalization needs leading to system collapse, at least up to May 15. However, the simulated scenarios revealed that easing social distancing measures abruptly, which will result in increased transmission rates, should not be considered due to the nonlinear transmission of the disease and the significant number of nondetected infections, which have been considered as the source for the majority of cases in the previous studies^{10}.
Our results reinforce the negative effects on healthcare resources related to the circulation of asymptomatic/mild cases, which usually go undetected. Accordingly, policies aiming at relaxing the current level of social distancing measures, in a scenario where the majority of the population does not have access to diagnostic tests, could pose an additional burden on an already limited health system infrastructure. These results are in line with a recent study suggesting early selfisolation as a strategy to cope with the increasing demand for COVID19related hospitalization^{18}.
Bounds for δ (a factor associated with the infectivity of asymptomatic/nondetected) were defined based on the previous studies^{10,17,24}, which suggest that it is lower than that of symptomatic individuals (thus, δ < 1). However, based on the search interval for δ between 0 and 0.75, simulations of a greater transmission by nondocumented infections due to an increased circulation of individuals presenting with asymptomatic/mild disease can also be indicated by values of δ ≥ 1. The sensitivity analysis presented in our modeling results revealed the importance of increased knowledge of the extent to which infected individuals, with varying degrees of symptoms, are able to transmit the disease.
The consequences of the spread of the disease are even worse when the healthcare system is no longer able to support the number of patients needing specialized assistance–a situation referred to as a health system collapse. Our results point that nonpharmaceutical measures should be implemented in order to reduce the transmission rate of the disease, and consequently gain time to create new hospitals, acquire protective equipment material and guarantee human resources. But what can be done when faced with an already collapsed health system? We performed simulations to address this question, presenting different scenarios in order to determine an efficient strategy, by considering the period and intensity of interventions. The interventions can be applied at a single moment in time and kept until a decrease of the number of cases is observed, or a combination of interventions can be enforced at different time intervals, as proposed in other works^{25,26}, depending on testing and monitoring capacities and/or local socialeconomical conditions. Our results show that, when faced with an already collapsed system, only vigorous measures (that reduce the transmission rate by at least 50%) enforced over at least two months or, alternatively, measures capable of reducing transmission by at least 75% over a 2week period, are capable of reestablishing hospitalization operation capacity. Albeit harsh, other countries have successfully managed to reduce transmission at such figures by employing a myriad of public health measures (including intracity and intercity travel restrictions, social distancing, home confinement, and centralized quarantine and expansion of available medical resources)^{27}. Of note, even in the event that the transmission rate is decreased at these levels, a further, second collapse on hospitalization needs cannot be completely averted, a result which evidences the importance of timely enforcement of interventions.
By performing an expost assessment of the model calibrated on May 4, 2020 compared with the actual epidemic dynamics in Bahia, the usefulness of the SEIIHURD model to predict the peak demand for ICU beds in the state was illustrated, with realworld values falling within our confidence intervals. Longerterm predictions, however, are hampered by the inherent complexities of an unfolding epidemic, where human behavior, timing of deployment and lifting of governmental policies and related parameters cannot be fully expressed by modeling strategies alone. Ultimately, these will all be reflected as changes in the transmission rate over time. It should also be stressed that some of these factors may also impact directly the demand for hospitalization beds in the months following the start of the epidemic, leading to a different range of clinical hospitalizations, which may help explain the differences in the results obtained for clinical bed usage. A recalibrated model with epidemiological data up to September 13, 2020 showed that a third decrease in the transmission rate occurred around June 11, in line with a further strengthening of state measures that took place at the end of May that could have had a positive impact on the epidemic control^{28}.
Our findings have some limitations. First, this study was carried out with reported confirmed cases, which may result in an underestimation of the real incidence of COVID19, a problem also common to other diseases^{29}, as mass testing is still not performed in the country. However, the currently available national surveillance data can be considered adequate for the identification of trends of the disease, as this system is standardized and implemented in all municipalities in the country. Nevertheless, we were able to parametrize our model to a more realistic setting by using hospitalization data from a local reference infectious disease hospital currently dedicated to the care of COVID19 patients, and the results were compared to key epidemiological parameters obtained from the literature. Thus, our modeling strategy has as an advantage being locally informed, yielding more realistic results. The implemented model does not consider the transmission by infected individuals undergoing hospitalization, although it is known that healthcare workers are more atrisk of many airborne infections, and transmission is particularly high during procedures that generate aerosols^{30}. The model presented in this work is not optimal to address possible caseclustering effects, although the qualitative behavior of our results remains unaltered with respect to varying population sizes (Supplementary Note 3). Heterogeneous models can further be used to address this question, which would also require data with increased granularity. In spite of these limitations, given the general character of the mathematical model described herein, it may be readily applied to other places currently tackling the COVID19 epidemic with simple reestimation of the assumed values for parameters, and by taking into account the local COVID19 epidemic situation. Notably, our predictions of the infection fatality ratio, estimated at an overall 0.69% in Bahia, are in line with current estimates drawn from multiple studies worldwide (of 0.68%)^{21}, reinforcing the utility of the obtained model.
By drawing on different modeling scenarios, this work attempted to determine an efficient strategy to be employed in an effort to avoid a collapse in the local healthcare system, taking into account the length and the intensity of governmental interventions. A compromise between the availability of hospital/ICU beds and the pool of susceptible individuals was identified, for which modeling indicates the eventual occurrence of subsequent waves of infection, leading to further shortages in hospital/ICU beds. Our results underscore the crucial need for policymakers to take into account the results of datainformed modeling when considering the lifting of restrictive measures.
Methods
Data sources and case definition
The models produced in this study were informed by data from multiple sources: The daily series of the cumulative confirmed COVID19 cases and the daily mortality series for the state of Bahia, its capital Salvador and the remaining cities were obtained from publicly available data provided by the Secretary of Health of the State of Bahia (SESAB). Throughout our analyses, we consider separately the state capital (which concentrates the number of cases in the region and is an important touristic destination) and the remaining 416 municipalities. Local health authorities use the following case definition of COVID19, based on two criteria: (i) clinical/epidemiological, namely a case of suspected flulike syndrome or severe acute respiratory syndrome (SARS) who had contact with a laboratoryconfirmed COVID19 case in the last 7 days prior to symptoms onset; or (ii) clinical/laboratory, a suspected case of flulike syndrome or SARS with a positive SARSCoV2 serology (IgM and/or IgG) or realtime PCR result.
Additionally, statelevel daily hospital bed occupancy of clinical and ICU beds were provided by SESAB. By May 2020, the state of Bahia had a total of 888 hospital beds dedicated to the treatment of COVID19 patients, of which 466 are clinical hospitalization and 422 are ICU beds. This data was not available at the municipal level; rather, due to the Brazilian administrative division of health regions, hospital bed occupancy was evaluated at the state level only. Data was available throughout the period of March 6 to May 4, 2020 for the initial analysis and up to September 13, 2020 for the expost assessment.
We also had access to administrative data from a reference infectious disease hospital located in Salvador (Instituto Couto Maia; ICM), in cooperation with the Rede CoVida consortium team. ICM is the leading public hospital in the state of Bahia for the treatment of COVID19 patients. The collected hospital administrative data, aggregated across 231 patients followed from admission to discharge/death in the period of March 23 to April 16, 2020, were used to inform the hospitalizationrelated model parameters, including the search intervals for optimization procedures, as described in Section “Evaluation and estimation of model parameters”.
The estimated population of Bahia in 2020 was obtained from the Brazilian Institute of Geography and Statistics (IBGE).
Assumptions and model construction
In this section, we present the SEIIHURD model that subdivides the population into eight compartments, as follows: susceptible (S), those who are not exposed to the disease; exposed (E), individuals who have been exposed to the virus and are in a latent, noninfectious period; (I) infectious, those currently infected and capable of transmitting the disease to contacts; recovered (R), those who were previously infected and recovered from the disease; deaths (D) those that resulted from death due to COVID19, after passing for a period of hospitalization or ICU. The infectious individuals are further separated into asymptomatic/nondetected infections, denoted I_{a}, and symptomatic, denoted by I_{s}. Of note, COVID19 transmission by undocumented infections, which encompasses truly asymptomatic (individuals that never develop symptoms) as well as those that present with very mild symptoms, has been shown to facilitate the spread of SARSCoV2^{10}. Thus, individuals in the I_{a} compartment represent this group of persons that usually do not require hospitalization, are not accounted for in the official data, and define a subset of nondetected infections. However, a proportion of the infected will present with severe symptoms requiring hospitalization (clinical beds) (H), while those in critical conditions will eventually require ICU admission (U). For simplicity, we have neglected the transmission of individuals in compartments H and U, assuming that hospital containment decreases the chances of contact with susceptible individuals. We also consider a flux of patients between the H and U compartments, as individuals initially admitted to a clinical ward may worsen their condition and require an ICU bed. Furthermore, all patients in U are transferred to H prior to discharge and recovery. This assumption was based on the analysis of the administrative data from ICM, in which we observed that all patients requiring ICU beds had one of two outcomes: They were moved to hospitalization wards (H) before recovery and discharge; or they died as a result of disease. In addition, this administrative patient flow is also reported to be more common in the literature than a discharge directly home^{31}. In Supplementary Fig. 6 we present the flow diagram of the proposed model. Similar works can be found in refs. ^{10,14,19,32}.
To account for local interventions of movement restriction (such as governmental stayathome orders), we consider the transmission rate as a function of time, varying according to local measures. To define β, let {t_{1}, t_{2}, …, t_{n}} be a set of points in time defining the change in the transmission rate. Then, we can write β as a function of time t as
where \({\mathcal{H}}(t)={\mathrm{lim}}_{k\to \infty }\frac{1}{1+\exp (2kt)}\) is a Heaviside step function, β_{i} are transmission rates that can be obtained by the fitting of the data to the time interval defined by the t_{i}’s. The system of differential equations then reads:
where the key epidemiological parameters are described in Table 3. More details on the system of equations are provided in Supplementary Note 4.
Analytical evaluation of \({{\mathcal{R}}}_{0}\) and \({\mathcal{R}}(t)\) in the SEIIHURD model
The basic reproduction number, \({{\mathcal{R}}}_{0}\), is a threshold parameter estimated in the beginning of the outbreak. It is defined by the average number of secondary infections caused by a single infective in a fully susceptible population. Under these conditions, with the model proposed here, the primary cases are generated under the initial preinterventions transmission rate β(t) = β_{0}^{33}.
The basic reproduction number \({{\mathcal{R}}}_{0}\) has been derived within the general next generation operator framework^{32,34}. It considers the unstable diseasefree equilibrium point of the model, where S corresponds to the whole population and all other compartments are identically set to 0. Following Van den Driessche et al. (2002)^{34}, the value of \({{\mathcal{R}}}_{0}\) results from a balance between the infectious and transition terms of the submodel composed of the variables (E, I_{a}, I_{s}) associated with the transmission of the disease, which are gathered in the corresponding 3 × 3 matrices \({\mathcal{K}}\) and \({\mathcal{T}}\), given by
Thus, given the above matrices, \({{\mathcal{R}}}_{0}\) corresponds to the largest eigenvalue of the matrix \({\mathcal{K}}{{\mathcal{T}}}^{1}\) and represents the sum of the contribution of the symptomatic and asymptomatic/nondetected transmission, being expressed by
The effective reproduction number \({\mathcal{R}}(t)\) provides a measure of how the newly infected part of the population will further transmit the pathogen as the epidemic evolves over time. Indeed, as reminded above, the evaluation of \({{\mathcal{R}}}_{0}\) considers that the whole population is initially susceptible, a condition that is strictly valid only when the pathogen is first introduced into the system. As time evolves, the susceptible fraction of the population always decreases with time for models where the R compartment does not feed S. It is still unknown whether reinfection by SARSCoV2 can occur, but initial evidence suggests against this possibility^{35}. Here we assume that only a single COVID19 infection event can occur in any single person.
The epidemiological meaning of \({\mathcal{R}}(t)\) is the same as for \({{\mathcal{R}}}_{0}\), namely, it represents the average number of secondary infections that an individual, who became infected at time t, is able to generate. The series of \({\mathcal{R}}(t)\) values indicates the current trend of the epidemic and captures changes caused by recentlyintroduced interventions (such as governmental policies) or by natural decrease of the susceptible population. Accordingly, it provides a quantitative evidence of whether further measures are needed to control the epidemic. Here \({\mathcal{R}}(t)\) has been estimated following the assumptions introduced in Wallinga, Jacco, and Marc Lipsitch (2007)^{36}. It is based on the series of daily infected individuals, that is considered here as the source to insert into the general renewal equation for a birth process
with J(t) = b(t + ℓ) where b(t) is the number of daily reported cases.
In an epidemiological context, J(t) represents the daily number of new infections, while g(x) is the disease probability distribution function for the time an individual takes to infect secondary cases, in accordance with the ideas in the original infectionage model by Kermack and McKendrick^{9}. In this case, the function g(x) receives contributions that depend on the dynamics of the same three compartments E, I_{a}, I_{s} that impact the evaluation of \({{\mathcal{R}}}_{0}\). The population flow through these compartments consists of a first sequential step (E) followed by a bifurcation event leading either to the asymptomatic/nondetected (I_{a}) or the symptomatic (I_{s}) compartments. Therefore, it is first necessary to separately evaluate the composite functions g_{a}(x) and g_{s}(x) that account, respectively, for the sequential contributions of the flows E → I_{a} → O and E → I_{s} → O, where O indicates any compartment not responsible for infectious steps. Here we follow the framework developed by Brauer^{37} to obtain the following expressions:
Subsequently, these two contributions are combined, leading to the expression:
The details of the evaluation of Eqs. (14) and (15) are available in Supplementary Note 5, where we also detail how the expressions in Equation (14) should be replaced when κ = γ_{a} or κ = γ_{s}. It is noteworthy to see that the weights in factors multiplying g_{a}(x) and g_{s}(x) correspond to the contributions of the corresponding flow paths to \({{\mathcal{R}}}_{0}\) in Eq. (12), with the difference that the value of β_{0} is replaced by the value of β at the current time t.
In order to overcome the fluctuations of the confirmed number of cases (which is influenced by testing capacity and its associated increase, even if momentarily, such as when pending tests accumulate), we present two series of \({{\mathcal{R}}}_{t}\), one calculated from the daily number of confirmed cases, as informed by local health authorities; and another \({{\mathcal{R}}}_{t}\) series where this data is informed by the predictions of the model. More details are given in Supplementary Note 5.
Parameter sensitivity analysis
Sensitivity analysis was conducted to assess the effects of model parameters in the dynamics of I_{a}, I_{s}, U, H, and D over time. By using an statistical variancebased method, described by Sobol (2001)^{38}, the sensitivity analysis of the system described by Eqs. (2)–(9) considers the following parameter vector
and assumes that its elements are uniformly distributed in proper intervals as follows:
This method is divided into two steps, described in more detail in Supplementary Note 2. The numerical simulations were performed using the SALib library^{39}, and the experiments were conducted generating N = 12,000 parameter combinations, totaling 120,000 simulations of the model. The influence of each parameter on the model dynamics was evaluated using the total effect index, which takes into account higherorder interactions amongst the variables of the model.
Evaluation and estimation of model parameters
The estimation of the parameters occurred within a chosen range based on literature and data collected locally, as described in Supplementary Tables 1 and 2. The initial conditions (S_{0}, I_{a,0}, I_{a,0}, E_{0}, R_{0}, H_{0}, U_{0}, D_{0}) is given by (1 − I_{a,0} − I_{s,0} − E_{0}, I_{s,0}, I_{a,0}, I_{s,0}, E_{0}, 0, 0, 0, 0).
The parameters p, κ, γ_{a}, γ_{s}, ξ, ω_{U}, ω_{H}, μ_{U}, μ_{H} were kept fixed and the remaining were obtained by estimating the best values that fit the model to the data. To define the fixed parameters and the search intervals to use for the estimations, we performed a literature review of published papers and collected the data regarding key epidemiological parameters that inform our model (see Supplementary Table 1).
As an additional guide to obtain a locallyinformed model, administrative data from a reference infectious disease hospital (ICM; see Data Sources section) were used in order to capture plausible ranges for the hospitalizationrelated model parameters: Mean hospitalization period (γ_{H}), mean ICU period (γ_{U}), death rate of hospitalized individuals (μ_{H}), death rate of ICU individuals (μ_{U}), proportion of clinically hospitalized transferred to ICU (ω_{H}) and proportion of ICU individuals that return to clinical hospitalization (ω_{u}) (see Supplementary Table 2).
Based on the search ranges, optimized model parameters were estimated using the Particle Swarm Optimization (PSO) metaheuristic^{40}. Under the PSO framework, we used a multioptimization function to simultaneously optimize the model to the series of daily confirmed cases, deaths, clinical hospitalization, and ICU occupations in the whole state, and to daily confirmed cases and deaths for the capital city Salvador and the remaining 416 municipalities (given that the hospitalization series were only available aggregated at the statewide level) up to May 4, 2020. PSO was implemented using pyswarms library version 1.1.0 for Python 3^{41}, and was executed with 300 particles through 1,000 iterations with cognitive parameter 0.1, social parameter 0.3, inertia parameter 0.9, evaluating five closest neighbors through Euclidean (or L2) distance metric. In addition to the point estimates obtained by the PSO method for the parameters β_{0}, β_{1}, δ, h, γ_{H} and γ_{U}, percentile confidence intervals were also estimated for these parameters. The intervals were constructed using the weighted nonparametric bootstrap method^{42}, considering 500 replicates of the original series S_{t}, t = 1, …, n, which represents the number of new cases observed at time t. The proportion of observed cases at time t (number of cases at time t/total number of cases in the analyzed period) was used as a weight in the resampling process to obtain the bootstrap replicates. Then, the SEIIHURD model was adjusted for each replicated series and the estimates obtained for the model parameters were stored in vectors, generating the empirical distribution for each parameter.
Given the complexity of the proposed model, we performed an identifiability analysis in terms of the number of parameters and possible correlations between them. A simulation study was carried out in order to assess the identifiability of the model presented. The study was conducted based on the approach developed by Roosa and Chowell^{43}, which makes use of the parametric bootstrap method to generate data from a system of dynamic equations, in order to quantify the uncertainty and assess the identifiability of the indicators of the model. More information is given in Supplementary Note 6.
Modeling scenarios
We present our analysis as follows: First, we study the effects of previously enforced interventions in the state of Bahia, its capital city Salvador and the remaining 416 municipalities. For this, we considered the SEIIHURD model with the proportion of symptomatic needing hospitalization or ICU (parameter h) equals to zero, so that the resulting model does not consider the compartments of hospitalization, ICU, and death, effectively resembling an SEIR model with asymptomatic/nondetected transmission.
Then, we analyze these effects on the number of deaths and hospitalization requirements in the state level. We show the impact of the nondetected individuals on the dynamics of COVID19 transmission.
Lastly, to study the future behavior of the transmission of the disease in Bahia, we simulated different scenarios that may impact the number of cases, mortality, and healthcare demands. The following scenarios were considered: (1) An immediate intervention taking place on May 5, sustained for a period of 7, 14, or 30 days, and resulting in a reduction of the transmission rate by 25%, 50%, or 75%; (2) A critical intervention, adopted when the collapse of clinical bed occupancy occurs (on May 14, 2020, the predicted date of peak demand), maintained for a period of 7, 14, 30, 60, 90 days and leading to a reduction of the transmission rate by 25%, 50% or 75%; and (3) implementations of more than two interventions in sequence.
Ethics statement
This study was conducted with publicly available data from the COVID19 epidemic in Bahia, obtainable from the periodic epidemiological bulletins published by the Secretary of Health of the State of Bahia (SESAB), as well as with aggregated administrative data from Instituto Couto Maia hospital (Salvador, Bahia), and therefore no approval by an ethics committee was required, according to Resolutions 466/2012 and 510/2016 (article 1, sections III, and V) from the National Health Council (CNS), Brazil.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Data availability
The series of COVID19 cases and deaths and hospital occupancy are publicly available from the State Secretary of Health of Bahia (SESAB) at https://infovis.sei.ba.gov.br/covid19/ and are also available as CSV files. All other data, including the list of parameters used to inform the model, are presented within the Supplementary Material and in the GitHub repository at https://github.com/cidacslab/MathematicalandStatisticalModelingofCOVID19inBrazil.git^{44}. Raw data is included within Figs. 1, 3, 4, 5, 6, and 7. Source data are provided with this paper.
Code availability
Codes used to produce the results presented herein are available in a public GitHub repository at https://github.com/cidacslab/MathematicalandStatisticalModelingofCOVID19inBrazil.git^{44}, as well as in the Supplementary Material.
References
Dong, E., Du, H. & Gardner, L. An interactive webbased dashboard to track COVID19 in real time. Lancet Infect. Dis. 20, 533–534 (2020).
Li, Q. et al. Early transmission dynamics in Wuhan, China, of novel coronavirusinfected pneumonia. N. Engl. J. Med. 382, 1199–1207 (2020).
Wu, J. T., Leung, K. & Leung, G. M. Nowcasting and forecasting the potential domestic and international spread of the 2019nCoV outbreak originating in Wuhan, China: a modelling study. Lancet 395, 689–697 (2020).
Cowling, B. J. et al. Impact assessment of nonpharmaceutical interventions against coronavirus disease 2019 and influenza in Hong Kong: an observational study. Lancet Public Health 5, E279–E288 (2020).
Candido, D. S. et al. Evolution and epidemic spread of SARSCoV2 in Brazil. Science 369, 1255–1260 (2020).
Teles, A. S., Coelho, T. C. B. & Ferreira da, M. P. d. S. Public expenditure on health in Bahia: exploring evidence of inequalities. Saúde. em Debate 41, 457–470 (2017).
PanovskaGriffiths, J. Can mathematical modelling solve the current Covid19 crisis? BMC Public Health 20, 551 (2020).
Ferguson, N. et al. Impact of nonpharmaceutical interventions (NPIs) to reduce COVID19 mortality and healthcare demand. http://hdl.handle.net/10044/1/77482 (2020).
Kermack, W. O. & McKendrick, A. G. A contribution to the mathematical theory of epidemics. Proc. R. Soc. Lond. (Ser. A) 115, 700–721 (1927).
Li, R. et al. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARSCoV2). Science 368, 489–493 (2020).
Eikenberry, S. E. et al. To mask or not to mask: modeling the potential for face mask use by the general public to curtail the COVID19 pandemic. Infect. Dis. Model. 5, 293–308 (2020).
Leung, K., Wu, J. T., Liu, D. & Leung, G. M. Firstwave COVID19 transmissibility and severity in China outside Hubei after control measures, and secondwave scenario planning: a modelling impact assessment. Lancet 395, 1382–1393 (2020).
Prem, K. et al. The effect of control strategies to reduce social mixing on outcomes of the COVID19 epidemic in Wuhan, China: a modelling study. Lancet Public Health 5, E261–E270 (2020).
Berger, D. W., Herkenhoff, K. F. & Mongey, S. An SEIR infectious disease model with testing and conditional quarantine. National Bureau of Economic Research, No. w26901 (2020).
Giordano, G. et al. Modelling the COVID19 epidemic and implementation of populationwide interventions in Italy. Nat. Med. 26, 855–860 (2020).
Kucharski, A. J. et al. Early dynamics of transmission and control of COVID19: a mathematical modelling study. Lancet Infect. Dis. 20, 553–558 (2020).
Kissler, S. M., Tedijanto, C., Goldstein, E., Grad, Y. H. & Lipsitch, M. Projecting the transmission dynamics of SARSCoV2 through the postpandemic period. Science 368, 860–868 (2020).
Moghadas, S. M. et al. Projecting hospital utilization during the COVID19 outbreaks in the United States. Proc. Natl Acad. Sci. 117, 9122–9126 (2020).
Weitz, J. S. et al. Modeling shield immunity to reduce COVID19 epidemic spread. Nat. Med. 26, 849–854 (2020).
Castro, M. C. et al. Demand for hospitalization services for COVID19 patients in Brazil. https://doi.org/10.1101/2020.03.30.20047662 (2020).
MeyerowitzKatz, G. & Merone, L. A systematic review and metaanalysis of published research data on COVID19 infectionfatality rates. https://doi.org/10.1101/2020.05.03.20089854 (2020).
Centers for Disease Control and Prevention–CDC. Pandemic Planning Scenarios. CDC. https://www.cdc.gov/coronavirus/2019ncov/hcp/planningscenarios.html
Hallal, P., Hartwig, F., Horta, B., Victora, G. D. & Silveira, M. Remarkable variability in SARSCoV2 antibodies across Brazilian regions: nationwide serological household survey in 27 states. medRxiv https://doi.org/10.1101/2020.05.30.20117531 (2020).
Cheng, H.Y. et al. Contact tracing assessment of COVID19 transmission dynamics in Taiwan and risk at different exposure periods before and after symptom onset. JAMA Intern. Med. 180, 1156–1163 (2020).
Müller, M., Derlet, P. M., Mudry, C. & Aeppli, G. Using random testing to manage a safe exit from the COVID19 lockdown. https://doi.org/10.1101/2020.04.09.20059360 (2020).
Kissler, S. M., Tedijanto, C., Goldstein, E., Grad, Y. H. & Lipsitch, M. Projecting the transmission dynamics of SARSCoV2 through the postpandemic period. Science 3, 433 (2020).
Pan, A. et al. Association of public health interventions with the epidemiology of the COVID19 outbreak in Wuhan. China Jama 323, 1915–1923 (2020).
Jorge, D. C. P. et al. Assessing the nationwide impact of COVID19 mitigation policies on the transmission rate of SARSCoV2 in Brazil. https://doi.org/10.1101/2020.06.26.20140780 (2020).
Oliveira, J. F. et al. Interdependence between confirmed and discarded cases of dengue, chikungunya and Zika viruses in Brazil: a multivariate timeseries analysis. PloS ONE 15, e0228347 (2020).
Tang, J. W., Li, Y., Eames, I., Chan, P. K. S. & Ridgway, G. L. Factors involved in the aerosol transmission of infection and control of ventilation in healthcare premises. J. Hospital Infect. 64, 100–114 (2006).
Stelfox, H. T. et al. Assessment of the safety of discharging select patients directly home from the intensive care unit: a multicenter populationbased cohort study. JAMA Intern. Med. 178, 1390–1399 (2018).
Diekmann, O. & Heesterbeek, J. A. P. Mathematical Epidemiology of Infectious Diseases: Model Building, Analysis and Interpretation 5 (John Wiley & Sons, 2000).
Chowell, G., Hengartner, N. W., CastilloChavez, C., Fenimore, P. W. & Hyman, J. M. The basic reproduction number of Ebola and the effects of public health measures: the cases of Congo and Uganda. J. Theor. Biol. 229, 119–126 (2004).
Van den Driessche, P. & Watmough, J. Reproduction numbers and subthreshold endemic equilibria for compartmental models of disease transmission. Math. Biosci. 180, 29–48 (2002).
Bao, L., Deng, W., Gao, H., Xiao, C. & Liu, J. Reinfection could not occur in SARSCoV2 infected rhesus macaques. https://doi.org/10.1101/2020.03.13.990226 (2020).
Wallinga, J. & Lipsitch, M. How generation intervals shape the relationship between growth rates and reproduction numbers. Proc. R. Soc. B: Biol. Sci. 274, 599–604 (2007).
Brauer, F. Age of infection in epidemiology models. Electron. J. Differential Equ. (EJDE) [Electron. only] 2005, 29–37 (2005).
Sobol, I. M. Global sensitivity indices for nonlinear mathematical models and their MonteCarlo estimates. Math. Computers Simul. 55, 271–280 (2001).
Herman, J. & Usher, W. SALib: an opensource Python library for sensitivity analysis. J. Open Source Softw. 2, 97 (2017).
Eberhart, R. & Kennedy, J. A new optimizer using particle swarm theory. In MHS’95. Proc. 6th International Symposium on Micro Machine and Human Science, 39–43 (1995).
Miranda, L. PySwarms: a research toolkit for particle swarm optimization in Python. J. Open Source Softw. 3, 433 (2018).
Davison, A. C., Hinkley, D. V. & Young, G. A. Recent developments in bootstrap methodology. Stat. Sci. 18, 141–157 (2003).
Roosa, K. & Chowell, G. Assessing parameter identifiability in compartmental dynamic models using a computational approach: application to infectious disease transmission models. Theor. Biol. Med. Model. 16, 1 (2019).
Oliveira, J. F. et al. Mathematical modelling of COVID19 in 14.8 million individuals in Bahia, Brazil. GitHub Repository: Mathematical and Statistical Modeling of COVID19 in Brazil (2020).
Acknowledgements
This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brazil (CAPES)—Finance Code 001. STRP was supported by an International Cooperation grant (process number INT0002/2016) from Bahia Research Foundation (FAPESB). STRP and RFSA were supported by the National Institute of Science and Technology—Complex Systems from CNPq, Brazil. JFO was supported by the Center of Data and Knowledge Integration for Health (CIDACS) through the Zika Platform—a longterm surveillance platform for Zika virus and microcephaly (Unified Health System (SUS), Brazilian Ministry of Health). AASA gratefully acknowledges the financial support received from the Engineering and Physical Sciences Research Council (EPSRC) in the form of grant EP/R002134/1. The authors acknowledge the helpful suggestions from members of the CoVida Network (http://www.redecovida.org), in special to contributors to the Rede CoVida Modelling Taskforce (See Supplementary Note 1). Andris K. Walter is gratefully acknowledged for English language revision and manuscript copyediting assistance.
Author information
Authors and Affiliations
Contributions
J.F.O., S.T.R.P., P.I.P.R., and R.F.S.A. conceived and designed the study. J.F.O., D.C.P.J., R.V.V., D.S.S., M.S.R., M.F.T., N.B.S., R.L.F., F.A.C.P., C.P.C., A.S.S.P., A.A.S.A., E.A.B.F.L., P.I.P.R., R.F.S.A., and S.T.R.P. performed the analysis. J.F.O. and P.I.P.R. wrote the first draft of the manuscript, which was reviewed by L.L.C., N.B.S., S.T.R.P., and R.F.S.A. All authors participated in the discussion of the results and contributed to the revision of the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Peer review information Nature Communications thanks Rowland Kao and the other, anonymous reviewer(s) for their contribution to the peer review of this work.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Source data
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Oliveira, J.F., Jorge, D.C.P., Veiga, R.V. et al. Mathematical modeling of COVID19 in 14.8 million individuals in Bahia, Brazil. Nat Commun 12, 333 (2021). https://doi.org/10.1038/s41467020197983
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467020197983
This article is cited by

Understanding the uneven spread of COVID19 in the context of the global interconnected economy
Scientific Reports (2022)

Heterogeneous adaptive behavioral responses may increase epidemic burden
Scientific Reports (2022)

Identification of the effects of COVID19 on patients with pulmonary fibrosis and lung cancer: a bioinformatics analysis and literature review
Scientific Reports (2022)

Differential evolution and particle swarm optimization against COVID19
Artificial Intelligence Review (2022)

Assessing the Spatiotemporal Spread of COVID19 via Compartmental Models with Diffusion in Italy, USA, and Brazil
Archives of Computational Methods in Engineering (2021)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.