Introduction

Since 2013, the Ebola virus outbreak in West Africa has become the largest such outbreak known. The epidemic first emerged in December 2013 in southern Guinea, but as of 11 May 2016, there have been about 28,600 cases of EVD in Guinea, Liberia, and Sierra Leone, and isolated cases in Italy, Mali, Nigeria, Senegal, Spain, the United Kingdom, and the United States. 11,300 of these cases were fatal1 and, as high as these numbers are, they may be under-estimates due to the poor quality of current data2. The goal of this paper is to better understand the spread of EVD, and test the assumptions of leading EVD models.

Individuals have often been assumed to homogenously mix with each other in many recent EVD models3,4,5,6,7, but we show that, by applying recent work on the migration of diseases8, homogeneous mixing is an especially poor approximation for EVD. We find that human migration patterns help predict where and when EVD originated and will appear, which would not be possible with a homogeneous mixing assumption. We also find evidence that the spread of EVD is much slower than other recent diseases, such as H1N1 and SARS8, which may have helped health workers control the disease.

Furthermore, against our expectations, we find that the initial growth rate of EVD can decrease significantly with population density, possibly because higher population density areas are correlated with other attributes, such as better healthcare. This compares to previous work where exponential and sub-exponential growth rates were found in many diseases, including the most recent EVD epidemic9,10, where variations in the growth rate of diseases were found, but mechanistic explanations were not explored. A previous model11, in comparison, found that higher population cities should contribute to a faster rate of disease spread, although we are not aware of previous research on disease spread and population density. Our work suggest that location-specific initial growth rates better model EVD, although the underlying reason for this heterogeneity should be a topic of future research.

Finally, we create novel metrics for the relative transmissibility of EVD strains, which are robust to sparse sampling. These metrics add to previous work on EVD in Sierra Leone12, and provide a novel understanding of EVD strains in Guinea. We find that the relative transmissibility of strains, as measured from these metrics, is not uniform; therefore, treating EVD as a single disease may be inappropriate3,4,5,6,7.

These results, when taken together, suggest unexpectedly simple ways to improve EVD modeling. In the Discussion section, we will explain how a meta-population model can potentially aid in our understanding of disease spread and growth. Furthermore, incorporating disease strain dynamics into this model could help us better predict which strains will become dominant in the future, which may improve vaccination strategies.

Results

Models of the West Africa Ebola outbreak have often assumed that the disease spreads via homogeneous mixing3,4,5,6,7. We find, however, that this assumption may not accurately model EVD when the disease first arrives in a given area. We will first discuss how the arrival time of EVD within a country or administrative area follows a predictable pattern due to the underlying migration model, in contrast to the mixing hypothesis. Next, we model the cumulative number of individuals infected in administrative divisions at the first or second level in Guinea, Liberia, and Sierra Leone to estimate the initial growth rate of EVD. We find this growth rate varies significantly, and appears to decrease with the population density within the administrative division. Finally, we introduce models of how EVD disease strains spread to rule out uniform strain transmissibility.

How Does Ebola Spread?

Homogeneous mixing models assume that healthy individuals can get sick regardless of where they are, even when they are hundreds of miles from the origin of the infection. If this is true, then the disease should be quickly seen in all susceptible areas almost simultaneously. Although this approximation may be reasonable at short distances, there has to be a lengthscale when this would break down because, in the years since Ebola first emerged, no more than a handful of countries have become infected (Fig. 1).

Figure 1
figure 1

The arrival time, Ta, of EVD in a country versus (a) the great-arc length distance, Dg and (b) the migration-based effective distance, Deff from the disease’s point of origin (Guinea). Error is smaller than marker size. The migration network used to construct the effective distance comes from census microdata13. The linear relationship between arrival time and effective distance suggests that there is a constant effective velocity of disease spread, in agreement with previous work on other diseases8.

Alternatively, one might assume that EVD spreads spatially. There is a significant positive correlation (Spearman ρ = 0.26, p < 0.05, n = 56 at the spatial resolution of administrative divisions; 0.81, p < 0.05, n = 8 at the country resolution) between the arrival time of EVD in administrative divisions at the first or second level and the distance from the outbreak origin, Guéckédou, Guinea, to division centroids. Furthermore, this assumption has been applied successfully to model EVD in Liberia2.

We find, however, that migration in West Africa is more complex than either of these assumptions13. Intuitively, diseases should spread more quickly between administrative divisions or countries with significant travel between them than between isolated areas. Therefore, it is reasonable to rescale distances such that areas with stronger travel ties are considered “closer” than areas without these ties, following work by Brockman and Helbing8. We find that rescaling distances using migration patterns helps us (1) better understand how quickly EVD spreads, and (2) estimate where the outbreak started.

To our surprise, we find that the correlation between the arrival time and effective distance for EVD (Spearman ρ = 0.95, p < 10−3, n = 8) was consistently higher than the correlation between the arrival time and geodesic distance (see Figs 1 and 2, and Supplementary Fig. S1). A high Pearson correlation (0.96, p < 10−3), and agreement with the normality assumption (p > 0.05, using the Kolmogorov-Smirnov normality test), also suggests a linear relationship between the arrival time and effective distance. Taking the slope of the plot gives us an effective velocity of spread, which we find to be 0.015 days−1, which is much slower than for previous diseases (≈0.1 days−1)8. An intuitive explanation for our finding is that lower overall migration in West Africa reduces the speed at which EVD spreads compared to other diseases.

Figure 2
figure 2

The arrival time, Ta, of patients with EVD in administration divisions at the first or second level within Guinea, Mali, Liberia, Sierra Leone, or Nigeria, versus (a) the great-arc length distance, Dg, and (b) the migration-based effective distance, Deff, from the disease’s point of origin (Guéckédou, Guinea). Error is smaller than marker size. The migration network used to construct the effective distance comes from a radiation migration model29 (similar results were found using the gravity migration models in ref. 13, see Supplementary Fig. S1).

The lower correlations at the first or second administrative level are due in part to the fact that we use migration models to determine the effective distance, and the disease spread for several months before it was detected7. Despite the lower quality data, however, we can still use it to determine the most likely origin of EVD, which we compare to the known origin, Guéckédou, Guinea. Quickly finding where a disease originated is important to help understand what caused it (e.g., what was the vector), and to predict where and when it will arrive, which can allow health workers to prepare8. Previously, it was found that the correlation between the arrival time and the effective distances from the disease origin is higher than correlations from areas where the disease did not originate8. We therefore ranked the correlation between the arrival times and effective distances from all the administrative divisions where Ebola was found between 2013 and 2016 (Fig. 3 and Supplementary Fig. S2), and found the true origin has the highest correlation. To determine the statistical significance of the ranking, we bootstrapped residuals of the linear regression between Deff and Ta, with Guéckédou as the origin, to accurately bootstrap arrival times. This is equivalent to simulating what would happen if we wound back the clock and restarted the infection from Guéckédou. The true origin has the highest correlation 45% ± 1.6% of the time for the radiation model, and 44–70% of the time for gravity models (Supplementary Fig. S2), therefore the true origin does not always have the highest correlation, but it often does, and can be a good first guess when determining the origin.

Figure 3
figure 3

The (ranked) correlations between arrival time, Ta, and migration-based effective distance, Deff, between administrative divisions, calculated via Eq. 5 in ref. 8.

The migration network used to construct the effective distance comes from a radiation migration model29 (similar results were found using the gravity migration models in ref. 13, see Supplementary Fig. S2). In red is the true origin, which is found to have the highest correlation.

In conclusion, we find strong evidence that a migration network can elucidate how quickly Ebola spreads, when and where it will arrive, and where the infection began even with limited data. Furthermore, we see that alternative hypotheses for how EVD spreads, such as homogeneous mixing and nearest neighbor interactions, provide quantitatively poorer agreement with data.

The Growth of EVD Across Administrative Divisions

In this section, we show that the cumulative number of Ebola cases within administrative divisions at the first or second level is well-approximated by a logistic function (Fig. 4a). We use this finding to estimate the initial growth rate of EVD for each infected administrative division, where, to our surprise, we find that the initial growth rate decreases with population density. We emphasize that variations in EVD growth rates have been seen before9,10, but mechanisms that might drive this behavior were not proposed. The logistic function has been used to model initial stages of EVD14, and is equivalent to the Susceptible-Infectious (SI) model when 100% of individuals are initially susceptible15. To fit the SI model to our data, however, we would have to make a simplistic assumption that only a fraction pn of individuals are susceptible, in order to explain why a small fraction of the population is ever infected. We do not claim this describes the actual dynamics of EVD, although we will explain later why the cumulative number of cases should approximately follow this distribution. For an administrative division n, the cumulative number of infected individuals over time, t, by the logistic growth function is simply:

Figure 4
figure 4

The cumulative number of infected individuals over time within administration divisions at the first or second level in Guinea, Sierra Leone and Liberia, from the patient database dataset1.

It is clear that the rate and size of infections are heterogeneous, but when we fit the data to logistic functions, and renormalize the coefficients to pn → 1, in (b), we see that the distributions collapse. A logistic function is plotted in red.

The initial growth rate is qn, while t0 is the time when the cumulative infection increases the most. The dynamics are highly heterogeneous (Fig. 4a), therefore, it would seem un-intuitive for a single function to fit all the data. However, after fitting each cumulative distribution to the logistic model, and rescaling the variables: pn → 1, , we find that the distributions collapse (Fig. 4b) to a good approximation.

Because small variations in qn very quickly become substantial variations in the infection size later on, we want to understand how qn varies across administrative divisions. When plotting qn versus population density (Fig. 5) with more than 20 infections total, we notice that, although qn is ≈0.1 days−1, which is similar to a previous EVD outbreak16, qn varies significantly across administrative divisions. This result contrasts with many previous models that assume a global parameter can describe the growth of Ebola3,4,5,6,7. Furthermore, we find that qn decreases significantly with population density (Spearman ρ = −0.48, p < 10−3, n = 44), plausibly because better healthcare may exist in higher density areas. This contrasts with a previous model, which predicted a positive scaling relation between the mean growth rate and population of cities11, although we are not aware of research that explored how disease spread is affected by population density. Therefore, not only is the growth rate of Ebola unexpectedly heterogeneous, but the dependence on population density may help us understand why this is the case.

Figure 5
figure 5

The initial growth rate, qn, versus population density for the PSD dataset with more than 20 infections (not shown is the outlier Kissidougou, Guinea, with a population density of 34 individuals per kilometer, and a growth rate of 0.41 days−1), where error bars are standard deviations.

We find that the initial growth rate drops significantly with population density (Spearman ρ = −0.48, p < 10−3, n = 44).

What Makes the Data Collapse?

In the SI model, 100% of individuals are eventually infected, therefore, to find agreement with data, our model has to assume a small proportion of individuals in each division are susceptible to the disease. This seems implausible; more likely, all individuals are susceptible and, as they become aware of an infection, they reduce their interactions or otherwise reduce the overall disease transmissibility. To demonstrate this hypothesis, we created a more realistic, although still simplistic, disease model, in which susceptible (s) individuals can become infected (i), but then recover or are removed17. In our data, all individuals who recovered or died were assumed to be “removed”. The SIR model, like the SI model, significantly overshoots the cumulative number of cases in the absence of intervention. We counter-balance this effect with an exponentially decreasing disease transmissibility as a result of public health interventions18,19. We call this model the Susceptible - Decreasingly Infectious - Recovered (SDIR) model.

The equations are:

in normalized units, where sn is the susceptible fraction of the population, in is the infected population and rn is the removed population (either by recovery or death), for each administrative division. b is the recovery rate, while the infectious rate, a(t), is defined as

In Eq. 5, a represents the overall infection rate, while k represents the rate at which control measures reduce transmission, t′ is a delay before which individuals are not aware enough of the disease to try to limit its spread, and θ is the Heaviside step function. Before t′, the disease infects at a rate a, while afterwards, we see a sharp drop-off in the disease transmissibility. It is clear that other, more realistic assumptions could be included into the model, including an exposed state (e.g., the SEIR model20, or the effect of burial practices, hospitalization, and other factors3,4,5,6, but we leave this out of our model for simplicity. We see rough quantitative agreement with empirical data (e.g. Fig. 6), which suggests that this simple model captures the essence of the real-world dynamics.

Figure 6
figure 6

SDIR fits to empirical data (fits for all infected administrative divisions can be seen in Supplementary Figs S3–S5).

The cumulative number of infected individuals in (a) Forecariah, Guinea; (b) Montserrado, Liberia; and (c) Bo, Sierra Leone, where the blue line is the best fit and the shaded area represents standard errors. While some fits are poorer than others, we generally capture the qualitative structure of the empirical data, including the cumulative number of infected. This model may therefore begin to explain the mechanism behind the s-curve.

In review, our model assumes only 3 states and a global time time-varying infection rate, a(t). Even though there are reasons to consider this model too simplistic, it is able to effectively describe the roughly s-like curve of infections, and therefore it begins to help us understand the mechanism for a logistic-like cumulative distribution (Fig. 4), such as reductions in infectability due to disease awareness.

Are Strains Uniformly Transmissible?

In this section, we use EVD genome sequences to determine what strains appear more often than expected by chance in Guinea and Sierra Leone. Our results suggest that EVD strains do not necessarily have uniform transmissibility. We are not aware of any previous models that take the strain of EVD into account, although a previous paper found certain EVD strains in Sierra Leone have different growth rates12. Unlike the previous paper, however, we can use our method to understand the transmissibility of strains in Guinea, where the sampling rate is otherwise too low.

Modeling Strain-Dependent Infection Probabilities

We use meta data from Ebola nucleotide sequences isolated from patients in Guinea21 between April, 2014 and January, 2015, and Sierra Leone between late May 2014 and January, 201522,23,24, to determine when and where a strain of EVD was found, then use kernel-density estimation (KDE, see Methods) to estimate the spatial probability density function (PDF) of being infected with an EVD strain s25:

Here, K represents a kernel with bandwidth h to represent the area around an observed sequence where individuals are likely to be infected, C is an overall constant and H is the Heaviside step function. are all labels for the set of pairs with known infections of strain s. We add a Heaviside step function in the above equation to represent a sliding time window of length Δt – only within timeframe (t − Δt) to t is sequence data relevant. For the rest of the paper, our kernel is chosen to be a radially symmetric Gaussian:

We do not believe that our results are qualitatively sensitive to the kernel choice. By summing these probabilities, we can then find the probability of being infected with EVD:

where . There are two free parameters: the kernel bandwidth h and sliding time window width Δt, but knowing the true infection pattern allows for these parameters to be estimated (see Fig. 7 for EVD in Guinea).

Figure 7
figure 7

A heat map of the Spearman rank correlation betweenEq. 8 and the number of individuals infected with EVD within a time Δt, as a function of the bandwidth h and the time window width, Δt in Eq. 8.

The correlation between the model and data is highest (Spearman ρ = 0.50, p < 0.01, n = 68) when the bandwidth is 0.5 degrees and the time window width is 120 days.

We apply KDE to EVD in Guinea and Sierra Leone, and test whether the estimated probabilities of becoming infected correlate with the number of infected individuals within each time window. A high correlation would represent close agreement between the KDE and actual spatial probability, and would increase our trust in these findings. In Guinea, we find Spearman correlations of up to 0.5 (p < 0.01, n = 68, see Fig. 7) which suggests that the KDE is in good agreement with data. In Sierra Leone, however, these correlations are negligable. The Guinea dataset will therefore be the focus of the rest of our paper.

From Fig. 7, we find that the model best correlates with Guinea’s infection data if h = 0.5 and Δt = 120 days. A plausible biological reason for the time window to be 120 days is that it may correspond to the effective viral shedding time, which can occur over timescale of roughly 100 days26. For example, the virus has been found to spread via sexual contact, and has been seen in vaginal fluid for up to 33 days, and in semen for up to 82 days via cell culture, and 550 days via RNA. These values are extremes and might not be likely to be encountered often, however there has been at least one other report of RNA seen in semen 100 days afterwards27. The length scale of 0.5 degrees, however, is roughly the distance between prefectures, which probably explains why the peak is at this bandwidth. We also find that our results are robust to choices of h and Δt, and we therefore let h vary between 0.1 and 1 degrees and Δt vary between 30 and 300 days.

Measuring the Relative Transmissibility of Strains

We have just demonstrated the applicability of KDE to measuring the relative likelihood of being infected with EVD across districts. This is not in and of itself too interesting – indeed other models may create better quantitative predictions of how EVD spreads2. Unlike previous work, however, this model can predict the relative transmissibility of individual EVD strains (Eq. 6). We will apply these predictions towards determining the relative transmissibility of EVD strains. When a strain s appears much more than it should compared to other strains, then we can conclude that s may be more transmissible.

Let a new infection arrive at position and at time ty. Our model may predict that the probability this infection would have a strain s is, e.g., 20% and any other strain is 40%. If we find the disease is indeed strain s, we may be a little “surprised”. If s consistently appears more often than expectations, we may believe that s is simply more successful – it can reach individuals more quickly than other strains. To quantify our small “surprise” of seeing a new s strain, we can write the equation:

where I is the indicator function that a new infection’s strain is s or not, and p(s) is the probability that the infection strain is s (See Fig. 8). On average, the difference between our prediction and data, Ss, defined as

Figure 8
figure 8

A schematic for our success metric.

(a) When a new infection appears, the probability the infection would be a strain s is . We define Qs to be the difference between the prediction and actual event. (b) Ss, the expectation value of Qs, should be 0 if s is no more transmissible than the disease as a whole. If Ss < 0, then we would say that s is more transmissible than the typical strain, while the opposite is true if Ss > 0.

should be 0, where the sum is over all sequences between the first and last appearance of strain s, and m is the number of sequences that satisfy this constraint. When Ss = 0, s is no stronger or weaker than the infection as a whole. If Ss < 0, then s is stronger than strains of EVD generally, while Ss > 0 implies the opposite (see Fig. 8). To determine the statistical significance of Ss, we bootstrap values for which Ss = 0 (see Methods). We find that Ss is significantly different than chance, (Fig. 9), therefore, Ebola strains might not be uniformly transmissible.For example, SL1 has one of the most negative values of Ss (Fig. 9), where all values are statistically significant (p < 0.05, n varies with Δt). Interestingly, we also find the values of SL1 appear to fluctuate, possibly because we only have 9 SL1 datapoints, versus 37, 19, 13, and 36 datapoints for GN1, GN2, GN3, and GN4, respectively. Most other strains have a success metric indicating a stronger strain than expected by chance probably because few strains are concurrent in time, and therefore, comparing Ss across strains is difficult. Our method may be compared to the method used by Meyer, Elias, and Hohle28, who compared the success of invasive meningococcal disease (IMD) strains. Common surveillance algorithms were found to be practical but these appear to be more useful for a chronic rather than an acute outbreak, such as EVD.

Figure 9
figure 9

The success metric for strains in Guinea for (a) SL1, (b) GN1, (c) GN2, (d) GN3, (e) GN4, across various time window widths and bandwidths, where red values correspond to strains seen less often, and blue more often, than expected between the time the strain first appeared and last was seen. Sequence data comes from ref. 21.

Discussion

In conclusion, we find several factors not often accounted for that may improve the accuracy of modeling EVD. First, EVD appears to spread with a constant effective velocity through a migration network, in disagreement with the homogeneous mixing hypothesis (Figs 1 and 2, and Supplementary Fig. S1) commonly used to model diseases like Ebola. By taking into account the role a migration network has in disease spread, we can predict where EVD will arrive with greater accuracy than before. This method can also accelerate the process of identifying the index case by determining which administrative division is the origin through arrival time-effective distance correlation maximization. Second, we find that the growth of EVD at the finer spatial resolutions can be well described by three scaling parameters, and the initial growth rate decreases with the population density, contrary to our intuition, which suggests that a population density-dependent EVD model may more accurately predict the spread of Ebola when the disease first arrives at an administrative division. One plausible explanation for this result is that higher population density areas receive better healthcare than other areas, but more work is necessary to understand this behavior. Finally, we find a wide variation in the transmissibility of different strains of EVD, which suggests that modeling each disease strain, when this information is known, can improve the prediction task by reducing the heterogeneity of the data. In addition, our method may improve vaccination strategies if vaccines are made for particularly transmissible strains as well as the most common ones.

One way to take these factors into account would be through a meta-population model on top of a migration network with high spatial resolution. A meta-population model treats areas such as cities, districts, or countries as nodes on a network, with links connecting them to represent the flow of individuals from one area to another. Diseases within each area (node) are modeled with a compartmental model, under the assumption that the homogeneous mixing approximation is more accurate in smaller areas than for the entire network. Previous work has already found that a meta-population model8, or spatio-temporal model2, can accurately predict the spread of diseases. Finally, strain-dependent transmissibility may further improve model accuracy.

Our approach towards testing assumptions in disease modeling is not restricted to EVD, but can be applied toward other diseases of epidemiological concern. Future work is therefore necessary to test our methods on other diseases and check whether a meta-population model will better predict disease spread.

Methods

This section explains how data on the cumulative number of infected individuals at the first and second administrative level (e.g., counties or districts) was gathered, how the migration network was constructed, and how we found and used strain data in Fig. 9.

Infection Data from Humanitarian Data Exchange and World Health Organization

For the 2014–2016 EVD epidemic, we are aware of two main data sources on the cumulative number of infections: World Health Organization (WHO) patient database and the WHO weekly situation reports1. The patient database data produces results similar to the Situation Reports, but for consistency, all plots in this paper use the patient database. We focused on data from December 2013 to January 2016 for the major West African countries affected: Guinea, Liberia, Mali, Nigeria, Senegal, and Sierra Leone.

There was a significant amount of work parsing data from the patient database. Administration names in the data had multiple spellings, some administrative areas appeared individually but also aggregated with nearby areas, and finally spaces, accents, and other characters appeared inconsistently. These were cleaned and harmonized. Although in the most affected countries, we have the cumulative number of cases at the second administrative level, in three countries (Liberia, Mali, and Nigeria) we only have data at the first administrative level (region, not district).

Migration Data from Flowminder

Data on intra- and international migration in West Africa is taken from Flowminder13. For modeling migration at fine spatial resolutions, the Flowminder data contain three different data sets: (1) within countries (capturing exclusively intranational movement of people); (2) between countries (capturing exclusively international movement of people); and (3) within and between countries, capturing both intra- and international movement of people. All three data sets include the West African countries most affected by EVD as well as Benin, Cote d’Ivoire, Gambia, Ghana, Guinea Bissau, Senegal, and Togo, which had few, if any, EVD cases. In the third dataset, Flowminder collected census microdata from Public Use Microdata Series (IPUMS) on what country (or countries) an individual resided during the previous year.

To create a migration network, we first matched the Flowminder node coordinates to known district centroids (errors between centroids and node coordinates were ±10 km). Having matched nodes to administrative names, we associated each node to the district-level arrival time of EVD, recording the date that the WHO patient database first records for a case in each administrative area. Four gravity model parameters were used to estimate the traffic between administration areas. Three were fit to migration using cell phone data in Cote d’Ivoire, Kenya, and Senegal, respectively, while the final one was fit to IPUMS data. We found that all produce similar fits, and work equally well to estimate the effective distances between areas. In addition, using population data from Geohive (next section), we created a radiation migration model, found to more accurately estimate migration patterns than gravity models29, we therefore used this for all figures that use migration networks in this paper. Figures using gravity models can be seen in Supplementary Figs S1 and S2.

Population data from GeoHive

To determine the population density, and to estimate the migration network from the radiation migration model29, we first find the population and area of each administrative division. First, we collected the area administrative divisions in West Africa from www.geohive.com. Next, we collected population in those districts from population census records. For districts providing multiple census datasets, we collected from the latest report: Guinea, 2014; Liberia, 2008; Mali, 2009; Nigeria 2011; Senegal 2013; and Sierra Leone, 2004. Some population data is probably out-of-date and may lead to some biases in the population density and radiation model. However, we believe that newer data will confirm our initial conclusions.

Fitting Disease Models

To find the best-fit parameters and associated errors in the logistic model (Eq. 1), and the SDIR model (Eqs 24), we used least squares fitting. To reduce the possibility of overfitting data, we focus on districts where more than 20 individuals become infected.

Temporal-Spatial Resolution of Sequences

To find empirical values of Eqs 6 and 8, we gathered infection meta-data (the strain, time, location of infected individual) from recent papers21,22,23,24. In the future we hope to make our own phylogenetic tree from the sequences, but for now we use the strain labels from the supplementary data itself.

A substantial fraction of sequences do not belong in any significant clade, and some sequences could belong to multiple clades, depending on the phylogenetic tree method used22,23,24, therefore, we found Qs and Ss for each strain by comparing that strain to all other sequences within the time window.

To determine the statistical significance of values in Fig. 9, we generate Bernoulli random variables (1 with probability , and 0 with probability ) with

where is the infection location at a time ti, to represent idealized data in which 〈Ss〉 = 0. We determine Ss,bootstrap (Eq. 10) from these idealized values of Qs. If the absolute value of the empirical Ss value, |Ss,empirical|, is greater than 95% of |Ss,bootstrap| values, then the empirical data is statistically significant.

Additional Information

How to cite this article: Burghardt, K. et al. Testing Modeling Assumptions in the West Africa Ebola Outbreak. Sci. Rep. 6, 34598; doi: 10.1038/srep34598 (2016).