Abstract
The immune system is inordinately complex with many interacting components determining overall outcomes. Mathematical and computational modelling provides a useful way in which the various contributions of different immunological components can be probed in an integrated manner. Here, we provide an introductory overview and review of mechanistic simulation models. We start out by briefly defining these types of models and contrasting them to other model types that are relevant to the field of immunology. We follow with a few specific examples and then review the different ways one can use such models to answer immunological questions. While our examples focus on immune responses to infection, the overall ideas and descriptions of model uses can be applied to any area of immunology.
Similar content being viewed by others
Introduction
The reductionist approach to science will continue to play an important role in scientific inquiry and progress. However, there is increasing interest across disciplines in studying the multiple interacting components of a given system simultaneously. This stems from the realization that it is often the complex interactions among these components that determine the ultimate outcome. While complexity in immunology is readily acknowledged, in many cases the ability to measure the contribution of each component is challenging. Even where this can be achieved, it can be difficult to interpret the results by looking at individual components independently. Mathematical and computational modelling can provide valuable information on the relative importance of different immunological components, how they are influenced by other components and how these relationships may vary across conditions. Models can provide informed hypotheses for experimental testing, generate a comprehensive map of the integrated performance of the immune system and identify potential targets for clinical manipulation of the immune response.
In this Review, we provide an introduction and overview of one category of models: those based on mechanistic simulations of an underlying system of interest. Our primary goal is to familiarize immunologists with, and increase interest in, these kinds of models, and to provide enough information for readers to understand the strengths, weaknesses and uses of such models. For those interested in pursuing modelling further, we also provide some pointers for getting started with developing and using simulation models.
Types of models
Models are everywhere in science. Models can be conceptual, including verbal models, graphs or charts; can be experimental, such as a specific cell culture system or mouse strain; or may take the form of quantitative mathematical or computer models. Here we exclusively focus on the latter type of models.
The most common types of quantitative models are what we term phenomenological models (we avoid the oftenapplied term ‘statistical’ because the contrasting mechanistic models we focus on here can also be used in a statistical manner). Phenomenological models are applied to extract patterns or, more broadly, information from data. As such, whenever data are being analysed in some mathematical manner, this type of model is in play. Computing a correlation coefficient between two quantities of interest is an example of a very simple model that tries to detect a pattern. Regression models, in which a mathematical function is specified and the distance between the data and the function is minimized, also fall into this category^{1}. In recent years, the increase of available data has led to greater use of more complex phenomenological models, which increasingly go by names such as machine learning or deep learning approaches^{2,3}. These models do not explicitly describe the mechanisms by which patterns arise, and this is both a strength and a weakness. On the plus side, one can determine correlations, find patterns, deduce potential causation and make predictions without having to understand the underlying mechanisms governing a given system. The drawback is that such models provide, at best, hints regarding potential mechanisms. Especially for complex systems, one can often find correlations or patterns in the data without knowing whether these are indicative of mechanistic or causal connections (for some illuminating and entertaining examples, such as the strong correlation between divorces in Maine and the consumption of margarine, see ref.^{4}).
To study mechanisms and processes, mechanistic models are ideal. One prominent type of such models uses simplified in silico representations of the processes underlying a system of interest to perform computer simulations. Other terms used for such models are systems models, dynamical models or simply mathematical models. In particular, the terms systems thinking and systems modelling have become popular in various fields during the past few decades^{5,6}. These are not clearly defined terms, but in general, a systems perspective looks at multiple — often numerous — components that interact with each other in potentially complicated ways. Somewhat confusingly, the terms systems immunology and systems biology are also used to describe the analysis of complex data sets, such as highdimensional omics data using phenomenological models.
Mechanistic simulation models explicitly specify processes describing the mechanisms of interaction between system components. Usually, these models are highly simplified — but done well, still very powerful — abstractions of the system under study. Engineering and the hard sciences provide some of the best examples for this approach. For instance, equations describing electric circuits can be simulated to study and predict the behaviour of an actual electronic component. The advantage of this kind of model is that they can provide mechanistic insights, leading to a better and deeper understanding of the system, to a point where the model might allow for very precise predictions. The main disadvantage of this approach is that model construction requires considerable knowledge (or at least assumptions) about the system and how its components interact.
Both phenomenological and mechanistic models are useful tools with distinct advantages and disadvantages. Deciding which type of model to use depends on the question and study system. It is common to start with phenomenological models, to determine patterns and obtain clues regarding the underlying processes and mechanisms, and then to move to a mechanistic model to analyse those processes, their interactions and the resulting outcomes in more detail. In this Review, we will focus on mechanistic simulation models. For the purposes of this article, we will simply use the term ‘model’ to mean a model that describes the dynamics of the components of a system in an explicit and mechanistic way through mathematical equations or computational algorithms. Those models are generally studied by simulating them on a computer. There are different ways that such models can be implemented. The most common types used in immunology are compartmental models, in which each compartment tracks the size of a given biological entity of interest — for example, pathogen load or cytokine concentrations. The most common way to implement a compartmental model is with ordinary differential equations. We will therefore focus on those. Box 1 introduces compartmental models, while Box 2 briefly describes alternative modelling approaches.
Uses for models
There are different ways one can categorize the uses of mechanistic simulation models. Figure 1 shows one way of conceptualizing different model uses, namely for exploration (also called hypothesis generation), fitting (also called statistical inference) and prediction (also called forecasting). Often, a single project might involve more than one use of a model. We describe these different model uses below and then explain briefly how they are often used iteratively. To make things more tangible, we first introduce and describe two very simple models, one for viral (and other intracellular) infections, and one for extracellular bacterial infections. We then use these example models to illustrate different modelling tasks. We keep the two models purposefully very simple and generic; thus, they should not be considered as representing a detailed model for a specific pathogen (though, as we point out, models as simple as these have been successfully used to answer scientific questions of interest).
A simple model for viral infections
For the viral infection model, we track the numbers of infected and uninfected cells and the levels of free virus. Other details, such as any aspects of the immune response, are ignored in this simple construction. Figure 2a shows a graphic representation of such a model. The model shown in Fig. 2a can be translated into equations and computer code in several different ways. The most commonly used implementation is through a set of ordinary differential equations (ODEs). The equations for this model are shown in Fig. 2b. Once the model has been implemented on a computer and the values for the model parameters and variable starting conditions are specified, we can simulate the system. Figure 2c shows examples of different dynamics that can be obtained using this model. Despite its simplicity, this type of model has been successfully applied to the study of chronic infections, such as HIV and hepatitis C virus (HCV)^{7,8}, and acute infections, such as influenza virus^{9,10,11,12,13}. We discuss a few of these studies in some detail below.
Model for extracellular bacterial infections
For the bacterial infection model, we track bacteria and the immune response. The latter is implemented in an abstract manner; you can consider it to represent the total immune response or a specific component of importance for a given system. The model is a type of predator–prey model in which the bacteria are the prey and the immune response is the predator. Such models have been widely used in ecology^{14}. Figure 3a shows a graphic representation of such a model, and Fig. 3b shows the set of ODEs corresponding to this model. Figure 3c shows two model simulations using different parameter values. The steep oscillations seen in bacterial load and immune response for the first scenario are biologically unrealistic, as is the fact that the number of bacteria drops below 1 (a feature of ODE models that is important to note and potentially to address; see Box 2). The second scenario, with different parameter values, is more likely to capture the basic dynamics for a real infection process. It is sometimes possible that a model does not produce outcomes that are consistent with the data for any choice of biologically reasonable model parameter values and starting conditions. This means that you have not yet captured all the important mechanisms and processes governing the system under study, and thus the model needs further refinement. We discuss this further below. Models like this have been applied to study of the dynamics of Mycobacterium tuberculosis^{15} and malaria^{16} infections, the interactions between cancers and the immune response^{17}, and the impact of drugs on Staphylococcus aureus infections^{18}. We discuss a few of these studies in more detail below.
Using models for exploration
If one knows enough about a system to postulate specific processes and mechanisms but does not have a good understanding of how the interactions between different processes affect the overall outcomes, building and analysing a model can be a useful approach. Using models in this way provides a good way to gain some intuition of how a system functions and to generate new hypotheses. It is advisable to keep models simple initially and to increase model complexity as your understanding of the system increases.
As an example of this approach, we consider the extracellular bacterial infection model introduced above and explore how a change in the rate at which the immune response increases in response to bacterial load (parameter r of the model) influences the peak bacterial burden (maximum of variable B). To do so, we implement the model on a computer and then simulate it for different values of r, with all other parameters and initial conditions kept fixed. For each simulation, we obtain a time series for bacteria and immune response like the one shown in Fig. 3c. From this time series, we record the peak bacterial load for each value of r. The results are shown in Fig. 4a.
Such an analysis allows you to explore how different components of the system interact to influence the outcomes. Because this is such a simple model, you might have expected a decrease in peak bacterial load as immune activation increases, even without performing the simulations. However, it might have been difficult to predict the shape and magnitude of the relation. Even basic intuitions can be harder to form as the systems under study, and the models representing them, become more complex.
Using models to fit data
Although models should be built on the basis of the best biological information available, once a model is built and parameter values are determined, it can be analysed without the need for data. To assess the quality of the model, one needs to compare its results with known biological data. This can initially happen qualitatively, which is a common approach during the exploratory stage.
Going beyond qualitative comparisons requires fitting models to data, and thus performing rigorous statistical inference. All the statistical machinery available for phenomenological models can be used to fit mechanistic models. The difference between fitting phenomenological and mechanistic models to data is that the latter allow for more direct testing and possibly for the rejection of specific postulated mechanisms. This provides a potentially deeper understanding of the system than would be possible with phenomenological models alone.
To demonstrate fitting, we consider viral load data from groups of individuals infected with influenza who receive neuraminidase inhibitors early, late or never (symbols in Fig. 4b, for which data were extracted from ref.^{19}). Assume that you want to investigate potential mechanisms of drug action and postulate the following two hypothetical mechanisms: one, the drug prevents virus entry and new infection of cells; two, the drug reduces the rate at which infected cells produce new virions. To investigate these two mechanisms, you can build two alternative models by incorporating two parameters into the model described above for viral replication. Those parameters, e_{1} and e_{2}, correspond to the drug’s mechanism of action, represented by hypotheses 1 and 2, respectively (see the Fig. 4b caption for details).
Instead of fixing the model parameter values — as is done during model exploration — (some of) the parameters are allowed to vary and are determined by the fitting routine. By fitting a model with parameter e_{1} present and another with parameter e_{2} present, you can test which mechanism (as implemented in your model) describes the data better. Of course, it could be that the data are best described with both mechanisms e_{1} and e_{2} acting, as they are not mutually exclusive, or that even with both mechanisms present, the model fails to properly describe the data. For simplicity, we do not test those model variants here.
Figure 4b shows the best fit of the model for either mechanism 1 or 2. The two versions of the model are fit to each virus load time series, with either e_{1} or e_{2} turned on at the indicated times (29 hours postinfection for early treatment, 50 hours postinfection for late treatment). The figure shows that models with either mechanism present come reasonably close to the data. You can discriminate between the model fits with different statistical approaches. A frequently used measure is Akaike’s information criterion (AIC), which tries to quantify the quality of a model fit, with lower values indicating a betterfitting model among a candidate set of models fit to data^{20}. Computing the AICs corrected (AICc) for small sample size for the two models gives AICc_{1} = −56 and AICc_{2} = −82. Thus, on the basis of AIC, the model fitting suggests that mechanism e_{2} — that is, druginduced reduction of virus production by infected cells — fits the data better. It is important to note that when doing model comparisons, the (statistically) ‘best’ model is not necessarily a ‘good’ model. Determination of the overall quality of the model cannot be done purely on statistical grounds, but requires a scientific, not a purely statistical, judgement call to decide whether a model can be considered a reasonable approximation of the underlying system.
In addition to discriminating between different models, and thus mechanisms, fitting provides estimates for the model parameters. In contrast to most parameters in phenomenological models (for example, regression coefficients), the parameters in mechanistic models often have direct biological meaning. Here, you find that for the more likely mechanism (mechanism 2), the value measuring the strength of the drug is e_{2} = 0.98, suggesting that the drug is highly effective and reduces virus production by 98%. Of course, an important caveat for the interpretation of the estimated parameters is that the model needs to provide a reasonable approximation of the real system.
Despite rapid improvements in the capability and userfriendliness of software, fitting mechanistic models to data can still be technically challenging. It also requires a good match between available data, the model and the scientific question. On the plus side, a fitting approach allows for direct testing of different hypotheses, formulated as different model mechanisms or model variants, and provides estimates for potentially important biological quantities.
Using models to make predictions
Through some combination of the model use approaches just described, you might be able to understand a system well enough that you can build a model that provides a fairly accurate approximation of the real system. You can then use the model to perform in silico experiments: you can make predictions about what might happen to the system if some components were altered, such as through the introduction of a drug. Using models for prediction or forecasting follows essentially the same approach as exploratory model use. The difference is that predictive modelling requires confidence that the model can decently approximate the real system.
Assume that the simple bacteria model accurately captures the dynamics of some real system of interest. In that case, the result shown in Fig. 4a could be interpreted as making predictions of how a change in immune activation rate (possibly mediated by some drug) influences the peak bacterial burden.
Often, if models are used for predictions, it is useful to provide estimates of uncertainty in the predictions. A common approach for obtaining such estimates is through an uncertainty and sensitivity analysis^{21,22}. For ODE models like the ones described here, such an analysis involves varying the model parameters in ranges that are considered biologically reasonable. For each set of model parameters, you run the model and compute the quantities of interest. This provides a set of model predictions, one for each set of model parameters. This distribution of model results provides some measure of uncertainty in the model predictions, due to uncertainty in the underlying model parameters.
Compared to real experiments, these in silico approaches are much faster and cheaper, and generally they have no ethical implications. The major caveat with predictions obtained from such models is that they are only reliable insofar as the model properly captures the important features of the real system. Thus, an iterative process is usually employed, of model predictions, comparisons to data and further exploration and refinement of the models. This can lead to increasingly better and more predictive models. Weather forecasting is a domain where this approach has proven to be very successful.
Model use in practice
Although it is possible to use a model in only one of the ways just described, iterative use as illustrated in Fig. 1 is common. Typically, one or several simple models are initially built to explore the dynamics of the system of interest and are qualitatively compared to what is known about the biological system. If no suitable data for fitting are available, the model can be used to generate hypotheses and make predictions, which then should be tested by comparing to data, either qualitatively or through statistically rigorous fitting. If suitable data are available, the exploration stage is often followed by fitting the most promising candidate model(s) to the data to obtain statistical support for specific models, as well as estimates for the model parameters. These statistically supported models can then be used to make predictions about asyetunobserved behaviour of the system (for example, simulating the removal of a cytokine in the model). Predictions should then be tested with further data, likely leading to further model refinements.
A few realworld examples
Mechanistic simulation models of the type we just described are increasingly used in immunological and infectious disease research. The literature is too vast to fully review it. We therefore provide a review and brief summary of a few prominent examples and pointers towards further discussions of such models.
Nowak and colleagues used a simple model similar to the viral infection model described above to gain general insights into HIV infection dynamics^{23}. A finding from their analysis was the suggestion that viral sequence diversity is positively correlated with virus load. In another study, model fitting was used to allow the authors to estimate the rates and total amount of HIV virus production, as well as CD4^{+} T cell numbers and virus halflives^{24}. These findings helped confirm the futility of singledrug treatment. Another study considered the impact of interferon (IFN) for HCVinfected patients; by fitting a simple model, the researchers determined that IFN’s main mode of action is to block virion production^{25}. That study also provided quantitative estimates for the efficacy of IFN treatment as well as virus halflife. For more examples and further details on such models applied to HIV and HCV, see, for example, refs^{7,8}.
The same types of viral infection models have been used to study influenza. In ref.^{26} the authors used a combination of models and data to show that the fitness of neuraminidaseresistant H1N1 2009 pandemic influenza strains was similar to that of drugsusceptible virus strains. Such models helped shed light on the dynamics of coinfection with influenza virus and Streptococcus pneumoniae. Analysis of a coinfection model suggested that around four to six days after influenza virus infection, secondary bacterial infection can occur at a much lower exposure dose^{27}. Another study^{28} discriminated between different mechanisms of pathogen interaction by fitting a model to data and found that increased virus release was likely in the presence of bacteria. Further examples and details of influenza models can be found in refs^{9,10,11,12,13}.
Models like the bacteria model discussed above have been used to study malaria and tuberculosis infections. In one such study^{29}, the authors used a simple discretetime model, fitted to data, to elucidate the relative roles of targetcell limitation versus immune responses during malaria infections. A fourequation differential equation model^{30} allowed the prediction of how changes in asexual parasite densities influence gametocyte conversion rates. In a study of tuberculosis^{31}, the authors used a detailed model to explore and predict the impact of depleting key cytokines on the infection dynamics. They found, for instance, that depletion of IL10 and IL4 during latency led to a large increase in bacterial density. Further examples of simulation models applied to malaria and tuberculosis can be found in refs^{32,33}.
Models are also often used to study the effects of antimicrobial drugs. This approach is generally referred to as pharmacokinetic–pharmacodynamic (PK–PD) modelling^{34}. While most PK–PD models include equations for the processes describing the pathogen and the drug dynamics, only a few also model components of the immune response. In an example of a model that includes PK–PD and the immune response^{35}, use of a model suggested that highdose, extended treatment with antibiotics is often the best strategy for reducing resistance emergence. For additional examples of models that include components of the immune response, see refs^{36,37,38}.
Another area in which such models have been used is in probing the dynamics of T cells. As an example, stochastic simulation models were used in ref.^{39} to determine that random differentiation and division events drive CD8^{+} T cell diversification. Application of another model helped characterize divergent subpopulations of CD4^{+} effector and central memory T cells^{40}. refs^{41,42} provide further examples.
These types of models have also been successfully applied to the study of noninfectious systems. A compartmental simulation model applied to chronic myeloid leukaemia showed that the drug imatinib inhibits the production of new leukaemic cells but does not deplete existing cells^{43}. In ref.^{44}, the authors combined models and data to determine the existence of distinct subpopulations of haematopoietic stem cells with different turnover rates.
These examples are just a few among many. For further examples of such models applied to specific systems or questions, see, for example, the recent collections of articles introduced in refs^{45,46}.
How to apply models
Reading thus far might have persuaded you that the kinds of models we describe could be useful for your research. Here are some suggestions for the next steps.
Form a team
We described what simulation models can and cannot do. If you have a question that lends itself to this kind of modelling, arguably the best option is to team up with a modelling expert. The number of scientists using mechanistic simulation modelling approaches has been increasing considerably over the past decades. These individuals are distinct from biostatisticians and bioinformaticians, although there is often considerable overlap. Modellers are often ready to apply their skills and tools to interesting immunological questions. To make this team approach successful, each collaborator needs to understand enough about the other person’s domain to engage in a meaningful manner. Thus, modellers need to understand enough biology and immunology to build reasonable models, and immunologists need to understand enough about the models to know the models’ strengths and limitations and to assess their usefulness for a given situation. We hope this article helps with the latter aspect.
Build your own model
Some readers might want to try building and analysing models themselves. Before doing so, consider whether a mechanistic model is the right tool to address your question. At times, a question may best be addressed by experiments and collecting more data. At other times, a phenomenological model might be the right approach. If a simulation model is suitable for your question, determine what type of mechanistic model you need. Compartmental models implemented as ODEs (the models we have focused on in this review) are often a good first choice. However, for certain questions and scenarios, those model types are not suitable, and you might need a different type of model. See Box 2 for a brief discussion.
Next, you need to decide how much detail to include. We recommend starting simple and increasing complexity as needed (Box 3). As you build your model, be clear about the assumptions you make, and ensure that your assumptions can be justified on the basis of what is known about the biology of the system. If several potential processes may be reasonably assumed, it might be suitable to explore multiple models, each encoding one or some of the biologically reasonable mechanisms (see, for instance, the two drug mechanism models described above).
A few specific pointers regarding practical steps towards implementing the models are given in Box 4. Once you have one or several starter models built, you can explore their behaviour, use them to generate hypotheses and predictions, or fit them to available data for hypothesis testing. During this process, you will likely further refine and improve your model.
While coding is generally required, there are ways to build models that do not require writing computer code. Some software, such as Berkeley Madonna, Stella or more specialized tools^{47}, allows you to graphically build and run models. However, be prepared for the likelihood that at some point you will need to engage in some level of code writing. Before you embark on learning a specific programming language, it is worth considering which one to learn and use. Currently, two of the most popular generalpurpose languages for scientific computing are R and Python. Both languages are free and highly flexible, and both have large user and developer communities. Commercial products such as MATLAB or Mathematica are also frequently used.
One of the authors has developed a free software package called Dynamical Systems Approaches to Immune Response Modelling (DSAIRM)^{48}. DSAIRM is implemented as an R package. The main goal of DSAIRM is to provide a userfriendly tool to learn about modelling in immunology, without the need to write code. It also provides access to the code for all the models implemented in DSAIRM, which you can then modify for your specific research question. Further details can be found on the package website^{48} and in ref.^{49}.
Next steps
To learn more, several books^{8,50,51,52} and review articles^{7,41,46} provide further details on mechanistic simulation modelling. Beyond additional reading, a great way to learn the material is by actively engaging with it. The abovementioned DSAIRM R package is meant for that purpose. It is quick and easy to install, and you can use it to explore and learn a range of models and concepts related to infection and immunology modelling using a graphical interface.
Conclusion
The type of mechanistic modelling discussed here is used increasingly in biology, and specifically in immunology, microbiology and related areas. The adoption and progress of modelling have been rapid, driven by data of higher quantity and quality, better and easiertouse computational tools, and a general drive in immunology towards becoming an increasingly rigorous, quantitative discipline. Together with other quantitative analysis approaches, mechanistic simulation models provide a useful set of tools that allow one to investigate mechanisms of interaction and the resulting dynamics for a specific system.
References
Jaqaman, K. & Danuser, G. Linking data to models: data regression. Nat. Rev. Mol. Cell Biol. 7, 813–819 (2006).
Altmann, D. M. New tools for MHC research from machine learning and predictive algorithms to the tumour immunopeptidome. Immunology 154, 329–330 (2018).
Ching, T. et al. Opportunities and obstacles for deep learning in biology and medicine. J. R. Soc. Interface 15, 20170387 (2018).
Vigen, T. Spurious correlations. tylervigen http://tylervigen.com/spuriouscorrelations (2019).
Narang, V. et al. Systems immunology: a survey of modeling formalisms, applications and simulation tools. Immunol. Res. 53, 251–265 (2012).
Arazi, A., Pendergraft, W. F., Ribeiro, R. M., Perelson, A. S. & Hacohen, N. Human systems immunology: hypothesisbased modeling and unbiased datadriven approaches. Semin. Immunol. 25, 193–200 (2013).
Perelson, A. S. Modelling viral and immune system dynamics. Nat. Rev. Immunol. 2, 28–36 (2002).
Nowak, M. A. & May, R. M. Virus Dynamics: Mathematical Principles of Immunology and Virology (Oxford Univ. Press, 2001).
Beauchemin, C. A. A. & Handel, A. A review of mathematical models of influenza a infections within a host or cell culture: lessons learned and challenges ahead. BMC Public Health 11 (Suppl. 1), S7 (2011).
Smith, A. M. & Perelson, A. S. Influenza a virus infection kinetics: quantitative data and models. Wiley Interdiscip. Rev. Syst. Biol. Med. 3, 429–445 (2011).
Murillo, L. N., Murillo, M. S. & Perelson, A. S. Towards multiscale modeling of influenza infection. J. Theor. Biol. 332, 267–290 (2013).
Smith, A. M. Host–pathogen kinetics during influenza infection and coinfection: insights from predictive modeling. Immunol. Rev. 285, 97–112 (2018).
Handel, A., Liao, L. E. & Beauchemin, C. A. A. Progress and trends in mathematical modelling of influenza A virus infections. Curr. Opin. Syst. Biol. 12, 30–36 (2018).
Otto, S. P. & Day, T. A Biologist’s Guide to Mathematical Modeling in Ecology and Evolution (Princeton Univ. Press, 2007).
Antia, R., Koella, J. C. & Perrot, V. Models of the withinhost dynamics of persistent mycobacterial infections. Proc. Biol. Sci. 263, 257–63 (1996).
Kochin, B. F., Yates, A. J., Roode, J. C. de & Antia, R. On the control of acute rodent malaria infections by innate immunity. PLOS ONE 5, e10444 (2010).
Wilkie, K. P. A review of mathematical models of cancer–immune interactions in the context of tumor dormancy. Adv. Exp. Med. Biol. 734, 201–234 (2013).
Chung, P., McNamara, P. J., Campion, J. J. & Evans, M. E. Mechanismbased pharmacodynamic models of fluoroquinolone resistance in Staphylococcus aureus. Antimicrob. Agents Chemother. 50, 2957–2965 (2006).
Hayden, F. G. et al. Safety and efficacy of the neuraminidase inhibitor GG167 in experimental human influenza. JAMA 275, 295–299 (1996).
Burnham, K. P. & Anderson, D. R. Model Selection and Multimodel Inference (Springer, 2002).
Marino, S., Hogue, I. B., Ray, C. J. & Kirschner, D. E. A methodology for performing global uncertainty and sensitivity analysis in systems biology. J. Theor. Biol. 254, 178–196 (2008).
Hoare, A., Regan, D. G. & Wilson, D. P. Sampling and sensitivity analyses tools (SaSAT) for computational modelling. Theor. Biol. Med. Model. 5, 4 (2008).
Nowak, M. A. & Bangham, C. R. Population dynamics of immune responses to persistent viruses. Science 272, 74–79 (1996).
Perelson, A. S., Neumann, A. U., Markowitz, M., Leonard, J. M. & Ho, D. D. HIV1 dynamics in vivo: virion clearance rate, infected cell lifespan, and viral generation time. Science 271, 1582–1586 (1996).
Neumann, A. U. et al. Hepatitis C viral dynamics in vivo and the antiviral efficacy of interferonalpha therapy. Science 282, 103–107 (1998).
Butler, J. et al. Estimating the fitness advantage conferred by permissive neuraminidase mutations in recent oseltamivirresistant a(H1N1)pdm09 influenza viruses. PLOS Pathog. 10, e1004065 (2014).
Shrestha, S. et al. Time and dosedependent risk of pneumococcal pneumonia following influenza: a model for withinhost interaction between influenza and Streptococcus pneumoniae. J. R. Soc. Interface 10, 20130233 (2013).
Smith, A. M. et al. Kinetics of coinfection with influenza a virus and Streptococcus pneumoniae. PLOS Pathog. 9, e1003238 (2013).
Metcalf, C. J. E. et al. Partitioning regulatory mechanisms of withinhost malaria dynamics using the effective propagation number. Science 333, 984–988 (2011).
Schneider, P. et al. Adaptive plasticity in the gametocyte conversion rate of malaria parasites. PLOS Pathog. 14, e1007371 (2018).
Wigginton, J. E. & Kirschner, D. A model to predict cellmediated immune regulatory mechanisms during human infection with mycobacterium tuberculosis. J. Immunol. 166, 1951–1967 (2001).
Mideo, N., Day, T. & Read, A. F. Modelling malaria pathogenesis. Cell Microbiol. 10, 1947–1955 (2008).
Kirschner, D., Pienaar, E., Marino, S. & Linderman, J. J. A review of computational and mathematical modeling contributions to our understanding of mycobacterium tuberculosis withinhost infection and treatment. Curr. Opin. Syst. Biol. 3, 170–185 (2017).
Drusano, G. L. Antimicrobial pharmacodynamics: critical interactions of ‘bug and drug’. Nat. Rev. Microbiol. 2, 289–300 (2004).
Ankomah, P. & Levin, B. R. Exploring the collaboration between antibiotics and the immune response in the treatment of acute, selflimiting infections. Proc. Natl Acad. Sci. USA 111, 8331–8338 (2014).
Canini, L., Conway, J. M., Perelson, A. S. & Carrat, F. Impact of different oseltamivir regimens on treating influenza a virus infection and resistance emergence: insights from a modelling study. PLOS Comput. Biol. 10, e1003568 (2014).
Handel, A., Margolis, E. & Levin, B. R. Exploring the role of the immune response in preventing antibiotic resistance. J. Theor. Biol. 256, 655–662 (2009).
Gjini, E. & Brito, P. H. Integrating antimicrobial therapy with host immunity to fight drugresistant infections: classical vs. adaptive treatment. PLOS Comput. Biol. 12, e1004857 (2016).
Buchholz, V. R. et al. Disparate individual fates compose robust CD8^{+} T cell immunity. Science 340, 630–635 (2013).
Gossel, G., Hogan, T., Cownden, D., Seddon, B. & Yates, A. J. Memory CD4 T cell subsets are kinetically heterogeneous and replenished from naive T cells at high levels. eLife 6, e23013 (2017).
Antia, R., Ganusov, V. V. & Ahmed, R. The role of models in understanding CD8^{+} Tcell memory. Nat. Rev. Immunol. 5, 101–111 (2005).
Gerritsen, B. & Pandit, A. The memory of a killer T cell: models of CD8^{+} T cell differentiation. Immunol. Cell Biol. 94, 236–241 (2016).
Michor, F. et al. Dynamics of chronic myeloid leukaemia. Nature 435, 1267–1270 (2005).
Takizawa, H., Regoes, R. R., Boddupalli, C. S., Bonhoeffer, S. & Manz, M. G. Dynamic variation in cycling of hematopoietic stem cells in steady state and inflammation. J. Exp. Med. 208, 273–284 (2011).
Kirschner, D. & Mehr, R. Editorial overview. Curr. Opin. Syst. Biol. 12, iv–vi (2018).
Perelson, A. S. & Ribeiro, R. M. Introduction to modeling viral infections and immunity. Immunol. Rev. 285, 5–8 (2018).
Germain, R. N., MeierSchellersheim, M., NitaLazar, A. & Fraser, I. D. C. Systems biology in immunology: a computational modeling perspective. Annu. Rev. Immunol. 29, 527–585 (2011).
Handel, A. et al. Software DSAIRM: dynamical systems approach to immune response modeling. GitHub https://ahgroup.github.io/DSAIRM/ (2019).
Handel, A. A software tool to teach mechanistic modeling to immunologists. BMC Immunol. https://doi.org/10.1186/s1286501903210 (2019).
Wodarz, D. Killer Cell Dynamics Mathematical and Computational Approaches to Immunology (Springer, 2007).
BassaganyaRiera, J. Computational Immunology: Models and Tools (Academic Press, 2015).
HernandezVargas, E. A. Modeling and Control of Infectious Diseases in the Host (Academic Press, 2019).
King, A. A. et al. POMP: statistical inference for partially observed Markov processes. R package, version 2.3. (2019).
Handel, A., Yates, A., Pilyugin, S. S. & Antia, R. Sharing the burden: antigen transport and firebreaks in immune responses. J. R. Soc. Interface 6, 447–454 (2009).
Acknowledgements
We thank A. Souquette and R. Mettelman for comments on an early draft. We also thank the reviewers for their useful feedback. A.H. and P.T. were partially supported by NIH U19AI117891. N.L.L.G. was supported by a National Health and Medical Research Council Program grant (APP1071916) and an Australian Research Council (ARC) Future Fellowship (FT170100174).
Reviewer information
Nature Reviews Immunology thanks R. de Boer and R. Regoes for their contribution to the peer review of this work.
Author information
Authors and Affiliations
Contributions
A.H., N.L.L.G and P.G.T. contributed to the writing, review and editing of the manuscript. A.H. and P.G.T. substantially contributed to the discussion of content. A.H. was involved in researching data for the article.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Glossary
 Phenomenological models

Mathematical and statistical models used to extract patterns and information from data, without trying to specify detailed mechanisms that lead to the observed data.
 Machine learning or deep learning

Data analysis approaches that generally use complex computational models to find patterns in the data, usually with the goal of making predictions.
 Mechanistic models

Models that explicitly include specific mechanisms/processes governing the system of interest (usually in a very simplified way) in order to allow direct investigation of such mechanisms.
 Simulation

Execution of a model on a computer; this often involves tracking changes of the system over time.
 Systems thinking and systems modelling

The concept that for systems with many components interacting in complex ways, studying only a small part of the system does not provide a full understanding of the overall system dynamics, and thus that to fully understand the system, one needs to study it in its entirety, often with the help of models.
 Systems immunology and systems biology

The application of systems thinking and modelling to immunology and biology.
 Compartmental models

A type of model in which one only tracks total numbers for the entities of interest — for example, total number of bacteria and immune response. This contrasts with agent/individualbased models (Box 2).
 Partial differential equations

(PDEs). A type of differential equation that tracks changes with respect to at least two directions; if used in immunology, these directions are generally time and space in one, two or three dimensions.
 Agentbased models

(ABMs). Models in which each entity of interest is tracked and simulated individually, instead of tracking total numbers only.
 In silico experiments

Using models to explore and predict outcomes for scenarios for which there are currently no data — for example, the introduction of a drug into the system described by the model.
Rights and permissions
About this article
Cite this article
Handel, A., La Gruta, N.L. & Thomas, P.G. Simulation modelling for immunologists. Nat Rev Immunol 20, 186–195 (2020). https://doi.org/10.1038/s4157701902353
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s4157701902353