## Abstract

A pressing challenge for ecologists is predicting how human-driven environmental changes will affect the complex pattern of interactions among species in a community. Weighted networks are an important tool for studying changes in interspecific interactions because they record interaction frequencies in addition to presence or absence at a field site. Here we show that changes in weighted network structure following habitat modification are, in principle, predictable. Our approach combines field data with mathematical models: the models separate changes in relative species abundance from changes in interaction preferences (which describe how interaction frequencies deviate from random encounters). The models with the best predictive ability compared to data requirement are those that capture systematic changes in interaction preferences between different habitat types. Our results suggest a viable approach for predicting the consequences of rapid environmental change for the structure of complex ecological networks, even in the absence of detailed, system-specific empirical data.

## Introduction

Anthropogenic land-use intensification reduces habitat complexity, with profound consequences for plant and animal species^{1}. The most immediate effects of habitat simplification are shifts in the frequency and specificity of interactions between consumer and resource species^{2}. These shifts result in changes to weighted network structure^{3, 4} and can have significant practical consequences, as species interactions underpin crucial ecosystem services such as biological control, pollination and seed dispersal^{5,6,7,8}. Field studies have begun to quantify how interaction frequencies differ among habitat types^{9,10,11,12,13}, but exhaustive collection of these data can be laborious and a bottleneck to understanding community responses to environmental changes, especially for species-rich communities containing rare and undocumented species^{11}. Models that could predict interaction frequencies in modified habitats would help alleviate this problem, but several hurdles need to be overcome^{14,15,16}. In particular, some changes to interaction patterns will result simply from changes in random encounter rates when species’ abundances change, whereas others will result from altered foraging behaviour. It would be useful to describe how changes in relative species abundance^{17} vs. changes in species behaviour^{18} contribute to changing network structure. Furthermore, it is important to describe these changes at the level of individual field sites, and not just for aggregated networks built from interaction data collected across multiple field sites. Separating relative species abundance and species behaviour is important because large differences in recorded interaction frequencies can be attributed to random encounter among species even when there are large differences in relative species abundance^{19}, without the need to appeal to more complex ecological processes or mechanisms^{20, 21}. In other cases, assuming only random encounters may be insufficient to fully explain changes in weighted network structure, so by separating out the contribution of relative species abundance it will be easier to identify and investigate the effects of habitat modification on species behaviour. Such clarifications are especially relevant for understanding major structural alterations of a habitat, such as deforestation: in addition to changes in relative species abundance, predator foraging efficiency and strategy are affected by decreases in habitat complexity^{22} and prey switching, in turn, depends on resource availability and accessibility^{23}.

In this study, we test whether we can accurately predict the effects of habitat modification on the structure of weighted host-parasitoid networks^{10,11,12,13} (parasitoids are insects that live in or on the body of their host, eventually killing it). Our approach involves networks sampled at field sites in both modified and relatively unmodified habitat types (hereafter ‘unmodified habitat types’), and uses mathematical models that both estimate differences in relative species abundance between field sites and separate random-encounter effects from differences in species behaviour. We represent the combined effect of host and parasitoid species behaviour by interaction preferences. Interaction preferences were originally designed to improve measurements of nestedness in weighted networks^{24}; here, we use them to describe differences in species behaviour between field sites in similar and different habitat types, and to make predictions of weighted network structure. We hypothesise that species behaviour does not change significantly between field sites in similar habitat types but does change significantly between field sites in different habitat types. This hypothesis would correspond to small differences in individual interaction preferences between field sites in similar habitat types, with larger differences between field sites in different habitat types. It also suggests that predicting weighted network structure at new field sites in a similar habitat type to existing data should be more straightforward than if new field sites are in a different habitat type.

Because interaction preferences may change as habitats are modified, we focus on predicting weighted network structure in modified habitat types using models primarily calibrated with data collected from unmodified habitat types. We consider a total of seven models with different complexities and data requirements, and show that neglecting to separate changes in relative species abundance from changes in species behaviour results in poor predictions of weighted network structure. We then assess the performance of five models based on ecological mechanisms that do make this separation and show that including increasingly more information from modified habitat types results in progressively better predictions. We find that models that capture systematic, community-wide changes in interaction preferences offer the best combination of model complexity and performance. These changes could, for example, relate to altered resource selectivity by consumers in habitat types with minimal forest coverage. Our new modelling approach represents a simple yet powerful way of scaling up existing data to predict weighted network structure across multiple field sites of a given habitat type, predict the effects of habitat modification, and inform the amount and type of additional data that should be collected in novel environments to improve predictions.

## Results

### Weighted host-parasitoid networks

Weighted networks record the frequency of interactions between pairs of species in a community and have become the standard tool for studying changes in interspecific interactions. We tested the performance of our models using empirical networks from four independent studies: Ecuador^{10}, Indonesia^{11}, Swiss lowland^{12} and Swiss meadow^{13}. These studies involve similar guilds of interacting species (cavity-nesting bees and wasps and their parasitoid consumers), but are drawn from diverse ecosystems, including tropical forest and agroforest, temperate meadows and plains, as well as modified versions of these habitat types. In each study, interaction data were collected from modified and unmodified habitat types, with coordinated sampling at multiple field sites in a given habitat type (see Methods section and Supplementary Note 1).

We analysed each study as a separate data set and organised data into a three-level hierarchy: network, group of networks and data set. Each network was built from interaction data collected at a single field site. For mathematical convenience, we represent weighted networks as matrices with entries *B*
_{
ijk
} that record the number of interactions, also referred to as counts, between host species *i* and parasitoid species *j* at field site *k*. To test hypotheses more easily, we grouped networks by habitat type and used metadata to identify two features with each group: habitat complexity and consumer-resource ratio. For habitat complexity, we labelled groups as either ‘forested’ or ‘open’ based on metadata including tree species richness and measurements of light intensity at ground level. We defined consumer-resource ratio as the total number of successful parasitism events across all species divided by the total number of parasitised and unparasitised hosts collected in the field. This measure indicates how easily parasitoids are able to locate their hosts in particular habitat types, and we labelled groups as being associated with either ‘high’ or ‘low’ consumer-resource ratio.

Across the four data sets, we considered 12 groups and situated them in quadrants defined by habitat complexity and consumer-resource ratio (Fig. 1 and Supplementary Table 1). These quadrants represent different categories of relative habitat modification, which allowed us to test whether host and parasitoid species behaviour—represented by interaction preferences—changes between field sites in similar or different habitat types, and what effect such changes may have on the predictability of weighted networks. We tested for changes in species behaviour between field sites in similar habitat types by assessing model predictions between groups from the same data set in the same quadrant (e.g., pasture and rice in Ecuador). To test for the effects of habitat modification, we used predictions between groups from the same data set but in different quadrants (e.g., forest and rice in Ecuador). Using consumer-resource ratio as an additional dimension of habitat modification allowed us to analyse the effects of restoring intensively managed meadows as ecological compensation areas in the Swiss meadow data set, which contains networks only from open habitat types.

### Interaction preferences

Interaction preferences describe how counts in a weighted network deviate from their expected values according to the assumption of random species encounter^{24}. Under this assumption, the expected number of counts between two interacting species is proportional to the product of their relative abundances, and so random species encounter is synonymous with a mass action process^{17}. Network data, however, often do not include independent measurements of species abundance or local population density. But given sufficient interaction data, it is possible to estimate relative species abundances that are consistent with mass action (see Methods section). In this way, weighted network structure can be decomposed as ${B}_{ijk}\propto {\gamma}_{ij}{\widehat{x}}_{i}{\widehat{x}}_{j}$; where *γ*
_{
ij
} is a contribution due to interaction preferences, and ${\widehat{x}}_{i}{\widehat{x}}_{j}$ is a contribution due to random species encounter where ${\widehat{x}}_{i}$ and ${\widehat{x}}_{j}$ are estimated or effective abundances of host and parasitoid species, respectively. Entries in a preference matrix $\underset{}{\underset{}{\gamma}}$ have value *γ*
_{
ij
} = 1 if an interaction is consistent with mass action; *γ*
_{
ij
} > 1 if counts are higher than expected, corresponding to a preferred interaction; and *γ*
_{
ij
} < 1 if counts are lower than expected, corresponding to a less-preferred interaction^{24}. Forbidden interactions^{20} have *γ*
_{
ij
} = 0, and arise, for example, if a host species has evolved an immune response to prevent successful parasitism by a particular parasitoid species^{25}. This decomposition of *B*
_{
ijk
} assumes that a single preference matrix is valid across all field sites included in the set of *k*-indices under consideration, e.g., across all networks in the same group. This assumption is useful for prediction because a single, model-generated preference matrix can then be used to determine weighted network structure at multiple field sites.

We refer to ${\widehat{x}}_{i}$ and ${\widehat{x}}_{j}$ as effective abundances because they can be considered a functional property of the system that contributes directly to recorded interaction counts, and also because their values may be different from other estimates of species abundance, such as those obtained from survey data. As explained in Methods section, the above decomposition assumes that effective abundances hold across all field sites in the same habitat type. This is a necessary assumption because there are often insufficient data in individual networks to determine non-trivial estimates of relative species abundance at individual field sites, and explains why there is no *k*-index attached to effective abundances despite it being mathematically more desirable.

It is worth emphasising the importance of modelling species abundances at the level of individual field sites, even if it is necessary to assume the same value for effective abundance at multiple field sites. This is because representing system properties using spatially aggregated data can give misleading results. For example, consider five networks that each contain the same two host (*i* = 1 and *i* = 2) and singe parasitoid species. When aggregated, there are 15 counts to the first host and 10 counts to the second host; and we therefore estimate relative host species abundance as *X*
_{
i
}
_{=}
_{1} = 15 and *X*
_{
i
}
_{=}
_{2} = 10. However, following our suggested approach, we find that effective abundances are ${\widehat{x}}_{i=1}=3$ and ${\widehat{x}}_{i=2}=6$ for the two host species. In this example, the relative magnitudes of host species abundance at the level of individual field sites are the reverse of the estimate based on aggregated data. This is because, on closer inspection, we might find that the number of recorded counts at the five field sites is something like {3, 3, 3, 3, 3} for the first host and {10, 0, 0, 0, 0} for the second host, which means that the second host (*i* = 2) should really be modelled as being more abundant than the first host (*i* = 1). In general, using the sum of counts across networks as a proxy for abundance or population density will underestimate values for spatially less-common species. Similar issues arise with temporal data aggregation^{26}. We discuss the related topic of aggregating networks by species taxonomy in Supplementary Note 1.

Before showing how preference matrices can be used as predictive models, we first summarise how interaction preferences derived from empirical data differ between groups of networks in the same data set (see also Supplementary Notes 2 and 3 and Supplementary Table 2). When comparing like-for-like entries in the two preference matrices associated with a pair of groups, we found that a large fraction of interaction preferences changed significantly even between similar habitat types (Ecuador: 30%; and Swiss lowland: 28%; there were insufficient data to perform the analysis with the other two data sets). Less surprisingly, a greater fraction changed significantly between unmodified and modified habitat types (Ecuador: 47%; Indonesia: 20%; Swiss lowland: 36%; and Swiss meadow: 33%). A greater proportion of interaction preferences changed significantly for incumbent interactions (those observed in both groups) than for switches (interactions observed in only one of the two groups). Among incumbent interactions, there were more significant increases in interaction preference than decreases; there was no pattern with switches.

### Predicting network structure using interaction preferences

In addition to analysing interaction preferences derived from network data, we can also use them to make predictions of weighted network structure. For a group of networks, we predicted weighted network structure at a new field site as

where *γ*
_{
ij
} is an element from a preference matrix generated by a predictive model, and ${\widehat{x}}_{i}$ and ${\widehat{x}}_{j}$ are effective abundances at the new field site (of course, if species abundances are known at the field site then those values could be used instead of ${\widehat{x}}_{i}$ and ${\widehat{x}}_{j}$).

Testing this approach using our data sets involved five steps. First, we selected a calibration and test group from the same data set. Second, we inferred effective abundances from interaction data in the test group to represent values at the new field site. Third, we used a predictive model to generate a preference matrix based primarily on information from the calibration group. Fourth, we combined the effective abundances with the preference matrix to produce a predicted set of interaction counts (Eq. 1). Fifth, we assessed model performance by comparing the predicted distribution of counts among species to the recorded distribution in the test group. These steps were repeated for each pair of calibration and test groups.

The simplest model in this approach, the random encounter model, assumes very limited species behaviour such that all interactions at a field site are indistinguishable from mass action. All entries in this model’s corresponding preference matrix have value *γ*
_{
ij
} = 1 if an interaction is not forbidden, and zero otherwise. By contrast, the most complex model, the complete characterisation model, assumes that changes in species behaviour are so elaborate that each interaction preference in the matrix must be characterised individually using data from the habitat type of a new field site.

In between the two modelling extremes, we designed the alternative preferences model for predicting between similar habitat types. This model assumes that species behaviour changes very little between similar habitat types, and so the preference matrix derived from one group of networks (the calibration group) is useful for predicting weighted network structure at a new field site. We developed two further models for predicting between different habitat types. The correlated preferences model assumes that parasitoid selectivity for hosts is more pronounced in open compared to forested habitat types. This model is based on our observation that, in open habitat types, if a host species was involved in a high-preference interaction then its other interactions usually had much lower preference, leading to significant negative correlations between the preferences of individual interactions and the average preferences of neighbouring interactions (see Supplementary Note 4 and Supplementary Fig. 1). Even after accounting for such systematic differences between preference matrices following habitat modification, prediction may be limited due to new consumer foraging strategies^{18, 22, 23} or as yet unidentified processes between interacting species. The specified preferences model accounts for this possibility by ‘hardcoding’ entries for influential interactions in preference matrices. This model is based on our observation that only a small fraction of interactions need to be characterised in modified habitat types to predict almost all changes to weighted network structure. These influential interactions did not only correspond to numerous recorded counts (Supplementary Fig. 2), as might be expected, but did typically involve abundant and generalist host and parasitoid species (Supplementary Fig. 3). For reference, the full set of models and their data requirements are summarised in Table 1.

We modelled switches (interactions present in the test group but not calibration group) in two ways: (i) switches follow mass action; or (ii) switches are inherently less-preferred interactions (Methods section). Assuming mass action switches consistently led to better model performance, so we present those results only (it is worth noting, however, that some switches had interaction preferences that differed significantly from the mass action value of one, see Supplementary Table 2 and Supplementary Note 3).

### Assessing model performance

We quantified the accuracy of model predictions using a likelihood function based on the multinomial distribution^{20} (Eq. 2 in Methods section). We chose this likelihood function because it describes how well a model is able to explain the recorded distribution of interaction counts among species at a field site. However, comparing likelihoods across field sites and data sets is not straightforward because likelihood will scale with the sum of counts in a network, which naturally varies among field sites. As such, we compared model performance among field sites using the measure ${\mathcal{F}}_{M,k}$ (Eq. 3 in Methods section), which rescales the likelihood of model *M* at field site *k* by the likelihood of a null model that assumes all non-forbidden interactions are equally likely to be observed. In general, models performed less well at field sites with very few recorded counts (Supplementary Fig. 4). This was due to the limited possibility for non-random and ecologically meaningful weighted structure to be observed in networks built using small amounts of interaction data.

For a given model, we found that ${\mathcal{F}}_{M,k}$ varied greatly among networks in the same group, which was potentially masking meaningful differences in model performance (Supplementary Fig. 5). This variation was due, in part, to our use of a single preference matrix to predict weighted network structure at all field sites in a group (Eq. 1). So to better compare model performance, we also used the measure ${\mathcal{R}}_{M}$ (Eq. 4 in Methods section), which describes model performance at the group level. This measure still compares predicted to recorded counts at individual field sites, but involves calculating likelihood for all field sites in a group at once. With ${\mathcal{R}}_{M}$, the likelihood of model *M* is rescaled to the likelihood of the simple random encounter model (corresponding to ${\mathcal{R}}_{M}=0$) and the likelihood of the maximally complex complete characterisation model (corresponding to ${\mathcal{R}}_{M}=1$).

### Predicting between similar habitat types

The alternative preferences model performed well when calibration and test groups were in similar habitat types (for both modified–modified and unmodified–unmodified combinations of groups). With the Ecuador data set, ${\mathcal{R}}_{M}=0.8$ when using interaction data from pasture sites to predict weighted network structure at rice sites (${\mathcal{R}}_{M}=0.82$ when predicting pasture using rice); and with the Swiss lowland data set, ${\mathcal{R}}_{M}=0.59$ and ${\mathcal{R}}_{M}=0.68$ when predicting between two groups of forested habitat type (log-likelihoods in Supplementary Table 3). Therefore, simply combining an existing preference matrix with abundance data from a given location can be useful for predicting network structure when species behaviour is not expected to change at a new field site.

### Predicting between different habitat types

Conventional analyses implicitly assume that recorded counts have intrinsic predictive value, such that interaction data from one habitat type can be used to make predictions at field sites in other habitat types without additional data processing. In this vein, the aggregate counts model does not separate changes in relative species abundance from changes in interaction preference, and assumes that recorded interaction frequencies or counts from one habitat type can be used directly to predict weighted network structure at new field sites. Unsurprisingly, the model resulted in poor predictions in modified habitats (Fig. 2), with this poor fit to data clearly evident when examining predicted and observed networks at the level of an individual field site (Fig. 3). This result was expected because, as mentioned above, the relative frequency of interactions is known to change as habitats are modified^{10}.

Moving to the simple assumption of mass action (i.e., the random encounter model) resulted in more accurate predictions, but unlike with similar habitat types, performance did not improve by using existing preference matrices (i.e., the alternative preferences model; Fig. 4). However, adjusting existing preference matrices based on expected patterns of parasitoid selectivity for hosts in modified habitat types (i.e., the correlated preferences model) substantially improved predictions: Ecuador, ${\mathcal{R}}_{M}=0.43$; Indonesia, ${\mathcal{R}}_{M}=0.4$; Swiss meadow, ${\mathcal{R}}_{M}=0.21$; and Swiss lowland, ${\mathcal{R}}_{M}=0.6$. Interestingly, the correlated preferences model performed least well with the Swiss meadow data set, which comprised only groups with open habitat complexity (but different consumer-resource ratio, see Fig. 1). In turn, the specified preferences model outperformed the correlated preferences model, and with consistently high model performance: Ecuador, ${\mathcal{R}}_{M}=0.87$ with 3/34 = 9% of interaction preferences hardcoded; Indonesia, ${\mathcal{R}}_{M}=0.68$ with 6/35 = 17%; Swiss meadow, ${\mathcal{R}}_{M}=0.69$ with 6/38 = 16%; and Swiss lowland, ${\mathcal{R}}_{M}=0.65$ with 8/93 = 8%. Model performance increased slightly when we combined the specified preferences model with the correlated preferences model (Supplementary Table 3). If the identity of interactions to target and hardcode in the specified preferences model is not known in advance, then a good rule of thumb is to focus on interactions between the more abundant species: Ecuador, ${\mathcal{R}}_{M}=0.87$ with 4/34 = 12% of interaction preferences hardcoded; Indonesia, ${\mathcal{R}}_{M}=0.68$ with 6/35 = 17%, Swiss meadow, ${\mathcal{R}}_{M}=0.53$ with 6/38 = 16%; and Swiss lowland, ${\mathcal{R}}_{M}=0.39$ with 6/93 = 6% (Supplementary Note 5).

Formal model selection using AIC and BIC^{27} favoured the correlated preferences model and the specified preferences model over the other models, including the complete characterisation model (Supplementary Note 5). This result matched our expectation that models that capture systematic changes in interaction preferences provide the most parsimonious combination of model complexity and performance.

## Discussion

A wealth of information about behaviour and species’ responses to the environment is contained in weighted interaction networks^{2}. However, predictions cannot be made based on empirical networks alone. Ecologists and conservation practitioners need models that combine information from existing networks with other data and theory to make accurate predictions in novel environments. In this study, we compared the performance of seven models and found that simpler models were sufficient to predict network structure at field sites in similar habitat types to existing data, but more complex models were required when field sites were in different habitat types. This result is consistent with our hypothesis that host and parasitoid species behaviour does not change significantly between field sites in similar habitat types but does change significantly between field sites in different habitat types.

Our findings suggest that if network data representative of new field sites are readily available then predicting weighted network structure is straightforward: interaction preferences are likely to be similar and the alternative preferences model can be used with empirical estimates of species abundance, such as those collected during biodiversity monitoring programmes. For example, the interaction preferences inferred here for rice and pasture habitat types could be used to make predictions at new but similar field sites in Ecuador. Of course, it must be recognised that interaction preferences can only be determined if pairs of species have been observed co-occurring already, which may be a limiting factor for predicting weighted network structure in systems with frequent spatial and temporal turnover of community composition. Prediction is more difficult if new field sites are in modified habitat types with limited existing data to inform models, as is the case with most urban habitat types like parks and community gardens. Interaction preferences are likely to be different, and accurate prediction requires understanding which ecological processes and mechanisms are driving these differences. But, as our results for the correlated preferences model show, consistent changes in species behaviour can be mapped to systematic changes in interaction preferences, with measurable benefits for prediction. In addition, the specified preferences model highlights how targeted data collection of particular species and interactions can make predicting the effects of habitat modification more efficient. And given that our models span a range of data requirements, it is possible to customise the trade-off between prediction accuracy and sampling effort depending on the practical question of interest.

In this study, independent measurements of relative species abundance were not available and so predictions were based on effective abundances estimated from network data. By design, our method for estimating relative species abundances will tend to favour an explanation of interaction frequencies in terms of mass action, potentially at the expense of under-estimating genuinely strong or weak interaction preferences. In this regard, it is a conservative method that could under-attribute changes in network structure to species behaviour. It is not currently known how effective abundances correspond to more direct measurements or estimates of species abundance in the field. Although our general approach to prediction is valid either way, determining how effective abundances relate to more direct measurements will be necessary to ensure accurate predictions of weighted network structure. Finding clear relationships between inferred and measured species abundances would also bring about time and cost savings, as only interaction data or abundance data would need to be collected, as appropriate. Identifying such relationships will help with the practical side of prediction, but other kinds of data are needed to clarify the role of species behaviour in determining network structure. This is because our current definition of interaction preferences does not separate ‘inherent’ preferences from complicating factors due to the local environment. By ‘inherent’ preferences, we mean some kind of baseline expectation for how often, for example, a parasitoid would select a particular host given a choice of alternative hosts from different species, but described at the population level rather than the more usual individual level. These ‘inherent’ preferences are best measured in the controlled setting of laboratory experiments, and doing so would also help untangle the issue of potential and realised niche (Supplementary Note 2). Once measurements have been made, it will then be possible to test more nuanced hypotheses, such as whether ‘inherent’ preferences are masked in forested habitat types but revealed in open habitat types.

We used a likelihood function based on the multinomial distribution to calculate model performance. This probability distribution is useful because it directly compares model predictions for multiple species to a recorded set of interaction counts. It does so by representing the probability that a parasitoid picks a given host, conditioned on information about other hosts in the community. This conditioning is necessary if, for example, the abundances of particular host species lead to parasitoids forming search images^{28} that affect their per capita probabilities of attacking other hosts in the community. As such, the multinomial distribution relies on species richness and community composition being relatively stable over the time period of data collection. Alternatively, one could use a likelihood function based on the binomial distribution, which represents the probability of recording a successful parasitism event given a host-parasitoid encounter in the field, independent of community composition (we discuss other possible probability distributions for the likelihood function in Supplementary Note 2). The binomial distribution assumes that network structure is primarily a pairwise phenomenon, whereas the multinomial distribution assumes that it is primarily a community phenomenon, and likely it is a mixture of the two.

In future work, it will be useful to compile general patterns of shifting interaction preferences between different habitat types, and, indeed, patterns that arise from other forms of environmental change. For example, interaction data could be collected along an altitudinal gradient as a proxy for temperature change, using differences between sets of inferred interaction preferences as the basis of predictive models for climate warming. Identifying which interactions need to be characterised and hardcoded in models is also important for prediction; and the fact that some interactions deviate so strongly from mass action suggests that they may be worth deeper investigation in their own right. Promisingly, we found that only a small fraction of interactions may need to be sampled in modified habitats to significantly improve predictions of network structure, and these interactions likely involve common species with many interaction partners. It will be interesting to apply our models, based on host-parasitoid networks, to other classes of weighted interaction network, such as plant-pollinator networks (in which weights represent the number of recorded visits between species). Although many biological details will of course vary between network classes, separating relative species abundance from other factors affecting network structure will still be useful because our general approach, at its core, represents a fundamental modelling step that is now taken for granted in population dynamical models^{29}.

With our new methods and models, we can now begin to predict how human-driven change could impact species’ interactions in novel environments and unfamiliar conditions. By separating abundance and behaviour, we are better able to compare the functional roles of rare and specialist species to the roles of more abundant and generalist species in a community, both in terms of ecosystem service output and also their relative contributions to network persistence and stability^{30,31,32,33}. Our approach is also relevant as the final step in a more ambitious sequence of predictions. Species distribution and demographic models use environmental variables and species’ vital rates (e.g., survival, growth, and reproduction) to predict the geographical distribution and abundance of species^{34, 35}. The models we have presented can convert these abundances into weighted interaction networks. In this way, we can begin to predict the composition and structure of communities, and, therefore, start assessing and predicting the effects of environmental changes on the global provision of ecosystem services.

## Methods

### Networks and data sets

We analysed four data sets of weighted networks that describe interactions between insects at two trophic levels: parasitoid species (predators or consumers) and their host species (prey or resources), including information on the number of successful parasitism events (counts) between each host and parasitoid species at the level of a single field site. Mathematically, we represented networks as matrices with entries *B*
_{
ijk
} that record the number of counts between host species *i* and parasitoid species *j* at field site *k*.

The Ecuador data set^{10} includes 48 networks sampled from five habitat types: forest (6 networks); shade-grown coffee agroforest (12); abandoned coffee agroforest (6); pasture (12); and rice (12). The Indonesia data set^{11} includes 24 networks all sampled from agroforests, and we categorised field sites into two habitat types: more forested (12 networks) and less forested (12). The Swiss meadow data set^{12} includes 47 networks sampled from two habitat types: restored meadow (ecological compensation areas, ECAs, 13 networks); and intensively managed meadows at distances 25 m (11), 50 m (12) and 100 m (11) from the nearest ECA. The Swiss lowland data set^{13} includes 30 networks sampled from three habitat types: adjacent to forest (10 networks); located at a distance of 100–200 m from the nearest forest but connected by woody elements (10); and isolated at least 100 m away from any woody habitat (10).

We grouped networks by habitat type and determined 12 groups as having sufficient data for analysis. We used metadata to identify two features with each group: habitat complexity (forested or open) and consumer-resource ratio (low or high). Forested-low: Ecuador {forest, coffee, abandoned coffee}; and Indonesia {more forested}. Forested-high: Swiss lowland {adjacent}, {connected}, and {10 most forested from adjacent and connected}. Open-low: Indonesia {less forested}; and Swiss meadow {25 m, 50 m, 100 m}. Open-high: Ecuador {pasture}, {rice} and {pasture, rice}; Swiss lowland {isolated}; and Swiss meadow {ECA}.

### Estimating relative species abundances from interaction data

Network data often do not include independent measurements of species abundance or local population density, but given sufficient count data it is possible to estimate relative species abundances that are consistent with mass action^{24}. These estimates may differ from other, independent measurements of abundance because they represent idealised abundances that provide the closest agreement to data under the mass action hypothesis; they should therefore be considered effective or functional species abundances.

A general form of mass action is ${B}_{ijk}\propto {x}_{i}^{\alpha}{x}_{j}^{\beta}$; where *B*
_{
ijk
} > 0 and *x*
_{
i
} and *x*
_{
j
} are the abundances or local population densities of interacting host and parasitoid species, respectively, and *α* and *β* are scaling parameters. Notice that this expression for *B*
_{
ijk
} assumes that abundances hold across a set of field sites indexed by *k*, e.g., all field sites of the same habitat type or in the same group. This is a necessary assumption because there are often insufficient data in individual networks to determine non-trivial estimates of relative species abundance at individual field sites.

Taking logarithms, $ln\left({B}_{ijk}\right)\propto \alpha ln\left({x}_{i}\right)+\beta \mathrm{ln}\left({x}_{j}\right)$. For a given pair of *α* and *β* values, if the network (*k* = 1) or group of networks (*k* > 1) is sufficiently dense with interactions then we have a set of over-determined equations^{24}, with one equation for each recorded *B*
_{
ijk
}. We used the function *lsei* in the R package limSolve^{36} to solve this set of equations and obtain estimates of *x*
_{
i
} and *x*
_{
j
}. In practice, we trialled combinations of 0 < *α* ≤ 2 and 0 < *β* ≤ 2 in increments of 0.05 and recorded the log-likelihood with ${p}_{ijk}=f\left(\alpha ,\beta \right)=\frac{{x}_{i}{x}_{j}}{{\sum}_{ij}{x}_{i}{x}_{j}}$ in Eq. 2. The combination resulting in the largest log-likelihood is the maximum likelihood estimate pair, $\widehat{\alpha}$ and $\widehat{\beta}$, and we denote the associated maximum likelihood estimate of species abundances by ${\widehat{x}}_{i}$ and ${\widehat{x}}_{j}$. As *α* only controls the distribution of estimated abundances among host species (and similarly with *β* for parasitoid species), our estimates of relative species abundance—our effective abundances—are simply ${\widehat{x}}_{i}$ and ${\widehat{x}}_{j}$ (i.e., the expected number of counts for an interaction that follows mass action is proportional to ${\widehat{x}}_{i}{\widehat{x}}_{j}$).

### Models

We developed a series of models for predicting weighted network structure at new field sites in a novel environment. We assessed the performance of models using pairs of groups from the same data set: models were parameterised using data from a calibration group and predictions were tested using recorded counts from a test group, which represents the novel environment. Let us denote variables in the calibration group by ${B}_{ijk}^{\mathrm{cal}}$, ${\widehat{x}}_{i}^{\mathrm{cal}}$, ${\widehat{x}}_{j}^{\mathrm{cal}}$ and ${\gamma}_{ij}^{\mathrm{cal}}$; and variables in the test group by ${B}_{ijk}^{{}^{\prime}}$, ${\widehat{x}}_{i}^{{}^{\prime}}$, ${\widehat{x}}_{j}^{{}^{\prime}}$ and ${\gamma}_{ij}^{{}^{\prime}}$. Here, we extended the original method^{24} for deriving preference matrices ($\underset{}{\underset{}{\gamma}}$) from network data to treat interaction data sampled at multiple field sites (Supplementary Note 2). Each model generates probabilities *p*
_{
ijk
} that are compared to ${B}_{ijk}^{{}^{\prime}}$ using Eq. 2, below, to calculate log-likelihoods; with log-likelihoods then used to measure and compare model performance at individual field sites (Eq. 3) and at the group level (Eq. 4).

Null model with uniform interaction frequencies. All interactions have the same probability, ${p}_{ijk}=\frac{1}{{\sum}_{ijk}{a}_{ijk}}$; where *a*
_{
ijk
} = 1 if ${B}_{ijk}^{{}^{\prime}}>0$, and zero otherwise, i.e., ∑_{
ijk
}
*a*
_{
ijk
} is the number of non-forbidden interactions recorded at a field site (ignoring counts).

Aggregate counts model. Probabilities are set proportional to the number of recorded counts summed across networks from different field sites in the calibration group: ${p}_{ijk}=\frac{{\sum}_{k}{B}_{ijk}^{\mathrm{cal}}}{{\sum}_{ijk}{B}_{ijk}^{\mathrm{cal}}}$.

Random encounter model. Probabilities are set proportional to the product of effective abundances of host and parasitoid species in the novel environment: ${p}_{ijk}=\frac{{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}{{\sum}_{ij}{{\widehat{x}}^{\prime}}_{i}{{\widehat{x}}^{\prime}}_{j}}$; recall that effective abundances are assumed to hold across all field sites in a group, which is why there is no *k*-index on the right-hand side of the expression for *p*
_{
ijk
}.

Alternative preferences model. Probabilities are set proportional to the product of an existing preference matrix from the calibration group ${\gamma}_{ij}^{\mathrm{alt}}={\gamma}_{ij}^{\mathrm{cal}}$ and effective abundances in the novel environment: ${p}_{ijk}=\frac{{\gamma}_{ij}^{\mathrm{alt}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}{{\sum}_{ij}{\gamma}_{ij}^{\mathrm{alt}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}$. Note that the preference matrix from the calibration group is derived using the effective abundances from data in the calibration group (Supplementary Note 2). For switches (interactions known to be possible but with no entry in ${\gamma}_{ij}^{\mathrm{alt}}$), we considered two possibilities: (i) switches follow mass action and we set ${\gamma}_{ij}^{\mathrm{alt}}=1$; or (ii) switches are inherently less-preferred interactions and we set ${\gamma}_{ij}^{\mathrm{alt}}=1-{2}^{-\frac{1}{{\widehat{x}}_{i}^{\mathrm{cal}}{\widehat{x}}_{j}^{\mathrm{cal}}}}$, which returns values between zero and one, in inverse proportion to the product of effective abundances in the calibration group. As mentioned in the main text, mass action switches consistently led to better model performance, so we present those results only (but see Supplementary Table 2 and Supplementary Note 3).

Correlated preferences model. First, we obtain the column-wise rank order of interaction preferences in ${\gamma}_{ij}^{{}^{\prime}}$, i.e., host species are sorted and identified (first, second, third etc.) from highest-to-lowest interaction preference for each parasitoid species. This rank order represents a systematic pattern in interaction preferences that is identifiable with the novel environment (see Supplementary Note 4). We then reorder entries in ${\gamma}_{ij}^{\mathrm{cal}}$ (including mass action switches) according to the rank order in ${\gamma}_{ij}^{{}^{\prime}}$ to obtain a new preference matrix: ${\gamma}_{ij}^{\mathrm{corr}}$. Probabilities are set as ${p}_{ijk}=\frac{{\left({\gamma}_{ij}^{\mathrm{corr}}\right)}^{\widehat{\delta}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}{{\sum}_{ij}{\left({\gamma}_{ij}^{\mathrm{corr}}\right)}^{\widehat{\delta}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}$; where $\widehat{\delta}$ is a scaling parameter that is applied to each entry in the preference matrix and is set to its maximum likelihood estimate value (we also present results for the model without the optimisation step—that is, with $\widehat{\delta}=1$—in Supplementary Table 3).

Specified preferences model. First, we determine the contribution of each interaction to log-likelihood by calculating Eq. 2 with ${B}_{ijk}^{{}^{\prime}}$ and ${p}_{ijk}=\frac{{\gamma}_{ij}^{{}^{\prime}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}{{\sum}_{ij}{\gamma}_{ij}^{{}^{\prime}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}$ with all non-zero entries in ${\gamma}_{ij}^{{}^{\prime}}$ set to one except the focal entry. We sort the log-likelihood contributions and identify the interactions above any obvious discontinuity (see Supplementary Fig. 2). We then replace—hardcode—the entries for these influential interactions in ${\gamma}_{ij}^{\mathrm{cal}}$ (including mass action switches) with their corresponding values in ${\gamma}_{ij}^{{}^{\prime}}$ to obtain a new preference matrix: ${\gamma}_{ij}^{\mathrm{spec}}$. Probabilities are set as ${p}_{ijk}=\frac{{\gamma}_{ij}^{\mathrm{spec}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}{{\sum}_{ij}{\gamma}_{ij}^{\mathrm{spec}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}$. The specified preferences and correlated preferences models can be combined by hardcoding entries for the influential interactions in ${\gamma}_{ij}^{\mathrm{corr}}$ (see above) rather than ${\gamma}_{ij}^{\mathrm{cal}}$.

Complete characterisation model. All interaction preferences must be characterised individually in the novel environment and so the relevant preference matrix is ${\gamma}_{ij}^{\mathrm{complete}}={\gamma}_{ij}^{{}^{\prime}}$. Probabilities are set as ${p}_{ijk}=\frac{{\gamma}_{ij}^{\mathrm{complete}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}{{\sum}_{ij}{\gamma}_{ij}^{\mathrm{complete}}{\widehat{x}}_{i}^{{}^{\prime}}{\widehat{x}}_{j}^{{}^{\prime}}}$. The model results in the best fit to data possible in our current approach and, by definition, returns the maximum model performance at the group level. It is worth emphasising that the model does not result in perfect fit to data, which would correspond to log-likelihood equal to zero; rather, the log-likelihood at the group level (${\mathcal{L}}_{\mathrm{complete}}$ in Eq. 4) indicates how well a single preference matrix is able to explain weighted network structure at multiple field sites in the same group.

### Likelihood function for testing model fit

We assumed that the number of recorded counts, *B*
_{
ijk
} > 0, between host species *i* and parasitoid species *j* at field site *k* follows a multinomial distribution^{20}. The corresponding likelihood function for a set of recorded counts generated with probabilities *p*
_{
ijk
} is

and the log-likelihood is $\mathcal{L}=\mathrm{ln}\left(L\right)$, which we calculated using the function dmultinomin in R^{36}.

### Model performance at individual field sites

We measured the performance of model *M* at field site *k* as

where the null model is described above and ${\mathcal{L}}_{\mathrm{null,}k}$ and ${\mathcal{L}}_{M,k}$ are log-likelihoods calculated using Eq. 2 with a single *k*-index. ${\mathcal{F}}_{M,k}=1$ if model *M* completely explains the distribution of recorded interaction counts at field site *k*; ${\mathcal{F}}_{M,k}=0$ if it performs the same as the null model; and ${\mathcal{F}}_{M,k}<0$ if it performs worse than the null model.

### Model performance at the group level

We measured the performance of model *M* at the group level as

where the random encounter (re) and the complete characterisation (complete) models are described above, and ${\mathcal{L}}_{\mathrm{re}}$, ${\mathcal{L}}_{\mathrm{complete}}$ and ${\mathcal{L}}_{M}$ are log-likelihoods calculated using Eq. 2 for all field sites in a group of networks together, and, therefore, with multiple *k*-indices. ${\mathcal{R}}_{M}=1$ if model *M* performs as well as the complete characterisation model; ${\mathcal{R}}_{M}=0$ if it performs the same as the random encounter model; and ${\mathcal{R}}_{M}<0$ if it performs worse than the random encounter model.

### Code availability

Computer code can be accessed by contacting the corresponding author (P.P.A.S.).

### Data availability

Host-parasitoid networks can be accessed by contacting the appropriate author (Ecuador: O.T.L. or J.M.T.; Indonesia: A.M.K.; Swiss meadow: M.A.; Swiss lowland: V.C.).

## Additional information

**Publisher's note:** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## References

- 1.
Foley, J. A. et al. Global consequences of land use.

*Science***309**, 570–574 (2005). - 2.
Tylianakis, J. M., Didham, R. K., Bascompte, J. & Wardle, D. A. Global change and species interactions in terrestrial ecosystems.

*Ecol. Lett.***11**, 1351–1363 (2008). - 3.
Blüthgen, N., Fründ, J., Vázquez, D. P. & Menzel, F. What do interaction network metrics tell us about specialization and biological traits.

*Ecology***89**, 3387–3399 (2008). - 4.
Dormann, C. F., Fründ, J., Blüthgen, N. & Gruber, B. Indices, graphs and null models: analyzing bipartite ecological networks.

*Open Ecol. J***2**, 7–24 (2009). - 5.
Costanza, R. et al. The value of the world’s ecosystem services and natural capital.

*Nature***387**, 253–260 (1997). - 6.
Losey, J. E. & Vaughan, M. The economic value of ecological services provided by insects.

*Bioscience***56**, 311–323 (2006). - 7.
Tylianakis, J. M., Laliberté, E., Nielsen, A. & Bascompte, J. Conservation of species interaction networks.

*Biol. Conserv.***143**, 2270–2279 (2010). - 8.
Tylianakis, J. M. & Binzer, A. Effects of global environmental changes on parasitoid-host food webs and biological control.

*Biol. Control***75**, 77–86 (2014). - 9.
Hagen, M. et al. Biodiversity, species interactions and ecological networks in a fragmented world.

*Adv. Ecol. Res.***46**, 89–210 (2012). - 10.
Tylianakis, J. M., Tscharntke, T. & Lewis, O. T. Habitat modification alters the structure of tropical host-parasitoid food webs.

*Nature***445**, 202–205 (2007). - 11.
Klein, A.-M., Steffan-Dewenter, I. & Tscharntke, T. Rain forest promotes trophic interactions and diversity of trap-nesting hymenoptera in adjacent agroforestry.

*J. Anim. Ecol.***75**, 315–323 (2006). - 12.
Albrecht, M., Duelli, P., Schmid, B. & Müller, C. B. Interaction diversity within quantified insect food webs in restored and adjacent intensively managed meadows.

*J. Anim. Ecol.***76**, 1015–1025 (2007). - 13.
Coudrain, V., Schüepp, C., Herzog, F., Albrecht, M. & Entling, M. Habitat amount modulates the effect of patch isolation on host-parasitoid interactions.

*Front. Environ. Sci.***2**, 27 (2014). - 14.
Poisot, T., Canard, E., Mouillot, D., Mouquet, N. & Gravel, D. The dissimilarity of species interaction networks.

*Ecol. Lett.***15**, 1353–1361 (2012). - 15.
Albouy, C. et al. From projected species distribution to food-web structure under climate change.

*Global Change Biol.***20**, 730–741 (2014). - 16.
Poisot, T., Stouffer, D. B. & Gravel, D. Beyond species: why ecological interaction networks vary through space and time.

*Oikos***124**, 243–251 (2015). - 17.
Vázquez, D. P. et al. Species abundance and asymmetric interaction strength in ecological networks.

*Oikos***116**, 1120–1127 (2007). - 18.
Pulliam, H. R. On the theory of optimal diets.

*Am. Nat.***108**, 59–74 (1974). - 19.
Hassell, M. P. & Varley, C. G. New inductive model for insect parasites and its bearing on biological control.

*Nature***223**, 1133–1137 (1969). - 20.
Vázquez, D., Chacoff, N. P. & Cagnolo, L. Evaluating multiple determinants of the structure of plant-animal mutualistic networks.

*Ecology***90**, 2039–2046 (2009). - 21.
Canard, E. F. et al. Empirical evaluation of neutral interactions in host-parasite networks.

*Am. Nat.***183**, 468–479 (2014). - 22.
Gols, R. et al. Reduced foraging efficiency of a parasitoid under habitat complexity: implications for population stability and species coexistence.

*J. Anim. Ecol.***74**, 1059–1068 (2005). - 23.
Murdoch, W. W. Switching in general predators: experiments on prey specificity and stability of prey populations.

*Ecol. Monogr.***39**, 335–342 (1969). - 24.
Staniczenko, P. P. A., Kopp, J. C. & Allesina, S. The ghost of nestedness in ecological networks.

*Nat. Commun.***4**, 1931 (2013). - 25.
Henri, D. C. & Van Veen, F. J. F. Body size, life history and the structure of host-parasitoid networks.

*Adv. Ecol. Res*.**45**, 135–180 (2011). - 26.
Jordán, F. & Osváthc, G. The sensitivity of food web topology to temporal data aggregation.

*Ecol. Model.***220**, 3141–3146 (2009). - 27.
Burnham, K. P. & Anderson, D. R. in

*Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach*2nd edn (Springer, 2002). - 28.
Ishii, Y. & Shimada, M. Learning predator promotes coexistence of prey species in host- parasitoid systems.

*Proc. Natl Acad. Sci. USA***109**, 5116–5120 (2012). - 29.
Brauer, F. & Castillo-Chavez, C.

*Mathematical Models in Population Biology and Epidemiology*(Springer, 2000). - 30.
Thébault, E. & Fontaine, C. Stability of ecological communities and the architecture of mutualistic and trophic networks.

*Science***329**, 853–856 (2010). - 31.
Saavedra, S., Stouffer, D. B., Uzzi, B. & Bascompte, J. Strong contributors to network persistence are the most vulnerable to extinction.

*Nature***478**, 233–235 (2011). - 32.
Stouffer, D. B., Sales-Pardo, M., Sirer, M. I. & Bascompte, J. Evolutionary conservation of species’ roles in food webs.

*Science***335**, 1489–1492 (2012). - 33.
Rohr, R. P., Saavedra, S. & Bascompte, J. On the structural stability of mutualistic systems.

*Science***345**, 416–425 (2014). - 34.
Ehrlén, J. & Morris, W. F. Predicting changes in the distribution and abundance of species under environmental change.

*Ecol. Lett.***18**, 303–314 (2015). - 35.
Staniczenko, P. P. A., Sivasubramaniam, P., Suttle, K. B. & Pearson, R. G. Linking macroecology and community ecology: Refining predictions of species distributions using biotic interaction networks.

*Ecol. Lett.***20**, 693–707 (2017). - 36.
R Core Team.

*R: A Language and Environment for Statistical Computing*(R Foundation for Statistical Computing, 2014).

## Acknowledgements

We thank Céline Bellard, Georgina Mace and Daniel Stouffer for comments, and Matt Walters for producing Fig. 2. P.P.A.S. was supported by an AXA Postdoctoral Research Fellowship and a Postdoctoral Fellowship from the National Socio-Environmental Synthesis Center (SESYNC) funded by National Science Foundation DBI-1052875, O.T.L. by NERC grant NE/N010221/1, J.M.T. by a Rutherford Discovery Fellowship administered by the Royal Society of New Zealand, M.A. by European commission grant QLRT-2001-01495 and Swiss Federal Office for Science and Technology grant 01.0524-2, V.C. by British Ecological Society grant 4785/5824 awarded to P.P.A.S., A.-M.K. by German Science Foundation grant DFG: KL 1849/5-2 and F.R.-T. by James Martin 21st Century Foundation grant LC1213-006.

## Author information

### Affiliations

#### National Socio-Environmental Synthesis Center (SESYNC), Annapolis, MD, 21401, USA

- Phillip P. A. Staniczenko

#### Department of Biology, University of Maryland College Park, Maryland, MD, 20742, USA

- Phillip P. A. Staniczenko

#### CABDyN Complexity Centre, Saïd Business School, University of Oxford, Oxford, OX1 1HP, UK

- Phillip P. A. Staniczenko
- & Felix Reed-Tsochas

#### Department of Zoology, University of Oxford, South Parks Road, Oxford, OX1 3PS, UK

- Owen T. Lewis

#### Centre for Integrative Ecology, School of Biological Sciences, University of Canterbury, Christchurch, 8140, New Zealand

- Jason M. Tylianakis

#### Department of Life Sciences, Imperial College London, Silwood Park Campus, Ascot, SL5 7PY, UK

- Jason M. Tylianakis

#### Institute for Sustainability Sciences, Agroscope, Zurich, 8046, Switzerland

- Matthias Albrecht

#### Mediterranean Institute of Marine and Terrestrial Biodiversity and Ecology, Aix-Marseille University, University of Avignon, CNRS, IRD, IMBE, Marseille, 13284, France

- Valérie Coudrain

#### Chair of Nature Conservation and Landscape Ecology, Faculty of Environment and Natural Resources, University of Freiburg, Freiburg, D-79106, Germany

- Alexandra-Maria Klein

#### Oxford Martin School, University of Oxford, Oxford, OX1 3BD, UK

- Felix Reed-Tsochas

### Authors

### Search for Phillip P. A. Staniczenko in:

### Search for Owen T. Lewis in:

### Search for Jason M. Tylianakis in:

### Search for Matthias Albrecht in:

### Search for Valérie Coudrain in:

### Search for Alexandra-Maria Klein in:

### Search for Felix Reed-Tsochas in:

### Contributions

P.P.A.S. was responsible for research planning, analysis and writing; O.T.L., J.M.T. and F.R.-T. for additional research planning and writing; and M.A., V.C., A.-M.K., O.T.L. and J.M.T. provided data. All authors discussed the results and edited the manuscript.

### Competing interests

The authors declare no competing financial interests.

### Corresponding author

Correspondence to Phillip P. A. Staniczenko.

## Electronic supplementary material

## About this article

### Publication history

#### Received

#### Accepted

#### Published

### DOI

https://doi.org/10.1038/s41467-017-00913-w

### Rights and permissions

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

## Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.