Neonicotinoids are the most widely used insecticides worldwide and are typically deployed as seed treatments (hereafter NST) in many grain and oilseed crops, including soybeans. However, there is a surprising dearth of information regarding NST effectiveness in increasing soybean seed yield, and most published data suggest weak, or inconsistent yield benefit. The US is the key soybean-producing nation worldwide and this work includes soybean yield data from 194 randomized and replicated field studies conducted specifically to evaluate the effect of NSTs on soybean seed yield at sites within 14 states from 2006 through 2017. Here we show that across the principal soybean-growing region of the country, there are negligible and management-specific yield benefits attributed to NSTs. Across the entire region, the maximum observed yield benefits due to fungicide (FST = fungicide seed treatment) + neonicotinoid use (FST + NST) reached 0.13 Mg/ha. Across the entire region, combinations of management practices affected the effectiveness of FST + NST to increase yield but benefits were minimal ranging between 0.01 to 0.22 Mg/ha. Despite widespread use, this practice appears to have little benefit for most of soybean producers; across the entire region, a partial economic analysis further showed inconsistent evidence of a break-even cost of FST or FST + NST. These results demonstrate that the current widespread prophylactic use of NST in the key soybean-producing areas of the US should be re-evaluated by producers and regulators alike.
In the US, the most recent published estimates reflect that approximately 34–44% of planted soybean hectares are treated with neonicotinoid seed treatments (NST)1. Based upon inferences drawn from trendlines shown in that work, the current estimate for NST use in soybeans is very likely to exceed 50%. Despite the prevalence of this practice nationally, the work we report here is the first large-scale analysis of soybean yield data. Insecticidal seed treatments of soybean belong to the neonicotinoid class of insecticides that include the active ingredients clothianidin, imidacloprid, and thiamethoxam. Corn and soybean seed treatments represent the largest uses of neonicotinoids nationally, and the higher seeding rate of soybeans mean that they are responsible for higher levels of active ingredient per unit area2. It is notable that current NST use rates far exceed historic benchmarks for insecticide use in soybeans; in the decade prior to introduction of neonicotinoid seed treatments, only about 5% of soybean hectares received insecticides3. This benchmark reflects that the region where most of US soybeans are grown, the upper Midwest, benefits from a temperate climate and relatively few insect pests, particularly in the early season when NST would provide most crop protection. Recent reviews of insect pest abundance in soybean re-confirm this assessment – early season pests of soybean are still infrequently encountered across the region4,5. Soybean aphid, a relatively recent invader to US soybean production, is a notable exception, but it’s abundance and phenology are a poor fit for the early-growing season, when NST are most effective6,7.
Recent studies report weak relationships between NST use and effectiveness in preserving crop yield. Specifically for soybean, in a recent multi-environment study in Wisconsin, yield benefit due to the use of insecticide seed treatments was variable8. In a comprehensive review conducted by the Environmental Protection Agency - EPA, NSTs were categorized as offering negligible overall benefits to soybean production in the Midwest9. A recent multi-state study of management tactics for the key pest in the region, the soybean aphid (Aphis glycines Matsumura) demonstrated that crop yield benefits and overall economic returns were marginally affected by NST, while an integrated pest management (IPM) approach, which combined scouting for the pest with foliar insecticide sprays only when the established economic threshold is reached, proved superior in all metrics outlined above6. Additionally, other management practices, such as planting date10, seeding rates11, and possibly region4, may affect the seed yield response of insecticide seed treatments. These results suggest that responses are unpredictable and support the notion that prophylactic application of NST across the region may be largely unnecessary. Aside from the fact that a farmer may be incurring unnecessary input costs, a growing body of research suggests that the use of NST in this manner can lead to a host of negative effects upon non-target organisms. It has been reported that neonicotinoids are increasingly detected in terrestrial and aquatic environments12,13. Furthermore, studies in the US and elsewhere have evaluated impacts of neonicotinoid on nontarget organisms such as honey bees13,14,15 wild bees16,17, monarch butterflies18, vertebrates19,20, terrestrial and aquatic invertebrates21,22 and overall declines in ecosystem function23. Although each of these concerns are relevant to the US soybean-producing regions, it is worthwhile to note that key soybean producing states represented in our study include ND, SD, and MN, which rank 3rd, 4th and 5th, respectively in honey bee colonies ranked by state24; many of these are migratory colonies used for pollination of key fruit and nut crops. This presents a key intersection between NST exposure and our principal managed pollinator species with demonstrated sensitivity to this class of compounds.
When implementing an IPM approach, an insecticide is used only when pest populations are expected to reach economically important populations and other management tools are not available or effective25. Using NST under an IPM strategy is admittedly challenging due to a lack of secondary pest predictive tools and thus, limited prediction power regarding early season pest populations. Consequently, the approach to NST use in North American annual crops since their introduction in the early 2000’s has been a continent-wide test of an “insurance-based” approach to insect pest management, where the risk of pests across the entire soybean-growing region was assumed to be sufficient to justify the use of insecticide over tens of millions of hectares annually, without corroborating monitoring or real-time yield assessments.
Results and Discussion
For this work, soybean seed yield data from 194 studies were assembled and stratified in four growing environments (Fig. 1) based on soil pH and in-season weather conditions. There were differences in average growing season temperatures and total precipitation among the four clusters (Table S1). The greatest precipitation occurred in locations in clusters 2 and 3. Locations in cluster 4 had the lowest precipitation and greatest average yields were observed in cluster 2.
FST, FST + NST, and untreated controls (UTC) were applied in all locations (Table S2). Across the entire region, concurrent use of FST + NST effectively increased soybean yield compared to FST and UTC seed (Fig. 2). Nevertheless, the maximum yield difference compared with fungicide only and from untreated seed was small and reached only 0.04 and 0.06 Mg/ha, respectively. Similar magnitudes of yield differences were observed within clusters 1, 2 and 4 where the effect of seed treatment was significant (Fig. S1).
When repeating the analysis with seed treatments separated by neonicotinoid active ingredients (imidacloprid, thiamethoxam, and clothianidin), across the entire region, concurrent thiamethoxam-based FST + NST resulted in the highest yield (4.3 Mg/ha), and differences compared with the other seed treatments did not exceed 0.13 Mg/ha (Fig. S2). A similar magnitude of yield differences due to seed treatments, separated by neonicotinoid active ingredients, was observed within each cluster (Fig. S3). These results suggest that the yield benefit due to neonicotinoid seed treatments was small but relatively consistent across the entire study area.
Conditional inference tree analysis was used to identify conditional effects of seed treatments with growing environments (clusters) and management practices. Irrigation, followed by cluster, were the most important yield limiting factors followed by the effect of row spacing and seeding rate (Fig. 3). In cluster 1, narrow rows in non-irrigated experiments were associated with yield increase by up to 0.3 Mg/ha whereas in cluster 2, seeding rate greater than 297,000 seeds/ha resulted in the greatest yield.
When repeating the analysis, with treatments separated by neonicotinoid active ingredient (imidacloprid, thiamethoxam, and clothianidin), the results were identical to Fig. 3. This analysis demonstrates that seed treatments, with and without neonicotinoids, have a negligible effect on soybean yield. In all experiments included in this study, the effectiveness of NST was examined concurrently with FST. This is a common practice (51% of treated fields) among farmers across the North-central Midwestern US26, and our results suggest that such a practice is unlikely to significantly increase yields across the region. Based on these analyses, we conclude that prophylactic use of seed treatments (with and without neonicotinoids) are not necessary to maximize yield returns across the region, and other management practices that have a more direct impact on soybean seed yield, are much more important considerations27, these include sowing date, and cultivar maturity group.
The effectiveness of the combined FST + NST compared with the FST alone appeared to be affected mainly by the use of row spacing, irrigation, and the cultivar’s maturity group (Fig. S4A). The greatest yield benefit of NSTs was observed in 12% of cropping systems that included non-irrigated plants in narrow rows (38 cm) and cultivars with maturity group ≤2 (+0.19 Mg/ha).
Effectiveness of concurrent use of FST + NST compared to the UTC was mainly affected by row spacing and seeding rate (Fig. S4B). The yield benefit in these cropping systems reached 0.22 Mg/ha. It appears that seed treatments including both FST + NST may be more effective in narrow row production systems, measuring 38 cm, and sub-optimal (<198,000 seeds/ha) seeding rates. However, across the Midwestern and North-central US, prevalent row spacings in non-irrigated production systems are 38 cm27. Our analysis demonstrates that the optimal management practices are already applied in farmer’s fields, and thus, no additional yield benefit should be expected from FST + NST applications.
Sowing date within a region has a large effect on soybean seed yield27. Sowing date (early vs. late) has also been reported as a risk factor for pest infestation in various crops and US regions28. Early sowing in cold and wet soil can increase the risk for pest infestation and yield reduction4. In early and medium sown trials concurrent FST + NST use resulted in 0.06 and 0.1 Mg/ha greater yield than UTC seeds, respectively, whereas no yield benefit was observed in late sown fields across the entire region (Fig. S5). When repeating the analysis by cluster × sowing window, in only half of the early and one fourth of the medium sown clusters FST + NST use resulted in greater yield (between 0.07 to 0.12 Mg/ha) than UTC seeds (Fig. S6).
The results in our study show an environmental- and management-specific soybean seed yield response due to the use of neonicotinoid seed treatments. In general terms, these small yield benefits call into question the economic return on investment of prophylactic applications of neonicotinoid seed treatments. Partial economic analysis of the observed yield increases under 294, 404, 514, 625, and 735 $/Mg soybean price scenarios at 250,000, 350,000, and 450,000 seeds/ha seeding rates showed that both FST and FST + NST seed should not cost more than UTC seed (Fig. 4). For all price scenarios, breakeven cost of FST + NST was significant only at 350,000 seeds/ha (P = 0.034). Hypothetically, a higher treatment cost would be justified if soybean prices were greater than 735 $/Mg. However, this is extremely unlikely; the average monthly soybean price during the last 10 years was 472 $/Mg and the maximum price has never reached this threshold (maximum of 684 $/Mg in Aug 2012, a year when drought impacted many states in the soybean-growing region)29.
The lack of consistent yield benefits attributable to NST, coupled with mounting reports of potential environmental risks, highlight that the current default approach of prophylactic applications of NST in soybeans in the US should be re-evaluated. Adjusting other soybean management practices, such as sowing date, row spacing and seeding rate, appear to have a greater potential to increase soybean yields across the entire examined region compared to neonicotinoid use26,27. Such practices represent a net-zero environmental burden compared with the prophylactic use of neonicotinoid treated seeds. IPM, a decision-making process based on scientific data to identify and reduce both yield limiting risks from pests and from pest-management related strategies, can be followed as an alternative to some extent. Although sporadic yield limiting pests are difficult to predict in advance, our data demonstrate that yield-limiting populations of these pests are uncommon across our growing region and that current use rates of NST are likely to far outpace their utility for soybean pest management. This observation is supported by previous analyses9, and by recent reviews of the prevalence and population dynamics of soybean insect pests across the region4,5.
In response to heightened concerns about the non-target effects of NST use in annual crops, the European Commission restricted the use of clothianidin, imidacloprid and thiamethoxam neonicotinoid insecticides. Initially a moratorium, these restrictions were renewed in 2018 and expanded to a complete ban on all outdoor uses of the compounds in 201830. The restriction in neonicotinoids initially resulted in the use of alternative insecticide seed treatments or foliar applications by farmers31. Thus, an important issue is the anticipated response of farmers to a similar use restriction in the US. Such action may lead to increased use of alternative treatments and products which in turn, can result in different environmental issues. Our data provide some measure of security for soybean producers and other agricultural professionals that pest pressure is low across the key soybean-growing regions of the US. This provides empirical data for researchers, regulators, and seed sales staff to inform producers about the likelihood of measurable pest management and yield benefits associated with NST use, and we can infer that other, similar pest management approaches would be equally unnecessary in the absence of pests. This affords the industry an opportunity for a correction where NST use rates align more closely with pest incidence and risk factors. Given the demonstrable non-target issues associated with the current approach to NST use, we argue that this correction is not only advisable, but necessary if these pest management tools are to be preserved for occasions where they can provide benefit.
Our analysis, spanning 12 years and 14 soybean-producing states, provides no empirical support for continuing the current approach of blanket NST use in soybeans. On the contrary, our data suggest that this approach provides little to zero net benefit in most cases, and that meaningful (i.e. significant) gains are likely to be realized by site-specific management practices, independent of NST use. Although we do not have site-specific pest data to identify the mechanisms behind our lack of observed pest management benefits, our results are given context by historical data that reflect the scarcity of soybean pests targeted by this approach. This means that throughout most soybean-producing regions of the US, the period of pest protection provided by NSTs does not align with economically significant pest populations. Absent economic infestations of pests, there is no opportunity for this plant protection strategy to provide benefit to most producers.
Soybean seed yield data from 194 randomized and replicated field studies, which were conducted specifically to evaluate the effect of seed treatments on soybean seed yield at sites within each of 14 states from 2006 through 2017, were assembled for this study. To include an individual experiment in the combined database, presence of replicated and randomized neonicotinoid seed treatments was essential. The final database included 11,146 plot-specific soybean seed yields. For all experiments, soil pH and information about nine major management practices, including irrigation, sowing date, cultivar maturity group, tillage operations, previous year crop, row spacing, seeding rate, double crop system, and manure application were recorded.
For each study, weather data were obtained from the PRISM dataset32. Weather variables included daily minimum and maximum temperatures (Tmin and Tmax, respectively), and precipitation. In all studies, sowing date as day of year was set to zero and the 30-d specific weather conditions, beginning 30-d before sowing (DBS) up to 150 days after sowing (DAS), and season-wide (0–150 DAS) were calculated.
Since individual experiments were located in different regions, the effect of environment on soybean yield was assumed to be significant. Therefore, to account for non-management-related effects on yield, cluster analysis was used to stratify experiments into similar growing environments based on soil pH and the aforementioned weather variables. Additionally, to enhance the clustering model, cumulative precipitation from sowing to 60 DAS, from sowing to 90 DAS, from sowing to 120 DAS, and use of irrigation were included as independent variables. Finally, coordinates (latitude and longitude), and sowing date were also included in the model to capture additional non-weather-related information (e.g., photoperiod). Variables were then standardized to mean = 0 and standard deviation = 1 and clusters were created using PROC FASTCLUS in SAS 9.4 (SAS Institute Inc., 2016). In this method, the iterative algorithm minimizes the sum of squared distances from the cluster means. The clustering is done using Euclidean distances computed from numeric variables. This kind of clustering method is often called a k-means model, since the cluster centers are the means of the observations assigned to each cluster. In each iteration, the least-squares criterion is reduced until convergence is achieved. We used adaptive training by using the DRIFT option in which the cluster seed is updated as the current mean of the cluster each time an observation is added. We specified LEAST = 2 which minimizes the root mean square difference between the data and the corresponding cluster means. Using canonical analysis, visual evaluation of the clusters showed a high degree of separation and small overlap among the clusters (Fig. S7).
In the first analysis, a multilevel model, as described previously33, was used in PROC MIXED in SAS 9.4 to quantify the effect of seed treatments on soybean seed yield across clusters and the nine major aforementioned management practices. The seed treatment variable was used as a fixed effect and included three levels: fungicide only (FST), fungicide + neonicotinoid insecticide (FST + NST), and untreated control (UTC). The stratification of environments and management practices were introduced in the model as random effects. For management practices, continuous variables (sowing date, seeding rate, cultivar maturity group, and row space) were transformed to categorical. Sowing date and seeding rate had three levels, (early, medium, and late sowed fields and sparse, medium, and dense sowed, respectively) that corresponded to three percentiles (<30th, 30th to 70th, and >70th). The median was used to create two levels for maturity group whereas for row spacing, two spacings were used across all studies (38 and 76 cm). Then, a combined management practice variable (mgm) was created as a nine-way combination of the levels of the nine recorded management practices. Thus, random effects included clusters, experiments within clusters, replication nested within experiments and clusters, the seed treatment nested within replications, mgm, the seed treatment nested within mgm, and the seed treatment nested within mgm and clusters. Degrees of freedom were calculated using the Kenward-Rodger approximation, 95% confidence limits were calculated, and the adjdfe = row and adjust = simulate adjustments were used for multiple pairwise means comparisons at 5% confidence level. These adjustments were used to take into account the fact that observations are not equal at all levels of the independent variables and thus, degrees of freedom are subject to variability.
When the analysis was repeated for seed treatments separated by active ingredient, the fixed effect variable had six levels: fungicide only, fungicide plus thiamethoxam (application rate range: 0.0756 to 0.1512 mg. a.i. per seed.), fungicide plus imidacloprid (application rate range: 0.10 to 0.2336 mg. a.i. per seed), fungicide plus clothianidin (application rate range: 0.081 to 0.13 mg. a.i. per seed), fungicide plus both imidacloprid and clothianidin (application rates: 0.1013 mg a.i. per seed and 0.1056 mg a.i. per seed, respectively), and an untreated control (UTC). All fungicides were applied according to labeled rates. The aforementioned model was used for this analysis.
To assess the seed treatment-related yield differences within each cluster, random effects included experiments, replication nested within experiments, the seed treatment nested within replications, mgm, and the seed treatment nested within mgm. The same model was also used when the analysis was repeated for seed treatments separated by active ingredient.
In our study, the levels of the nine major management practices were not replicated or randomized across all individual experiments. Therefore, evaluation of the levels of individual management practices with the greatest effect on seed treatment performance using traditional linear models (e.g., analysis of variance, multiple linear regression) are not appropriate. Consequently, we used the conditional inference regression trees methodology, within the “partykit” package in R (R development Core team, 2016). To evaluate which management practices had the greatest impact on the effectiveness of insecticide only and FST + NST, in every individual experiment (n = 194) and for every nine-way management combination, we calculated the following respective yield differences: FST + NST minus FST and FST + NST minus UTC. In these analyses, the criterion for the independence test was based on a univariate p-value of alpha = 0.01. Additionally, to ensure adequate power at all steps, each intermediate node had to account for >25% of total observations and a terminal node had to consist of >10% of total observations. To avoid overfitting and enhance interpretability, the maximum tree depth was set to 5 nodes.
For the partial economic analysis, yield in every plot in every trial with seeding rate of 250,000, 350,000, and 450,000 seeds/ha were converted to profit for five soybean price scenarios: 294, 404, 514, 625, and 735 $/Mg. Then, the profit for each scenario (seeding rate × seed treatment (FST, FST + NST, UTC) × soybean price) was used as dependent variable in a mixed model analysis as was described earlier.
Douglas, M. R. & Tooker, J. F. Large-scale deployment of seed treatments has driven rapid increase in the use of neonicotinoid insecticides and preemptive pest management in U.S. field crops. Environ. Sci. Technol. 49, 5088–5097 (2015).
USGS. Estimated Annual Agricultural Pesticide Use (accessed at, https://water.usgs.gov/nawqa/pnsp/usage/maps/show_map.php?year=2014&map=THIAMETHOXAM&hilo=L) (2014).
Fernandez-Cornejo, J. et al. Pesticide use in US agriculture: 21 selected crops, 1960–2008. Economic Information Bulletin 124. USDA Economic Research Service, Washington, DC (2014).
Hesler, S. L., Allen, C. K., Luttrell, R. G., Sappington, T. W. & Papiernik, S. K. Early-season pests of soybean in the United States and factors that affect their risk of infestation. Journal of Integrated Pest Management. 9(1), 19, https://doi.org/10.1093/jipm/pmx028 (2018).
Papiernik, S. K., Sappington, T. W., Luttrell, R. G., Hesler, L. S. & Allen, K. C. Overview: Risk Factors and Historic Levels of Pressure From Insect Pests of Seedling Corn, Cotton, Soybean, and Wheat in the United States. Journal of Integrated Pest Management, 9(1), 1, 18, https://doi.org/10.1093/jipm/pmx026 (2018).
Krupke, C. H. et al. Assessing the value and pest management window provided by neonicotinoid seed treatments for management of soybean aphid (Aphis glycines Matsumura) in the Upper Midwestern United States. Pest. Manag. Sci 73, 2184–2193, https://doi.org/10.1002/ps.4602 (2017).
Ragsdale, D. W., Landis, D. A., Brodeur, J., Heimpel, G. E. & Desneux, N. Ecology and management of the soybean aphid in North America. Annual review of entomology 56, 375–399, https://doi.org/10.1146/annurev-ento-120709-144755 (2001).
Gaspar, A. P., Marburger, D. A., Mourtzinis, S. & Conley, S. P. Soybean seed yield response to multiple seed treatment components across diverse environments. Agron. J. 106, 1955–1962 (2014).
Myers, C. M. & Hill, E. Benefits of neonicotinoid seed treatments to soybean production. United States Environmental Protection Agency: The Biological and Economic Analysis Division (2014).
De Bruin, J. L. & Pedersen, P. Soybean seed yield response to planting date and seeding rate in the upper Midwest. Agron. J. 100, 696–703 (2008).
Gaspar, A. P., Mitchell, P. D. & Conley, S. P. Economic risk and profitability of soybean fungicide and insecticide seed treatments at reduced seeding rates. Crop Sci. 55, 924–933 (2015).
Bonmatin, J. M. et al. Environmental fate and exposure; neonicotinoids and fipronil. Environ. Sci. Pollut. Res. 22, 35–67 (2015).
Sánchez-Bayo, F. et al. Are bee diseases linked to pesticides? - A brief review. Environ. Int. 89–90, 7–11 (2016).
Long, E. Y. & Krupke, C. H. Non-cultivated plants present a season-long route of pesticide exposure for honey bees. Nature communications 7, 11629 (2016).
Krupke, C. H., Holland, J. D., Long, E. Y. & Eitzer, B. D. Planting of neonicotinoid-treated maize poses risks for honey bees and other non-target organisms over a wide area without consistent crop yield benefit. Journal of Applied Ecology 54(5), 1449–1458 (2017).
Whitehorn, P. R., O’Connor, S., Wackers, F. L. & Goulson, D. Neonicotinoid pesticide reduces bumble bee colony growth and queen production. Science 336, 351–352 (2012).
Woodcock, B. A. et al. Impacts of neonicotinoid use on long-term population changes in wild bees in England. Nat. Commun. 7, 12459 (2016).
Pecenka, J. R. & Lundgren, J. G. Non-target effects of clothianidin on monarch butterflies. Sci. Nat. 102, 1–4, https://doi.org/10.1007/s00114-015-1270-y (2015).
Hoshi, N. et al. Insight into the mechanism of reproductive dysfunction caused by neonicotinoid pesticides. Biol. Pharm. Bull. 37, 1439–1443 (2014).
Gibbons, D., Morrissey, C. & Mineau, P. A review of the direct and indirect effects of neonicotinoids and fipronil on vertebrate wildlife. Environ. Sci. Pollut. Res. 22, 103–118 (2015).
Van Dijk, T. C., Van Staalduinen, M. A. & Van der Sluijs, J. P. Macro-Invertebrate Decline in Surface Water Polluted with Imidacloprid. PLOS ONE 8(5), e62374 (2013).
Pisa, L. W. et al. Effects of neonicotinoids and fipronil on non-target invertebrates. Environ. Sci. Pollut. Res. 22, 68–102 (2015).
Chagnon, M. et al. Risks of large-scale use of systemic insecticides to ecosystem functioning and services. Environ. Sci. Pollut. Res. 22, 119–134 (2015).
USDA-NASS. Economics, Statistics and Market Information System (accessed at, http://usda.mannlib.cornell.edu/MannUsda/viewDocumentInfo.do?documentID=1943.) (2018).
Lewis, W. J., van Lenteren, J. C., Phatak, S.C., & Tumlinson, J. H. A total system approach to sustainable pest management Proceedings of the National Academy of Sciences, 94(23) 12243–12248, https://doi.org/10.1073/pnas.94.23.12243 (1997).
Edreira, R. J. I. et al. Assessing causes of yield gaps in agricultural areas with diversity in climate and soils. Agricultural and Forest Meteorology 247, 170–180 (2017).
Mourtzinis, S. et al. Sifting and winnowing: analysis of farmer field data for soybean in the US North-Central region. Field Crops Research 221, 130–141 (2018).
Sappington, T. W., Hesler, L. S., Allen, K. C., Luttrell, R. G. & Papiernik, S. K. Prevalence of sporadic insect pests of seedling corn and factors affecting risk of infestation. Journal of Integrated Pest Management 16, 1–27 (2018).
Indexmundi. Soybean commodity prices (accessed at, https://www.indexmundi.com/commodities/?commodity=soybeans&months=120) (2019).
Europa. Policies, information and services – Pesticides (accessed at, https://ec.europa.eu/food/plant/pesticides_en) (2018).
Kathage, J., Castanera, P., Alonso-Prados, J. L., Gomez-Barbero, M. & Rodriguez-Cerezo, E. The impact of restrictions on neonicotinoid and fipronil insecticides on pest management in maize, oilseed rape and sunflower in eight European Union regions. Pest Manag. Sci. 74, 88–99 (2018).
PRISM Climate Data, Oregon State University (accessed at, http://prism.oregonstate.edu) (2019).
Bell, A. B., Ene, M., Smiley, W. & Schoeneberger, J. A. A Multilevel Model Primer Using SAS® PROC MIXED. SAS Global Forum. Statistics and Data Analysis. Paper 433 Accessed at: http://support.sas.com/resources/papers/proceedings13/433-2013.pdf (2013).
The authors declare no competing interests.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.