Article | Open | Published:

Warning signals of biodiversity collapse across gradients of tropical forest loss

Abstract

We evaluate potential warning signals that may aid in identifying the proximity of ecological communities to biodiversity thresholds from habitat loss—often termed “tipping points”—in tropical forests. We used datasets from studies of Neotropical mammal, frog, bird, and insect communities. Our findings provide only limited evidence that an increase in the variance (heteroskedasticity) of biodiversity-related parameters can provide a general warning signal of impending threshold changes in communities, as forest loss increases. However, such an apparent effect was evident for amphibians in the Brazilian Atlantic Forest and Amazonian mammal and bird communities, suggesting that impending changes in some species assemblages might be predictable. We consider the potential of such warning signs to help forecast drastic changes in biodiversity.

Introduction

Our scientific capability to predict abrupt changes in nature—such as from disease epidemics, earthquakes, and insect-plagues—is limited, and this can have serious consequences for human wellbeing1. The ecological threshold concept is generally defined as a point where even small changes in environmental conditions will lead to large changes in the state of a system—frequently termed a “tipping point”2,3,4. This concept is useful for guiding decisions made on relatively short timescales and in human-impacted systems. Further, the concept is particularly useful for setting regulatory limits and defining conservation actions involving societal choices and negotiation of values and aims2,5.

Changes in environmental conditions can lead to a drastic, nonlinear loss of biodiversity at a threshold of vegetation loss. This could arise from several underlying mechanisms5,6,7,8. For example, thresholds may originate from species having synchronous responses to habitat loss and fragmentation, such as shrinking forest patch size and increasing isolation, exacerbating Allee effects or breakdowns in mutualisms6,7,9. These nonlinear effects of habitat loss and fragmentation on population abundances can cause dramatic shifts in community composition when disturbances surpass a level that the community can no longer tolerate. Another potential mechanism that may affect populations and communities is habitat change feedbacks and cascade effects. For instance, fragmentation may degrade the canopy structure of tropical forests, increasing light penetration, leading to grass recruitment10,11. Increased grass abundance can then facilitate fires that subsequently kill fire-sensitive forest trees, causing a feedback loop and abrupt community changes12.

Because of the expected consequences of rapid biodiversity loss and the mechanisms exacerbating those consequences, the detection of biodiversity thresholds along forest loss and landscape modification gradients has considerable value for science and conservation. Threshold identification is especially pertinent given the recent catastrophic declines in wilderness areas around the world, particularly those in tropical forests13. Detecting warning signals before biodiversity thresholds are surpassed could give conservationists time to act, thereby potentially lessening the extent of negative impacts on biodiversity.

Here, we evaluate potential warning signals that may aid in identifying community proximity to biodiversity thresholds as a response to forest cover loss and fragmentation in the Neotropics. Our identification of threshold proximity is based on the general theoretical idea that a broad class of systems shows “critical slowing down” when nearing a threshold (i.e., systems become slower in recovering from small perturbations which may result in a great variability of trajectories in biodiversity responses among fragments)3,14,15. Moreover, deforestation may decrease population sizes and increase the influence of stochastic processes. This may in turn lead to an increase in beta diversity among fragments as forest loss increases16,17. As such, we might detect anomalies, such as increased autocorrelation and variance, in biodiversity-related metric values prior to reaching thresholds in response to increasing forest loss15,18.

We focused on heteroskedasticity of biodiversity measures as a potential warning signal of collapse (Fig. 1), because heteroskedasticity is related to greater variance in a system and is simple to calculate and extract from all measures of diversity, including richness and incidence. Heteroskedasticity of biodiversity measures is also one of the better indicators of warning-signals as it is known to minimize false-positive signals due to the inclusion of thresholds, and its use has been validated across a variety of ecological systems18. In addition, we explore the possibilities and challenges of using warning signals and threshold information in the context of monitoring different animal groups along gradients of tropical forest loss.

Figure 1
figure1

Hypothetical path towards a biodiversity threshold as forest loss increases including increasing heteroskedasticity as a potential warning signal of biodiversity before the threshold.

We compiled data from recent Neotropical research papers that documented thresholds for mammal, frog, bird, and insect communities due to forest loss in a variety of forest types and metrics5,19,20,21. We recalculated the threshold values obtained by the original studies in a standardized way using piecewise regression analyses and we focused on identifying trends in heteroskedasticity before these thresholds were reached. We then fitted linear mixed models and linear models to these data and estimated the heteroskedasticity for the subset of data before the thresholds. We selected the residual values before the thresholds to avoid the effect of the abrupt change in the calculation of heteroskedasticity (see Methods).

Results

All piecewise regression models converge to a threshold value. However, some were different from the value reported by the authors of the original studies. More precisely, the threshold values provided by authors for Brazilian Atlantic forest birds, and Amazonian mammals and birds were higher than the confidence interval of our thresholds (Af: Authors: 70.61% of habitat loss, our study: 77.58% ± 3.61 s.e.; Am mammals and birds: Authors: 51.58%, our study: 64.17 ± 2.13; Fig. 2a). Although the significance of these differences was not assessed, the estimated standard error was small for all thresholds, ranging from 2.13 for Amazonian mammals and birds to 8.17 for bats. Despite our results not agreeing with those reported in the original papers, likely due to differences in the regression models used and in the iterative fitting procedure to estimate model parameters, we opted to use our calculated threshold values since our method was consistent among studies.

Figure 2
figure2

Absolute residuals of regressions of biodiversity metrics and forest loss. According to our hypothesis as deforestation progresses, diversity should increasingly fluctuate until it reaches a threshold point where biodiversity suffers a major collapse. Consequently, absolute residuals in a model of diversity, when examined per unit forest loss, should increase close to the threshold. (a) Thresholds detected for different groups along a gradient of habitat loss in the Neotropical region; Absolute residual value for the subset of data before the thresholds for (b) Amazonian aquatic insects21; (c) Cerrado-forest bats20; (d) Amazonian mammals and birds19; (e) Atlantic Forest mammals5; (f) Atlantic Forest pooled groups5; (g) Atlantic Forest amphibians5; and (h) Atlantic Forest birds5. Black lines show significant relationships (P < 0: 05;F-test) (see Methods). AF – Atlantic Forest; Am – Amazonian.

Most piecewise regressions showed a trend similar to that observed in the original publications; an initial decline in diversity with forest cover, followed by a sudden decrease after a certain level of forest loss. However, the dataset on bats showed an increase in richness with increase forest loss until it reached a threshold. The same pattern can be observed in the original article. Lastly, the study on aquatic insects showed that beta-diversity decreases with increased forest cover, which increases when vegetation cover goes beyond the threshold. In summary, although our results showed some differences in trends along forest loss gradients, all showed clear thresholds.

Overall, there was no significant increase in heteroskedasticity with proximity to the threshold (χ² = 3.35, d.f. = 2, p = 0.19), suggesting it has limited use as a standard tool for forecasting biodiversity collapse due to forest loss. However, amphibians in the Atlantic Forest (Fig. 2d), and mammals and birds in the Amazon (Fig. 2g) did display evidence of increasing heteroskedasticity close to the threshold as we expected.

Discussion

Threshold studies have previously been undertaken on a variety of taxa, responses, habitat types, landscape types and spatial scales5,19,20,21,23. The findings of these studies do not reach a clear consensus, and they are limited in number, restricting our ability to provide a general understanding of the mechanisms underlying the processes. Our findings provide only limited evidence that heteroskedasticity of biodiversity-related parameters can provide a general warning signal of impending threshold changes in communities along forest loss gradients. However, an apparent effect of increasing variance associated with threshold was evident for amphibians and for mammal and bird communities, suggesting that impending changes in some species assemblages might be predictable.

Amphibians, mammals and birds have been reported to be sensitive to landscape changes. Moreover, several species are known to be dependent on particular forest habitats10,22,23,24. However, their responses before a threshold have not been previously documented. We believe that increased heteroskedasticity near the threshold implied population instability. This instability might be a result of declining forest patch size and increased patch isolation. These changes in forest patches may have lasting effects on the population, exacerbating density dependent effects and increasing extinction risk for local populations. Furthermore, these changes may lead to decreased population sizes in fragments. If that were to occur, population size may also vary more within and among patches, potentially resulting in some local extinctions. These mechanisms could imprint variability in the alpha and beta diversity of some groups before a collapse17, such as we detected in the community composition of amphibians (occurrence data) in Atlantic Forest and the species richness for mammals and birds in the Amazon; both metrics whose sentitivity depends on the dynamic of local extinctions.

Our results have several implications for biodiversity conservation and monitoring in tropical forests. First, although the lack of replication within taxonomic groups prevent any generalization about context-dependent responses, our results do not support the idea that decreasing forest cover had a similar effect on different communities. Therefore, when proximity to a threshold is identified for a group, conservationists and managers should act rapidly to prevent the attainment of the extinction threshold in that specific group. This is a valid message even in cases where the mechanisms behind the warning signals are not clearly understood, because stopping forest loss around a threshold value is clearly valuable as a management practice.

Second, when dealing with multiple animal groups in an area, the focus should be given to the groups with the earliest threshold values. For example, aquatic insects reach community threshold responses at approximately 10% of forest loss while mammals do not display a similar response until near 60% (Fig. 2). So, one can use, for example, the response of aquatic insects as an early signal of biodiversity loss in response to the level of forest cover, even if there are no clear ecological relationships among different groups.

Third, thresholds of sensitive groups may be used to anticipate the response of other communities, though this method is yet to be proven as consistent among different geographic regions. For instance, an animal group may display different thresholds in different regions, thus being a useful indicator in one region where that threshold has been determined but not in another where it is yet to be examined. In this regard, we identified that Amazonian mammals and birds had much lower thresholds to forest loss than their Atlantic Forest counterparts (Fig. 2). This lower threshold could be related to the longer history of defaunation in the Atlantic Forest where even big forest patches are in fact largely empty of large mammals, such as jaguars, lowland tapirs, and white-lipped peccaries25. However, it still unclear if the sequence of threshold attainment by different animal groups is consistent across different regions. If this sequence is consistent, it would be a valuable and as yet untapped area of research on indicators of tropical forest loss. If proven to be true, for instance, the sequential thresholds among groups in the tropical forest could be caused by complex mechanisms linking them, such as species operating over a broad range of scales and cascade effects among dependent groups through ecological networks26.

Our study explored just one possible signal that could warn of an approaching threshold of community diversity. However, many other potential variables may exist including a direct measure of “critical slowing down” in a process, and transitioning between alternate states of a system14,15. Moreover, the sensitivity of different biodiversity metrics (e.g., richness, composition) as identifiers of thresholds is an almost unexplored topic. As our main focus here was to examine the practicality and ubiquity of heteroskedasticity as an indicator of a community warning signal, we explored the metrics already reported in the data of the underlying papers. However, it is important to consider two aspects. First, our results showed that the trends of some metrics along the gradient of forest loss vary according to the groups. For example, the richness of bats showed a positive response to native vegetation loss after the threshold while amphibians showed a gradual decline in richness. This finding suggests that solely evaluating a general trend of a metric may not adequately inform of a coming threshold. Second, the detectability and level of thresholds for different community metrics is a controversial issue. Although the majority of studies to date do not explore the sensitivity of different metrics, three cases can exemplify our point. Based on data from Atlantic Forest, Banks-Leite et al. documented that different community metrics for mammals, birds and amphibians showed similar patterns of thresholds5. However, in Amazonian streams, the threshold value was near 90% for compositional data (abundance) of aquatic insects, and below 20% (highly uncertain) for richness. Another study with aquatic insects in Brazilian savanna streams detected a threshold value around 50% for composition (abundance) but has failed to corroborate the threshold hypothesis using richness27. So, metrics that detected changes in the identity and abundance of species seem to be more sensitive to gradients of habitat loss than those based on richness which is more suceptible to compensatory mechanisms, such as substitution and invasions. Third, most studies on thresholds have focused on classic community metrics. We believe new avenues should be explored. For instance, different metrics from those used here, such as ecological network analysis or population parameters of sensitive species (e.g., movement behavior), could also be used to identify useful surrogates with which to detect thresholds and early signals of community collapse. Irrespective of the metric used, for threshold identification, research into the prediction of community thresholds will require substantial sampling, and a thorough understanding of the examined community. A particular challenge to this approach is that the availability of such data for the highly diverse and often under-studied tropical ecosystems along an entire gradient of forest loss is at present very limited.

Historically, most research on warning signals and thresholds have been focused on the temporal dimension. In our approach, we used a classic idea in ecology of considering a gradient in space to represent differences in time. These snapshots of biodiversity along a spatial gradient offer unique advantages for evaluating warning signals as they do not require intensive time series data which is rare in tropical community ecology28. However, neglecting the time since the habitat loss and fragmentation occurred could result in ineffectively identifying the thresholds and warning signals among different groups because extinctions follow deforestation may not occur immediately29. The fact that we detected warning signals for amphibians but not for mammals in the datasets from Atlantic Forest exemplifies this point. Considering that all habitat patches in this study were composed of a patchwork of secondary vegetation and that mammals and amphibians could differ in their extinction debt27, one would expect that the metrics of mammal and amphibian communities would show warning signals along a spatial gradient in different moments—a phenomenon which is extremely difficult to detect with snapshot survey approaches. In addition, most researchers argue that extinction debt is paid faster in extremely small size habitat remnants and is therefore a scale dependent phenomenon30. This finding calls for caution when comparing data based just on the percentage of remnant patches left in a landscape as this may mask functional effects in the remnant patches based on size and conditions. For example, we detected warning signals for mammals and birds in the Amazonian data which were collected in a natural landscape recently converted to pasture that still keep remnants of primary forest. Conversely, we did not find signals in the mammal community in data from the Atlantic forest, a region with a long history of land changes. In this way, we could imagine ghost (historic) warning signals experienced by the Atlantic Forest mammal community becoming no longer detectable. Thus, long-term biodiversity monitoring along entire gradients of forest loss at multiple scales may provide powerful insights into the spatial-temporal dynamics of thresholds and warning signals in tropical systems.

Sensitivity to changes, and the ability to detect system instability are critical aspects in determining a useful indicator in the context of the practical application of thresholds and warning signal information in forest monitoring. As positive data about thresholds is needed to test the prediction of warning signals and it is probable most studies in this area suffer from selective reporting31, using our analyses we could not go further in proposing community metrics for detecting thresholds without bias, though we may propose steps for selecting them. Considering that different metrics vary in their sensitivity to identify thresholds along forest loss gradients and, as we demonstrated here, not all variables that show thresholds also show a warning signal, we suggest a filtering process for selecting potential indicators of warning signals. First, one should evaluate the sensitivity of different community metrics (richness, beta diversity, so on) along a forest loss gradient and select those that respond clearly to the gradient. Second, potential thresholds along gradients should be evaluated for efficacy. Finally, one should evaluate the potential warning signals before approaching thresholds as we did or using other methods32. In summary, instead of looking for universal indicators, we believe that applying a filtering process is a more promising avenue for selecting effective warning signal indicators.

Despite future research challenges and a lack of clear, ubiquitous warning signals for all examined faunal guilds (which does not support the idea of a ubiquitous mechanism operating before threshold, such as the manifestation of critical slowing down), our findings support the identification of threshold responses as a potentially relevant future managerial tool for specific groups. While, the underlying mechanism is unlikely to be ubiquitous across numerous animal groups, our work supports the general message that while reducing habitat loss should remain a top priority for conservation planners6, the level of habitat loss at which communities can still be self-sustaining may be context and taxon specific.

Methods

For each dataset we used, we recalculated diversity thresholds using a piece-wise regression33,34, following the procedure described by the authors in their original articles. In these regressions, the effect of deforestation on diversity was modelled, but we assumed there was a breakpoint in this relationship. This breakpoint represents a threshold in biodiversity, a point from which diversity decreases faster with deforestation. Piecewise regression estimates this point together with regression before and after it. We used the same measure of diversity that the authors used to detect these thresholds, as follows: composition of Amazonian aquatic insects21; richness of bats in Cerrado-Forest20; community composition of Amazonian mammals and birds19; community composition of Atlantic Forest mammals and bird5; community composition of Atlantic Forest (pooled groups)5; community composition of Atlantic Forest amphibians5; and community composition of Atlantic Forest birds5. “Community composition”, originally named “integrity” in Banks-Leite et al.5 is calculated as the Sorensen distance in species composition when comparing a community with no habitat fragmentation to that of the current community. All studies had vegetation cover as one of their independent variables, i.e. the percentage of the area that was not deforested. When comparing forest fragments with different levels of deforestation, all authors reported changes in their respective measures of diversity, with a clear threshold.

Once we recalculated the threshold values obtained by the original studies, we discarded data where deforestation levels were above the threshold since our interest was in measuring heteroskedasticy before the threshold. We then calculated the absolute standard residuals from the remaining data and pooled the absolute residuals from all models. Using standard residuals, guaranteed that the residuals will not be affected by the scale of the variable. Using absolute values implies that both negative and positive residuals represent heteroskedasticity. This pooled residuals variable was used as a reponse variable in the linear mixed model. In this model, standard residuals (residuals divided by their standard error) were the response variable, distance to threshold was a fixed independent variable and dataset was an independent random variable. To fit the model, we used a Nelder Mead optimization mechanism in the lme4 package in R35,36. To make inferences, we compared the previous model with a null model using an ANOVA. The null model was similar to the calculated model but did not contain distance to the threshold as a variable. If this model was significant, it indicates that residuals increase with proximity to threshold, and thus that heteroskedasticty increases with proximity to threshold.

We also examined each dataset separately, in addition to pooling them in the same model. For that, we again used the standard residuals obtained from a piecewise model. We then applied a linear regression for each dataset (Table 1). In all regressions, we used distance to the threshold as the independent variable. Residuals (as detailed below) were our target dependent variable; however, significance seems dependent on how residuals were transformed to a heteroskedasticty metric. Since we had no prior reason to prefer one transformation over another, we tested these using the three most common transformations: absolute residuals, squared residual (analogous to the Breusch–Pagan test for heteroskedasticity37) and ranked residuals (analogous to spearman correlation). In total, 21 tests were conducted (7 data sets x 3 independent variables).

Table 1 The effect of threshold proximity on variance of diversity metrics. According to our hypothesis, deforestation should increase flunctuations in diversity measures until it reaches a threshold at which large diversity loss occurs. We measured variance as the residuals in a segmented regression model with diversity as the dependent variable and deforestation as the independent variable. These residuals were then regressed with proximity to threshold, after three different transformations (absolute, squared and ranked). We rejected the null hypothesis if any of the three transformation was significant. Datasets: Am aquatic insects21; bats20; Am mammals and birds19; AF mammals5; AF pooled groups5; AF amphibians5; AF birds5. AF – Atlantic Forest; Am – Amazonian.

Data Availability

The datasets generated and/or analyzed during the current study are available from the corresponding author on request.

Additional information

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. 1.

    Boettiger, C., Ross, N. & Hastings, A. Early warning signals: the charted and uncharted territories. Theor. Ecol. 6, 255–264 (2013).

  2. 2.

    Siding, K. N. & Hobbs, R. J. Threshold models in restoration and conservation: a developing framework. TREE 24, 271–278 (2009).

  3. 3.

    Scheffer, M. et al. Generic indicators of ecological resilience: Inferring the Chance of a Critical Transition. Annu. Rev. Ecol. Evol. Syst. 46, 145–67 (2015).

  4. 4.

    van Nes, E. H. et al. What Do You Mean, ‘Tipping Point’? TREE 31, 902–904 (2016).

  5. 5.

    Banks-Leite, C. et al. Using ecological thresholds to evaluate the costs and benefits of set-asides in a biodiversity hotspot. Science 345, 1041–1045 (2014).

  6. 6.

    Pardini, R. et al. Beyond the fragmentation threshold hypothesis: regime shifts in biodiversity across fragmented landscapes. PLoS One 5, 1–10 (2010).

  7. 7.

    Dakos, V. & Bascompte, J. Critical slowing down as early warning for the onset of collapse in mutualistic communities. PNAS 111, 17546–17551 (2014).

  8. 8.

    Lindenmayer, D. B. & Luck, G. A. Synthesis: thresholds in conservation and management. Biol. Conserv. 124, 351–354 (2005).

  9. 9.

    Villard, M. A. & Metzger, J. P. Beyond the fragmentation debate: a conceptual model to predict when habitat configuration really matters. J. Appl. Ecol. 51, 309–318 (2014).

  10. 10.

    Haddad, N. M. et al. Habitat fragmentation and its lasting impact on Earth’s ecosystems. Science Advances 1, e1500052 (2015).

  11. 11.

    Laurance, W. F. et al. Conservation: rainforest fragmentation kills big trees. Nature 404, 836–836 (2000).

  12. 12.

    Hoffmann, W. A. et al. Ecological thresholds at the savanna–forest boundary: how plant traits, resources and fire govern the distribution of tropical biomes. Ecol. Lett. 15, 759–768 (2012).

  13. 13.

    Watson, J. E. M. et al. Catastrophic declines in wilderness areas undermine global environment targets. Curr. Biol. 26, 2929–2934 (2016).

  14. 14.

    Dakos, V. et al. Resilience indicators: prospects and limitations for early warnings of regime shifts. Phil. Trans. R. Soc. B 370, 20130263 (2015).

  15. 15.

    Carpenter, S. R. et al. Early warnings of regime shifts: A whole- ecosystem experiment. Science 332, 1079–1082 (2011).

  16. 16.

    Chase, J. M. Community assembly: when should history matter? Oecologia 136, 489–498 (2003).

  17. 17.

    Pardini, R. et al. The role of forest structure, fragment size and corridors in maintaining small mammal abundance and diversity in an Atlantic forest landscape. Biol. Conserv. 124, 253–266 (2005).

  18. 18.

    Seekell, D. A., Carpenter, S. R. & Pace, M. L. Conditional heteroskedasticity as a leading indicator of ecological regime shifts. Am. Nat. 178, 442–451 (2011).

  19. 19.

    Ochoa-Quintero, J. M. et al. Thresholds of species loss in Amazonian deforestation frontier landscapes. Conserv. Biol. 29, 440–451 (2015).

  20. 20.

    Muylaert, R. L., Stevens, R. D. & Ribeiro, M. C. Threshold effect of habitat loss on bat richness in cerrado-forest landscapes. Ecol. Applic. 26, 1854–1867 (2016).

  21. 21.

    Brito, J. G. Comunidade de invertebrados aquáticos como ferramenta para avaliar o efeito do uso da terra sobre riachos da Amazônia Oriental, Brasil. (PhD dissertation), Manaus, AM: Instituto Nacional de Pesquisas da Amazônia (2016).

  22. 22.

    Vieira, M. V. et al. Land use vs. fragment size and isolation as determinants of small mammal composition and richness in Atlantic Forest remnants. Biol. Conserv. 142, 1191–1200 (2009).

  23. 23.

    Andrén, H. Effects of habitat fragmentation on birds and mammals in landscapes with different proportions of suitable habitat: a review. Oikos 71, 355–366 (1994).

  24. 24.

    Becker, C. G. et al. Habitat split and the global decline of amphibians. Science 318 (2007).

  25. 25.

    Jorge, M. L. S., Galetti, M., Ribeiro, M. C. & Ferraz, K. M. P. Mammal defaunation as surrogate of trophic cascades in a biodiversity hotspot. Biol. Conserv. 163, 49–57 (2013).

  26. 26.

    Elmqvist, T. et al. Response diversity, ecosystem change, and resilience. Fron. Ecol. Environ. 1, 488–494 (2003).

  27. 27.

    Rodrigues, M. E. et al. Nonlinear responses in damselfly community along a gradient of habitat loss in a savanna landscape. Biol. Conserv. 194, 113–120 (2016).

  28. 28.

    Carpenter, S. R. Spatial signatures of resilience. Nature 18, 308–309 (2013).

  29. 29.

    Wearn, O. R., Reuman, D. C. & Ewers, R. M. Extinction debt and windows of conservation opportunity in the Brazilian Amazon. Science 337, 228–232 (2012).

  30. 30.

    Hylander, K. & Ehrlén, J. The mechanisms causing extinction debts. Trends Ecol. Evol. 28, 341–346 (2013).

  31. 31.

    Parker, T. H. et al. Transparency in Ecology and Evolution: real problems, real solutions. Trends Ecol. Evol. 31, 711–719 (2016).

  32. 32.

    Kéfi, S. et al. Early Warning Signals of Ecological Transitions: Methods for Spatial Patterns. Plos One 9, e92097 (2014).

  33. 33.

    Muggeo, V. M. R. Package ‘segmented. Biometrika 58, 525–534 (2014).

  34. 34.

    Muggeo, V. M. R. Estimating regression models with unknown break–points. Stat. Med. 22, 3055–3071 (2003).

  35. 35.

    R Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing (2017).

  36. 36.

    Bates, D. et al. Fitting linear mixed-effects models using lme4. J. Stat. Soft. 67, 1–48 (2015).

  37. 37.

    Breusch, T. S. & Pagan, A. R. A Simple test for heteroskedasticity and random coefficient Variation. Econometrica 47, 1287–1294 (1979).

Download references

Author information

F.O.R., J.F.S.M., T.N., J.M.O.Q., M.J.C., W.F.L. participated in the formulation process of the idea for the study. J.F.S.M. performed data analysis. F.O.R. and J.F.S.M. led the writing. Authors participated in drafting the article or revising it critically for important intellectual content.

Competing Interests

The authors declare that they have no competing interests.

Correspondence to Fabio de Oliveira Roque.

Rights and permissions

Creative Commons BY

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.