Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

# A meta-analysis of the greenhouse gas abatement of bioenergy factoring in land use changes

## Abstract

Non-food biomass production is developing rapidly to fuel the bioenergy sector and substitute dwindling fossil resources, which is likely to impact land-use patterns worldwide. Recent publications attempting to factor this effect into the climate mitigation potential of bioenergy chains have come to widely variable conclusions depending on their scope, data sources or methodology. Here, we conducted a first of its kind, systematic review of scientific literature on this topic and derived quantitative trends through a meta-analysis. We showed that second-generation biofuels and bioelectricity have a larger greenhouse gas (GHG) abatement potential than first generation biofuels, and stand the best chances (with a 80 to 90% probability range) of achieving a 50% reduction compared to fossil fuels. Conversely, directly converting forest ecosystems to produce bioenergy feedstock appeared as the worst-case scenario, systematically leading to negative GHG savings. On the other hand, converting grassland appeared to be a better option and entailed a 60% chance of halving GHG emissions compared to fossil energy sources. Since most climate mitigation scenarios assume still larger savings, it is critical to gain better insight into land-use change effects to provide a more realistic estimate of the mitigation potential associated with bioenergy.

## Introduction

The rapid development of first generation biofuels such as ethanol and biodiesel, which use food crops as feedstocks, has become controversial in the last decade because of the unintended consequences of the underlying policies on food prices and land use worldwide. Biofuel expansion creates an additional demand for agricultural commodities which impacts global markets and may interfere with food security1. It also increases the overall pressure on agricultural land since the displacement of food crops by bioenergy crops not only leads to direct land use changes in the region where the feedstock is grown but also to indirect land use changes (iLUC) in other parts of the world, to compensate for the foregone production of food commodities2,3. Compensation may involve either an intensification of existing cropland, to increase the output of biomass per unit area, or the conversion of pastures, forests and peat land to arable land4. These consequences are usually associated with detrimental effects on the environment, such as increased emissions of GHG and biodiversity depletion from the conversion of natural ecosystems5. Even though they remain controversial because of the difficulty in tracking their occurrence6, indirect LUC effects are likely to reduce the potential benefits of biofuel chains, in particular regarding GHG emissions7.

Although review articles on this topic were recently published8,9, none of them involved a systematic survey of literature. As a consequence, it is difficult to derive consistent patterns for the effect of LUC on the GHG balance of bioenergy pathways because of differences in the methodology, scope or data sources used in individual studies10. Thus, there remains a large uncertainty of the magnitude of these effects, which hampers the policy processes around biofuels and their contribution to both the energy and climate transitions6,11.

This study aimed to alleviate the above-mentioned limitations by uncovering consistent trends via a novel, systematic review of scientific literature of LUC (whether direct or indirect) in relation to biomass development. A quantitative, meta-analysis approach was used to capture the relative differences in GHG intensity between the bioenergy chains and their fossil counterfactuals. Thus, the main focus of this study was the potential GHG abatement potential related to the substitution of fossil-based energy sources by their bio-based counterparts. This was quantified through the following effect size R in the meta-analysis: $$=\frac{Eb-Ef}{Ef}$$, where E f and E b corresponds to the life-cycle GHG emissions of the fossil and bio-based chains, respectively, expressed per unit of energy output (1 MJ). A negative R value implies lower GHG emissions for the bioenergy chain, where a value of −0.5 indicates a 50% reduction compared to the fossil reference. The effect size R was successively calculated for each scenario of the 50 articles with two different values of E f (i.e., Ef min and Ef max ; see Methods). Mean effect sizes were estimated from a dataset covering 50 articles by fitting mixed-effect models for different groups of scenarios corresponding to different bioenergy end-products (e.g., electricity or biodiesel), or to different types of LUC (e.g., conversion of forest to cropland).

## Results

The effect size R spanned a wide range, encompassing both situations with a very low GHG intensity of biomass compared to fossil fuels, and others with much larger emissions (Table 1). The overall medians stood at −0.59 and −0.65 with the minimum and maximum value of E f , respectively. Thus, bioenergy emitted less GHG than fossil fuels in more than half of the situations assessed. Bioenergy scenarios involving the conversion of forests had the lowest GHG abatement potential, with a median R value ranging from 0.57 to 0.84 – which indicates 157 to 184% larger emissions than fossil fuels (Fig. 1). All the other groups had negative R values on average, most of which were significantly lower than zero. The effect size was lowest for the “not forest”, “grassland”, and “bioelectricity” groups, followed by “second generation (2G) biofuels”. The estimated average effect size was lower than −0.5 for two groups of land use (“not forest” and “bioelectricity”), regardless of the E f value, and for three groups of bioenergy end-products (“bioelectricity”, “not forest” and “grassland”) with Ef min . However, R was significantly lower than −0.5 only for the “bioelectricity” group with Ef max (Fig. 1).

Second generation biofuels had higher GHG abatement potentials than their first generation counterparts, especially biodiesel whose potential was 40% lower than the “not biodiesel” group, overall. This difference was statistically significant (p < 0.05). The effect size estimated for the “forest” group was more than 100% higher than that estimated for the “not forest” group (Fig. 2). Conversely, the grassland had a significantly lower R estimate than the “not grassland” group. Differences between the “grassland” and “not grassland and not forest” groups (i.e., land use scenarios impacting neither grasslands nor forests) were smaller but statistically significant (Fig. 2), regardless of the fossil emissions E f .

Except for the groups “forest” and “1G”, most bioenergy scenarios abated GHG emissions by more than 50% (Figs 3, 4). In most of the groups, less than half of the bioenergy scenarios assessed did not achieve a 50% abatement potential relative to fossil fuels (i.e., had an R value exceeding −0.5); (Figs 3, 4). The two exceptions were the “forest” group where this fraction reached 70% (Fig. 3), and the “1G biofuel” group with the minimum value of E f (Fig. 4).

The logarithm of the odds ratio (ratio of the proportion of scenarios with a R > −0.5 to the proportion of scenarios with R < −0.5) estimated for the group “Forest vs. not forest” was significantly higher than zero. Thus, bioenergy scenarios not impacting forest ecosystems stood better chances of exceeding a 50% GHG abatement potential than those infringing on forests (Fig. 3). The proportions of scenarios with R > −0.5 (i.e., scenarios reducing emissions by less than 50%) were lower in the “2G biofuels” group than in their “1G” counterpart, and in the group “bioelectricity” compared to other types of energy (Fig. 4). The odds ratios indicated that differences were significant for “2G” vs. “1G” biofuels, and for “bioelectricity” vs. “not bioelectricity” (Fig. 4).

## Discussion

Effect sizes were sensitive to the values selected for the emissions of fossil chains (E f ), although the latter varied within a narrow range for liquid biofuels (Table 1). Shifting from the minimum value of E f to its maximum increased the fraction of bioenergy scenarios achieving a 50% GHG abatement from 55% to 62% (Figs 3, 4). For the “1G biofuel” group, this fraction was higher than 50% with Efmax but not with Efmin. This has important policy implications since the 50% reduction was made legally-binding in the EU and the USA12,13. It emphasizes the need for an accurate assessment of fossil counterfactuals, but also that the probability of certain bioenergy systems complying with these standards is mixed, at best.

Converting forests to biomass crops (whether annual or perennial) appeared as the worst-case scenario (Fig. 3), as could be expected from the differences in carbon pools between the two types of ecosystems, and has been emphasized by previous work14. We did not find any significant effect of oil palm on GHG savings (Fig. 3), which is not entirely consistent with primary studies on LUC effects14,15. Conversely, the fact that converting grassland was beneficial compared to converting other ecosystems (and in particular cropland and forests – Fig. 3) appears counter-intuitive, given that grasslands are generally deemed carbon-rich16,17 compared to cropland. However, some of these grasslands actually corresponded to degraded pastures with lower productivity and thus smaller soil C stocks than the latter land use. In terms of end-products, 2G biofuels and bioelectricity scenarios led to the highest GHG abatements (Figs 1 and 4). This reflects the higher energy-efficiency of these chains compared to liquid fuels5.

Although all the studies reviewed used the same system boundaries to account for life-cycle emissions, they resorted to a large variety of methods to assess the consequences of developing bioenergy. Global economic models were only explicitly mentioned in one article (out of 50) while about half of the references did not report a particular method to assess LUC, probably relying on literature data.

Simple methods were also used to account for market mechanisms such as the causal-descriptive approach, which establishes direct correspondences between direct and indirect LUC. Biophysical models18 can simulate the biogeochemical processes governing the GHG emissions related to LUC19, but were explicitly mentioned in only 10% of the studies. Indirect LUC were ignored in 40% of the bioenergy systems assessed, most of the time on the ground that biomass crops were grown on formerly unproductive land (eg, natural ecosystems or abandoned farmland). Although this ‘no iLUC’ assumption may be debated15, it did not significantly affect the effect size R: the estimated effect of iLUC inclusion was equal to – 0.12, its standard error was equal to 0.2 and the p value higher than 0.5. Separating between direct and indirect LUC effects proved impossible from the information presented in the articles, stemming from the fact that some methods (eg economic modelling) only provide a lumped result in terms of LUC14.

These differences in methodologies account for some of the uncertainty around the estimates of GHG abatement for a given bioenergy chain, in addition to local specificities and the types of LUC involved. For instance, economic models tend to result in larger GHG emissions from LUC than the other approaches18, and their results are sensitive to modelling assumptions and parameter settings20. Inter-comparison of models appears a first step to harmonize methods to assess iLUC and compare bioenergy chains on a similar basis21. A key hypothesis also lies in the time horizon during which the C losses incurred upon the conversion of ecosystems to agriculture are amortized. It typically ranges from 20 to 30 years, and has a straightforward effect on LUC-related emissions22. This information could be retrieved from all articles but one, with a wide overall range (from 2 to 119 years). Fitting a model relating our response variable R to the time horizon (expressed in numbers of years) did not reveal any significant effect of this variable (p value > 0.3). Its variations across studies may still explain the larger than average confidence intervals observed in the “forest” group, involving C-rich ecosystems. Another factor likely to affect life-cycle GHG accounting is the procedure used to deal with co-products, which is especially critical for 1G biofuels10. The substitution or system expansion method was predominant, with a 40% share, followed by allocation based on energy content (35%) or economic value (17%). Allocation methods had no significant effect on R values (p > 0.1; Supplementary Fig. 4).

Although the LUC literature is very recent and its methodologies evolve at a fast pace, no effect of the publication year on the outcomes of the studies could be evidenced (Supplementary Fig. 3). Thus, reducing the uncertainty on the climate benefits of non-food biomass development probably calls for methodological improvements and some degree of standardization, and a more widespread use of state-of-the-art modelling frameworks. This would enhance our understanding of the causal chain from biomass expansion to its impacts on climate, which is paramount to minimizing emissions from LUC and designing efficient bioenergy chains. Land-use models often attribute a larger than 50% GHG abatement potential for bioenergy, with numbers in the 70–90% range for second-generation biofuels or bioelectricity19,23. Integrated Assessment Models, which are used to derive socio-economic pathways and emission trajectories to meet given climate targets often even consider bioenergy carbon neutral altogether24 – translating as an effect-size of −1.0 here. Although these models may factor in indirect LUC effects, their assessment of bio-based strategies are not aligned with the outcomes of this meta-analysis and should be accordingly revisited. Accounting for LUC effects remains an exercise fraught with uncertainties, as revealed by the large confidence intervals in this meta-analysis, but deserves further improvements to provide an honest view of the mitigation potential of the bio-economy, in the wider perspective of the overall costs and benefits it may incur.

Pending further insights, some patterns already emerge clearly from our comprehensive and quantitative survey. First generation biofuels have the lowest GHG abatement potential of all bioenergy pathways, and stand only about 50% chance of achieving a 50% GHG reduction target. Second-generation biofuels and bioelectricity have a larger greenhouse gas (GHG) abatement potential. Bioenergy value-chains that would impact hitherto unmanaged forest ecosystems should be avoided to maximize the abatement potentials. These results have direct policy implications, whether in terms of the type of pathways that should be supported or the constraints that should be put in place to ensure minimal direct or indirect impact on natural ecosystems.

## Methods

### Literature search and data extraction

A systematic literature search was conducted in the Web of Science using the search equation given in Supplementary Table 1, and led to the identification of 5730 references (published up to Feb. 4th, 2015). A subset of 614 articles dealing with non-food biomass production was extracted by screening the titles and abstracts of these references. The 614 articles were scrutinized and 127 of them focusing on the greenhouse gas emissions of bioenergy were selected based on their content. Among this subset, 50 articles were found to report GHG emission data for one or several land use change scenarios characterized by different direct/indirect land use changes and/or by different types of bioenergy chains. A constraint was that articles should cover all the steps of the production to impact chain, and that they include a quantitative evaluation of the GHG emissions of bioenergy (whether for heat production, electricity generation or transport) while fully factoring in LUC effects. Some articles included an assessment of a reference fossil-based energy chain providing the same service as the bioenergy chain at hand. All references relied on the principles of life-cycle assessment encompassing all the stages of the energy systems studied, using a cradle-to-grave approach11. The total number of scenarios amounted to 380; 114 of them involved Europe, 110 Southern America, 67 Northern America, 74 Asia, 2 Australia, 1 Southern Africa, and 12 took place in multiple regions. To compare the GHG emissions of fossil and bio-based energy supply the following effect-size R was used: $$R=\frac{Eb-Ef}{Ef}$$, where E f and E b corresponds to the life-cycle GHG emissions of the fossil- and bio-based chains, respectively, expressed per unit of energy output (1 MJ). Thus, R corresponds to the relative difference in GHG intensity between the bioenergy chain and its fossil counterfactual, and is unitless. To account for the variations of E f across studies, two values were used for this parameter (Ef min and Ef max , respectively) corresponding to the lower and upper bounds of the range found in global assessments of fossil chains. Values for Ef min and Ef max were 84 and 94 gCO2 MJ−1 for biofuels, and 200 and 500 kWh for bioelectricity, respectively5, and correspond to the references used for regulation purposes in the European Union and the USA.

### Data analysis and modelling

The two series of effect sizes R obtained with Ef min and Ef max were analyzed for several groups of scenarios corresponding to different types of bioenergy and land use changes. The following groups were defined: ‘All’: all scenarios; ‘1G’ and ‘2G’: 1st and 2nd generation biofuels; ‘Forest’: forest as initial land-use; ‘Grassland’: grassland (including degraded pastures) as initial land-use; ‘Palm Oil’: biodiesel from palm oil; ‘Biodiesel’: production of biodiesel; ‘Bioelectricity’: production of bioelectricity; ‘Bioethanol’: production of bioethanol. The proportion of R values higher than −0.5 and the mean effect size were estimated over all scenarios and for each group of scenarios separately. The significance of the differences among groups was tested using linear mixed effect models and binomial logit mixed models (glmm), including random article effects25. The relationship between the year of publication and the effect size was not significant (p = 0.091 and 0.095 with Ef min and Ef max , respectively (Supplementary Fig. 3). The mixed models were fitted by restricted maximum likelihood26with the packages nlme27 and lme4 of the R software28 (v. 3.2.3). In order to check the robustness of the results to the model assumptions, all mean effect sizes were estimated a second time with a non-parametric method based on 500 bootstrap replicates (articles were used as blocks). The results obtained with the mixed models and with the bootstrap replicates were similar (Supplementary Figs 1, 2).

### Data and code availability

The complete list of references used and the dataset are given in the corresponding sections of the Supplementary Material. The routines used to calculate and analyse the effect sizes are available upon request from the authors.

## References

1. 1.

Elobeid, A. et al. Integration of agricultural and energy system models for biofuel assessment. Environmental Modelling & Software 48, 1–16 (2013).

2. 2.

Searchinger, T. et al. Cropland for biofuels increases Greenhouse Gases Through Emissions from Land-Use Change. Science 319, 1238–1240 (2008).

3. 3.

Harvey, M. & Pilgrim, S. The new competition for land: Food, energy, and climate change. Food Policy 36, S40–S51 (2011).

4. 4.

Brunelle, T., Dumas, P. & Souty, F. The Impact of Globalization on Food and Agriculture: The Case of the Diet Convergence. The Journal of Environment & Development 23, 41–65 (2014).

5. 5.

Chum, H. et al. Bioenergy. In Edenhofer K, et al. (Eds.) IPCC Special Report on Renewable Energy Sources and Climate Change Mitigation. Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA (2011).

6. 6.

Zilberman, D. Indirect land use change: much ado about (almost) nothing. GCB Bioenergy 9, 485–488 (2017).

7. 7.

Plevin, R. J., Jones, A. D., Torn, M. S. & Gibbs, H. K. Greenhouse Gas Emissions from Biofuels’ Indirect Land Use Change Are Uncertain but May Be Much Greater than Previously Estimated. Environmental Science & Technology 44, 8015–8021 (2010).

8. 8.

Broch, A. et al. A review of variability in indirect land use change assessment and modeling in biofuel policy. Environmental Science & Policy 29, 147–157 (2013).

9. 9.

Berndes, G. et al. Bioenergy and land use change - state of the art. Wiley Interdisciplinary Reviews: Energy and Environment 2,282303– (2013).

10. 10.

Farrell, A. E. et al. Ethanol can contribute to energy and environmental goals. Science 311, 506–508 (2006).

11. 11.

Liska, A. J. & Perrin, R. K. Indirect land use emissions in the life cycle of biofuels: regulations vs science. Biofuels Bioproducts & Biorefining-Biofpr 3, 318–328 (2009).

12. 12.

European Commission. Directive 2009/30/EC of the European Parliament and of the Council of 23 April 2009 amending Directive 98/70/EC as regards the specification of petrol, diesel and gas-oil and introducing a mechanism to monitor and reduce greenhouse gas emissions and amending Council Directive 1999/32/EC as regards the specification of fuel used by inland waterway vessels and repealing Directive 93/12/EEC. OJEU L 140, 88–113, Brussels (2009).

13. 13.

USEPA. Renewable Fuel Standard Program:Standards for 2017 and Biomass-Based Diesel Volume for 2018. EPA–HQ–OAR–2016–0004; FRL–9955–84–OAR, Federal Register 81:238 (2017).

14. 14.

Fargione, J., Hill, J., Tilman, D., Polasky, S. & Hawthorne, P. Land Clearing and the Biofuel Carbon Debt. Science 319, 1235–1238 (2008).

15. 15.

Valin, H. et al. The land use change impact of biofuels consumed in the EU: Quantification of area and greenhouse gas impacts. Ecofys, IIASA and E4tech, EcoFys Utrecht (2015).

16. 16.

Janssens, I. A. et al. Europe’s terrestrial biosphere absorbs 7 to 12% of European anthropogenic CO2 emissions. Science 300, 1538 (2003).

17. 17.

Post, W. M. & Kwon, K. C. Soil carbon sequestration and land-use change: processes and potential. Global change biology 6, 317–327 (2000).

18. 18.

Gabrielle, B., Gagnaire, N., Massad, R. S., Dufossé, K. & Bessou, C. Environmental assessment of biofuel pathways in Ile de France based on ecosystem modeling. Bioresource technology 152, 511–518 (2014).

19. 19.

Smith, P. et al. Biophysical and economic limits to negative CO2 emissions. Nature Climate Change 6, 42–50 (2016).

20. 20.

Wicke, B., Verweij, P., van Meijl, H., van Vuuren, D. P. & Faaij, A. P. Indirect land use change: review of existing models and strategies for mitigation. Biofuels 3, 87–100 (2012).

21. 21.

Lotze-Campen, H. et al. Impacts of increased bioenergy demand on global food markets: an AgMIP economic model intercomparison. Agricultural Economics 45, 103–11 (2014).

22. 22.

Creutzig, F. et al. Bioenergy and climate change mitigation: an assessment. GCB Bioenergy 7, 916–944 (2015).

23. 23.

Havlık, P. et al. Global land-use implications of first and second generation biofuel targets. Energy Policy 39, 5690–5702 (2010).

24. 24.

Creutzig, F. et al. Reconciling top-down and bottom-up modelling on future bioenergy deployment. Nature Climate Change 2, 320–327 (2012).

25. 25.

Mengersen, K. & Schmid, C. H. Maximum likelihood approaches to meta-analysis. In: Handbook of meta-analysis in ecology and evolution. Koricheva J., Gurevitch J., Mengersen K. (eds). Princeton University Press 125–144 (2013).

26. 26.

Mengersen, K., Schmid, C. H., Jennions, M. D & Gurevitch, J. Statistical models and approaches to inferrence. In : Handbook of meta-analysis in ecology and evolution. Koricheva J., Gurevitch J., Mengersen K. (eds.). Princeton University Press 89–107 (2013).

27. 27.

Pinheiro, J. & Bates, D. Mixed-Effects Models in S and S-PLUS. Springer (2000).

28. 28.

R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria (2015).

## Acknowledgements

This work was funded by the French Environment and Energy Management Agency (ADEME) and the Ministry of Agriculture and Food under grant contract 12-60-C0004, via the French Scientific Group on Land Use Changes (“GIS CAS”). Assistance from the scientists who contributed to the detailed analysis of the scientific articles is acknowledged here, as well as the help of Polina Voylokov in proof-reading the manuscript.

## Author information

Authors

### Contributions

All authors contributed to the selection of articles and to the interpretation of the results from the meta-analysis. M.E.A. extracted the relevant data from the articles and ran the statistical treatments; D.M. designed the statistical models and analysed their outputs, M.E.A., D.M. and B.G. wrote the manuscript.

### Corresponding author

Correspondence to M. El Akkari.

## Ethics declarations

### Competing Interests

The authors declare no competing interests.

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Reprints and Permissions

El Akkari, M., Réchauchère, O., Bispo, A. et al. A meta-analysis of the greenhouse gas abatement of bioenergy factoring in land use changes. Sci Rep 8, 8563 (2018). https://doi.org/10.1038/s41598-018-26712-x

• Accepted:

• Published:

• ### Bioenergy research under climate change: a bibliometric analysis from a country perspective

• Yajie Zhang
• , Qiang Yu
•  & Juan Li

Environmental Science and Pollution Research (2021)