Abstract
Housing policies address the human dimensions of increasing urban density, but their energy and sustainability implications are hard to measure due to challenges with siloed civic data. This is especially critical when evaluating policies targeting low- and moderate-income (LMI) households. For example, a major challenge to achieving national energy efficiency goals has been participation by LMI households. Standalone energy efficiency policies, such as information-based programmes and weatherization assistance, tend to attract affluent, informed households or suffer from low participation rates. In this Article, we provide evidence that federal housing policies, specifically community development block grants, accelerate energy efficiency participation from LMI households, including renters and multifamily residents. We conduct record linkage on 5.9M observations of housing programme participation and utility consumption to quantify the hidden benefits of locally administered housing block grants in a typical entitlement community in the US Southeast. We provide long-run evidence across 16,680 properties that housing policies generate 5–11% energy savings as spillover benefits to economically burdened households not conventionally targeted for energy efficiency participation.
Similar content being viewed by others
Main
For several decades, US housing investment policies, such as community development block grants, have distributed more than US$5.8B per year (all $ in US$ henceforth) in public assistance to distressed communities1. Block grants offer flexible mechanisms that preserve local control over and prioritization of administered public funds. However, evidence that these policies effectively serve low- and moderate-income (LMI) households has been unclear. A fundamental challenge in quantifying these programme’s benefits is that the civic data needed for impact evaluation are often siloed across city information systems. Block grants administered by the US Department of Housing and Urban Development (HUD) address the human dimensions of increasing urban density and land use. More generally, these housing policies can be important mediating strategies in scenarios of human affluence and environmental impact2, including estimates of building energy use or resource consumption at various geographic scales3,4. This notion of housing as a driver of resource consumption is important as renewed federalism debates over public funds for housing assistance also affect modelling assumptions about sustainable urban growth, social equity, and climate resilience. Yet, despite over three decades of programmatic evidence and evaluation, the energy and sustainability outcomes of HUD-funded programmes have been largely missing from public decision-making (Supplementary Note 1). Consequently, the analysis of sustainability trade-offs or sustainability co-benefits from housing investment has been invisible to the policy process.
A hurdle for policymakers is that the community benefits of these programmes are often hard to measure. Scholars have suggested dedicated funds be set aside to develop more sophisticated, holistic approaches for impact evaluation5. A principal limitation for evaluators is usually structural. For example, the disaggregated data required to rigorously evaluate the benefits of these programmes, such as energy, water or resource use, are often inaccessible across information systems or city bureaucracies. Other performance data reported to HUD are commonly in the form of community surveys or self-reported information from programme participants. However, due to the limited availability of contemporaneous data from non-participants, which are necessary to construct credible reference groups for evaluation, obtaining consistent, reliable estimates of programme impacts for block grants is rare.
In this Article, we describe a multiyear effort on the use of civic data analytics in the public sector. We linked siloed data on energy consumption and housing programme participation. Using an open data hub, we created an automated housing registry to process large datasets from over a dozen independently administered databases and multiple city departments (Supplementary Note 2). This process of combining and standardizing records from relational databases is referred to in the data science community as data fusion6. The housing registry’s capabilities include access to open data with geographic information systems (GIS) mapping and a community engagement analytics platform. Importantly, the registry links housing and utility consumption records at the property-address level. These records are more granular than common evaluation studies at the parcel or county scale, which typically do not permit analyses of individual household behaviour.
We investigated long-term sustainability outcomes for two of the largest HUD-administered block grants, the Community Development Block Grant (CDBG) entitlement programme and the HOME Investment Partnerships (HOME) programme (Supplementary Note 3). We analysed 16 years of evidence (2004–2019) from the City of Albany, Georgia—a typical, small-to-mid-sized entitlement community in the US Southeast. The data include 5.9 million monthly observations of participating and non-participating households. We asked whether HUD-administered block grants, which fund housing capital improvements, could generate hidden spillover benefits to private citizens through energy savings. In quantifying possible spillover benefits of housing assistance, we investigated potential policy innovation to use housing programme targeting as an entry strategy to include LMI communities often left out of energy conservation upgrades. Although the connection between block grant programmes and energy efficiency might not be immediately obvious, we found that home upgrades and rehabilitation greatly affect household resource consumption. We document that housing programmes can accelerate energy efficiency in LMI communities, including households with a lower awareness of or interest in energy efficiency.
Block grants for LMI households
Programme ‘targeting’ is a central tenet of US federal housing policies but creates fundamental challenges for research and evaluation. HUD-administrated block grants are mean-tested policies that distribute targeted federal resources to state and local officials to build more resilient communities1. A key feature of the block grant funding mechanism is that cities have decentralized authority over these funds.
Advocates for block grants praise the programme’s flexibility. They suggest that local public administrators will seek the most efficient and cost-effective means to deliver programme services as those officials have better information about community needs. Local administrators are also presumed to be more ‘visible’ and thus can be held more accountable by citizens versus federal administrators1,7. However, critics argue that block grants have too much flexibility. For example, grantees can redirect programme targeting away from individuals with the greatest need or shift programme services with long-term pay-offs in favour of short-term initiatives with less impact.
When local governments receive federal grants, it often stimulates higher levels of spending than theory would predict from local revenues, a phenomenon known as the ‘flypaper effect’8,9. Nevertheless, debates persist about whether increased expenditures actually lead to higher levels of public service provision, especially within LMI communities10,11. In the context of block grants and housing, scholars have argued that the actual value of block grant funding tends to diminish over time12. As a result, block grant programmes have been criticized for gradually decreasing services to the neediest or most vulnerable populations5,13,14. CDBG and HOME programmes reduce capital and information barriers for entitlement communities to be able to access and receive governmental assistance. However, it remains an open question whether income-qualified households meaningfully participate in and benefit from these federal funds. We therefore investigated whether a broader range of co-benefits from housing assistance, such as energy savings and other unmeasured sustainability benefits, might be generated by housing block grants.
The energy-relevant programme activities under CDBG include energy efficiency projects, rental rehabilitation and emergency repairs, that is, roof replacements, heating, ventilation and air conditioning (HVAC), electrical, plumbing and other repairs that bring structures up to current building codes. Under HOME grants, the relevant programme activities include the rehabilitation of owner-occupied housing units, acquisition, rehabilitation or construction of rental units as affordable housing for low-income individuals, and tenant-based rental assistance. For a more detailed list of CDBG and HOME activities and programme rules, see refs. 1,15.
Our field site, Albany, Georgia, is 74% Black or African American, and its poverty rate is 30.8%—nearly triple the US national average (Supplementary Discussion). Albany is ideally suited for formula targeting under block grant eligibility rules due to its population size, ageing housing stock and high poverty rate. On the basis of the city’s data, we calculated the average household energy consumption in Albany as 13,255 kilowatt-hours (kWh) per year, making it an important population of interest. This is nearly 25% higher than the US national average (10,791 kWh)16. For a review of causes and correlates of household energy burden in low-income communities, see ref. 17. Given the high energy and cost burdens, we could expect to observe substantial improvements from policy intervention.
Results and Discussion
Programme targeting
We evaluated the household characteristics of programme participants in Albany to assess evidence of programme targeting. The most common housing problems include cost burdening, crowding and substandard housing (for example, lacking complete plumbing, kitchen facilities or weatherization)18. The city has 7,985 LMI renter households and 2,232 LMI owner households that spend more than 30% of their monthly income on housing costs, including utilities (Supplementary Note 4). Given this high share of cost-burdened households, it is understandable that the demand for housing assistance far exceeds the available funds, with long waiting lists of income-qualified applicants. In Fig. 1, we show, by census tract, the spatial distribution of 549 HUD-funded housing projects participating in either CDBG or HOME among 16,680 properties in the city. While there are funded activities across all six city wards, a high proportion of participating properties are also located within Federal Opportunity Zones (Fig. 1).
Although energy intensity is not a consideration in targeting or eligibility criteria, we found that participating households that received HOME or CDBG funds are heavily concentrated in areas with high poverty rates and where energy burdens are prevalent (Fig. 1). Out of 10,127 households at 80% of the area median income or below, 5,714 have a severe cost burden (4,440 renters and 1,274 owners); these households comprise a substantial share, 38% of LMI households18. In these tracts, the ratio of median electricity bill charges to median income is 8–12%—higher than the national threshold (Fig. 1). This type of evidence has previously been hard to discover given the persistent data silos and lack of researcher access to integrated utility data for evaluation. Next, we compared programme targeting under federal housing rules to more conventional policies targeting energy efficiency.
Previous work has shown that self-selection into energy efficiency programmes generally has low take-up rates among LMI households, even when energy efficiency services are subsidized or free19,20. Given the upfront investment, administrative or coordination costs necessary to achieve large-scale savings, dedicated energy efficiency programmes can actually have negative rates of return20. Further, when standalone energy efficiency policies are not means tested, they also tend to attract participation in higher-income areas21. This situation raises questions about inframarginal participation—whether participants would have invested in energy efficiency without public subsidies or benefits22. Yet, although not all activities covered under HOME and CDBG may be relevant for energy conservation, we argue that programme targeting under housing block grant rules could be a favourable alternative to standalone energy efficiency policies that are not necessarily means tested or have a low service take-up. This is because the housing programme selection process simultaneously attracts the most energy-intensive and energy-burdened households in situations where the demand for services is also strong.
Surprisingly, we found that housing policies can accelerate participation in energy efficiency among capital-constrained homeowners or renters, even in cases where participants were not initially motivated by energy conservation measures. For example, one resident said, ‘When they put the roof on it was like night and day. I could feel the warmth of the house’. In the next section, we quantify the realized energy savings within targeted LMI communities.
Energy savings from housing programmes
We estimated the long-run energy savings in kWh per square foot for participating properties in CDBG and HOME programmes. These spillover energy savings can be conceptualized as a bonus in programme performance beyond core housing programme objectives. To calculate energy savings, we implemented several matching models with regression adjustment to construct suitable statistical reference groups pre- and post-programme participation. To mitigate observational bias, we used algorithmic matching procedures with a genetic search algorithm23 to achieve covariate balance between treated and counterfactual observations. We also implemented staggered difference-in-differences (DiD) estimators that mitigate potential biases of two-way fixed effects with heterogeneous effects (Methods). For transparency in protocols, we report the bias reduction in Fig. 2 and note that in staggered DiD models without matching, the energy savings can be understated (Supplementary Table 1). We report the most conservative estimates, robust to various matching procedures and estimators (for more details, see Methods).
HUD-funded housing projects in Albany generated statistically significant monthly average energy savings of 5–11% for participating households as compared with multivariate matched properties with similar characteristics (Table 1). For the subset of energy-relevant projects estimated by staggered DiD estimators (that is, Energy Efficiency, Emergency Repairs and Homeowner Rehabilitation), we report energy savings of 11–14% after correcting for potential estimation biases due to treatment effect heterogeneity under staggered participation (Table 1 and Supplementary Table 2). We note that point estimates can be higher when considering staggered designs. While there is year-to-year variability in performance depending on the mix of implemented projects, the energy savings for housing participants are relatively stable across years, with increasing performance in the last 2 years of the study period (Supplementary Fig. 1).
Overall, HUD-funded block grants in Albany reduced electricity use by 4.72 million kWh over the study period. The reduction in non-baseload emissions is equivalent to 3.70 million pounds of coal not being burned or the carbon sequestered by 3,695 acres of forest (Supplementary Note 5). These long-term savings are remarkable, given that energy efficiency is not an explicit criterion for these policies.
Participating properties in the CDBG programme achieved monthly savings of 6–14% (Supplementary Table 1, 95% confidence interval (CI)). Emergency repairs, where households could elect for one critical repair (for example, HVAC), comprising 248 projects, generated 6% energy savings. Albany’s CDBG-funded Energy Efficiency programme, offering new insulation and windows, comprising 62 projects, generated ~13% energy savings. The largest savings came from the CDBG-funded Rental Rehabilitation programme, which focuses on structural upgrades (for example, roof) to city-owned rental properties, comprising 22 projects, generating 32% energy savings. This performance is consistent with the high savings associated with major building upgrades reported in voluntary and information-based programmes21,24,25.
The HOME portfolio had more mixed results. On the one hand, Homeowner Rehabilitation, which provided households with a full range of repairs, comprising 29 projects, generated ~11% energy savings. HOME had a larger share of projects not relevant to energy savings (for example, Tenant Based Rental Assistance). Unsurprisingly, these 160 unrelated HOME projects were associated with a 15% increase in energy consumption. Therefore, we found evidence of energy savings across a broad portfolio of CDBG projects and, to a more limited extent, HOME projects.
To further contextualize savings from the HUD-funded CDBG programmes, we translated the lower and upper range of estimated energy savings (for example, 6% for Emergency Repairs and 32% for Rental Rehabilitation) to dollar amounts using an average monthly electricity bill in Albany ($125). When annualized, housing participants saved anywhere from $75 to $482 in direct kWh charges. According to the Bureau of Labor Statistics consumer price index26, these savings are equivalent to nearly two months of groceries for households in the region (Supplementary Table 3).
Housing spillovers versus energy conservation programmes
We evaluated how meaningful these savings are in comparison with dedicated energy efficiency programmes reported in the literature. First, we compared the magnitude of energy savings for both non-LMI- and LMI-targeted programmes and found that housing spillovers meet or exceed the reported energy savings from standalone programmes. For example, savings ranging from 0% to 25% were reported for a broad range of interventions involving capital upgrades24. Savings from behavioural and information-based interventions also ranged from 0% to 20%, depending on the intervention type and methodology27,28,29,30.
We found that energy savings from housing programme spillovers (which range from 6% to 32%; Supplementary Table 1) are generally consistent with and sometimes exceed previous reports for non-LMI-targeted interventions. In another review, energy savings of 0.9% to 8.2% were reported for non-LMI-targeted informational nudges for energy conservation31. Although energy savings from capital improvements often generate substantially larger savings, we acknowledge that information and behavioural nudges can also offer other benefits. For example, treatment effects from information-based interventions can persist for years after the treatments are discontinued32,33; or they can generate conservation spillovers from one form of resource consumption to another. Reported cases include water to energy savings34; waste sorting to waste reduction35; or hot water savings to space heating conservation36. We acknowledge that energy savings may not be the only important outcome measure for programme evaluation.
In addition, we benchmarked the energy savings from housing spillovers to standalone energy efficiency programmes where LMI households were the principal recipients of the energy savings. Studies of standalone energy efficiency programmes geared toward LMI households, such as the Weatherization Assistance Program (WAP), Low-Energy Efficiency Plus (LEEP-Plus) and Energy Savings Assistance Program (ESAP), have reported energy savings in the range of 2% to 7%, albeit with challenges in programme uptake20,37,38. Therefore, given the range of treatment effects in this study, we found that housing spillovers are competitive with and occasionally exceed the energy savings from standalone energy efficiency programmes targeting LMI communities.
Comparatively, housing spillovers are also meaningful in effectively reaching a broader range of LMI households versus standalone programmes. This is because LMI households in need of home repairs are generally a larger subset of the population than those actively seeking specialized energy efficiency support. Notably, the majority of grantees are simultaneously concentrated in areas with high poverty rates and, surprisingly, high energy consumption, which has been previously unknown (Fig. 1). We believe this profile is notable as it differs from descriptions of low LMI participation in dedicated energy efficiency programmes20,37.
Cost-effective comparisons
Although energy savings is not the intended aim of CDBG and HOME block grants, we calculated cost-effectiveness ratios in kWh saved per dollar spent for four energy-relevant housing programmes: Emergency Repairs, Energy Efficiency, and Rental Rehabilitation (under CDBG) and Homeowner Rehabilitation (under HOME). Because of our unique partnership with City of Albany public administrators, we were able to access programme and administrative costs at the project level. The fiscal period for which we had access to the costs is October 2007 to May 2018, spanning 11 years. We noted that such long-term evaluations of block grant outcomes have been uncommon5. For details on cost-effectiveness calculations, see Methods. Within CDBG, we report cost-effectiveness ratios of 83.5 kWh $−1 for Rental Rehabilitation, 10.8 kWh $−1 for Energy Efficiency and 3.7 kWh $−1 for Emergency Repairs. Within the HOME programme, we report the cost-effectiveness ratio of 0.8 kWh $−1 for Homeowner Rehabilitation.
Further, we benchmarked the cost-effectiveness ratios (in 2021 $) of housing spillovers against reported estimates from dedicated energy efficiency programmes. We considered recent meta-reviews24,31 and other highly cited studies published in the past 20 years. In Fig. 3, we provide a comparison, beginning with standalone Capital Upgrades programmes, which include both LMI- and non-LMI-targeted programmes. We also compared housing spillovers to non-LMI-targeted programmes including Information & Behavioural Programmes and Rebates & Financial Incentives. We found that housing spillovers from Rental Rehabilitation in the CDBG programme are nearly 2.9 times more cost effective than common Capital Upgrades programmes, such as utility-based retrofitting (that is, 29.0 kWh $−1)17. As the Rental Rehabilitation funds upgrades in city-owned properties, we learned that Rental Rehabilitation is revenue generating (unlike non-city-owned properties in homeowner rehabilitation). Therefore, the cost-effectiveness ratio is substantially higher because administrators can also leverage programme income to re-invest in additional upgrades. We consider split incentives issues within rental rehabilitation in Supplementary Discussion. Spillovers from Emergency Repairs and other block grant programmes are also within the reported cost-effectiveness ratios from dedicated programmes that target LMI communities, including WAP, LEEP-Plus and ESAP17,20,38. Similarly, we find that cost-effectiveness ratios from housing spillovers are also competitive with non-LMI-targeted Capital Upgrades programmes, such as building labels and building codes (that is, ranging from 21.3 to 4.7 kWh $−1)21,39,40 (Fig. 3).
As expected, the cost-effectiveness ratios of housing spillovers are less favourable than those estimated for Information & Behavioural programmes27,28,32,33,41,42 (that is, ranging from 64.3 to 0.1 kWh $−1) (Fig. 3), which do not typically involve capital upgrades. We also compared cost-effectiveness ratios in this study to Rebates & Financial Incentives, such as appliance replacement (refrigerator, heat pump), electricity bill credits and other rebates (that is, ranging from 29.3 to 0.4 kWh $−1)43,44,45,46,47,48. In contrast to nudge interventions, we find that the cost-effectiveness ratios in this study are generally competitive with Rebates & Financial Incentives (Fig. 3). This is intriguing since direct monetary incentives for energy efficiency, unless restricted by programme rules, do not generally target LMI communities. Although outside the scope of this paper, we did back-of-the-envelope calculations of the implied internal rates of return for housing programme spillovers for interested readers (Supplementary Note 8)49. Over the study period, the implied internal rates of return are ~40% and higher. Many dedicated energy efficiency programmes, such as weatherization, have reported variable rates of return as low as 3% to over 100% (refs. 20,30). For further discussion of rates of return in energy efficiency programme evaluation, see refs. 50,51,52,53,54,55,56,57,58.
In summary, whether a comparable programme is LMI-targeted or not, we found that the cost-effectiveness ratios from housing spillovers are generally competitive with dedicated energy efficiency programmes across a broad range of intervention types.
Evidence of programme uptake
To further understand the drivers of performance in CDBG and HOME programme administration, we conducted semi-structured interviews with public administrators and residents (see Supplementary Discussion). Engaging with public administrators and residents allowed us to compare programme uptake for dedicated energy efficiency programmes with the uptake for housing programmes. This is important because programme uptake has been a critical barrier to accelerating energy efficiency participation in LMI communities. Through our interviews, we found evidence of persistent barriers contributing to low programme uptake in dedicated energy efficiency programmes and strong drivers of programme uptake within housing.
We know from the literature that barriers to uptake of residential energy efficiency programmes can typically include: (1) capital, resource and liquidity constraints; (2) information barriers and behavioural or cognitive biases; and (3) transaction and process costs24. We found evidence for many of these same barriers in Albany, including a less-documented barrier: (4) local mistrust of government. First, evidence of low uptake of energy efficiency programmes is commonly due to a lack of capital and other resources. According to the housing programme director, most applicants in Albany are ‘elderly and on fixed incomes’. A resident shared, “The [financial] barrier is having those resources to conserve”. Another resident stated, “… a lot of my fellow homeowners cannot afford homeowners insurance, without which you cannot get weatherization and stuff”. Second, when asked why more residents were not participating in the programmes, a resident proffered that they “don’t understand and don’t get the information right”. Another said, “I don’t know what type of appliance would be available to say, this will help you decrease your electricity”. Third, evidence of process and transaction costs came up in several interviews. For programme participation to occur, public administrators for the City of Albany must ‘see a lot of customers’; work ‘24/7’; always be ‘on call’; and put in ‘110 or more percent’. One resident shared, “[The administrators] have funds available for Energy Assistance, but they take you through so much to get whatever they’re going to give you. If they’re going to help you, you’ll be so burned out because it takes so much”. While we confirmed that high-involvement processes might be necessary at the local level, additional transaction costs could limit the scalability and so decrease the uptake of dedicated energy efficiency programmes.
A fourth barrier, local mistrust of government, has been discussed in the public management literature for a broad range of services, but less so for energy efficiency59,60,61. Public administrators in Albany are aware of this issue. For example, one official shared, “It’s hard to convince people to do energy efficiency and let folks into their homes”. According to some public administrators, certain residents have “… perceptions that [the city government is] going to put a lien on [their property]”. They say, “The mistrust is enormous” and that residents “don’t believe [city administrators are] doing what it is they say they’re doing”. Evidence from our interviews demonstrates that mistrust of local government service delivery, in addition to capital constraints, cognitive biases and transaction costs (among others), may also limit energy efficiency programme uptake in LMI communities.
In contrast, housing programmes have high demand and participation. These programmes attract a broad range of eligible participants from LMI households. According to the City of Albany’s 5-Year Consolidated Plan, “Over 2,000 families are on waiting lists for a total of just 1,117 public housing units, and the occupancy rate for existing units is virtually 100%”18. This evidence of high take-up of public housing assistance—nearly twice the availability—reveals the broad reach of the city’s housing programmes’ HUD block grants in our study. Stakeholder meetings conducted by the city revealed that ‘high utility costs may be a common issue for low-income, disabled, senior and minority households living in older and less energy efficient homes’. These households comprise the vast majority of entitlement grantees in Albany. Other stakeholders testified that ‘while households may be able to afford their homes, units may lack appliances or are in need of major repairs’18. Reports of high utility costs and the need for housing repairs confirm the high complementarity between energy efficiency and housing programme uptake. Residents’ interviews further illustrate the potential impacts. “You’re talking about [sic] putting… money toward buying food and groceries versus paying utility bills; so [the housing policies] can have a big impact”, said one resident. Another stated, “I only get $1,200 a month, and my utilities is $4 almost $5 [hundred], and my mortgage is $765”. Such resident feedback confirms that the policies can have an impact in financially struggling households regardless of awareness of or interest in energy efficiency measures. Considering that housing policies have strong demand, we conclude that expansions in housing programme participation can lead to strong energy and sustainability co-benefits for a broader range of LMI households.
Dedicated energy efficiency policies tend to attract affluent and informed households but suffer from low participation rates among LMI households37. We found substantial energy savings from housing programme spillovers in situations where demand for services is also strong. These sustainability co-benefits have remained largely hidden from programme evaluation and policy decision-making due to widespread data silos at the city scale. Through data innovation in record-linkage procedures, we have been able to uncover previously unmeasured energy savings impacting low- and moderate-income communities. For a family facing trade-offs between essential household needs, the quantified energy savings can make a dramatic difference: nearly two months of groceries. For the community writ large, the energy co-benefits accelerate long-term participation from households facing structural and persistent barriers to energy efficiency. We argue that energy and sustainability-oriented outcomes should be further integrated into federal housing programme evaluation criteria, and we expect that doing so will uncover a multitude of other hard-to-measure social benefits.
Methods
Ethics statement
Human participant protocols were conducted under Georgia Tech Institutional Review Board (IRB) protocol number H20089.
Data and programme details
Administrators in the City of Albany have used open data tools to respond to local demands for greater transparency and accountability in the delivery of public services. These open data initiatives are becoming increasingly common among similar-sized cities across the United States. For the current study, the city provided data access to 5.9 M housing-related open data records from more than 12 city departments. The dataset included monthly electricity consumption for all residential properties in Albany from 2004 to 2019. After we linked housing and energy consumption data by property identifiers, we obtained a proper subset of 2,931,406 panel observations covering 16,680 residential properties.
Out of nearly 20 programmes funded under HOME and CDBG, we focused the analysis on programmes directly related to household energy use. These are Energy Efficiency, Emergency Repairs, Homeowner Rehabilitation and Rental Rehabilitation. These energy-relevant projects comprise 65% of the whole project portfolio during the analysis period from 2004 to 2019. Emergency Repairs, for example, constituted an important share of the total housing portfolio, and it represented more than 30% of all treated properties in our analysis. Programmes unrelated to energy use, such as Tenant Based Rental Assistance or New Construction, in which rental support can travel with the individual and not necessarily the housing unit, were used for falsification (placebo) testing.
The unit of analysis is the property address (we used property address and household interchangeably). The dependent variable used for analysis is the monthly electricity consumption in kWh per square foot. We log transformed the dependent variable and multiplied this by 100 for ease of interpreting the estimated coefficients directly as a percentage change. The policy indicator variable was coded as 1 for months in which CDBG or HOME projects started and continued to be active and 0 otherwise before a project’s implementation. The policy indicator variable for properties that never received treatment and were thus available for counterfactual analysis was coded as 0 for all the periods. Given the large dataset of counterfactual, non-treated observations, we mitigated selection bias by matching households on the basis of similar baseline electricity usage and household characteristics within the same city21,42. We combined matching models for bias reduction and covariate balance with staggered DiD or two-way fixed effects (TWFE) estimators for estimation efficiency. For more details, see Supplementary Note 10.
To evaluate the characteristics of treated and control units, we compiled data from the 2019 5-year American Community Survey62 and the Dougherty County Tax Assessor’s database of property records. This dataset included important property, demographic and neighbourhood characteristics known to affect household energy consumption. The most important pre-treatment property-level characteristics included the average monthly baseline energy consumption (in kWh per month per household), property size (in square feet), property age (in years), number of bedrooms and number of bathrooms. Demographic and neighbourhood characteristics included the household median income (in dollars), the share of female head of household (in percentage), the share of Black or African American population (in percentage) and alternative economic measures at the tract level (such as the share of the population below poverty level (in percentage), the share of the households with gross rent more than 35% of household income (in percentage) and the population on the Supplemental Nutrition Assistance Programme (SNAP (in percentage)). These physical and demographic characteristics are widely used in the building energy efficiency literature as matching or conditioning variables to reduce imbalance between treated and control properties21,63.
To mitigate the effect of possible unobservables on energy use, we included the fair market property value as a proxy for other potentially unobserved quality attributes64. Because property values could be influenced by housing programme criteria with the explanatory variable, we conducted additional analyses to show the main results with and without the property value as a conditioning variable to check for any potential biasing effect. Excluding property value in the conditioning variables generated somewhat higher treatment effects of 10%–19% (Supplementary Table 4). However, given possible unobserved factors related to housing stock quality, we included the property value in our models and reported the more conservative estimates. We also conducted additional robustness checks with an expanded set of testing variables related to age, homeownership and disability status to confirm bias reduction across further occupant characteristics. To mitigate other time-varying factors related to outdoor ambient temperature effects on energy demand, we also included archival weather station data from the National Oceanic and Atmospheric Administration (NOAA) to adjust for seasonal heating and cooling degree-days65. We used data for the nearest weather station in Albany, which is located 4 miles from downtown Albany at the Southwest Georgia regional airport.
Selection bias and protocols for bias reduction
As expected in impact evaluation studies with voluntary programmes, we found evidence of strong self-selection bias. Before implementing the matching models, the treated and non-treated properties had large differences in observable property characteristics. Descriptive statistics revealed statistically significant differences across key testing variables (Supplementary Table 5). For example, participating properties receiving HUD funding are ~30% smaller in square footage and have almost two times lower property values (Supplementary Table 5), which characterizes the profile of units that typically receive federal housing assistance. For further pre-treatment comparisons across other conditioning variables, including demographic and neighbourhood features, see Supplementary Table 5. Figure 2 shows a summary of the pre- and post-matching differences and covariate balance between treated and non-treated properties expressed as standardized percent bias (Supplementary Note 9).
Matching algorithms
Before analysis by difference-in-differences, we implemented multivariate matching procedures as a pre-processing step to construct statistical reference groups for analysis and to mitigate observational bias. Previous research in building energy efficiency has demonstrated notable performance gains in large datasets, particularly with the availability of high-performance computing resources21. We implemented algorithmic matching procedures with genetic matching, which automatically finds the optimal solution and fitness parameters that achieve maximum covariate balance23,66. Genetic matching automates the process of covariate balancing under various objective functions such as maximizing P values or minimizing standardized mean differences in empirical quantile–quantile distances across all matching variables.
We used matching protocols ‘with replacement’ that allowed us to preserve a larger sample size while not exceeding the ratio of controls over treated units that degrade performance. We ran the Genmatch script with all possible ratios of treated to control observations in the range from 1 to 100. This grid search resulted in a local optimum at a ratio of 19:1, meaning that up to 19 untreated properties weighted on their characteristics were available to each of the treated units for comparison. To fine-tune the ratio parameter, we implemented a rule-based optimization procedure that (1) maximized the average reduction in standardized mean differences and (2) minimized the number of pruned observations in the counterfactual66. Supplementary Fig. 2 shows the sensitivity of the standardized mean differences to changes in the ratio parameter for genetic matching, while Supplementary Fig. 3 shows the sensitivity of standardized mean differences to changes in observations pruned for the same values of the ratio parameter. Given the extended run times for genetic matching, we used multiple cores on a high-performance computing cluster to reduce computation time.
To benchmark our matching results, we conducted propensity score matching (PSM). We found a local optimum for bias reduction at a ratio of 21:1 of non-treated to treated units. In Supplementary Fig. 4, we show the sensitivity of standardized mean differences to changes in the ratio parameter, while Supplementary Fig. 5 shows the sensitivity of standardized mean differences to changes in observations pruned for the same values of the treated to untreated ratio.
Our best-performing model was genetic matching, which achieved an average and median bias reduction of 91% and 93%, respectively. This is better than the 78% average and 84% median bias reduction achieved with PSM across our conditioning and testing variables in Fig. 2. One limitation of propensity score models is that they might require a researcher’s discretion in the selection of parameters of interest67. For this reason, we favoured use of the automated methods with genetic matching, which also achieves better bias reduction in this application.
Balance–size matching frontier
To provide additional evidence on the comparative performance of the matching models, we implemented the Matching Frontier technique68, which allows us to estimate the theoretical limit to jointly maximize covariate balance and sample size. We used a specialized R package that allows for synchronous optimization of covariate balance and sample size (for details, see the Code Availability Statement). These results are presented in Supplementary Fig. 6. Genetic matching achieves a larger bias reduction, but it also produces a lower absolute loss imbalance (L1) compared with the PSM approach. These findings confirm that genetic matching is more efficient and gets closer to the balance–sample size frontier. The genetic matching procedures weakly dominate PSM matching across the key conditioning and testing variables. Therefore, given the richness of the current dataset, we were able to confirm that genetic matching is the preferred matching algorithm for this domain of building energy efficiency, as introduced in ref. 21.
Sensitivity of matching procedures to unobservables
We conducted Rosenbaum’s sensitivity analysis using protocols described in refs. 69,70. We calculated the critical value of the sensitivity parameter Γ, which captures the level of influence an unobserved confounder should need to affect the monthly kWh ft−2 outcome to change our inference. We estimated the changes in P values or significance levels on the basis of different values of Γ from 1 to 3 with a step size of 0.05. The critical gamma value is 1.45, where the confidence interval includes zero (Supplementary Table 6). This means that an unobserved covariate would have to change the energy intensity (in kWh ft−2) of participating households by ~45% before changing our inference at the 90% confidence level.
Although there could be other selection processes or time-varying unobservables not captured in our conditioning and testing variables, we believe it is unlikely because an unobserved confounder would have to exceed our threshold of 45% of the impact on the outcome variable in kWh ft−2.
Estimating treatment effects
To estimate causal programme impacts, we analysed the panel data using 16 years of monthly energy consumption records (in kWh ft−2) with and without matching. We used a TWFE with standard errors clustered at the property-address level, as reported in Table 1, as well as staggered DiD estimators. We provide additional details on the policy indicator in Supplementary Note 10. The reported treatment effects are robust to various levels of one-way and two-way clustering options (Supplementary Table 7).
To address potential estimation biases due to treatment effect heterogeneity in the presence of staggered programme adoption71, we implemented staggered DiD estimators72,73. We implemented two alternative protocols. The first approach72 uses not-yet-treated observations in a given period as counterfactual, while the second approach73 calculates the average treatment effect among switchers. We note that not every HUD-funded project in our study is subject to staggered adoption, which means that concerns about potential estimation biases with fixed effects estimators apply only to a subset of the studied projects. In Table 1, we report the results for three out of four energy-related projects that had staggered participation based on the project start date (for example, Energy Efficiency, Emergency Repairs and Homeowner Rehabilitation).
Supplementary Fig. 1 compares the dynamic DiD treatment effects with TWFE estimators after matching. Although there is some divergence in the dynamic treatment effect estimates in the later periods after more than 10 years or 40 quarters of performance data, we found that the staggered DiD treatment effect estimates were broadly consistent and within the 95% confidence intervals of each other for nearly all years in the study period (Supplementary Table 2). We also provide evidence of parallel trends for years before the start of housing projects and programme data collection in Supplementary Fig. 7. Importantly, given the quality of the data, we note that we did not rely on cross-sectional results for statistical significance, and we were able to measure year-to-year impacts using multiple approaches with matching before estimation of the event study (Supplementary Fig. 1). Due to covariate imbalances, the coupling of matching with DiD estimators was preferred such that covariates of never-treated units matched treated units. Recent econometric literature also points to the merits of matching before DiD analysis74,75. For a more general discussion of design issues to staggered DiD approaches, see refs. 71,76,77,78.
Placebo tests and other robustness checks
We implemented placebo tests in multiple ways to confirm the validity of our technical approach. First, we implemented a placebo test by analysing treated properties before any HUD investment from 2004 to 2007, where no effects are logically possible. We found treatment effects not statistically different from zero with two-way fixed effects and in models with and without matching, as shown in our main results in Table 1. As an additional falsification test, we considered funded CDBG and HOME projects not directly related to energy consumption, such as Tenant Based Rental Assistance or New Construction, to test for the direction of treatment effects. As shown in Supplementary Table 1, we found positive treatment effects up to 15% for non-energy projects with and without matching, as expected.
Another potential concern in treatment effect estimation is the uncertainty of the exact date ranges of project completion. This could introduce a source of measurement error, even as the benefits of capital improvements (HVAC unit, window sealing, roof repairs and so on) persist. Following ref. 30, we tested additional specifications by dropping observations where the treatment status is uncertain. Of 549 treated projects, we excluded 43 projects tagged as ‘incomplete’ (7.8% of treated projects). We confirmed that results with and without incomplete projects are all within the reported 95% confidence intervals under our three main specifications (Supplementary Table 8). This is expected given that the share of ‘incomplete projects’ in the sample is relatively small compared with the overall number of studied projects. Access to project status, tracked by the programme administrators and subsequently shared with the researchers, indicates minimal uncertainty in the date range as a possible source of evaluation error.
Cost effectiveness
To calculate the cost-effectiveness ratios, we considered the total kWh saved across all programme years divided by the total cost, which includes programme plus administrative costs. We used the most conservative treatment effect estimates (that is, genetic matching with two-way fixed effects), which provide a lower bound on the cost-effectiveness ratios. The programme costs are the direct entitlement funds, and administrative costs are the share of indirect costs as reported to HUD, excluding programme income (Supplementary Note 7). For this analysis, we did not consider other indirect costs, such as the social cost of carbon.
Administrator interviews and community engagement
To understand the localized administrative drivers of the CDBG and HOME programmes, we conducted 10 semi-structured interviews with public administrators, including the City of Albany’s Manager’s Office, the Department of Community and Economic Development (DCED), which manages the HUD projects and funding, Technology and Communications, and Utility Operations departments. We also conducted 40 semi-structured interviews with Albany residents to assess the programme effectiveness in the field. Of the 40 interviewees, 24 received a CDBG or HOME treatment at some point during the project period, and 16 did not receive the treatment. Participants in the Emergency Repairs programme made up 55% of all interviewees and 92% of all treated households. All interviews were conducted via phone from May 2020 to August 2020. We recruited resident interviewees in several ways: cold called past participants from DCED lists; mailed 927 postcards to past participants, which included contact information and a link to an online form to sign up for the interviews; circulated a press release and social media posts via the city’s communications office (from which we received two press articles); and sent personalized hand-addressed letters to 15 past HOME participants. All interviewees gave their informed consent for research purposes; personal data were anonymized and saved separately from interview recordings and transcripts.
Reporting summary
Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.
Data availability
The anonymized data have been deposited in human and machine-readable format to Dataverse: https://doi.org/10.7910/DVN/SF1DRW (ref. 79). Additional data related to CDBG and HOME funded projects are available at the Albany Open Data GeoHub: https://geohub.albanyga.gov (ref. 80). Source data are provided with this paper.
Code availability
All computer code needed to replicate the findings in this study have been deposited on Zenodo at https://doi.org/10.5281/zenodo.5684354 (ref. 81).
References
Jaroscak, J. V., Lawhorn, J. M. & Dilger, R. J. Block grants: perspectives and controversies R40486 (Congressional Research Service, 2020).
Wiedmann, T., Lenzen, M., Keyser, L. & Steinberger, J. K. Scientists’ warning on affluence. Nat. Commun. 11, 3107 (2020).
Guneralp, B. et al. Global scenarios of urban density and its impacts on building energy use through 2050. Proc. Natl Acad. Sci. USA 114, 8945–8950 (2017).
Dietz, T. & Rosa, E. A. Effects of population and affluence on CO2 emissions. Proc. Natl Acad. Sci. USA 94, 175–179 (1997).
Bostic, R. W. CDBG at 40: opportunities and obstacles. Hous. Policy Debate 24, 297–302 (2014).
Bleiholder, J. & Naumann, F. Data fusion. ACM Comput. Surv. 41, 1 (2009).
Handley, D. M. & Howell-Moroney, M. Ordering stakeholder relationships and citizen participation: evidence from the community development block grant program. Public Adm. Rev. 70, 601–609 (2010).
Hines, J. R. & Thaler, R. H. The flypaper effect. J. Econ. Perspect. 9, 217–226 (1995).
Inman, R. P. in The New Palgrave Dictionary of Economics 1–6 (Palgrave Macmillan, 2009).
Wong, K. K. & Peterson, P. E. Urban response to federal program flexibility: Politics of Community Development Block Grant. Urban Aff. Q. 21, 293–309 (1986).
Finegold, K. et al. Block Grants: Historical Overview and Lessons Learned New Federalism Issues and Options for States, Series A, No. A-63 (The Urban Institute, 2004).
Reich, D., Shapiro, I., Cho, C. & Kogan, R. Block-Granting Low-income Programs Leads to Funding Declines Over Time, History Shows (Center on Budget and Policy Priorities, 2017); https://www.cbpp.org/sites/default/files/atoms/files/2-22-17bud.pdf
Collinson, R. A. Assessing the allocation of CDBG to community development need. Hous. Policy Debate 24, 91–118 (2014).
Dilger, R. J. & Boyd, E. Block Grants: Perspectives and Controversies (Congressional Research Service, 2014).
Jones, K. An Overview of the HOME Investment Partnerships Program (Congressional Research Service, 2014).
US Energy Information Administration. How much electricity does an American home use? https://www.eia.gov/tools/faqs/faq.php?id=97&t=3 (8 January 2024).
Brown, M. A., Soni, A., Lapsa, M. V., Southworth, K. & Cox, M. High energy burden and low-income energy affordability: conclusions from a literature review. Prog. Energy 2, 042003 (2020).
2016–2021 Consolidated Plan and 2016–2017 Annual Action Plan, City of Albany, Georgia OMB Control No: 2506-0117 (City of Albany Department of Community & Economic Development, 2016).
Reames, T. G. A community-based approach to low-income residential energy efficiency participation barriers. Local Environ. 21, 1449–1466 (2016).
Fowlie, M., Greenstone, M. & Wolfram, C. Do energy efficiency investments deliver? Evidence from the weatherization assistance program. Q. J. Econ. 133, 1597–1644 (2018).
Asensio, O. I. & Delmas, M. A. The effectiveness of US energy efficiency building labels. Nat. Energy 2, 17033 (2017).
Boomhower, J. & Davis, L. W. A credible approach for measuring inframarginal participation in energy efficiency programs. J. Public Econ. 113, 67–79 (2014).
Diamond, A. & Sekhon, J. S. Genetic matching for estimating causal effects: a general multivariate matching method for achieving balance in observational studies. Rev. Econ. Stat. 95, 932–945 (2013).
Gillingham, K., Keyes, A. & Palmer, K. Advances in evaluating energy efficiency policies and programs. Annu. Rev. Resour. Econ. 10, 511–532 (2018).
Gillingham, K. & Palmer, K. Bridging the energy efficiency gap: policy insights from economic theory and empirical evidence. Rev. Environ. Econ. Policy 8, 18–38 (2020).
US Bureau of Labor Statistics. Consumer Price Index, South Region – December 2019 https://www.bls.gov/regions/southeast/cpi-summary/2020/consumerpriceindex_summary_southeast_201912.pdf (accessed 9 August 2021).
Allcott, H. & Mullainathan, S. Behavior and energy policy. Science 327, 1204–1205 (2010).
Asensio, O. I. & Delmas, M. A. Nonprice incentives and energy conservation. Proc. Natl Acad. Sci. USA 112, 510–515 (2015).
Delmas, M. A., Fischlein, M. & Asensio, O. I. Information strategies and energy conservation behavior: a meta-analysis of experimental studies from 1975 to 2012. Energy Policy 61, 729–739 (2013).
Christensen, P., Francisco, P., Myers, E. & Souza, M. Decomposing the wedge between projected and realized returns in energy efficiency programs. Rev. Econ. Stat. 105, 798–817 (2023).
Benartzi, S. et al. Should governments invest more in nudging? Psychol. Sci. 28, 1041–1055 (2017).
Allcott, H. Social norms and energy conservation. J. Public Econ. 95, 1082–1095 (2011).
Allcott, H. & Rogers, T. The short-run and long-run effects of behavioral interventions: experimental evidence from energy conservation. Am. Econ. Rev. 104, 3003–3037 (2014).
Jessoe, K., Lade, G. E., Loge, F. & Spang, E. Spillovers from behavioral interventions: experimental evidence from water and energy use. J. Assoc. Environ. Resour. Econ. 8, 315–346 (2021).
Alacevich, C., Bonev, P. & Söderberg, M. Pro-environmental interventions and behavioral spillovers: evidence from organic waste sorting in Sweden. J. Environ. Econ. Manage. 108, 102470 (2021).
Kumar, P., Caggiano, H., Cutie, C., Felder, F. A. & Shwon, R. Analyzing spillovers from food, energy and water conservation behaviors using insights from systems perspective. Behav. Public Policy 7, 773–807 (2023).
Hancevic, P. I. & Sandoval, H. H. Low-income energy efficiency programs and energy consumption. J. Environ. Econ. Manage. 113, 102656 (2022).
Zivin, J. G. & Novan, K. Upgrading efficiency and behavior: electricity savings from residential weatherization programs. Energy J. 37, 1–23 (2016).
Novan, K., Smith, A. & Zhou, T. Residential building codes do save energy: evidence from hourly smart-meter data. Rev. Econ. Stat. 104, 483–500 (2022).
Levinson, A. How much energy do building energy codes save? Evidence from California houses. Am. Econ. Rev. 106, 2867–2894 (2016).
Ayres, I., Raseman, S. & Shih, A. Evidence from two large field experiments that peer comparison feedback can reduce residential energy usage. J. Law Econ. Organ. 29, 992–1022 (2013).
Alberini, A. & Towe, C. Information v. energy efficiency incentives: evidence from residential electricity consumption in Maryland. Energy Econ. 52, S30–S40 (2015).
Houde, S. & Aldy, J. E. Consumers’ response to state energy efficient appliance rebate programs. Am. Econ. J. Econ. Policy 9, 227–255 (2017).
Arimura, T. H., Li, S., Newell, R. G. & Palmer, K. Cost-effectiveness of electricity energy efficiency programs. Energy J. 33, 63–99 (2012).
Davis, L. W., Fuchs, A. & Gertler, P. Cash for coolers: evaluating a large-scale appliance replacement program in Mexico. Am. Econ. J. Econ. Policy 6, 207–238 (2014).
Alberini, A., Gans, W. & Towe, C. Free riding, upsizing, and energy efficiency incentives in Maryland homes. Energy J. 37, 259–290 (2016).
Ito, K. Asymmetric incentives in subsidies: evidence from a large-scale electricity rebate program. AM. Econ. J. Econ. Policy 7, 209–237 (2015).
Giraudet, L.-G., Houde, S. & Maher, J. Moral hazard and the energy efficiency gap: theory and evidence. J. Assoc. Environ. Resour. Econ. 5, 755–790 (2018).
Remer, D. S. & Nieto, A. P. A compendium and comparison of 25 project evaluation techniques. Part 1: net present value and rate of return methods. Int. J. Prod. Econ. 42, 79–96 (1995).
Metcalf, G. E. & Hassett, K. A. Measuring the energy savings from home improvement investments: evidence from monthly billing data. Rev. Econ. Stat. 81, 516–528 (1999).
Giandomenico, L., Papineau, M. & Rivers, N. A systematic review of energy efficiency home retrofit evaluation studies. Annu. Rev. Resour. Econ. 14, 689–708 (2022).
Allcott, H. & Greenstone, M. Is there an energy efficiency gap? J. Econ. Perspect. 26, 3–28 (2012).
Tuominen, P. et al. Economic appraisal of energy efficiency in buildings using cost-effectiveness assessment. Proc. Econ. Financ. 21, 422–430 (2015).
Nikolaidis, Y., Pilavachi, P. A. & Chletsis, A. Economic evaluation of energy saving measures in a common type of Greek building. Appl. Energy 86, 2550–2559 (2009).
Kim, J. J. Economic analysis on energy saving technologies for complex manufacturing building. Resour. Conserv. Recycl. 123, 249–254 (2017).
Benefit-Cost Evaluation of U.S. Department of Energy Investment in HVAC, Water Heating, and Appliance Technologies (US DOE, 2017); https://www.energy.gov/sites/default/files/2017/09/f36/DOE-EERE-BTO-HVAC_Water%20Heating_Appliances%202017%20Impact%20Evaluation%20Final.pdf
Sutherland, R. J. Market barriers to energy-efficiency investments. Energy J. 12, 15–34 (1991).
Lai, Y. et al. Building retrofit hurdle rates and risk aversion in energy efficiency investments. Appl. Energy 306, 118048 (2022).
Lee, Y. & Schachter, H. L. Exploring the relationship between trust in government and citizen participation. Int. J. Public Adm. 42, 405–416 (2019).
Miller, D. & Rivera, J. D. Guiding principles: rebuilding trust in government and public policy in the aftermath of hurricane Katrina. J. Public Manage. Soc. Policy 12, 37–47 (2006).
Kampen, J. K., De Walle, S. V. & Bouckaert, G. Assessing the relation between satisfaction with public service delivery and trust in government. The impact of the predisposition of citizens toward government on evaluations of its performance. Public Perform. Manage. Rev. 29, 387–404 (2006).
American Community Survey 5-Year Data (2009–2019) (United States Census Bureau, accessed 23 May 2021); https://www.census.gov/data/developers/data-sets/acs-5year.html
Walls, M., Gerarden, T., Palmer, K. & Bak, X. F. Is energy efficiency capitalized into home prices? Evidence from three U.S. cities. J. Environ. Econ. Manage. 82, 104–124 (2017).
Im, J., Seo, Y., Cetin, K. S. & Singh, J. Energy efficiency in U.S. residential rental housing: adoption rates and impact on rent. Appl. Energy 205, 1021–1033 (2017).
Degree Days Statistics (2004–2019) (NOAA, accessed 13 March 2021); https://www.cpc.ncep.noaa.gov/products/analysis_monitoring/cdus/degree_days/
Sekhon, J. S. Multivariate and propensity score matching software with automated balance optimization: the matching package for R. J. Stat. Softw. 42, 1–52 (2011).
Imai, K., King, G. & Stuart, E. A. in Field Experiments and Their Critics (ed. Teele, D. L.) 196–227 (Yale Univ. Press, 2008).
King, G., Lucas, C. & Nielsen, R. The balance-sample size frontier in matching methods for causal inference. Am. J. Polit. Sci. 61, 473–489 (2017).
Rosenbaum, P. R. in Observational Studies 71–104 (Springer, 2002).
Rosenbaum, P. R. Sensitivity analysis for M-estimates, tests, and confidence intervals in matched observational studies. Biometrics 63, 456–464 (2007).
Athey, S. & Imbens, G. W. Design-based analysis in difference-in-differences settings with staggered adoption. J. Econom. 226, 62–79 (2022).
Callaway, B. & Sant’Anna, P. H. Difference-in-differences with multiple time periods. J. Econom. 225, 200–230 (2021).
de Chaisemartin, C. & d’Haultfoeuille, X. Two-way fixed effects estimators with heterogeneous treatment effects. Am. Econ. Rev. 110, 2964–2996 (2020).
Miller, D. L. An introductory guide to event study models. J. Econ. Perspect. 37, 203–230 (2023).
Ham, D. W. & Miratrix, L. Benefits and costs of matching prior to a difference in differences analysis when parallel trends does not hold. Preprint at https://arxiv.org/abs/2205.08644v5 (2024).
Goodman-Bacon, A. Difference-in-differences with variation in treatment timing. J. Econom. 225, 254–277 (2021).
Baker, A. C., Larcker, D. F. & Wang, C. C. How much should we trust staggered difference-in-differences estimates? J. Financ. Econ. 144, 370–395 (2022).
Sun, L. & Abraham, S. Estimating dynamic treatment effects in event studies with heterogeneous treatment effects. J. Econom. 225, 175–199 (2021).
Asensio, O. I., Churkina, O., Rafter, B. & O'Hare, K. E. Replication data for: housing policies and energy efficiency spillovers in low and moderate income communities. Harvard Dataverse V3 https://doi.org/10.7910/DVN/SF1DRW (2024).
City of Albany’s GeoHub. City of Albany Georgia https://geohub.albanyga.gov (2020).
Asensio, O. I., Churkina, O., Rafter, B. & O'Hare, K. E. Replication code for: “Housing policies and energy efficiency spillovers in low and moderate-income communities”. Zenodo https://doi.org/10.5281/zenodo.5684354 (2024).
Acknowledgements
This work was partially supported by awards from the National Science Foundation (NSF) Award No. 1945332 (O.I.A.); ESRI, Inc. (O.I.A.); the Georgia Smart Communities Challenge (O.I.A.); and the Institute for the Study of Business in Global Society at Harvard Business School (O.I.A.). We thank collaborators at the Albany Department of Community and Economic Development, Dougherty County, the Georgia Initiative for Community Housing, and Fight Albany Blight for supporting this study; public administrators in Albany, GA, including S. Carter, Shelena Hawkins, Shuronda Hawkins, S. Subadan, D. Cooper, M. Broughton, P. Brown, P. Whitley-Banks, D. Hughley, M. Petty, C. Mathis, C. Fisher, J. Dawson, R. Smith, J. Zackery, S. Beale, C. Brown, S. Collier and the Emerging Technologies Team for invaluable feedback and engagement; A. Turner, D. Lam, C. Le Dantec, A. Meng, C. Mesimer, M. Majumdar, J. Dev, J. Mendez, G. McCormick, S. Hodges and X. Mi for valuable discussions and collaboration. This study would not have been possible without the research assistance of O. Fiol, W. Jang, D. Marchetto, M. Reid and D. Reynolds, who conducted pre-analysis of data. We also thank 40 anonymous community residents for their participation; L. Goulder and participants at the Stanford Organizations and Environmental Sustainability conference, and the Alliance for Research on Corporate Sustainability (ARCS) conference for valuable discussant feedback. This research was supported in part through research cyberinfrastructure resources and services provided by the Partnership for an Advanced Computing Environment (PACE) at the Georgia Institute of Technology, Atlanta, Georgia, USA.
Author information
Authors and Affiliations
Contributions
O.I.A. conceptualized the project. O.I.A., O.C., B.D.R. and K.E.O. developed the methodology. O.C. and K.E.O. developed software. O.C. and B.D.R. performed validation. O.I.A., O.C., B.D.R. and K.E.O. conducted investigations. O.I.A. procured resources. O.C., B.D.R. and K.E.O. curated data. O.C., B.D.R. and K.E.O. performed visualization. O.I.A., O.C. and B.D.R. wrote the original draft. O.I.A., O.C. and B.D.R. reviewed and edited the paper. O.I.A. administered the project and acquired funding.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Sustainability thanks Maya Papineau and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary Information
Supplementary Notes 1–10, Discussion, Figs. 1–7, Tables 1–8 and references.
Source data
Source Data Fig. 1
Source data for ‘Housing policies target households with higher energy burdens’: ‘PropertyStats_Fig1.csv’ includes information on location and baseline consumption of properties; ‘pov.csv’ includes information on poverty rates by tract.
Source Data Fig. 2
Source data for ‘Matching algorithms reduce observational bias’ include data points for the standardized percent bias before and after matching.
Source Data Fig. 3
Source data for ‘Cost effectiveness of housing spillovers versus standalone energy efficiency programmes’ contain point estimates of cost-effectiveness ratios from this study and other secondary studies in the literature, 2010–2022.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Asensio, O.I., Churkina, O., Rafter, B.D. et al. Housing policies and energy efficiency spillovers in low and moderate income communities. Nat Sustain (2024). https://doi.org/10.1038/s41893-024-01314-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41893-024-01314-w