Abstract
Background:
Many large-scale epidemiological data sources used to evaluate the body mass index (BMI: kg/m2) mortality association have relied on BMI derived from self-reported height and weight. Although measured BMI (BMIM) and self-reported BMI (BMISR) correlate highly, self-reports are systematically biased.
Objective:
To rigorously examine how self-reporting bias influences the association between BMI and mortality rate.
Subjects:
Samples representing the US non-institutionalized civilian population.
Design and Methods:
National Health and Nutrition Examination Survey data (NHANES II: 1976–80; NHANES III: 1988–94) contain BMIM and BMISR. We applied Cox regression to estimate mortality hazard ratios (HRs) for BMIM and BMISR categories, respectively, and compared results. We similarly analyzed subgroups of ostensibly healthy never-smokers.
Results:
Misclassification by BMISR among the underweight and obesity ranged from 30–40% despite high correlations between BMIM and BMISR (r>0.9). The reporting bias was moderately correlated with BMIM (r>0.35), but not BMISR (r<0.15). Analyses using BMISR failed to detect six of eight significant mortality HRs detected by BMIM. Significantly biased HRs were detected in the NHANES II full data set (χ2=12.49; P=0.01) and healthy subgroup (χ2=9.93; P=0.04), but not in the NHANES III full data set (χ2=5.63; P=0.23) or healthy subgroup (χ2=1.52; P=0.82).
Conclusions:
BMISR should not be treated as interchangeable with BMIM in BMI mortality analyses. Bias and inconsistency introduced by using BMISR in place of BMIM in BMI mortality estimation and hypothesis tests may account for important discrepancies in published findings.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$259.00 per year
only $21.58 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Baskin ML, Ard J, Franklin F, Allison DB . Prevalence of obesity in the United States. Obes Rev 2005; 6: 5–7.
Gregg EW, Cheng YJ, Cadwell BL, Imperatore G, Williams DE, Flegal KM et al. Secular trends in cardiovascular disease risk factors according to body mass index in US adults. JAMA 2005; 293: 1868–1874.
Gregg EW, Cheng YJ, Narayan KM, Thompson TJ, Williamson DF . The relative contributions of different levels of overweight and obesity to the increased prevalence of diabetes in the United States: 1976–2004. Prev Med 2007; 45: 348–352.
Calle EE, Thun MJ . Obesity and cancer. Oncogene 2004; 23: 6365–6378.
Allison DB, Zannolli R, Narayan KM . The direct health care costs of obesity in the United States. Am J Public Health 1999; 89: 1194–1199.
Fontaine KR, Redden DT, Wang C, Westfall AO, Allison DB . Years of life lost due to obesity. JAMA 2003; 289: 187–193.
Adams KF, Schatzkin A, Harris TB, Kipnis V, Mouw T, Ballard-Barbash R et al. Overweight, obesity, and mortality in a large prospective cohort of persons 50 to 71 years old. N Eng J Med 2006; 355: 763–778.
Allison DB, Fontaine KR, Manson JE, Stevens J, VanItallie TB . Annual deaths attributable to obesity in the United States. JAMA 1999; 282: 1530–1538.
Baik I, Ascherio A, Rimm EB, Giovannucci E, Spiegelman D, Stampfer MJ et al. Adiposity and mortality in men. Am J Epidemiol 2000; 152: 264–271.
Calle EE, Thun MJ, Petrelli JM, Rodriguez C, Heath Jr CW . Body-mass index and mortality in a prospective cohort of US adults. N Eng J Med 1999; 341: 1097–1105.
Flegal KM, Graubard BI, Williamson DF, Gail MH . Excess deaths associated with underweight, overweight, and obesity. JAMA 2005; 293: 1861–1867.
Flegal KM, Graubard BI, Williamson DF, Gail MH . Cause-specific excess deaths associated with underweight, overweight, and obesity. JAMA 2007; 298: 2028–2037.
Gelber RP, Kurth T, Manson JE, Buring JE, Gaziano JM . Body mass index and mortality in men: evaluating the shape of the association. Int J Obes (London) 2007; 31: 1240–1247.
Manson JE, Willett WC, Stampfer MJ, Colditz GA, Hunter DJ, Hankinson SE et al. Body weight and mortality among women. N Eng J Med 1995; 333: 677–685.
Prospective Studies Collaboration, Whitlock G Lewington S Sherliker P Clarke R Emberson J, Halsey J et al. Body-mass index and cause-specific mortality in 900 000 adults: collaborative analyses of 57 prospective studies. Lancet 2009; 373: 1083–1096.
Flegal KM, Graubard BI, Williamson DF, Gail MH . Impact of smoking and preexisting illness on estimates of the fractions of deaths associated with underweight, overweight, and obesity in the US population. Am J Epidemiol 2007; 166: 975–982.
Black DR, Taylor AM, Coster DC . Accuracy of self-reported body weight: stepped approach model component assessment. Health Educ Res 1998; 13: 301–307.
Ezzati M, Martin H, Skjold S, Vander Hoorn S, Murray CJ . Trends in national and state-level obesity in the USA after correction for self-report bias: analysis of health surveys. J R Soc Med 2006; 99: 250–257.
Gillum RF, Sempos CT . Ethnic variation in validity of classification of overweight and obesity using self-reported weight and height in American women and men: the Third National Health and Nutrition Examination Survey. Nutr J 2005; 4: 27.
James WP, Jackson-Leach R, Mhurchu CN, Kalamara E, Shayeghi M, Rigby NJ et al. Overweight and obesity (high body mass index). In: Ezzati M, Lopez AD, Rodgers A, Murray CJ (eds). Comparative Quantification of Health Risks: Global and Regional Burden of Disease Attributable to Selected Major Risk Factors Vol. 1. World Health Organization: Geneva, 2004, p 497.
Jeffery RW . Bias in reported body weight as a function of education, occupation, health and weight concern. Addict Behav 1996; 21: 217–222.
Kuczmarski MF, Kuczmarski RJ, Najjar M . Effects of age on validity of self-reported height, weight, and body mass index: findings from the Third National Health and Nutrition Examination Survey, 1988–1994. J Am Diet Assoc 2001; 101: 28–34; quiz 35-6.
McAdams MA, Van Dam RM, Hu FB . Comparison of self-reported and measured BMI as correlates of disease markers in US adults. Obesity (Silver Spring) 2007; 15: 188–196.
Niedhammer I, Bugel I, Bonenfant S, Goldberg M, Leclerc A . Validity of self-reported weight and height in the French GAZEL cohort. Int J Obes Relat Metab Disord 2000; 24: 1111–1118.
Nyholm M, Gullberg B, Merlo J, Lundqvist-Persson C, Rastam L, Lindblad U . The validity of obesity based on self-reported weight and height: Implications for population studies. Obesity (Silver Spring) 2007; 15: 197–208.
Plankey MW, Stevens J, Flegal KM, Rust PF . Prediction equations do not eliminate systematic error in self-reported body mass index. Obes Res 1997; 5: 308–314.
Rowland ML . Self-reported weight and height. Am J Clin Nutr 1990; 52: 1125–1133.
Stommel M, Schoenborn CA . Accuracy and usefulness of BMI measures based on self-reported weight and height: findings from the NHANES & NHIS 2001–2006. BMC Public Health 2009; 9: 421.
Villanueva EV . The validity of self-reported weight in US adults: a population based cross-sectional study. BMC Public Health 2001; 1: 11.
Wada K, Tamakoshi K, Tsunekawa T, Otsuka R, Zhang H, Murata C et al. Validity of self-reported height and weight in a Japanese workplace population. Int J Obes (London) 2005; 29: 1093–1099.
Yannakoulia M, Panagiotakos DB, Pitsavos C, Stefanadis C . Correlates of BMI misreporting among apparently healthy individuals: the ATTICA study. Obesity (Silver Spring) 2006; 14: 894–901.
Spencer EA, Appleby PN, Davey GK, Key TJ . Validity of self-reported height and weight in 4808 EPIC-Oxford participants. Public Health Nutr 2002; 5: 561–565.
Manson JE, Bassuk SS, Hu FB, Stampfer MJ, Colditz GA, Willett WC . Estimating the number of deaths due to obesity: can the divergent findings be reconciled? J Women Health (Larchmt) 2007; 16: 168–176.
Loria CM, Semps CR, Vuong C . Plan and operation of the NHANES II mortality study, 1992. Vital Health Stat 1999; 38: 1–16.
National Center for Health Statistics. Plan and operation of the Third National Health and Nutrition Examination Survey, 1988–1994, Series I: programs and collection procedures. Vital Health Stat 1994; 32: 1–407.
Data Linkage Team. Comparative analysis of the NHANES III public-use and restricted-use linked mortality files: 2010 public-use data release. National Center for Health Statistics, 2010. Available at: http://www.cdc.gov/nchs/data/datalinkage/nhanes3_mort_compare_2010_final.pdf (accessed 20 July 2010).
NHLBI Obesity Education Initiative Expert Panel. Clinical guidelines on the identification, evaluation, and treatment of overweight and obesity in adults. Obes Res 1998; 6 (suppl 2): 51S. Available at: http://www.nhlbi.nih.gov/guidelines/obesity/ob_home.htm (accessed 16 January 2010).
Gail MH, Graubard B, Williamson DF, Flegal KM . Comments on ‘Choice of time scale and its effect on significance of predictors in longitudinal studies’ by Michael J. Pencina, Martin G. Larson and Ralph B. D’Agostino, Statistics in Medicine 2007; 26:1343-1359. Stat Med 2009; 28: 1315–1317.
Korn EL, Graubard BI, Midthune D . Time-to-event analysis of longitudinal follow-up of a survey: choice of the time-scale. Am J Epidemiol 1997; 145: 72–80.
Anderson PK, Gill RD . Cox's regression model for counting processes: a large sample study. Ann Stat 1982; 10: 1100–1120.
Rust KF, Rao JNK . Variance estimation for complex surveys using replication methods. Stat Methods Med Res 1996; 5: 283–310.
Korn EL, Graubard BI . Analysis of Health Surveys. John Wiley & Sons: New York, 1999.
National Center for Health Statistics. Analytic and Reporting Guidelines: The Third National Health and Nutrition Examination Survey, NHANES III (1988-94). Centers for Disease Control and Prevention 1996. Available at: http://www.cdc.gov/nchs/data/nhanes/nhanes3/nh3gui.pdf (accessed 20 July 2010).
Connor Gorber S, Tremblay M, Moher D, Gorber B . A comparison of direct vs. self-report measures for assessing height, weight and body mass index: a systematic review. Obes Rev 2007; 8: 307–326.
Jain RB . Regression models to predict corrected weight, height and obesity prevalence from self-reported data: data from BRFSS 1999-2007. Int J Obes (London) 2010 (e-pub ahead of print 13 April 2010).
Lash TL, Fox MP, Thwin SS, Geiger AM, Buist DS, Wei F et al. Using probabilistic corrections to account for abstractor agreement in medical record reviews. Am J Epidemiol 2007; 165: 1454–1461.
Carroll RJ, Ruppert D, Stefanski LA, Crainiceanu CM . Measurement Error in Nonlinear Models: A Modern Perspective, Vol. Second. Chapman and Hall CRC Press: Boca Raton, FL, 2006.
Fox MP, Lash TL, Greenland S . A method to automate probabilistic sensitivity analyses of misclassified binary variables. Int J Epidemiol 2005; 34: 1370–1376.
Chiolero A, Peytremann-Bridevaux I, Paccaud F . Associations between obesity and health conditions may be overestimated if self-reported body mass index is used. Obes Rev 2007; 8: 373–374.
Rothman KJ . BMI-related errors in the measurement of obesity. Int J Obes (London) 2008; 32 (Suppl 3): S56–S59.
Acknowledgements
This research was supported in part by NIH grants P30DK056336, T32HL079888, T32HL072757, K23MH066381, and AR49720.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
DBA has received grants, honoraria, donations, and consulting fees from numerous food, beverage, pharmaceutical companies, and other commercial, government, and nonprofit entities with interests in obesity. Other authors declare no conflict of interest.
Additional information
Author Contributions
SWK: Conception of project, acquisition and statistical analysis of data, analysis and interpretation of data, drafting of the manuscript, and critical revision of the manuscript for important intellectual content. KRF: Interpretation of the data, critical revision of the manuscript important to the intellectual content, and supervision. NMP: Interpretation of the data, critical revision of the manuscript for important intellectual content, and technical support. TM: Interpretation of the data, critical revision of the manuscript for important intellectual content, and technical support. DBA: Conception of project, drafting sections and critical revision of the manuscript for important intellectual content, analysis and interpretation of data, obtaining funding, and supervision. SWK is the guarantor of the paper, having had full access to all of the data in the study, and takes responsibility for the integrity of the data and the accuracy of the data analysis. He had final responsibility for the decision to submit for publication.
Disclaimer
The opinions expressed are those of the authors and not necessarily those of the NIH or any other organization with which the authors are affiliated.
Rights and permissions
About this article
Cite this article
Keith, S., Fontaine, K., Pajewski, N. et al. Use of self-reported height and weight biases the body mass index–mortality association. Int J Obes 35, 401–408 (2011). https://doi.org/10.1038/ijo.2010.148
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/ijo.2010.148
Keywords
This article is cited by
-
Examining validity of body mass index calculated using height and weight data from the US driver license
BMC Public Health (2019)
-
Severe obesity and cardio-metabolic comorbidities: a nationwide study of 2.8 million adolescents
International Journal of Obesity (2019)
-
Black Immigrants from Africa and the Caribbean Have Similar Rates of Diabetes but Africans Are Less Obese: the New York City Community Health Survey 2009–2013
Journal of Racial and Ethnic Health Disparities (2019)
-
Foreign-Born Blacks Experience Lower Odds of Obesity but Higher Odds of Diabetes than US-Born Blacks in New York City
Journal of Immigrant and Minority Health (2019)
-
Body mass index and infectious disease mortality in midlife in a cohort of 2.3 million adolescents
International Journal of Obesity (2018)