Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Article
  • Published:

Epidemiology and Population Health

Use and reporting of Bland–Altman analyses in studies of self-reported versus measured weight and height

Abstract

Background/Objectives

Bland–Altman methods for assessing the agreement between two measures are highly cited. However, these methods may often not be used to assess agreement, and when used, they are not always presented or interpreted correctly. Our objective was to evaluate the use and the quality of reporting of Bland–Altman analyses in studies that compare self-reported with measured weight and height.

Methods

We evaluated the use of Bland–Altman methods in 394 published articles that compared self-reported and measured weight and height data for adolescents or adults. Six reporting criteria were developed: assessment of the normality of the distribution of differences, a complete and correctly labeled Bland–Altman plot displaying the mean difference and limits of agreement (LOA), numerical values and confidence intervals, standard errors, or standard deviations for mean difference, numerical values of LOA, confidence intervals for LOA, and prespecified criteria for acceptable LOA.

Results

Only 72/394 (18%) studies comparing self-reported with measured weight and height or BMI used some form of Bland–Altman analyses. No study using Bland–Altman analyses satisfied more than four of the six criteria. Of the 72 studies, 64 gave mean differences along with confidence intervals or standard deviations, 55 provided complete Bland–Altman plots that were appropriately labeled and described, 37 provided numerical values for LOA, 4 reported that they examined the normality of the distribution of differences, 3 provided confidence intervals for LOA, and 3 had prespecified criteria for agreement.

Conclusions

Bland–Altman methods appear to be infrequently used in studies comparing measured with self-reported weight, height, or BMI, and key information is missing in many of those that do use Bland–Altman methods. Future directions would be defining acceptable LOA values and improving the reporting and application of Bland–Altman methods in studies of self-reported anthropometry.

This is a preview of subscription content, access via your institution

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Prices may be subject to local taxes which are calculated during checkout

Fig. 1

Similar content being viewed by others

References

  1. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.

    Article  CAS  PubMed  Google Scholar 

  2. Altman DG, Bland JM. Assessing agreement between methods of measurement. Clin Chem. 2017;63:1653–4.

    Article  PubMed  Google Scholar 

  3. Bland JM, Altman DG. Applying the right statistics: analyses of measurement studies. Ultrasound Obstet Gynecol. 2003;22:85–93.

    Article  CAS  PubMed  Google Scholar 

  4. Giavarina D. Understanding Bland Altman analysis. Biochem Med. 2015;25:141–51.

    Article  Google Scholar 

  5. Hamilton C, Stamey J. Using Bland-Altman to assess agreement between two medical devices-don’t forget the confidence intervals! J Clin Monit Comput. 2007;21:331–3.

    Article  PubMed  Google Scholar 

  6. Ludbrook J. Confidence in Altman-Bland plots: a critical review of the method of differences. Clin Exp Pharmacol Physiol. 2010;37:143–9.

    Article  CAS  PubMed  Google Scholar 

  7. Phatak AG, Nimbalkar SM. Method comparison (agreement) studies: myths and rationale. J Clin Diagn Res. 2017;11:Ji01–3.

    PubMed  PubMed Central  Google Scholar 

  8. Twomey PJ. How to use difference plots in quantitative method comparison studies. Ann Clin Biochem. 2006;43:124–9.

    Article  PubMed  Google Scholar 

  9. Watson PF, Petrie A. Method agreement analysis: a review of correct methodology. Theriogenology. 2010;73:1167–79.

    Article  CAS  PubMed  Google Scholar 

  10. Dewitte K, Fierens C, Stockl D, Thienpont LM. Application of the Bland-Altman plot for interpretation of method-comparison studies: a critical investigation of its practice. Clin Chem. 2002;48:799–801. Author reply 801–792.

    Article  CAS  PubMed  Google Scholar 

  11. Abu-Arafeh A, Jordan H, Drummond G. Reporting of method comparison studies: a review of advice, an assessment of current practice, and specific suggestions for future reports. Br J Anaesth. 2016;117:569–75.

    Article  CAS  PubMed  Google Scholar 

  12. Berthelsen PG, Nilsson LB. Researcher bias and generalization of results in bias and limits of agreement analyses: a commentary based on the review of 50 Acta Anaesthesiologica Scandinavica papers using the Altman-Bland approach. Acta Anaesthesiol Scand. 2006;50:1111–3.

    Article  CAS  PubMed  Google Scholar 

  13. Mantha S, Roizen MF, Fleisher LA, Thisted R, Foss J. Comparing methods of clinical measurement: reporting standards for bland and altman analysis. Anesth Analg. 2000;90:593–602.

    Article  CAS  PubMed  Google Scholar 

  14. Chhapola V, Kanwal SK, Brar R. Reporting standards for Bland-Altman agreement analysis in laboratory research: a cross-sectional survey of current practice. Ann Clin Biochem. 2015;52:382–6.

    Article  PubMed  Google Scholar 

  15. Zaki R, Bulgiba A, Ismail R, Ismail NA. Statistical methods used to test for agreement of medical instruments measuring continuous variables in method comparison studies: a systematic review. PLoS ONE. 2012;7:e37908.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Bowman RL, DeLucia JL. Accuracy of self-reported weight: a meta-analysis. Behav Ther. 1992;23:637–55.

    Article  Google Scholar 

  17. Connor Gorber S, Tremblay M, Moher D, Gorber B. A comparison of direct vs. self-report measures for assessing height, weight and body mass index: a systematic review. Obes Rev. 2007;8:307–26.

    Article  CAS  PubMed  Google Scholar 

  18. Engstrom JL, Paterson SA, Doherty A, Trabulsi M, Speer KL. Accuracy of self-reported height and weight in women: an integrative review of the literature. J Midwifery Womens Health. 2003;48:338–45.

    Article  PubMed  Google Scholar 

  19. He J, Cai Z, Fan X. Accuracy of using self-reported data to screen children and adolescents for overweight and obesity status: a diagnostic meta-analysis. Obes Res Clin Pract. 2017;11:257–67.

    Article  PubMed  Google Scholar 

  20. Headen I, Cohen AK, Mujahid M, Abrams B. The accuracy of self-reported pregnancy-related weight: a systematic review. Obes Rev. 2017;18:350–69.

    Article  CAS  PubMed  Google Scholar 

  21. Maukonen M, Mannisto S, Tolonen H. A comparison of measured versus self-reported anthropometrics for assessing obesity in adults: a literature review. Scand J Public Health. 2018;46. https://doi.org/10.1177/1403494818761971.

    Article  PubMed  Google Scholar 

  22. Seijo M, Minckas N, Cormick G, Comande D, Ciapponi A, Belizan JM. Comparison of self-reported and directly measured weight and height among women of reproductive age: a systematic review and meta-analysis. Acta Obstet Gynecol Scand. 2018;97:429–39.

    Article  PubMed  Google Scholar 

  23. Sherry B, Jefferds ME, Grummer-Strawn LM. Accuracy of adolescent self-report of height and weight in assessing overweight status: a literature review. Arch Pediatr Adolesc Med. 2007;161:1154–61.

    Article  PubMed  Google Scholar 

  24. De Rubeis V, Bayat S, Griffith LE, Smith BT, Anderson LN. Validity of self-reported recall of anthropometric measures in early life: a systematic review and meta-analysis. Obes Rev. 2019;20:1426–40.

    Article  PubMed  Google Scholar 

  25. Cuspidi C, Negri F, Giudici V, Muiesan ML, Grandi AM, Ganau A, et al. Self-reported weight and height: implications for left ventricular hypertrophy detection. An Italian multi-center study. Clin Exp Hypertens. 2011;33:192–201.

    Article  PubMed  Google Scholar 

  26. Wang Z, Patterson CM, Hills AP. A comparison of self-reported and measured height, weight and BMI in Australian adolescents. Aust N Z J Public Health. 2002;26:473–8.

    Article  CAS  PubMed  Google Scholar 

  27. Bes-Rastrollo M, Sabate J, Jaceldo-Siegl K, Fraser GE. Validation of self-reported anthropometrics in the Adventist Health Study 2. BMC Public Health. 2011;11:213.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Celis-Morales C, Livingstone KM, Woolhead C, Forster H, O’Donovan CB, Macready AL, et al. How reliable is internet-based self-reported identity, socio-demographic and obesity measures in European adults? Genes Nutrition. 2015;10:28.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Villarini M, Acito M, Gianfredi V, Berrino F, Gargano G, Somaini M, et al. Validation of self-reported anthropometric measures and body mass index in a subcohort of the dianaweb population study. Clin Breast Cancer. 2019;19:e511–8.

    Article  PubMed  Google Scholar 

  30. Xie YJ, Ho SC, Liu ZM, Hui SS. Comparisons of measured and self-reported anthropometric variables and blood pressure in a sample of Hong Kong female nurses. PLoS ONE. 2014;9:e107233.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  31. Burton NW, Brown W, Dobson A. Accuracy of body mass index estimated from self-reported height and weight in mid-aged Australian women. Aust N Z J Public Health. 2010;34:620–3.

    Article  PubMed  Google Scholar 

  32. Elgar FJ, Stewart JM. Validity of self-report screening for overweight and obesity. Evidence from the Canadian Community Health Survey. Can J Public Health. 2008;99:423–7.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Haverkort EB, de Haan RJ, Binnekade JM, van Bokhorst-de van der Schueren MA. Self-reporting of height and weight: valid and reliable identification of malnutrition in preoperative patients. Am J Surg. 2012;203:700–7.

    Article  PubMed  Google Scholar 

  34. Yoshitake N, Okuda M, Sasaki S, Kunitsugu I, Hobara T. Validity of self-reported body mass index of Japanese children and adolescents. Pediatr Int. 2012;54:397–401.

    Article  PubMed  Google Scholar 

  35. Zhou X, Dibley MJ, Cheng Y, Ouyang X, Yan H. Validity of self-reported weight, height and resultant body mass index in Chinese adolescents and factors associated with errors in self-reports. BMC Public Health. 2010;10:190.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Barrios P, Martin-Biggers J, Quick V, Byrd-Bredbenner C. Reliability and criterion validity of self-measured waist, hip, and neck circumferences. BMC Med Res Methodol. 2016;16:49.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Krakowiak P, Walker CK, Tancredi DJ, Hertz-Picciotto I. Maternal recall versus medical records of metabolic conditions from the prenatal period: a validation study. Matern Child Health J. 2015;19:1925–35.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Pursey K, Burrows TL, Stanwell P, Collins CE. How accurate is web-based self-reported height, weight, and body mass index in young adults? J Med Internet Res. 2014;16:e4.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Powell-Young YM. The validity of self-report weight and height as a surrogate method for direct measurement. Appl Nurs Res. 2012;25:25–30.

    Article  PubMed  Google Scholar 

  40. Fonseca H, Silva AM, Matos MG, Esteves I, Costa P, Guerra A, et al. Validity of BMI based on self-reported weight and height in adolescents. Acta Paediatr. 2010;99:83–88.

    CAS  PubMed  Google Scholar 

  41. Kee CC, Lim KH, Sumarni MG, Teh CH, Chan YY, Nuur Hafizah MI, et al. Validity of self-reported weight and height: a cross-sectional study among Malaysian adolescents. BMC Med Res Methodol. 2017;17:85.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Olivarius NF, Andreasen AH, Loken J. Accuracy of 1-, 5- and 10-year body weight recall given in a standard questionnaire. Int J Obes Relat Metab Disord. 1997;21:67–71.

    Article  CAS  PubMed  Google Scholar 

  43. De Vriendt T, Huybrechts I, Ottevaere C, Van Trimpont I, De Henauw S. Validity of self-reported weight and height of adolescents, its impact on classification into BMI-categories and the association with weighing behaviour. Int J Environ Res Public Health. 2009;6:2696–711.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Yoong SL, Carey ML, D’Este C, Sanson-Fisher RW. Agreement between self-reported and measured weight and height collected in general practice patients: a prospective study. BMC Med Res Methodol. 2013;13:38.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Pasalich M, Lee AH, Burke L, Jancey J, Howat P. Accuracy of self-reported anthropometric measures in older Australian adults. Australas J Ageing. 2014;33:E27–32.

    Article  PubMed  Google Scholar 

  46. McAdams MA, van Dam RM, Hu FB. Comparison of self-reported and measured BMI as correlates of disease markers in US adults. Obesity. 2007;15:188–96.

    Article  PubMed  Google Scholar 

  47. Steventon A, Chaudhry SI, Lin Z, Mattera JA, Krumholz HM. Assessing the reliability of self-reported weight for the management of heart failure: application of fraud detection methods to a randomised trial of telemonitoring. BMC Med Inform Decis Mak. 2017;17:43.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Bowring AL, Peeters A, Freak-Poli R, Lim MS, Gouillou M, Hellard M. Measuring the accuracy of self-reported height and weight in a community-based sample of young people. BMC Med Res Methodol. 2012;12:175.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Brestoff JR, Perry IJ, Van den Broeck J. Challenging the role of social norms regarding body weight as an explanation for weight, height, and BMI misreporting biases: development and application of a new approach to examining misreporting and misclassification bias in surveys. BMC Public Health. 2011;11:331.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Lawlor DA, Bedford C, Taylor M, Ebrahim S. Agreement between measured and self-reported weight in older women. Results from the British Women’s Heart and Health Study. Age Ageing. 2002;31:169–74.

    Article  PubMed  Google Scholar 

  51. Spencer EA, Appleby PN, Davey GK, Key TJ. Validity of self-reported height and weight in 4808 EPIC-Oxford participants. Public Health Nutr. 2002;5:561–5.

    Article  PubMed  Google Scholar 

  52. Wright FL, Green J, Reeves G, Beral V, Cairns BJ. Validity over time of self-reported anthropometric variables during follow-up of a large cohort of UK women. BMC Med Res Methodol. 2015;15:81.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Pirie P, Jacobs D, Jeffery R, Hannan P. Distortion in self-reported height and weight data. J Am Diet Assoc. 1981;78:601–6.

    CAS  PubMed  Google Scholar 

  54. Rimm EB, Stampfer MJ, Colditz GA, Chute CG, Litin LB, Willett WC. Validity of self-reported waist and hip circumferences in men and women. Epidemiology. 1990;1:466–73.

    Article  CAS  PubMed  Google Scholar 

  55. Luo J, Thomson CA, Hendryx M, Tinker LF, Manson JE, Li Y, et al. Accuracy of self-reported weight in the Women’s Health Initiative. Public Health Nutr. 2019;22:1–10.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katherine M. Flegal.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Flegal, K.M., Graubard, B. & Ioannidis, J.P.A. Use and reporting of Bland–Altman analyses in studies of self-reported versus measured weight and height. Int J Obes 44, 1311–1318 (2020). https://doi.org/10.1038/s41366-019-0499-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41366-019-0499-5

This article is cited by

Search

Quick links