Delgardo-Ron et al. [1] use flawed methods to conclude that salt restriction in those with caloric deficiency may not be advisable. In a repeated cross-sectional analysis using publicly available National Health and Nutrition Examination Survey (NHANES) data 2007–2018, they restrict participants to those they believe are on calorie restricted diets and use regression methods to assess the association between sodium intake and hypertension.
Delgado-Ron et al. [1] use the energy balance method to identify people with calorie restricted diets- diets that are in energy deficit of at least 350 calories (equivalent to around 1465 kJ) per day. The use of energy balance methods are not new, and are designed to identify people likely to be under-reporting dietary intake, rather than those genuinely on an energy restricted diet [2, 3]. These methods used estimated energy expenditure from equations that estimate basal metabolic energy requirements from age, sex, weight and height plus self-reported energy expenditure (weekly vigorous and moderate physical activity) from the NHANES dataset. They then compare these with self-reported energy intake derived from 24 hour recall data.
Under-reporting in dietary surveys is common. Although the USDA multiple pass methods have been shown to reduce under-reporting compared with more traditional 24 h recall methods, under reporting is likely in around 25% of participants [4]. Under-reporting in dietary surveys is not random, and has been shown to be greater among older participants, those with lower education and those with a higher body mass index in NHANES data [4]. Under-reporting of sodium intake data has been shown to be much greater in overweight and obese subjects when validated with the gold standard 24 hour urine measure [5]. Further, those who under-report dietary intake are more likely to systematically under report foods perceived as unhealthy than healthy foods [6].
Participants included in this analysis (less than 10% of NHANES participants that completed dietary recalls between 2007 and 2018) are therefore likely to be a mixed group of those who under-reported energy intake, and those who genuinely have a calorie restricted diet- those who are overweight and attempting to lose weight, and those who are underweight [7], leading to bias. Both underweight and overweight participants are likely to have increased risk of co-morbidities and cardiovascular disease than those of normal weight [8].
Twenty four hour urinary excretion is the preferred method for assessment of dietary sodium intake in epidemiological studies. The Delgado-Ron et al’s statement that because they are examining blood pressure as the outcome, using dietary food recall survey data of sodium intake is more appropriate than assessing sodium excretion is false. Validation studies of food recall surveys use 24 hr urine sodium excretion as the standard of comparison [5, 9, 10]. Complete 24 hr urine samples on average represent 93% of ingested sodium at steady state but due to day-to-day fluctuations in diet and excretion multiple non-consecutive 24 hr urine samples are required to accurately assess usual sodium intake in individuals [11]. Food recall surveys have a variable but substantive systematic error underestimating sodium intake in the population (relative to 24 hr urine studies) and also have substantial random error in assessing individual sodium intake [5]. Based on a systematic review of the literature of studies comparing food recall surveys to 24 hr urine sodium excretion, an expert panel of a consortium of major international health and scientific organizations (TRUE consortium) specifically recommended food recall surveys to not be used to assess individual sodium intake [10]. The validity of using the NHANES food recall survey method of assessing sodium intake in individuals to associate with health outcomes has been reported as having a strong bias towards the null hypothesis based on the inaccuracies of the method (low correlation and attenuation factor) to assess sodium intake in individuals [5]. This is likely to at least partially explain the null findings of the Delgado-Ron analysis.
The choice of study design (repeated cross sectional analysis) can not be used for showing causal relationships in epidemiology. There is a high likelihood of residual confounding (given the marked differences between participants with hypertension and those without shown in Table 1 of Delgardo-Ron et al’s paper), and reverse causality (people with diagnosed hypertension may well be restricting both energy and sodium as a result of health advice based on current guidelines) [12]. Well conducted randomised controlled trials consistently show that reducing dietary sodium intake is associated with blood pressure lowering and reduced incidence of hypertension [13]. The totality of evidence strongly supports a reduction in salt intake across the whole population which will lower population blood pressure and reduce cardiovascular disease burden in the population.
References
Delgado-Ron JA, López-Jaramillo P, Karim ME. Sodium intake and high blood pressure among adults on caloric deficit: a multi-year cross-sectional analysis of the U.S. population, 2007–2018. J Hum Hypertension. 2022;36:968–75.
Gemming L, Jiang Y, Swinburn B, Utter J, Ni Mhurchu C. Under-reporting remains a key limitation of self-reported dietary intake: an analysis of the 2008/09 New Zealand Adult Nutrition Survey. Eur J Clin Nutr. 2013;68:259–64.
Black A. The sensitivity and specificity of the Goldberg cut-off for EI: BMR for identifying diet reports of poor validity. Eur J Clin Nutr. 2000;54:395.
Murakami K, Livingstone MBE. Prevalence and characteristics of misreporting of energy intake in US adults: NHANES 2003–2012. Br J Nutr. 2015;114:1294–303.
Va P, Dodd KW, Zhao L, Thompson-Paul AM, Mercado CI, Terry AL, et al. Evaluation of measurement error in 24-hour dietary recall for assessing sodium and potassium intake among US adults — National Health and Nutrition Examination Survey (NHANES), 2014. Am J Clin Nutr. 2019;109:1672–82.
Subar AF, Freedman LS, Tooze JA, Kirkpatrick SI, Boushey C, Neuhouser ML, et al. Addressing Current Criticism Regarding the Value of Self-Report Dietary Data. J Nutr. 2015;145:2639–45.
Ahluwalia N, Dwyer J, Terry A, Moshfegh A, Johnson C. Update on NHANES Dietary Data: Focus on Collection, Release, Analytical Considerations, and Uses to Inform Public Policy. Adv Nutr. 2016;7:121–34.
Park D, Lee JH, Han S. Underweight: another risk factor for cardiovascular disease?: A cross-sectional 2013 Behavioral Risk Factor Surveillance System (BRFSS) study of 491,773 individuals in the USA. Medicine. 2017;96:e8769.
McLean R, Cameron C, Butcher E, Cook NR, Woodward M, Campbell NRC. Comparison of 24-hour urine and 24-hour diet recall for estimating dietary sodium intake in populations: a systematic review and meta-analysis. J Clin Hypertens. 2019;21:1753–62.
McLean RM, Farmer VL, Nettleton A, Cameron CM, Cook NR, Woodward M, et al. Twenty-four-hour diet recall and diet records compared with 24-hour urinary excretion to predict an individual’s sodium consumption: A systematic review. J Clin Hypertens. 2018;20:1360–76.
Campbell NRC, He FJ, Tan M, Cappuccio FP, Neal B, Woodward M, et al. The International Consortium for Quality Research on Dietary Sodium/Salt (TRUE) position statement on the use of 24-hour, spot, and short duration (<24 h) timed urine collections to assess dietary sodium intake. J Clin Hypertens. 2019;21:700–9.
Whelton PK, Carey RM, Aronow WS, Casey DE, Collins KJ, Dennison Himmelfarb C, et al. 2017 ACC/AHA/AAPA/ABC/ACPM/AGS/APhA/ASH/ASPC/NMA/PCNA Guideline for the Prevention, Detection, Evaluation, and Management of High Blood Pressure in Adults: Executive Summary: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. J Am Coll Cardiol. 2018;71:2199–269.
He FJ, Li J, MacGregor GA. Effect of longer term modest salt reduction on blood pressure: Cochrane systematic review and meta-analysis of randomised trials. BMJ. 2013;346;f1325. https://doi.org/10.1136/bmj.f1325.
Funding
Open Access funding enabled and organized by CAUL and its Member Institutions.
Author information
Authors and Affiliations
Contributions
RM wrote the first draft, RM, FH and GM reviewed and revised the manuscript.
Corresponding author
Ethics declarations
Competing interests
GM is the unpaid Chair of Consensus Action on Salt, Sugar and Health (CASSH), World Action on Salt, Sugar and Health (WASSH) and Blood Pressure UK. FH is an unpaid member of CASSH and WASSH. RM has no conflicts of interest to declare.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
McLean, R.M., He, F.J. & MacGregor, G.A. Flawed research methods result in misleading conclusions. J Hum Hypertens (2023). https://doi.org/10.1038/s41371-023-00818-w
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41371-023-00818-w
This article is cited by
-
Adding nuance to dietary prescriptions: does sodium reduction benefit people already losing weight?
Journal of Human Hypertension (2023)