Abstract
The accuracy of Omron 10 Series BP7450 (HEM-7342T-Z), Omron Platinum BP5450 (HEM-7343T-Z), Walmart Equate Premium 8000 Series UA-8000WM, Walgreens Premium 15+ WGNBPA-960BT, and CVS Series 800 BP3MW1-4YCVS were assessed in an adult general population compared to a mercury sphygmomanometer standard according to the ISO 81060-2:2018/AMD 1:2020 validation procedure. Omron selected the monitors and included three non-Omron monitors because they were from large retail vendors in the United States and these monitors did not have accessible results from validation testing. The BP7450, N = 85, passed both criteria for the standard. Mean (SD) differences in paired SBP and DBP determinations between the test device and reference were 0.5 (7.7) and 2.5 (6.8) mm Hg. The BP5450, N = 86, passed both criteria. Mean (SD) differences in paired SBP and DBP determinations were 1.9 (7.0) and 3.6 (6.4) mm Hg. The UA-8000WM, N = 85, did not meet the first criterion for the standard. Mean (SD) differences in paired SBP and DBP determinations were 2.5 (8.0) and 5.1 (6.4) mm Hg. The WGNBPA-240BT, N = 85, did not meet the first criterion for the standard. Mean (SD) differences in paired SBP and DBP determinations were 7.9 (8.5) and 5.5 (6.7) mm Hg. The BP3MW1-4YCVS, N = 85, did not meet the first criterion for the standard. Mean (SD) differences in paired SBP and DBP determinations were 5.8 (8.7) and 3.1 (5.6) mm Hg. These findings emphasize the importance of verifying the validation status of home blood pressure monitors before use by consumers.
Introduction
Out-of-office blood pressure measurement is widely recommended due to its ability to provide more accurate measurements to guide diagnosis and treatment compared to infrequent office BP measurements. Multiple guidelines recommend out-of-office blood pressure measurement for hypertension diagnosis and management [1,2,3,4]. Accurate blood pressure measurement is important when diagnosing and treating hypertension [5], since inaccuracy in blood pressure measurement values can result in over diagnosis or under diagnosis as well as overtreatment or under treatment of hypertension [6]. However, many marketed blood pressure monitors currently have not been validated and are inaccurate [7]. As a result, consumers may unknowingly end up with an inaccurate BP monitor purchased from the market. Moreover, many consumers may be unaware of the existence of a website that helps them determine the validation status of available monitors.
Retailers provide blood pressure monitors for home use without access to published results of validation testing. The aim of this study was to determine the accuracy of five digital blood pressure monitors intended for home use that are widely available through major retailers in the US. Omron 10 Series BP7450 (HEM-7342T-Z made by Omron Healthcare Co., Ltd., Kyoto, Japan), Omron Platinum BP5450 (HEM-7343T-Z made by Omron Healthcare Co., Ltd., Kyoto, Japan), Walmart Equate Premium 8000 Series UA-8000WM (Manufacturer part number wmtbpa-240bt, distributed by HoMedics, LLC, Commerce Township, MI. USA), Walgreens Premium 15+ WGNBPA-960BT (made and distributed exclusively for Walgreens by HoMedics, LLC, Commerce Township, MI. USA), and CVS Series 800 BP3MW1-4YCVS (manufactured by Microlife USA Inc, Clearwater, FL. USA and distributed by CVS Pharmacy, Inc) in a general adult population using the validation requirements of the American National Standards Institute/Association for the Advancement of Medical Instrumentation/International Organization for Standardization (ISO 81060-2:2018/AMD 1:2020) standard [8, 9]. Omron Healthcare, Inc. contracted with investigators at Northwestern University to conduct an independent validation study of two Omron monitors and three additional monitors under the same conditions. Omron selected the non-Omron devices to be included in the study because these vendors represent a major part of the market for consumers to purchase blood pressure monitors across the United States, and these retail-available monitors did not have accessible published results of validation testing. This study is important because it tests the validity of 5 monitors sold by 4 of the large retail brands on the U.S. market under the same test conditions.
Methods
Devices
All of the 5 devices used in the study are automatic oscillometric devices for BP measurements on the upper arm. BP7450 has the preformed cuff called the ComFit Cuff, covering arm circumference range of 22–42 cm (9–17 inches); and the BP5450 has wide range D-ring cuff covering arm circumference range of 22–42 cm (9–17 inches) and a small D-Ring cuff for adult arm circumferences of 17–22 cm (7–9 inches). UA-8000WM is has a D-Ring cuff that covers arm circumference range of 23–43 cm (9–17 inches). WGNBPA-240BT has an UltraSoft™ D-Ring cuff that covers arm circumference range of 23–43 cm (9–17 inches). BP3MW1-4YCVS has a SoftFit™ D-Ring cuff that covers arm circumference range of 22–42 cm (9–17 inches). Two units of study devices were provided by study sponsor with a written statement that BP7450 and BP5450 were obtained from the sponsors’ inventory at their warehouse, whereas UA-8000WM, WGNBPA-240BT, and BP3MW1-4YCVS monitors were purchased directly from their corresponding retail stores. These three devices were selected because they are major retail store branded blood pressure monitors with more functions and features than some other store branded monitors. Therefore, consumers might view such monitors as being of above average quality. One of each monitor was randomly selected out of the 2 units and used for the entire duration of the study.
Participants
Study participants who were 18 years and older with arm circumference of 17 cm to 43 cm were recruited from the general public using IRB approved research study flyers. Staff and patients of Northwestern University and Northwestern Medicine could also participate. We also recruited from patients identified through searches of the Northwestern Medicine Electronic Data Warehouse to identify potential participants with low body mass index who would be more likely to have a small arm circumference and to identify individuals with elevated blood pressures. We screened participants who met the age, arm circumference and BP readings criteria and consented them into the study. Participants who did not meet the study inclusion criteria were excluded from participating in the study.
Study team
The study was conducted by an experienced project manager (study supervisor) and 2 observers who were all trained and certified in the basic Shared Care Research and Education, Inc. Stateline Nevada, USA blood pressure measurement training program using the American Heart Association (AHA) guidelines, with additional training on how to conduct an Association for the Advancement Medical Instrumentation (AAMI) protocol for validations of automatic BP devices.
Blood pressure measurements
Northwestern University’s Institutional Review Board reviewed and approved the study. After obtaining written informed consent forms, participants’ arms were measured as a reference to select a corresponding cuff size for BP measurements. Participants rested for 5 minutes before baseline BP readings were taken with the reference sphygmomanometer. Two observers listened through a connected y-tube standard mercury sphygmomanometers that was calibrated before the study began. Using a dual head teaching stethoscope, the observers recorded simultaneous reference auscultatory BP measurements blinded to the other observer’s reading.
The independent readings were handed to a third study staff member, a study supervisor who determined whether the readings were within 4 mm Hg. When the two observers’ readings differed by more than 4 mm Hg, those readings were discarded in accordance with the ISO 81060-2:2018/AMD 1:2020 validation procedure. Both observers were blinded to each other’s readings and to the results of the device under test. The test device was also used to obtain an initial reading. After both baseline readings were recorded, four reference mercury sphygmomanometer measurements were taken alternately with three test device measurements with 60 second rests observed between readings. Additional readings were taken to replace the excluded readings in order to complete three valid sets of reference, test device, reference BP comparisons. Readings were excluded for pre-specified observer differences, blood pressure reading variation, participant body movement, talking or when one or both observers were unable to hear a reading. The subject was excluded if readings were repeated for a third time and the two observer measurements were not within 4 mmHg. Furthermore, subjects with BP variability in reference BP measurements >12/8 mm Hg between any two of the four reference BP measurements were excluded with the option to include from these subjects in the analysis two (instead of the three) consecutive valid pairs of reference measurements that fulfill the requirement provided this applied to no more than 10% of subjects.
Identification of the final study cohorts
We aimed to recruit participants who had an adequate distribution of SBP, DBP, sex, and arm circumference to satisfy the requirements of the ISO 81060-2:2018/AMD 1:2020 standard. In order to reduce the burden of recruiting participants with less common characteristics (e.g., very small arm circumference, higher diastolic blood pressure) in some cases we recruited more than the 85 required participants who had eligible measurements. We used a blinded backwards removal process based solely on the participants’ initial mercury sphygmomanometer readings, sex and arm circumference—whoever was most recently recruited was examined and if they were not needed to fulfill the distribution requirements of arm circumference, SBP, DBP or sex they were removed not to be in excess of 85 subjects.
Statistical analysis
We assessed means and standard deviations of the absolute values of the differences between the SBP and DBP measurements of the devices under test and the reference standard and compared these to Criterion 1 of the ISO 81060-2:2018/AMD 1:2020 standard, namely whether or not the means were ≤5.0 mm Hg and the standard deviation was ≤8.0 mm Hg. We made Bland-Altman plots of the differences in SBP and DBP determinations by blood pressure (means of test device and observer measurements) and arm circumference values. We calculated the standard deviations of the differences of the averaged paired determinations of the device under test and the reference measurement for each subject and compared these to Criterion 2 of the ISO 81060-2:2018/AMD 1:2020 standard.
Results
The number of participants screened, number ineligible, the number removed by blinded backwards removal and the number included in the analytic cohorts are detailed in Table 1. The blinded backward removal process successfully identified cohorts of 85 subjects who met the distribution requirements of the ISO 81060-2:2018/AMD 1:2020 standard for SBP, DBP sex, and arm circumference for each device. After evaluation against the validation criteria, the first criterion was met for the BP5450 with N = 85 participants. The standard deviation of the subject-level diastolic blood pressure difference did not meet the second criterion and was within 0.1 mm Hg of the permissible difference [mean DBP difference 3.67 (5.93)]. With the addition of the next eligible subject, the distribution requirements were still met and the second criterion was also met. For the BP5450 (N = 86) the small cuff was tested in 14 subjects, mean SBP difference (SD) −1.5 (4.3), mean DBP difference (SD) −0.2 (5.1). The large cuff was tested in 72, mean SBP difference (SD) 2.5 (6.2), mean DBP difference (SD) 4.30 (5.8). Participant characteristics of the cohorts for all 5 devices are presented in Table 2. The test cohorts fulfilled requirements for participant arm circumference distribution in each case. Participant limb size distribution is presented in Supplementary Table 1. The test cohorts fulfilled requirements for sex, age, cuff distribution, SBP and DBP [8, 9].
The comparison of the test devices BP measurements and the reference measurements are provided in Table 2. Two devices had mean SBP and mean DBP differences of 5.0 mm Hg or less with SD no greater than 8.0 mm Hg (BP7450 and BP5450). One device did not meet the SBP criterion, BP3MW1-4YCVS, mean (SD) SBP difference 5.9 (8.7) mm Hg. Two devices did not meet the SBP or DBP criteria, UA-8000WM, mean (SD) SBP 2.5 (8.0) mm Hg and mean (SD) DBP 5.1 (6.4) mm Hg, and WGNBPA-240BT, mean (SD) SBP 7.9 (8.5) mm Hg and mean (SD) DBP 5.5 (6.7) mm Hg (ISO 81060-2:2018/AMD 1:2020 Criterion 1). BP7450 and BP5450 both met Criterion 2, although the SD of DBP difference at the subject level for BP5450 was borderline (Table 3).
Bland–Altman scatter plots of the differences between the device under test and observer measurements for SBP and DBP against their average value and scatterplots of test-reference BP differences by subject’s arm circumference are shown in Figs. 1–5.
Discussion
We tested five automated blood pressure monitors intended for home use using the ISO 81060-2:2018/AMD 1:2020 standard. Two devices (BP5450 and BP7450) fulfilled this standard for a general adult population, although for BP5450 the standard deviation of the subject-level diastolic blood pressure difference was borderline. UA-8000WM, WGNBPA-240BT and BP3MW1-4YCVS did not meet this validation standard in our test. Using the ANSI/AAMI/ISO 81060-2:2018 + A1:2020 protocol as a guide, we removed measurements with discrepant observer readings based on our interpretation of the technical document and the recommendations we received from an expert consultant who trained the study team.
These findings suggest that the accuracy of automated home blood pressure monitors available in the U.S. market that have not been validated cannot be assumed and underscores the importance of verifying the validation status of at-home blood pressure monitors prior to use for diagnosis or clinical monitoring. Prior observers have noted that many BP monitors available for home use have not been validated [10, 11], and that accuracy is lower in non-validated devices than validated devices [7, 12, 13].
Since monitors that have been validated for accuracy are recommended for BP measurement, it is important that consumers and patients are advised to check whether a blood pressure monitor has been validated for accuracy [14]. Fortunately, there are readily available websites consumers can use to determine the validation status of home blood pressure monitors [15, 16].
Strengths and limitations
Strengths of this study include the testing of multiple commercial home BP monitors under similar rigorous conditions and achieving the required distribution of subjects by arm size, blood pressure and sex. Limitations are that the study population was limited to a general adult population, and the generalizability of these findings to other populations (e.g., pregnant women, children) is unknown. Additionally, while we followed the recommendations for which data points to include or exclude from an expert consultant who trained the study team, we removed and repeated reference measurements with discrepant observer readings but did not remove and repeat the preceding test device measurement when the repeated reference measurement met the criteria for observer agreement. While we believe that this choice is consistent with the ISO 81060-2:2018 + A1:2020 protocol [8, 9], we acknowledge that this interpretation differs from the one described by Stergiou et al. [17].
Summary
What is known about this topic
-
The importance of out-of-office BP is increasingly recognized for hypertension diagnosis and management.
-
Many devices marketed for home use do not have published validation information available testing them using an international standard.
What this study adds
-
BP5450 and BP7450 are accurate enough for home use in a general adult population.
-
UA-8000WM, WGNBPA-240BT and BP3MW1-4YCVS did not meet the applied ISO standard for home use.
Data availability
Final study data is available by written request to the investigators.
References
Whelton PK, Carey RM, Aronow WS, Casey DE Jr, Collins KJ, Himmelfarb CD, et al. 2017 ACC/AHA/AAPA/ABC/ACPM/AGS/APhA/ASH/ASPC/NMA/PCNA Guideline for the Prevention, Detection, Evaluation, and Management of High Blood Pressure in Adults: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines 2018;71:1269-1324. Erratum in: Hypertension. 2018; 71:e136-e139. Erratum: Hypertension 2018;71:e13–e115.
Unger T, Borghi C, Charchar F, Khan NA, Poulter NR, Prabhakaran D, et al. International Society of Hypertension Global Hypertension Practice Guidelines. Hypertension. 2020;75:1334–57.
Siu AL, U S. Preventive Services Task Force. Screening for high blood pressure in adults: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med. 2015;163:778–86.
Williams B, Mancia G, Spiering W, Agabiti Rosei E, Azizi M, Burnier M, et al. ESC/ESH Guidelines for the management of arterial hypertension: The Task Force for the management of arterial hypertension of the European Society of Cardiology and the European Society of Hypertension. J Hypertens. 2018;36:1953–2041.
Ulusoy Ş, Özkan G, Arıcı M, Derici Ü, Akpolat T, Şengül Ş, et al. Which out-of-office measurement technique should be used for diagnosing hypertension in prehypertensives? J Hum Hypertens. 2020;34:586–92.
Kallioinen N, Hill A, Horswill MS, Ward HE, Watson MO. Sources of inaccuracy in the measurement of adult patients’ resting blood pressure in clinical settings: a systematic review. J Hypertension. 2017;35:421–41.
Jung M-H, Kim G-H, Kim J-H, Moon K-W, Yoo K-D, Rho T-H, et al. Reliability of home blood pressure monitoring: in the context of validation and accuracy. Blood Press Monit. 2015;20:215–20.
ANSI/AAMI/ISO 81060-2:2019 Non-invasive sphygmomanometers—Part 2: Clinical investigation of intermittent automated measurement type. 2018. https://www.iso.org/standard/73339.html. Accessed 20 July 2022.
ISO 81060-2:2018/AMD 1:2020 Non-invasive sphygmomanometers—Part 2: Clinical investigation of intermittent automated measurement type—Amendment 1. International Organization for Standardization. 2020. https://www.iso.org/standard/75432.html. Accessed 20 July 2022.
Picone DS, Campbell NRC, Schutte AE, Olsen MH, Ordunez P, Whelton PK, et al. Validation Status of Blood Pressure Measuring Devices Sold Globally. JAMA. 2022;327:680–1.
Picone DS, Deshpande RA, Schultz MG, Fonseca R, Campbell NRC, Delles C, et al. Nonvalidated Home Blood Pressure Devices Dominate the Online Marketplace in Australia: Major Implications for Cardiovascular Risk Management. Hypertension. 2020;75:1593–9.
Akpolat T, Dilek M, Aydogdu T, Adibelli Z, Erdem DG, Erdem E. Home sphygmomanometers: validation versus accuracy. Blood Press Monit. 2009;14:26–31.
Hodgkinson JA, Lee MM, Milner S, Bradburn P, Stevens R, Hobbs FR, et al. Accuracy of blood-pressure monitors owned by patients with hypertension (ACCU-RATE study): a cross-sectional, observational study in central England. Br J Gen Pr. 2020;70:e548–e554.
Picone DS, Padwal R, Campbell NRC, Boutouyrie P, Brady TM, Olsen MH, et al. How to check whether a blood pressure monitor has been properly validated for accuracy. J Clin Hypertens. 2020;22:2167–74.
Validate BP: US Blood Pressure Validated Device Listing. 2022. https://www.validatebp.org/
Medaval Ltd: Medaval Validated Medical Device Registry. 2022. https://medaval.ie/blood‐pressure‐monitors/
Stergiou GS, Alpert B, Meike S, Asmar R, Atkins N, Eckert S, et al. A universal standard for the validation of blood pressure measuring devices: Association for the Advancement of Medical Instrumentation/European Society of Hypertension/International Organization for Standardization (AAMI/ESH/ISO) Collaboration Statement. J Hypertens. 2018;36:472–8.
Funding
This work was funded by Omron Healthcare, Inc. paid to Northwestern University. REDCap is supported at Feinberg School of Medicine by the Northwestern University Clinical and Translational Science (NUCATS) Institute. Research reported in this publication was supported, in part, by the National Institutes of Health’s National Center for Advancing Translational Sciences, Grant Number UL1TR001422. Northwestern University investigators were solely responsible for the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation and approval of the manuscript; and decision to submit the manuscript for publication. All analyses were conducted by Northwestern University employees. Employees from Omron Healthcare, Inc. participated and provided input into study meetings and reviewed the manuscript. Omron also selected 3 non Omron devices (Walmart Equate Premium 8000 Series UA-8000WM, Walgreens Premium 15+ WGNBPA-960BT, and CVS Series 800 BP3MW1-4YCVS) for testing. Northwestern University investigators retained the right to publish and what content to publish independent of the funder.
Author information
Authors and Affiliations
Contributions
The authors confirm contribution to the paper as follows: study conception and design: SDP, YP; data collection: YP; analysis and interpretation of results: JYL, SDP. YP; draft manuscript preparation: YP, SDP. All authors reviewed the results and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The investigators (YP, JYL, SDP) reported receiving grant funding from Omron Healthcare, Inc. during the conduct of the study paid to Northwestern University. SDP has received an honorarium for speaking from Omron Healthcare unrelated to the current work. The authors have no other disclosures to report.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Peprah, Y.A., Lee, J.Y. & Persell, S.D. Validation testing of five home blood pressure monitoring devices for the upper arm according to the ISO 81060-2:2018/AMD 1:2020 protocol. J Hum Hypertens 37, 134–140 (2023). https://doi.org/10.1038/s41371-022-00795-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41371-022-00795-6
This article is cited by
-
Journal of Human Hypertension special issue on the accuracy of automated blood pressure measuring devices
Journal of Human Hypertension (2023)