Number of Measurements Needed to Obtain a Reliable Estimate of Home Blood Pressure: Results From the Improving the Detection of Hypertension Study
Abstract
Background
Obtaining out‐of‐clinic blood pressure (
Methods and Results
We analyzed data from 316 community‐dwelling adults not taking antihypertensive medication from the
Conclusions
Using the average of morning and evening readings, 3 days of
Clinical Perspective
What Is New?
This community‐based study of adults who were not taking any antihypertensive treatment showed that using the average of morning and evening readings a minimum of 3 days are needed to reliably estimate out‐of‐office blood pressure and confirm a diagnosis of hypertension.
A longer period of monitoring using other home blood pressure monitoring strategies is needed to achieve similar reliability.
What Are the Clinical Implications?
Healthcare providers can use these findings to interpret patient‐provided home blood pressure monitoring data and determine whether an adequate number of out‐of‐office readings have been obtained or whether further monitoring is needed.
Introduction
In 2015, the US Preventive Services Task Force (USPSTF) reaffirmed its recommendation to screen all adults 18 years and older for high blood pressure (BP).1 The USPSTF and, more recently, the 2017 American College of Cardiology (ACC)/American Heart Association (AHA) Guideline for the Prevention, Detection, Evaluation, and Management of High Blood Pressure in Adults further recommend obtaining BP measurements outside of the clinic setting to confirm the diagnosis of hypertension before initiating treatment.1
Home BP monitoring (HBPM) is an approach for measuring out‐of‐clinic BP to confirm a diagnosis of hypertension after initial BP screening in the clinic.3 There are few studies that have compared the reliability of different HBPM strategies that vary in the number of days HBPM is performed, the time(s) of day BP is assessed, and the number of measurements that are taken at each assessment.4 Based on expert opinion, several guidelines3 have recommended that 2 home BP readings be obtained by the patient in the morning and in the evening for a preferred period of 7 days, with a minimum of 3 days of HBPM. The 2017 ACC/AHA guidelines on high BP recommend that multiple home BP readings (at least 2 readings 1 minute apart in the morning and in the evening) should be taken, and home BP should be based on an average of readings on ≥2 occasions for clinical decision‐making.2
In the current study of a community‐based sample of adults not taking antihypertensive medication, we examined the reliability of mean home BP and, secondarily, hypertension status when based on 1 to 7 days of measurements, 1 to 4 readings per day, and morning or evening readings. These data can inform clinicians and patients on how HBPM should be conducted to obtain a reliable estimate of mean home BP.
Methods
Study Population
The IDH (Improving the Detection of Hypertension) study was designed to compare different strategies for the diagnosis of hypertension. The IDH study enrolled a community‐based sample of 408 adults older than 18 years primarily from upper Manhattan between March 2011 and October 2013.12 Participants were ineligible for the study if they had any of the following: a clinic systolic/diastolic BP ≥160/105 mm Hg; evidence of secondary hypertension; antihypertensive medication use or were taking any other medications known to affect BP; a history of overt cardiovascular disease (CVD), chronic kidney disease, liver disease, adrenal disease, thyroid disease, rheumatologic disease, hematologic disease, cancer, or dementia; history of organ transplantation; or current pregnancy. All participants provided informed consent, and the study protocol was approved by Columbia University's institutional review board. The data, analytic methods, and study materials may be made available to other researchers for purposes of reproducing the results upon reasonable request.
Study Procedures
Demographics were ascertained at a baseline visit using a self‐administered questionnaire and information about CVD risk factors was ascertained by a structured interview during a subsequent study visit. Participants underwent HBPM for up to 21 days, with readings obtained twice in the morning and twice in the evening. Data from the first 2 weeks were used for the current analyses.
Clinic BP Measurement
Following a 5‐minute rest, clinic BP was measured in each participant's nondominant arm, 3 times with at least 1 minute between readings.14 All readings were performed by a research nurse/technician using a mercury sphygmomanometer (Baum), an appropriate‐sized arm cuff, and a high‐quality stethoscope. Clinic BP was defined as the mean of the 3 readings.
Home BP Measurement
Participants attended a second visit 1 day after the baseline visit during which they were given an Omron HEM‐790IT (HEM‐7080‐ITZ2) or HEM‐791IT (HEM‐7222‐ITZ)8 with an appropriate‐sized cuff and educated on its use. These devices store all BP measurements electronically. Participants were asked to obtain home BP measurements in the seated position after 5 minutes of rest with 1 minute between readings and were instructed to measure their BP 2 times in the morning immediately after awakening and 2 times in the evening for up to 3 consecutive weeks. Data from the first 2 weeks (days 1–7 and days 8–14) were used for the current analysis. Participants who withdrew from the study (n=8) or who did not have at least 3 complete days of home BP data with 2 morning and 2 evening readings during both weeks 1 and 2 (n=84) were excluded from the present analyses, leaving a final sample size of 316 participants.
Definition of Hypertension Categories
Clinic hypertension was defined as mean clinic systolic BP ≥140 mm Hg and/or clinic diastolic BP ≥90 mm Hg. Home hypertension was defined as mean home systolic BP ≥135 mm Hg and/or mean home diastolic BP ≥85 mm Hg.9 In sensitivity analyses, clinic and home hypertension were defined using the BP thresholds recommended in the 2017 ACC/AHA high BP guideline (mean clinic systolic BP ≥130 mm Hg and/or mean clinic diastolic BP ≥80 mm Hg and mean home systolic BP ≥130 mm Hg and/or mean home diastolic BP ≥80 mm Hg).2
Statistical Analysis
Characteristics of IDH study participants included in the current analysis were summarized as mean and SD for continuous variables or percentage of participants for categorical variables.
Mean daily home systolic and diastolic BPs were calculated as the average of 2 morning and 2 evening readings for all 7 days in week 1. Further, mean home systolic and diastolic BP were calculated for each participant as the average of 2 morning and 2 evening readings for 6 days (days 1–6), 5 days (days 1–5), 4 days (days 1–4), 3 days (days 1–3), 2 days (days 1–2), and 1 day (day 1). The same approach was used to calculate mean daily home systolic and diastolic BP in week 2. For each week, analyses were repeated using (1) the first morning and first evening reading, (2) the 2 morning readings, (3) the first morning reading, (4) the 2 evening readings, and (5) the first evening reading.
Mean daily home systolic and diastolic BP were compared among days during week 1 and separately week 2 for each of the 6 HBPM strategies defined above (2 morning and 2 evening, 1 morning and 1 evening, 2 morning, 1 morning, 2 evening, 1 evening). Using the data for all 14 days, we estimated a multilevel nested repeated measures ANOVA model (day, nested within week) in order to test for differences in mean systolic and diastolic BP by day (day 1 versus day 2 versus … day 7). Next, for each HBPM strategy, the within‐participant difference in mean home systolic and diastolic BP between week 1 and week 2 was calculated. Overall mean home systolic and diastolic BPs during week 1 and week 2 were compared for each HBPM strategy using paired t tests.
The reliability of home systolic BP and home diastolic BP was assessed using the intraclass correlation for agreement coefficient for weeks 1 and 2. The 95% lower 1‐sided confidence limit (LCL) of the intraclass correlation coefficient (ICC) was calculated using the β‐distribution approach described by Demetrashvili et al.18 An ICC (95% LCL) ≥0.80 was a priori considered to indicate the presence of excellent reliability.19 A 1‐sided confidence interval was used as we were interested in identifying the minimum number of days of measurement required to provide a sufficiently reliable estimate of mean home BP. Additionally, the percentage of participants for whom the absolute difference in home systolic and diastolic BP between weeks 1 and 2 was <10 mm Hg was calculated22 We a priori defined sufficient agreement to be present if ≥85% of participants had a difference <10 mm Hg. An intraindividual systolic and diastolic BP difference of <10 mm Hg has been considered to be a tolerable error for BP measurement in clinical practice.23 The reliability of home hypertension status between weeks 1 and 2 was assessed using the κ statistic.25 As previously proposed, a κ statistic ≥0.60 was considered to represent good agreement.25 We considered requiring the 95% LCL of the κ statistic to be ≥0.60 as the criterion for good agreement. However, the confidence intervals were wide and the study was underpowered to detect a 95% LCL of the κ statistic ≥0.60. Therefore, we used the point estimate of the κ statistic ≥0.60 as the criterion for good agreement. SAS version 9.4 (SAS Institute) was used for all analyses. The analyses for the reliability of home hypertension were repeated using the BP thresholds recommended in the 2017 ACC/AHA high BP guideline.2 A P<0.05 was used as the threshold for statistical significance.
Results
Participant Characteristics
The mean (SD) age of participants was 42.3 (13.3) years, 60.8% were women, 62.0% were Hispanic, 26.3% were black, 13.6% had clinic hypertension, and 18.0% had home hypertension (Table 1). Table 2 shows the mean number of readings obtained per participant for each HBPM strategy. During week 1, there were no statistically significant differences in mean home systolic and diastolic BP across days (day 1 versus day 2 versus … day 7) when calculated using 2 morning and 2 evening readings, single morning and single evening readings, 2 morning readings, a single morning reading, 2 evening readings, or a single evening reading (data not shown). Results were similar for week 2.
| Characteristics | Analysis Sample (N=316) |
|---|---|
| Age, y | 42.3 (13.3) |
| Women, % | 60.8 |
| Race/ethnicity | |
| Non‐Hispanic black, % | 15.5 |
| Hispanic, % | 62.0 |
| Non‐Hispanic white, % | 15.2 |
| Other, % | 7.3 |
| BMI, kg/m2 | 27.6 (5.1) |
| Self‐reported diabetes mellitus, % | 2.5 |
| Fasting glucose, mg/dL | 86.2 (27.8) |
| Glycated hemoglobin, % | 5.4 (0.9) |
| Cholesterol | |
| Total, mg/dL | 185.1 (41.4) |
| Triglycerides, mg/dL | 102.0 (55.7) |
| HDL, mg/dL | 52.3 (13.5) |
| LDL, mg/dL | 112.4 (36.9) |
| Smoking status | |
| Never, % | 83.2 |
| Past, % | 9.8 |
| Current, % | 7.0 |
| Alcohol usea | |
| Nondrinker, % | 45.3 |
| Moderate drinker, % | 50.6 |
| Heavy drinker, % | 4.1 |
| Mean clinic BPb | |
| Systolic, mm Hg | 117.1 (16.0) |
| Diastolic, mm Hg | 76.3 (10.1) |
| Clinic hypertension, % | 13.6 |
| Mean home BPc | |
| Systolic, mm Hg | 115.4 (13.3) |
| Diastolic, mm Hg | 76.6 (9.1) |
| Home hypertension, %d | 18.0 |
| No. of Days | Morning and Evening Readings | Morning Readings Only | Evening Readings Only | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Expected | Mean (SD) Obtained | Expected | Mean (SD) Obtained | Expected | Mean (SD) Obtained | ||||
| Week 1 | Week 2 | Week 1 | Week 2 | Week 1 | Week 2 | ||||
| Two readings per occasion | |||||||||
| 7 | 28 | 25.4 (2.6) | 24.6 (3.1) | 14 | 13.0 (1.6) | 12.6 (1.8) | 14 | 12.4 (1.8) | 12.0 (2.1) |
| 6 | 24 | 21.8 (2.4) | 21.1 (2.7) | 12 | 11.1 (1.5) | 10.8 (1.6) | 12 | 10.7 (1.6) | 10.3 (1.9) |
| 5 | 20 | 18.2 (2.1) | 17.7 (2.4) | 10 | 9.3 (1.4) | 9.0 (1.4) | 10 | 8.9 (1.4) | 8.7 (1.7) |
| 4 | 16 | 14.5 (1.8) | 14.1 (2.2) | 8 | 7.4 (1.1) | 7.2 (1.3) | 8 | 7.1 (1.3) | 6.9 (1.5) |
| 3 | 12 | 10.9 (1.5) | 10.7 (1.8) | 6 | 5.5 (0.9) | 5.5 (1.0) | 6 | 5.4 (1.0) | 5.2 (1.2) |
| 2 | 8 | 7.2 (1.3) | 7.1 (1.4) | 4 | 3.7 (0.7) | 3.7 (0.7) | 4 | 3.6 (0.8) | 3.5 (0.9) |
| 1 | 4 | 3.6 (0.8) | 3.7 (0.7) | 2 | 2.0 (0.1) | 2.0 (0.1) | 2 | 2.0 (0.2) | 2.0 (0.1) |
| One reading per occasion | |||||||||
| 7 | 14 | 12.8 (1.3) | 12.4 (1.5) | 7 | 6.5 (0.8) | 6.3 (0.9) | 7 | 6.3 (0.9) | 6.0 (1.0) |
| 6 | 12 | 11.0 (1.2) | 10.6 (1.4) | 6 | 5.6 (0.7) | 5.5 (0.8) | 6 | 5.4 (0.8) | 5.2 (0.9) |
| 5 | 10 | 9.2 (1.0) | 8.9 (1.2) | 5 | 4.7 (0.7) | 4.5 (0.7) | 5 | 4.5 (0.7) | 4.4 (0.8) |
| 4 | 8 | 7.3 (0.9) | 7.1 (1.1) | 4 | 3.7 (0.5) | 3.6 (0.7) | 4 | 3.6 (0.6) | 3.5 (0.7) |
| 3 | 6 | 5.5 (0.7) | 5.4 (0.9) | 3 | 2.8 (0.5) | 2.8 (0.5) | 3 | 2.7 (0.5) | 2.6 (0.6) |
| 2 | 4 | 3.7 (0.6) | 3.6 (0.7) | 2 | 1.9 (0.3) | 1.9 (0.4) | 2 | 1.8 (0.4) | 1.8 (0.4) |
| 1 | 2 | 1.8 (0.4) | 1.8 (0.4) | 1 | 1.0a | 1.0a | 1 | 1.0a | 1.0a |
Reliability of Each Measurement Strategy to Estimate Mean Home BP
Strategies using both morning and evening readings
When using 2 morning and 2 evening readings per day to define daily BP, there were no statistically significant differences in mean home systolic and diastolic BP between weeks 1 and 2, regardless of the numbers of days for which HBPM was performed (Table 3). For the strategy of using 2 morning and 2 evening readings per day, the ICCs for the 7‐day mean home systolic and diastolic BP were excellent with the 95% LCL of the ICCs being above 0.80 (0.95 [1‐sided 95% LCL 0.94] and 0.94 [1‐sided 95% LCL 0.93], respectively) (Figure 1). The ICCs for mean home systolic and diastolic BP were excellent using the mean of at least 2 days with 2 morning and 2 evening readings, and for at least 3 days when using the mean of a single morning and single evening reading.
| No. of Days | Week 1 | Week 2 | Differencea | P Valueb |
|---|---|---|---|---|
| Mean (SD) systolic BP, mm Hg | ||||
| Two morning and 2 evening readings | ||||
| 7 | 115.4 (13.3) | 115.5 (13.7) | −0.11 (4.36) | 0.67 |
| 6 | 115.4 (13.4) | 115.5 (13.8) | −0.12 (4.75) | 0.65 |
| 5 | 115.4 (13.5) | 115.5 (13.9) | −0.03 (5.15) | 0.92 |
| 4 | 115.4 (13.6) | 115.4 (14.2) | 0.05 (5.63) | 0.86 |
| 3 | 115.5 (13.7) | 115.2 (14.2) | 0.28 (6.37) | 0.44 |
| 2 | 115.3 (13.7) | 114.9 (14.3) | 0.37 (7.48) | 0.38 |
| 1 | 115.2 (14.3) | 114.7 (14.9) | 0.49 (10.11) | 0.40 |
| Single morning and single evening reading | ||||
| 7 | 116.4 (13.6) | 116.6 (14.0) | −0.17 (4.67) | 0.51 |
| 6 | 116.5 (13.7) | 116.6 (14.1) | −0.17 (5.12) | 0.55 |
| 5 | 116.6 (13.9) | 116.6 (14.2) | −0.01 (5.55) | 0.98 |
| 4 | 116.5 (14.0) | 116.4 (14.5) | 0.09 (6.19) | 0.80 |
| 3 | 116.6 (14.1) | 116.4 (14.6) | 0.20 (7.12) | 0.61 |
| 2 | 116.3 (14.2) | 116.1 (14.9) | 0.21 (8.63) | 0.67 |
| 1 | 116.1 (15.1) | 115.9 (15.5) | 0.18 (11.59) | 0.78 |
| Mean (SD) diastolic BP, mm Hg | ||||
| Two morning and 2 evening readings | ||||
| 7 | 76.6 (9.1) | 76.7 (9.2) | −0.09 (3.15) | 0.62 |
| 6 | 76.6 (9.2) | 76.7 (9.3) | −0.07 (3.41) | 0.72 |
| 5 | 76.6 (9.3) | 76.6 (9.3) | −0.02 (3.63) | 0.94 |
| 4 | 76.6 (9.4) | 76.5 (9.4) | 0.05 (3.89) | 0.82 |
| 3 | 76.6 (9.3) | 76.4 (9.4) | 0.20 (4.60) | 0.44 |
| 2 | 76.7 (9.4) | 76.4 (9.6) | 0.31 (5.48) | 0.31 |
| 1 | 76.7 (9.8) | 76.1 (10.2) | 0.46 (7.20) | 0.26 |
| Single morning and single evening reading | ||||
| 7 | 76.5 (9.3) | 76.5 (9.3) | −0.02 (3.35) | 0.92 |
| 6 | 76.6 (9.4) | 76.6 (9.4) | 0.02 (3.68) | 0.94 |
| 5 | 76.6 (9.5) | 76.5 (9.4) | 0.09 (3.91) | 0.69 |
| 4 | 76.5 (9.6) | 76.4 (9.5) | 0.12 (4.23) | 0.61 |
| 3 | 76.6 (9.6) | 76.3 (9.6) | 0.30 (5.01) | 0.28 |
| 2 | 76.7 (9.7) | 76.3 (9.9) | 0.49 (6.14) | 0.16 |
| 1 | 76.8 (10.2) | 75.9 (10.7) | 0.77 (8.25) | 0.10 |

Figure 1 Reliability of mean home blood pressure (
When defining mean home BP as the mean of 7 days of 2 morning and 2 evening readings of HBPM, 100% of the participants had <10 mm Hg absolute difference between weeks 1 and 2 for both home systolic and diastolic BP (Figure 2). The percentage of participants with an absolute difference in home BP <10 mm Hg declined as the number of days of HBPM decreased from 7 to 1 days. There was sufficient agreement (≥85% of participants had a difference <10 mm Hg) with ≥2 days of HBPM for home systolic BP, and ≥1 days of HBPM for diastolic BP when using 2 morning and 2 evening readings or a single morning and single evening reading.

Figure 2 Percentage of participants with <10 mm Hg absolute difference between week 1 and week 2 mean home blood pressure when defining daily blood pressure using 2 morning and 2 evening readings or a single morning and single evening reading. Dashed line indicates 85% threshold for agreement.
Strategies using morning readings only
When using 2 or 1 morning readings per day, there were no statistically significant differences in mean home systolic and diastolic BP between weeks 1 and 2, regardless of the number of days HBPM was performed (Table S1). Using 2 morning readings per day, the ICCs were excellent (ie, 95% LCL of the ICCs ≥0.80) with ≥3 days of HBPM for home systolic and diastolic BP (Figure S1). Using a single morning reading per day, the ICCs were excellent with ≥3 days of HBPM for home systolic BP and with ≥4 days of HBPM for home diastolic BP.
Defining mean home BP using 2 morning readings per day for 7 days of HBPM had sufficient agreement; 99% and 100% of participants had a difference <10 mm Hg for home systolic and diastolic BP, respectively (Figure S2). There was sufficient agreement between weeks with ≥2 days of HBPM for home systolic BP and ≥1 days of HBPM for diastolic BP. Using a single morning reading per day, there was sufficient agreement with ≥3 days of HBPM for home systolic BP and ≥1 days of HBPM for diastolic BP.
Strategies using evening readings only
When using 2 or 1 evening readings per day, there were no statistically significant differences in mean home systolic and diastolic BP between weeks 1 and 2, regardless of the number of days HBPM was performed (Table S2). Using 2 or 1 evening readings per day, the ICCs were excellent (95% LCL of the ICCs ≥0.80) with ≥4 days of HBPM for home systolic BP and diastolic BP (Figure S3).
Defining mean home BP using 2 evening readings per day across 7 days of HBPM had sufficient agreement; 99% and 100% of participants had an absolute difference <10 mm Hg for home systolic and diastolic BP, respectively, between weeks 1 and 2 (Figure S4). There was sufficient agreement with ≥2 days of HBPM for home systolic BP and ≥1 days of HBPM for diastolic BP. When using a single evening reading per day, there was sufficient agreement with ≥3 days of HBPM for home systolic BP and ≥1 days of HBPM for diastolic BP.
Reliability of Home Hypertension Status
Using 2 morning and 2 evening readings or a single morning and single evening reading, the κ statistic for home hypertension between week 1 and week 2 indicated good agreement (≥0.60) with ≥3 days of HBPM (Table 4). When using 2 morning readings or a single morning reading, the κ statistic indicated good agreement with ≥4 days of HBPM (Table S3). To obtain good agreement, ≥5 days of HBPM were needed when using 2 evening readings, and ≥6 days of HBPM were needed when using a single evening reading (Table S4).
| No. of Days | Week 1 or 2 | Home Hypertension, %a | κ Statistic (95% LCL) | Overall Percentage Agreement (95% LCL) | ||||
|---|---|---|---|---|---|---|---|---|
| Overall No. (%) | Week 1: No Week 2: No | Week 1: No Week 2: Yes | Week 1: Yes Week 2: No | Week 1: Yes Week 2: Yes | ||||
| Two morning and 2 evening readings | ||||||||
| 7 | Week 1 Week 2 | 59 (18.7) 59 (18.7) | 77.5 | 3.8 | 3.8 | 14.9 | 0.75 (0.67) | 92.4 (89.5) |
| 6 | Week 1 Week 2 | 59 (18.7) 63 (19.9) | 75.3 | 6.0 | 4.7 | 13.9 | 0.65 (0.57) | 89.2 (85.8) |
| 5 | Week 1 Week 2 | 58 (18.4) 60 (19.0) | 76.6 | 5.1 | 4.4 | 13.9 | 0.69 (0.60) | 90.5 (87.3) |
| 4 | Week 1 Week 2 | 59 (18.7) 59 (18.7) | 76.3 | 5.1 | 5.1 | 13.6 | 0.67 (0.58) | 89.9 (86.5) |
| 3 | Week 1 Week 2 | 58 (18.4) 56 (17.7) | 76.3 | 5.4 | 6.0 | 12.3 | 0.61 (0.52) | 88.6 (85.1) |
| 2 | Week 1 Week 2 | 60 (19.0) 55 (17.4) | 75.6 | 5.4 | 7.0 | 12.0 | 0.59 (0.49) | 87.7 (84.0) |
| 1 | Week 1 Week 2 | 59 (19.3) 53 (17.3) | 72.2 | 6.0 | 7.9 | 10.8 | 0.52 (0.42) | 85.6 (81.7) |
| Single morning and single evening reading | ||||||||
| 7 | Week 1 Week 2 | 63 (19.9) 64 (20.3) | 76.6 | 3.5 | 3.2 | 16.8 | 0.79 (0.72) | 93.4 (90.6) |
| 6 | Week 1 Week 2 | 64 (20.3) 63 (19.9) | 75.6 | 4.1 | 4.4 | 15.8 | 0.73 (0.65) | 91.5 (88.4) |
| 5 | Week 1 Week 2 | 62 (19.6) 60 (19.0) | 76.3 | 4.1 | 4.7 | 14.9 | 0.72 (0.63) | 91.1 (88.0) |
| 4 | Week 1 Week 2 | 63 (19.9) 60 (19.0) | 75.6 | 4.4 | 5.4 | 14.6 | 0.69 (0.60) | 90.2 (86.9) |
| 3 | Week 1 Week 2 | 61 (19.3) 61 (19.3) | 75.6 | 5.1 | 5.1 | 14.2 | 0.67 (0.59) | 89.9 (86.5) |
| 2 | Week 1 Week 2 | 62 (19.6) 60 (19.0) | 74.4 | 6.0 | 6.6 | 13.0 | 0.59 (0.50) | 87.3 (83.7) |
| 1 | Week 1 Week 2 | 64 (20.9) 55 (18.0) | 70.6 | 6.0 | 8.9 | 11.4 | 0.51 (0.41) | 84.6 (80.6) |
Using the BP thresholds recommended in the 2017 ACC/AHA high BP guideline, 39.9% of participants had clinic hypertension and 37.0% had home hypertension. The κ statistic indicated good agreement with ≥2 days of HBPM using 2 morning and 2 evening readings and ≥3 days of HBPM using a single morning and single evening reading (Table S5), ≥2 days of HBPM using 2 morning readings and ≥3 days of HBPM using a single morning reading (Table S6), and ≥3 days of HBPM using 2 evening readings and ≥5 days of HBPM using a single evening reading (Table S7).
Table 5 summarizes the minimum number of days of HBPM required to reliably estimate mean home BP and diagnose home hypertension using the different strategies.
| HBPM Strategy | Excellent Reliability for Mean BPa | Sufficient Agreement for Mean BPb | Excellent Reliability and Sufficient Agreement for Mean Home SBP and DBP | Good Agreement for Home Hypertensionc | Good Agreement for Home Hypertensionc Using the New ACC/AHA High BP Guideline Threshold | ||
|---|---|---|---|---|---|---|---|
| Home SBP | Home DBP | Home SBP | Home DBP | ||||
| Two morning and 2 evening | 2 | 2 | 2 | 1 | 2 | 3 | 2 |
| Single morning and single evening | 3 | 3 | 2 | 1 | 3 | 3 | 3 |
| Two morning | 3 | 3 | 2 | 1 | 3 | 4 | 2 |
| Single morning | 3 | 4 | 3 | 1 | 4 | 4 | 3 |
| Two evening | 4 | 4 | 2 | 1 | 4 | 5 | 3 |
| Single evening | 4 | 4 | 3 | 1 | 4 | 6 | 5 |
Discussion
In the current study, we examined whether less burdensome strategies of HBPM provide reliable estimates of home BP among individuals not taking antihypertensive medication. Mean home BP was reliable using the average of 2 morning and 2 evening BP readings for a minimum of 2 days and a single morning and single evening reading for a minimum of 3 days. For diagnosing home hypertension, there was good agreement using a minimum of 3 days of either 2 morning and 2 evening readings or a single morning and single evening BP reading. A greater number of days of HBPM was required to reliably estimate home BP and diagnose home hypertension when using the other strategies.
Guidelines and scientific statements have recommended that out‐of‐clinic BP monitoring with either ambulatory BP monitoring (ABPM) or HBPM be used to identify white‐coat hypertension, defined as having clinic hypertension without out‐of‐clinic hypertension, and masked hypertension, defined as having out‐of‐clinic hypertension without clinic hypertension.2 ABPM is more commonly recommended than HBPM for measuring out‐of‐clinic BP1 as there are more outcome studies demonstrating that higher BP on ABPM is associated with an increased risk of CVD.28 In the United States, several barriers prevent the widespread adoption of ABPM in clinical practice. These include a lack of availability in many areas, excessive patient burden due to poor tolerability and discomfort, and unreimbursed costs.3 The 2017 ACC/AHA high BP guideline2 considered HBPM to be a more practical approach than ABPM for the measurement of out‐of‐clinic BP.
A systematic review of HBPM conducted by Verberk et al5 identified 4 studies examining the accuracy and reproducibility of HBPM.4 These studies differed greatly from one another in the HBPM strategies they employed as well as the populations examined (ie, clinic patients versus community participants, and inclusion of individuals with both untreated and treated hypertension versus those without treated hypertension). Despite the wide variability across the 4 studies, the systematic review concluded that a minimum of 3 days of 4 daily readings (2 morning and 2 evening readings) should be obtained to estimate out‐of‐clinic BP. A more recent systematic review conducted for the USPSTF29 to determine the diagnostic and predictive accuracy of different BP methods for CVD events identified 11 studies of HBPM.30 There was wide variation in the conduct of HBPM across these studies, with differences in the number of days of measurement, the number of readings per days, and the timing of the readings. In contrast to Verberk and others,3 the USPSTF did not specify how HBPM should be performed.
Data from the current study demonstrated that a greater number of days of HBPM produced more reliable estimates of home BP. Prior studies have also suggested that obtaining a greater number of home BP readings was associated with lower BP variability and improved CVD risk prediction.6 Therefore, in clinical practice, it may be reasonable to encourage patients to obtain 2 morning and 2 evening readings for 7 days of HBPM, recognizing that patients may obtain incomplete data or prefer a shorter monitoring period.47 In the current study, 84 (21%) of the participants were excluded because they did not have at least 3 complete days of home BP data with 2 morning and 2 evening readings during both weeks 1 and 2. This is consistent with prior studies in which 24% to 34% of participants were unable to obtain the minimum number of HBPM recordings for analysis.33 Given that nonadherence may be an issue for some patients, this study provides important practical data on the minimum number of days that are required to reliably estimate home BP.48 If a patient does not complete the minimum number of days of any of the HBPM strategies, then clinicians should recommend that their patient undergo additional HBPM to obtain more readings until these minimum criteria are achieved or alternatively consider the use of ABPM.
In the current study, the prevalence of clinic hypertension and home hypertension was 13.6% and 18.0% using a clinic BP threshold of ≥140/90 mm Hg and home BP threshold of ≥135/85 mm Hg, respectively. When applying the lower BP thresholds recommended in the 2017 ACC/AHA high BP guideline,2 the prevalence of clinic hypertension (≥130/80 mm Hg) and home hypertension (≥130/80 mm Hg) increased to 39.9% and 37.0%, respectively. Good agreement for home hypertension was present after fewer days of HBPM using the BP thresholds recommended in the 2017 ACC/AHA high BP guideline compared with the results not using these BP thresholds (≥135/85 mm Hg). Overall, the reliability of HBPM was greater when there was a higher prevalence of hypertension.
Study Strengths and Limitations
A major strength of this study is the diverse, community‐based urban sample, which had a high representation of Hispanic and black individuals. The current study examined the reliability of HBPM using several different measurement strategies. Each of the strategies is practical to implement in clinical practice, thereby increasing the generalizability of our results. The study has several potential limitations. The mean clinic BP was 117/76 mm Hg and individuals taking antihypertensive medication were excluded. Therefore, the results may not be generalizable to individuals with treated hypertension or those with higher mean clinic BP. The average age of the study population was 42.3 years. Further, individuals with a history of chronic kidney disease were excluded and only a small number of enrolled participants had diabetes mellitus. Therefore, it is unclear whether the current results can be extended to populations at high CVD risk. The current study did not compare the reliability of HBPM with ABPM, and was not designed to examine the longer‐term reliability of HBPM. Given the sample size, we were also unable to examine the reliability of HBPM strategies within subgroups defined by sex, age, or race. Finally, the study did not collect data on CVD events and we were unable to compare the association of mean home BP with CVD events using the different HBPM strategies.
Conclusions
Data from the current study suggest that the average of 2 morning and 2 evening readings or 1 morning and 1 evening reading over 3 days of HBPM are needed to reliably estimate mean home BP and diagnose out‐of‐clinic hypertension. A greater number of days was required to reliably estimate mean home BP and diagnose home hypertension for the other HBPM strategies. The results of the current study inform how patients should be instructed to conduct HBPM and will help guide clinicians in their interpretation of home BP data.
Sources of Funding
This work was supported by P01‐HL047540 (PI: Schwartz), K24‐HL125704 (PI: Shimbo), and K23‐HL136853 (PI: Bello) from the National Heart, Lung, and Blood Institute at the National Institutes of Health (NIH). Drs Muntner, Shimbo, and Schwartz were supported by 15SFRN2390002 from the American Heart Association. The research was also supported by R01‐HS024262 from the Agency for Healthcare Research and Quality (AHRQ). The contents are solely the responsibility of the authors and do not necessarily represent the official view of the NIH or AHRQ.
Disclosures
Oparil reports grants, nonfinancial support, and other from the National Institutes of Health (NIH)/National Heart, Lung, and Blood Institute (NHLBI); grants from Actelion (Sponsor‐George Institute for Global Health/George Clinical Pty Ltd), Novartis, Bayer Healthcare Pharmaceuticals, Inc; personal fees from Boehringer‐Ingelheim/Lilly, George Clinical Pty Ltd/Actelion Clinical Research Inc, Lundbeck, Novo Nordisk, Inc, ROX Medical, Inc, and 98point6, Inc, outside the submitted work; and is Editor‐in‐Chief, Current Hypertension Reports. Shimbo reports he is a consultant for Abbott Vascular, outside the submitted work. The remaining authors have no disclosures to report.
Footnotes
References
- 1 Siu AL. Screening for high blood pressure in adults: U.S. Preventive services task force recommendation statement. Ann Intern Med. 2015; 163:778–786.CrossrefMedlineGoogle Scholar
- 2 Whelton PK, Carey RM, Aronow WS, Casey DE, Collins KJ, Dennison Himmelfarb C, DePalma SM, Gidding S, Jamerson KA, Jones DW, MacLaughlin EJ, Muntner P, Ovbiagele B, Smith SC, Spencer CC, Stafford RS, Taler SJ, Thomas RJ, Williams KA, Williamson JD, Wright JT. 2017 ACC/AHA/AAPA/ABC/ACPM/AGS/APHA/ASH/ASPC/NMA/PCNA guideline for the prevention, detection, evaluation, and management of high blood pressure in adults: a report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. Hypertension. 2018; 71:e13–e115.LinkGoogle Scholar
- 3 Shimbo D, Abdalla M, Falzon L, Townsend RR, Muntner P. Role of ambulatory and home blood pressure monitoring in clinical practice: a narrative review. Ann Intern Med. 2015; 163:691–700.CrossrefMedlineGoogle Scholar
- 4 Imai Y, Satoh H, Nagai K, Sakuma M, Sakuma H, Minami N, Munakata M, Hashimoto J, Yamagishi T, Watanabe N, Yabe T, Nishiyama A, Nakatsuka H, Koyama H, Abe K. Characteristics of a community‐based distribution of home blood pressure in Ohasama in Northern Japan. J Hypertens. 1993; 11:1441–1449.CrossrefMedlineGoogle Scholar
- 5 Verberk WJ, Kroon AA, Kessels AG, de Leeuw PW. Home blood pressure measurement: a systematic review. J Am Coll Cardiol. 2005; 46:743–751.CrossrefMedlineGoogle Scholar
- 6 Ohkubo T, Asayama K, Kikuya M, Metoki H, Hoshi H, Hashimoto J, Totsune K, Satoh H, Imai Y. How many times should blood pressure be measured at home for better prediction of stroke risk? Ten‐year follow‐up results from the Ohasama study. J Hypertens. 2004; 22:1099–1104.CrossrefMedlineGoogle Scholar
- 7 Niiranen TJ, Asayama K, Thijs L, Johansson JK, Hara A, Hozawa A, Tsuji I, Ohkubo T, Jula AM, Imai Y, Staessen JA. Optimal number of days for home blood pressure measurement. Am J Hypertens. 2015; 28:595–603.CrossrefMedlineGoogle Scholar
- 8 Mancia G, Fagard R, Narkiewicz K, Redon J, Zanchetti A, Bohm M, Christiaens T, Cifkova R, De Backer G, Dominiczak A, Galderisi M, Grobbee DE, Jaarsma T, Kirchhof P, Kjeldsen SE, Laurent S, Manolis AJ, Nilsson PM, Ruilope LM, Schmieder RE, Sirnes PA, Sleight P, Viigimaa M, Waeber B, Zannad F. 2013 ESH/ESC practice guidelines for the management of arterial hypertension. Blood Press. 2014; 23:3–16.CrossrefMedlineGoogle Scholar
- 9 Parati G, Stergiou GS, Asmar R, Bilo G, de Leeuw P, Imai Y, Kario K, Lurbe E, Manolis A, Mengden T, O'Brien E, Ohkubo T, Padfield P, Palatini P, Pickering TG, Redon J, Revera M, Ruilope LM, Shennan A, Staessen JA, Tisler A, Waeber B, Zanchetti A, Mancia G; Monitoring ESHWGoBP . European society of hypertension practice guidelines for home blood pressure monitoring. J Hum Hypertens. 2010; 24:779–785.CrossrefMedlineGoogle Scholar
- 10 Leung AA, Nerenberg K, Daskalopoulou SS, McBrien K, Zarnke KB, Dasgupta K, Cloutier L, Gelfer M, Lamarre‐Cliche M, Milot A, Bolli P, Tremblay G, McLean D, Tobe SW, Ruzicka M, Burns KD, Vallée M, Prasad GVR, Lebel M, Feldman RD, Selby P, Pipe A, Schiffrin EL, McFarlane PA, Oh P, Hegele RA, Khara M, Wilson TW, Penner SB, Burgess E, Herman RJ, Bacon SL, Rabkin SW, Gilbert RE, Campbell TS, Grover S, Honos G, Lindsay P, Hill MD, Coutts SB, Gubitz G, Campbell NRC, Moe GW, Howlett JG, Boulanger J‐M, Prebtani A, Larochelle P, Leiter LA, Jones C, Ogilvie RI, Woo V, Kaczorowski J, Trudeau L, Petrella RJ, Hiremath S, Drouin D, Lavoie KL, Hamet P, Fodor G, Grégoire JC, Lewanczuk R, Dresser GK, Sharma M, Reid D, Lear SA, Moullec G, Gupta M, Magee LA, Logan AG, Harris KC, Dionne J, Fournier A, Benoit G, Feber J, Poirier L, Padwal RS, Rabi DM. Hypertension Canada's 2016 Canadian hypertension education program guidelines for blood pressure measurement, diagnosis, assessment of risk, prevention, and treatment of hypertension. Can J Cardiol. 2016; 32:569–588.CrossrefMedlineGoogle Scholar
- 11 Pickering TG, Miller NH, Ogedegbe G, Krakoff LR, Artinian NT, Goff D; American Heart Association; American Society of Hypertension; Preventive Cardiovascular Nurses Association . Call to action on use and reimbursement for home blood pressure monitoring: a joint scientific statement from the American Heart Association, American Society of Hypertension, and Preventive Cardiovascular Nurses Association. Hypertension. 2008; 52:10–29.LinkGoogle Scholar
- 12 Booth JN, Muntner P, Diaz KM, Viera AJ, Bello NA, Schwartz JE, Shimbo D. Evaluation of criteria to detect masked hypertension. J Clin Hypertens (Greenwich). 2016; 18:1086–1094.CrossrefMedlineGoogle Scholar
- 13 Abdalla M, Goldsmith J, Muntner P, Diaz KM, Reynolds K, Schwartz JE, Shimbo D. Is isolated nocturnal hypertension a reproducible phenotype?Am J Hypertens. 2016; 29:33–38.CrossrefMedlineGoogle Scholar
- 14 Pickering TG. Principles and techniques of blood pressure measurement. Cardiol Clin. 2002; 20:207–223.CrossrefMedlineGoogle Scholar
- 15 Topouchian J, Agnoletti D, Blacher J, Youssef A, Chahine MN, Ibanez I, Assemani N, Asmar R. Validation of four devices: Omron M6 Comfort, Omron HEM‐7420, Withings BP‐800, and Polygreen KP‐7670 for home blood pressure measurement according to the European Society of Hypertension International Protocol. Vasc Health Risk Manag. 2014; 10:33–44.MedlineGoogle Scholar
- 16 Mancia G, De Backer G, Dominiczak A, Cifkova R, Fagard R, Germano G, Grassi G, Heagerty AM, Kjeldsen SE, Laurent S, Narkiewicz K, Ruilope L, Rynkiewicz A, Schmieder RE, Boudier HA, Zanchetti A, Vahanian A, Camm J, De Caterina R, Dean V, Dickstein K, Filippatos G, Funck‐Brentano C, Hellemans I, Kristensen SD, McGregor K, Sechtem U, Silber S, Tendera M, Widimsky P, Zamorano JL, Erdine S, Kiowski W, Agabiti‐Rosei E, Ambrosioni E, Lindholm LH, Viigimaa M, Adamopoulos S, Agabiti‐Rosei E, Ambrosioni E, Bertomeu V, Clement D, Erdine S, Farsang C, Gaita D, Lip G, Mallion JM, Manolis AJ, Nilsson PM, O'Brien E, Ponikowski P, Redon J, Ruschitzka F, Tamargo J, van Zwieten P, Waeber B, Williams B. 2007 guidelines for the management of arterial hypertension: the task force for the management of arterial hypertension of the European Society of Hypertension (ESH) and of the European Society of Cardiology (ESC). J Hypertens. 2007; 25:1105–1187.CrossrefMedlineGoogle Scholar
- 17 Pickering TG, White WB. ASH position paper: home and ambulatory blood pressure monitoring. When and how to use self (home) and ambulatory blood pressure monitoring. J Clin Hypertens (Greenwich). 2008; 10:850–855.CrossrefMedlineGoogle Scholar
- 18 Demetrashvili N, Van den Heuvel ER. Confidence intervals for intraclass correlation coefficients in a nonlinear dose‐response meta‐analysis. Biometrics. 2015; 71:548–555.CrossrefMedlineGoogle Scholar
- 19 Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep. 1966; 19:3–11.CrossrefMedlineGoogle Scholar
- 20 Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86:420–428.CrossrefMedlineGoogle Scholar
- 21 Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994; 6:284–290.CrossrefGoogle Scholar
- 22 Asayama K, Ohkubo T, Kikuya M, Metoki H, Hoshi H, Hashimoto J, Totsune K, Satoh H, Imai Y. Prediction of stroke by self‐measurement of blood pressure at home versus casual screening blood pressure measurement in relation to the joint national committee 7 classification: the Ohasama study. Stroke. 2004; 35:2356–2361.LinkGoogle Scholar
- 23 Non‐invasive sphygmomanometers ‐ Part 2: Clinical investigation of automated measurement type. American National Standards Institute. ANSI/AAMI/ISO 81060‐2; 2013. http://webstore.ansi.org. Accessed November 22, 2017.Google Scholar
- 24 Friedman BA, Alpert BS, Osborn D, Prisant LM, Quinn DE, Seller J. Assessment of the validation of blood pressure monitors: a statistical reappraisal. Blood Press Monit. 2008; 13:187–191.CrossrefMedlineGoogle Scholar
- 25 Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005; 37:360–363.MedlineGoogle Scholar
- 26 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33:159–174.CrossrefMedlineGoogle Scholar
- 27 Fleiss JL. Statistical methods for rates and proportions. New York, NY: Wiley; 1981.Google Scholar
- 28 Shimbo D, Abdalla M, Falzon L, Townsend RR, Muntner P. Studies comparing ambulatory blood pressure and home blood pressure on cardiovascular disease and mortality outcomes: a systematic review. J Am Soc Hypertens. 2016; 10:224–234.e217.CrossrefMedlineGoogle Scholar
- 29 Piper MA, Evans CV, Burda BU, Margolis KL, O'Connor E, Whitlock EP. Diagnostic and predictive accuracy of blood pressure screening methods with consideration of rescreening intervals: a systematic review for the U.S. preventive services task force. Ann Intern Med. 2015; 162:192–204.CrossrefMedlineGoogle Scholar
- 30 Fagard RH, Van Den Broeke C, De Cort P. Prognostic significance of blood pressure measured in the office, at home and during ambulatory monitoring in older patients in general practice. J Hum Hypertens. 2005; 19:801–807.CrossrefMedlineGoogle Scholar
- 31 Kent ST, Shimbo D, Huang L, Diaz KM, Viera AJ, Kilgore M, Oparil S, Muntner P. Rates, amounts, and determinants of ambulatory blood pressure monitoring claim reimbursements among Medicare beneficiaries. J Am Soc Hypertens. 2014; 8:898–908.CrossrefMedlineGoogle Scholar
- 32 Shimbo D, Kent ST, Diaz KM, Huang L, Viera AJ, Kilgore M, Oparil S, Muntner P. The use of ambulatory blood pressure monitoring among Medicare beneficiaries in 2007–2010. J Am Soc Hypertens. 2014; 8:891–897.CrossrefMedlineGoogle Scholar
- 33 Celis H, De Cort P, Fagard R, Thijs L, Staessen JA. For how many days should blood pressure be measured at home in older patients before steady levels are obtained?J Hum Hypertens. 1997; 11:673–677.CrossrefMedlineGoogle Scholar
- 34 Stergiou GS, Skeva II, Zourbaki AS, Mountokalakis TD. Self‐monitoring of blood pressure at home: how many measurements are needed?J Hypertens. 1998; 16:725–731.CrossrefMedlineGoogle Scholar
- 35 Garcia‐Vera MP, Sanz J. How many self‐measured blood pressure readings are needed to estimate hypertensive patients’ “true” blood pressure?J Behav Med. 1999; 22:93–113.CrossrefMedlineGoogle Scholar
- 36 Bobrie G, Chatellier G, Genes N, Clerson P, Vaur L, Vaisse B, Menard J, Mallion JM. Cardiovascular prognosis of “masked hypertension” detected by blood pressure self‐measurement in elderly treated hypertensive patients. JAMA. 2004; 291:1342–1349.CrossrefMedlineGoogle Scholar
- 37 Asayama K, Ohkubo T, Kikuya M, Obara T, Metoki H, Inoue R, Hara A, Hirose T, Hoshi H, Hashimoto J, Totsune K, Satoh H, Imai Y. Prediction of stroke by home “morning” versus “evening” blood pressure values: the Ohasama study. Hypertension. 2006; 48:737–743.LinkGoogle Scholar
- 38 Niiranen TJ, Hanninen MR, Johansson J, Reunanen A, Jula AM. Home‐measured blood pressure is a stronger predictor of cardiovascular risk than office blood pressure: the Finn‐Home study. Hypertension. 2010; 55:1346–1351.LinkGoogle Scholar
- 39 Ohkubo T, Imai Y, Tsuji I, Nagai K, Kato J, Kikuchi N, Nishiyama A, Aihara A, Sekino M, Kikuya M, Ito S, Satoh H, Hisamichi S. Home blood pressure measurement has a stronger predictive power for mortality than does screening blood pressure measurement: a population‐based observation in Ohasama, Japan. J Hypertens. 1998; 16:971–975.CrossrefMedlineGoogle Scholar
- 40 Hond ED, Celis H, Fagard R, Keary L, Leeman M, O'Brien E, Vandenhoven G, Staessen JA. Self‐measured versus ambulatory blood pressure in the diagnosis of hypertension. J Hypertens. 2003; 21:717–722.CrossrefMedlineGoogle Scholar
- 41 Hozawa A, Ohkubo T, Kikuya M, Yamaguchi J, Ohmori K, Fujiwara T, Hashimoto J, Matsubar M, Kitaoka H, Nagai K, Tsuji I, Satoh H, Hisamichi S, Imai Y. Blood pressure control assessed by home, ambulatory and conventional blood pressure measurements in the Japanese general population: the Ohasama study. Hypertens Res. 2002; 25:57–63.CrossrefMedlineGoogle Scholar
- 42 Kario K. Diagnosis of true uncontrolled hypertension using both home and ambulatory blood pressure monitoring. J Hum Hypertens. 2014; 28:176–179.CrossrefMedlineGoogle Scholar
- 43 Nasothimiou EG, Tzamouranis D, Rarra V, Roussias LG, Stergiou GS. Diagnostic accuracy of home vs. Ambulatory blood pressure monitoring in untreated and treated hypertension. Hypertens Res. 2012; 35:750–755.CrossrefMedlineGoogle Scholar
- 44 Tanabe P, Persell SD, Adams JG, McCormick JC, Martinovich Z, Baker DW. Increased blood pressure in the emergency department: pain, anxiety, or undiagnosed hypertension?Ann Emerg Med. 2008; 51:221–229.CrossrefMedlineGoogle Scholar
- 45 Toyama H, Hasegawa Y, Ejima Y, Kurosawa S, Sanada S, Hatano R, Hida W, Matsubara M. Characteristics of young‐onset white coat hypertension identified by targeted screening for hypertension at a university health check‐up. Hypertens Res. 2008; 31:1063–1068.CrossrefMedlineGoogle Scholar
- 46 Stergiou GS, Nasothimiou EG, Kalogeropoulos PG, Pantazis N, Baibas NM. The optimal home blood pressure monitoring schedule based on the Didima outcome study. J Hum Hypertens. 2010; 24:158–164.CrossrefMedlineGoogle Scholar
- 47 Stergiou GS, Parati G. The optimal schedule for self‐monitoring of blood pressure by patients at home. J Hypertens. 2007; 25:1992–1997.CrossrefMedlineGoogle Scholar
- 48 Grant S, Hodgkinson JA, Milner SL, Martin U, Tompson A, Hobbs FR, Mant J, McManus RJ, Greenfield SM. Patients’ and clinicians’ views on the optimum schedules for self‐monitoring of blood pressure: a qualitative focus group and interview study. Br J Gen Pract. 2016; 66:e819–e830.CrossrefMedlineGoogle Scholar


