Using Artificial Intelligence to Reduce the Risk of Nonadherence in Patients on Anticoagulation Therapy
Abstract
Background and Purpose—
This study evaluated the use of an artificial intelligence platform on mobile devices in measuring and increasing medication adherence in stroke patients on anticoagulation therapy. The introduction of direct oral anticoagulants, while reducing the need for monitoring, have also placed pressure on patients to self-manage. Suboptimal adherence goes undetected as routine laboratory tests are not reliable indicators of adherence, placing patients at increased risk of stroke and bleeding.
Methods—
A randomized, parallel-group, 12-week study was conducted in adults (n=28) with recently diagnosed ischemic stroke receiving any anticoagulation. Patients were randomized to daily monitoring by the artificial intelligence platform (intervention) or to no daily monitoring (control). The artificial intelligence application visually identified the patient, the medication, and the confirmed ingestion. Adherence was measured by pill counts and plasma sampling in both groups.
Results—
For all patients (n=28), mean (SD) age was 57 years (13.2 years) and 53.6% were women. Mean (SD) cumulative adherence based on the artificial intelligence platform was 90.5% (7.5%). Plasma drug concentration levels indicated that adherence was 100% (15 of 15) and 50% (6 of 12) in the intervention and control groups, respectively.
Conclusions—
Patients, some with little experience using a smartphone, successfully used the technology and demonstrated a 50% improvement in adherence based on plasma drug concentration levels. For patients receiving direct oral anticoagulants, absolute improvement increased to 67%. Real-time monitoring has the potential to increase adherence and change behavior, particularly in patients on direct oral anticoagulant therapy.
Clinical Trial Registration—
URL: http://www.clinicaltrials.gov. Unique identifier: NCT02599259.
Introduction
Treatment adherence is a critical component of anticoagulation therapy. The recent introduction of direct oral anticoagulants (DOACs) offers a more convenient alternative to warfarin, including a wide therapeutic window, few drug and food interactions, and fixed dosing without the need for laboratory monitoring. Although DOACs have reduced the need for regular monitoring, they have also placed pressure on patients to self-manage. At the same time, the shorter half-life of DOACs makes medication adherence a significant concern.1 Laboratory tests currently used to monitor vitamin K antagonists are either too sensitive or too insensitive to DOACs to act as reliable measures of adherence, making dose titration and the determination of failure of therapy versus poor adherence challenging in routine clinical practice.2,3 As a result, suboptimal rates of adherence4–6 to DOACs go undetected, placing patients at increased risk of stroke and bleeding.
Most studies rely on claims data and patient self-reports to measure adherence: both are unreliable.7,8 Other measures, such as electronic medication packaging, although providing a date and time stamp, are largely limited to adherence studies and have limited effect on adherence.9 Adherence interventions (counseling, educational, text messages, and electronic monitoring) have demonstrated mixed results.10,11 The major limitation of these approaches is that they do not verify drug administration. Although blood levels are considered the gold standard, interperson variation, logistics, and cost make them impractical in routine clinical practice.12
Because of its ability to ensure treatment adherence, directly observed therapy has been used for decades to measure and maximize adherence for treatment of tuberculosis and HIV infection, and in inpatient settings. The artificial intelligence (AI) platform (AiCure, New York, NY) automates directly observed therapy using AI to visually confirm medication ingestion on smartphones (Figure I in the online-only Data Supplement).
Methods
Eligible patients diagnosed with ischemic stroke (with or without preceding transient ischemic attack and with a score between 1 and 20 on the National Institutes of Health Stroke Scale) and receiving oral anticoagulation therapy were randomized to daily monitoring by the AI platform (intervention) or to no daily monitoring (control) in this 12-week, randomized, parallel-group, controlled, single-site study. All patients were prescribed warfarin, dabigatran, rivaroxaban, or apixaban. Patients attended 4 clinic visits (baseline and weeks 4, 8, and 12); prothrombin time/international normalized ratio and the activated partial thromboplastin time were regularly measured. Medication adherence was measured by pill counts, plasma sampling, and the AI platform. Informed consent was obtained before entering the study. The study was approved by an institutional review board.
Exploratory, hypothesis-generating analyses were performed for all randomized patients who took at least 1 dose and included data through week 12.
AI Platform
Patients randomized to the intervention group were provisioned mobile devices with the Health Insurance Portability and Accountability Act-compliant application installed. Software algorithms identified the patient, the medication, and the confirmed ingestion. The software provided medication reminders and dosing instructions. Late doses triggered notifications within the hour and before the end of the dosing window. Real-time data were encrypted and transmitted to web-based dashboards for review. Clinic staff received automated text messages or emails if doses were missed, late, or based on incorrect usage. AI app data fell into 5 categories: (1) visual confirmation of ingestion, (2) self-reported dose via the AI app, (3) self-reported dose by clinic staff, (4) missed dose, and (5) dose taken in clinic (Figure I in the online-only Data Supplement).
Results
A total of 117 patients were screened, with 28 patients randomized; 15 to the AI platform and 13 to the control group. One patient randomized to the control group withdrew from the study before the first dose taken and is excluded from further analysis. Baseline demographics were similar across both groups (Table). Mean (SD) age was 57.0 years (13.17 years), and 53.6% of patients were women. Patients receiving DOACs (n=20) outnumbered patients on warfarin (n=8). Previous smartphone usage and comfort with smartphones were comparable between the 2 groups.
Overall (N=28) | Control (n=13) | AI Platform (n=15) | |
---|---|---|---|
Subject disposition, n (%) | |||
Completed | 27 (96) | 12 (92) | 15 (100) |
Did not complete | 1 (4) | 1 (8) | 0 |
Demographic characteristics | |||
Age, y | |||
Mean (SD) | 57.0 (13.17) | 55.5 (16.55) | 58.3 (9.79) |
Median (range) | 59 (30–79) | 57 (30–79) | 61 (38–71) |
Sex, n (%) | |||
Female | 15 (54) | 9 (69) | 6 (40) |
Male | 13 (46) | 4 (31) | 9 (60) |
Race, n (%) | |||
White | 3 (11) | 3 (23) | 0 |
Black | 13 (46) | 4 (31) | 9 (60) |
Hispanic | 12 (43) | 6 (46) | 6 (40) |
Medication type, n (%) | |||
Warfarin | 8 (29) | 3 (23) | 5 (33) |
Apixaban | 10 (36) | 5 (39) | 5 (33) |
Rivaroxaban | 7 (25) | 3 (23) | 4 (27) |
Dabigatran | 3 (11) | 2 (15) | 1 (7) |
AI indicates artificial intelligence.
Adherence for All Subjects
A total of 2234 adherence parameters were collected during 12 weeks for patients monitored with the AI app. Mean (SD) cumulative adherence (visual confirmation of drug administration using the AI app) was 90.5% (7.5%; Figure 1).
Mean (SD) cumulative adherence based on pill count was 97.2% (4.4%) for the AI platform group and 90.6% (5.8%) for the control group. A total of 108 plasma samples (4 per patient) were collected across both groups (3 samples were clotted). Plasma samples were marked as adherent if drug concentration levels were above the minimum required therapeutic range (Cmin). Fifty percent (6 out of 12) and 100% (15 out of 15) of patients in the control and intervention groups, respectively, had all samples above Cmin. Among patients deemed nonadherent (n=6), all were in the control group and all were prescribed DOACs. At all clinic visits, the intervention group had a higher percentage of samples above Cmin than the control group (Figure 2).
Substudy—Adherence for Patients Receiving DOACs
More than half of the patients (n=19) received DOACs. Mean (SD) cumulative adherence (visual confirmation of drug administration using the AI app) was 90.1% (7.3%). Mean (SD) cumulative adherence based on pill count was 96.4% (5.1%) for the AI platform group and 90.9% (6.0%) for the control group. Mean (SD) cumulative adherence based on pill count for subjects with plasma samples below therapeutic range was 90.5% (5.6%) compared with 95.3% (5.9%) for subjects with plasma samples above therapeutic range. On the basis of drug concentration levels, 33% (3 out of 9) in the control and 100% (10 out of 10) in the intervention group had all samples above Cmin.
Activated Partial Thromboplastin Time and Prothrombin Time/International Normalized Ratio
Averages for activated partial thromboplastin time and prothrombin time/international normalized ratio were similar across the control and intervention groups: activated partial thromboplastin time, 48.4 and 41.7, respectively; prothrombin time, 32.9 and 35.1, respectively; and international normalized ratio, 3.1 and 3.4, respectively.
Usability and Feasibility of the AI Platform
Patients randomized to the intervention group were asked to complete pre- and poststudy usability questionnaires. In the pre- and poststudy questionnaire, overall 73.3% and 83.3% of patients, respectively, answered extremely good when asked 4 questions to rate the AI platform as a medication management tool and as a means to improve the doctor/patient relationship.
Discussion
This study used a novel artificial intelligence platform to assess and increase medication adherence in patients with a recently diagnosed ischemic stroke. Unlike most studies, which rely on indirect measures, to our knowledge, this study was the first randomized controlled trial to compare adherence rates of all 3 DOACs (dabigatran, rivaroxaban, and apixaban) and warfarin together based on daily real-time monitoring against a control group and verified by plasma sampling. Suboptimal adherence across all DOACs confirms previous findings although this study suggests that adherence might be lower than previously recognized; high adherence to warfarin underlines the value of routine laboratory tests to, in effect, ensure adherence. Absolute improvement of 67% in patients taking DOACs and monitored by the AI app—and confirmed by drug levels—demonstrates the potential value of daily real-time monitoring to measure and maximize adherence. Few studies have deployed smartphone apps in middle-aged or elderly populations.13 Consistent use and general likability of the AI app over 12 weeks underscores the possibility of harnessing new technologies to optimize adherence in patients on DOACs for whom routine laboratory tests are not good indicators of adherence. AI platforms have the potential to accurately monitor medication ingestion and change patient behavior.
Acknowledgments
We acknowledge Aubri Charboneau of Sage Scientific Writing, LLC, for editorial support and John E. Hinkle of EarlyPhase Sciences, Inc, for database support and statistical analyses.
Supplemental Material
References
1.
Bauer KA. Pros and cons of new oral anticoagulants. Hematology Am Soc Hematol Educ Program. 2013;2013:464–470. doi: 10.1182/asheducation-2013.1.464.
2.
Ten Cate H. New oral anticoagulants: discussion on monitoring and adherence should start now! Thromb J. 2013;11:8. doi: 10.1186/1477-9560-11-8.
3.
Favaloro EJ, Lippi G. The new oral anticoagulants and the future of haemostasis laboratory testing. Biochem Med (Zagreb). 2012;22:329–341.
4.
Yao X, Abraham NS, Alexander GC, Crown W, Montori VM, Sangaralingham LR, et al. Effect of adherence to oral anticoagulants on risk of stroke and major bleeding among patients with atrial fibrillation. J Am Heart Assoc. 2016;5:e003074.
5.
Song X, Sander SD, Varker H, Amin A. Patterns and predictors of use of warfarin and other common long-term medications in patients with atrial fibrillation. Am J Cardiovasc Drugs. 2012;12:245–253. doi: 10.2165/11632540-000000000-00000.
6.
Zhou M, Chang HY, Segal JB, Alexander GC, Singh S. Adherence to a novel oral anticoagulant among patients with atrial fibrillation. J Manag Care Spec Pharm. 2015;21:1054–1062. doi: 10.18553/jmcp.2015.21.11.1054.
7.
Marrazzo JM, Ramjee G, Richardson BA, Gomez K, Mgodi N, Nair G, et al.; VOICE Study Team. Tenofovir-based preexposure prophylaxis for HIV infection among African women. N Engl J Med. 2015;372:509–518. doi: 10.1056/NEJMoa1402269.
8.
Blaschke TF, Osterberg L, Vrijens B, Urquhart J. Adherence to medications: insights arising from studies on the unreliable link between prescribed and actual drug dosing histories. Annu Rev Pharmacol Toxicol. 2012;52:275–301. doi: 10.1146/annurev-pharmtox-011711-113247.
9.
Checchi KD, Huybrechts KF, Avorn J, Kesselheim AS. Electronic medication packaging devices and medication adherence: a systematic review. JAMA. 2014;312:1237–1247. doi: 10.1001/jama.2014.10059.
10.
Wei J, Hollin I, Kachnowski S. A review of the use of mobile phone text messaging in clinical and healthy behaviour interventions. J Telemed Telecare. 2011;17:41–48. doi: 10.1258/jtt.2010.100322.
11.
Wu YP, Pai AL. Health care provider-delivered adherence promotion interventions: a meta-analysis. Pediatrics. 2014;133:e1698–e1707. doi: 10.1542/peds.2013-3639.
12.
Shemesh E, Fine RN. Is calculating the standard deviation of tacrolimus blood levels the new gold standard for evaluating non-adherence to medications in transplant recipients? Pediatr Transplant. 2010;14:940–943. doi: 10.1111/j.1399-3046.2010.01396.x.
13.
Mira JJ, Navarro I, Botella F, Borrás F, Nuño-Solinís R, Orozco D, et al. A Spanish pillbox app for elderly patients taking multiple medications: randomized controlled trial. J Med Internet Res. 2014;16:e99. doi: 10.2196/jmir.3269.
Information & Authors
Information
Published In
Copyright
© 2017 American Heart Association, Inc.
Versions
You are viewing the most recent version of this article.
History
Received: 5 December 2016
Revision received: 7 February 2017
Accepted: 16 February 2017
Published online: 6 April 2017
Published in print: May 2017
Keywords
Subjects
Authors
Disclosures
Dr Labovitz, Dr Virmani, and Dr Gil are employees of Montefiore Medical Center, Bronx, NY. L. Shafner and A. Hanina are employees of AiCure, New York, NY.
Sources of Funding
Funding was received from the National Center for Advancing Translational Sciences grant number: 9R44 TR000873-02.
This study was sponsored by AiCure, New York, NY.
Metrics & Citations
Metrics
Citations
Download Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Select your manager software from the list below and click Download.
- Satisfaction and Usability of a Commercially Available Medication Adherence App (Medisafe) Among Medically Underserved Patients With Chronic Illnesses: Survey Study, JMIR Human Factors, 12, (e63653), (2025).https://doi.org/10.2196/63653
- Patient reported tools for assessing potential medicine-related symptoms: A systematic review, Research in Social and Administrative Pharmacy, (2025).https://doi.org/10.1016/j.sapharm.2025.01.002
- Anxiety about artificial intelligence from patient and doctor-physician, Patient Education and Counseling, 133, (108619), (2025).https://doi.org/10.1016/j.pec.2024.108619
- Effectiveness of Mobile Health Intervention in Medication Adherence: a Systematic Review and Meta-Analysis, Journal of Medical Systems, 49, 1, (2025).https://doi.org/10.1007/s10916-024-02135-2
- Medical Doctors’ Perceptions of Artificial Intelligence (AI) in Healthcare, Cureus, (2024).https://doi.org/10.7759/cureus.70508
- Assessing the Efficacy of an AI-Powered Chatbot (ChatGPT) in Providing Information on Orthopedic Surgeries: A Comparative Study With Expert Opinion, Cureus, (2024).https://doi.org/10.7759/cureus.63287
- Anticoagulation: Past, Present, and Future Therapies, Anticoagulation - An Update, (2024).https://doi.org/10.5772/intechopen.114188
- Coping with Complications that Occur after Prostate Biopsy for Satisfactory Evaluation of Call Service Using Artificial Intelligence: A Pilot Randomized Controlled Trial, The World Journal of Men's Health, 42, (2024).https://doi.org/10.5534/wjmh.240191
- Artificial intelligence and machine learning in hemostasis and thrombosis, Bleeding, Thrombosis and Vascular Biology, 2, 4, (2024).https://doi.org/10.4081/btvb.2023.105
- Promoting Emotional Well-Being in Older Adults, Physical Health, Mental Health, and Human Well-Being in the Age of AI, (137-166), (2024).https://doi.org/10.4018/979-8-3693-6190-0.ch008
- See more
Loading...
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Personal login Institutional LoginPurchase Options
Purchase this article to access the full text.
eLetters(0)
eLetters should relate to an article recently published in the journal and are not a forum for providing unpublished data. Comments are reviewed for appropriate use of tone and language. Comments are not peer-reviewed. Acceptable comments are posted to the journal website only. Comments are not published in an issue and are not indexed in PubMed. Comments should be no longer than 500 words and will only be posted online. References are limited to 10. Authors of the article cited in the comment will be invited to reply, as appropriate.
Comments and feedback on AHA/ASA Scientific Statements and Guidelines should be directed to the AHA/ASA Manuscript Oversight Committee via its Correspondence page.