Skip to main content
Research Article
Originally Published 6 April 2017
Free Access

Using Artificial Intelligence to Reduce the Risk of Nonadherence in Patients on Anticoagulation Therapy

Abstract

Background and Purpose—

This study evaluated the use of an artificial intelligence platform on mobile devices in measuring and increasing medication adherence in stroke patients on anticoagulation therapy. The introduction of direct oral anticoagulants, while reducing the need for monitoring, have also placed pressure on patients to self-manage. Suboptimal adherence goes undetected as routine laboratory tests are not reliable indicators of adherence, placing patients at increased risk of stroke and bleeding.

Methods—

A randomized, parallel-group, 12-week study was conducted in adults (n=28) with recently diagnosed ischemic stroke receiving any anticoagulation. Patients were randomized to daily monitoring by the artificial intelligence platform (intervention) or to no daily monitoring (control). The artificial intelligence application visually identified the patient, the medication, and the confirmed ingestion. Adherence was measured by pill counts and plasma sampling in both groups.

Results—

For all patients (n=28), mean (SD) age was 57 years (13.2 years) and 53.6% were women. Mean (SD) cumulative adherence based on the artificial intelligence platform was 90.5% (7.5%). Plasma drug concentration levels indicated that adherence was 100% (15 of 15) and 50% (6 of 12) in the intervention and control groups, respectively.

Conclusions—

Patients, some with little experience using a smartphone, successfully used the technology and demonstrated a 50% improvement in adherence based on plasma drug concentration levels. For patients receiving direct oral anticoagulants, absolute improvement increased to 67%. Real-time monitoring has the potential to increase adherence and change behavior, particularly in patients on direct oral anticoagulant therapy.

Clinical Trial Registration—

URL: http://www.clinicaltrials.gov. Unique identifier: NCT02599259.

Introduction

Treatment adherence is a critical component of anticoagulation therapy. The recent introduction of direct oral anticoagulants (DOACs) offers a more convenient alternative to warfarin, including a wide therapeutic window, few drug and food interactions, and fixed dosing without the need for laboratory monitoring. Although DOACs have reduced the need for regular monitoring, they have also placed pressure on patients to self-manage. At the same time, the shorter half-life of DOACs makes medication adherence a significant concern.1 Laboratory tests currently used to monitor vitamin K antagonists are either too sensitive or too insensitive to DOACs to act as reliable measures of adherence, making dose titration and the determination of failure of therapy versus poor adherence challenging in routine clinical practice.2,3 As a result, suboptimal rates of adherence46 to DOACs go undetected, placing patients at increased risk of stroke and bleeding.
Most studies rely on claims data and patient self-reports to measure adherence: both are unreliable.7,8 Other measures, such as electronic medication packaging, although providing a date and time stamp, are largely limited to adherence studies and have limited effect on adherence.9 Adherence interventions (counseling, educational, text messages, and electronic monitoring) have demonstrated mixed results.10,11 The major limitation of these approaches is that they do not verify drug administration. Although blood levels are considered the gold standard, interperson variation, logistics, and cost make them impractical in routine clinical practice.12
Because of its ability to ensure treatment adherence, directly observed therapy has been used for decades to measure and maximize adherence for treatment of tuberculosis and HIV infection, and in inpatient settings. The artificial intelligence (AI) platform (AiCure, New York, NY) automates directly observed therapy using AI to visually confirm medication ingestion on smartphones (Figure I in the online-only Data Supplement).

Methods

Eligible patients diagnosed with ischemic stroke (with or without preceding transient ischemic attack and with a score between 1 and 20 on the National Institutes of Health Stroke Scale) and receiving oral anticoagulation therapy were randomized to daily monitoring by the AI platform (intervention) or to no daily monitoring (control) in this 12-week, randomized, parallel-group, controlled, single-site study. All patients were prescribed warfarin, dabigatran, rivaroxaban, or apixaban. Patients attended 4 clinic visits (baseline and weeks 4, 8, and 12); prothrombin time/international normalized ratio and the activated partial thromboplastin time were regularly measured. Medication adherence was measured by pill counts, plasma sampling, and the AI platform. Informed consent was obtained before entering the study. The study was approved by an institutional review board.
Exploratory, hypothesis-generating analyses were performed for all randomized patients who took at least 1 dose and included data through week 12.

AI Platform

Patients randomized to the intervention group were provisioned mobile devices with the Health Insurance Portability and Accountability Act-compliant application installed. Software algorithms identified the patient, the medication, and the confirmed ingestion. The software provided medication reminders and dosing instructions. Late doses triggered notifications within the hour and before the end of the dosing window. Real-time data were encrypted and transmitted to web-based dashboards for review. Clinic staff received automated text messages or emails if doses were missed, late, or based on incorrect usage. AI app data fell into 5 categories: (1) visual confirmation of ingestion, (2) self-reported dose via the AI app, (3) self-reported dose by clinic staff, (4) missed dose, and (5) dose taken in clinic (Figure I in the online-only Data Supplement).

Results

A total of 117 patients were screened, with 28 patients randomized; 15 to the AI platform and 13 to the control group. One patient randomized to the control group withdrew from the study before the first dose taken and is excluded from further analysis. Baseline demographics were similar across both groups (Table). Mean (SD) age was 57.0 years (13.17 years), and 53.6% of patients were women. Patients receiving DOACs (n=20) outnumbered patients on warfarin (n=8). Previous smartphone usage and comfort with smartphones were comparable between the 2 groups.
Table. Subject Disposition and Demographics (All Randomized Subjects)
 Overall (N=28)Control (n=13)AI Platform (n=15)
Subject disposition, n (%)
 Completed27 (96)12 (92)15 (100)
 Did not complete1 (4)1 (8)0
Demographic characteristics
 Age, y
  Mean (SD)57.0 (13.17)55.5 (16.55)58.3 (9.79)
  Median (range)59 (30–79)57 (30–79)61 (38–71)
 Sex, n (%)
  Female15 (54)9 (69)6 (40)
  Male13 (46)4 (31)9 (60)
 Race, n (%)
  White3 (11)3 (23)0
  Black13 (46)4 (31)9 (60)
  Hispanic12 (43)6 (46)6 (40)
 Medication type, n (%)
  Warfarin8 (29)3 (23)5 (33)
  Apixaban10 (36)5 (39)5 (33)
  Rivaroxaban7 (25)3 (23)4 (27)
  Dabigatran3 (11)2 (15)1 (7)
AI indicates artificial intelligence.

Adherence for All Subjects

A total of 2234 adherence parameters were collected during 12 weeks for patients monitored with the AI app. Mean (SD) cumulative adherence (visual confirmation of drug administration using the AI app) was 90.5% (7.5%; Figure 1).
Figure 1. Mean cumulative adherence per patient based on artificial intelligence (AI) platform (intervention group).
Mean (SD) cumulative adherence based on pill count was 97.2% (4.4%) for the AI platform group and 90.6% (5.8%) for the control group. A total of 108 plasma samples (4 per patient) were collected across both groups (3 samples were clotted). Plasma samples were marked as adherent if drug concentration levels were above the minimum required therapeutic range (Cmin). Fifty percent (6 out of 12) and 100% (15 out of 15) of patients in the control and intervention groups, respectively, had all samples above Cmin. Among patients deemed nonadherent (n=6), all were in the control group and all were prescribed DOACs. At all clinic visits, the intervention group had a higher percentage of samples above Cmin than the control group (Figure 2).
Figure 2. Mean percentage of samples marked as adherent over time (above Cmin). AI indicates artificial intelligence.

Substudy—Adherence for Patients Receiving DOACs

More than half of the patients (n=19) received DOACs. Mean (SD) cumulative adherence (visual confirmation of drug administration using the AI app) was 90.1% (7.3%). Mean (SD) cumulative adherence based on pill count was 96.4% (5.1%) for the AI platform group and 90.9% (6.0%) for the control group. Mean (SD) cumulative adherence based on pill count for subjects with plasma samples below therapeutic range was 90.5% (5.6%) compared with 95.3% (5.9%) for subjects with plasma samples above therapeutic range. On the basis of drug concentration levels, 33% (3 out of 9) in the control and 100% (10 out of 10) in the intervention group had all samples above Cmin.

Activated Partial Thromboplastin Time and Prothrombin Time/International Normalized Ratio

Averages for activated partial thromboplastin time and prothrombin time/international normalized ratio were similar across the control and intervention groups: activated partial thromboplastin time, 48.4 and 41.7, respectively; prothrombin time, 32.9 and 35.1, respectively; and international normalized ratio, 3.1 and 3.4, respectively.

Usability and Feasibility of the AI Platform

Patients randomized to the intervention group were asked to complete pre- and poststudy usability questionnaires. In the pre- and poststudy questionnaire, overall 73.3% and 83.3% of patients, respectively, answered extremely good when asked 4 questions to rate the AI platform as a medication management tool and as a means to improve the doctor/patient relationship.

Discussion

This study used a novel artificial intelligence platform to assess and increase medication adherence in patients with a recently diagnosed ischemic stroke. Unlike most studies, which rely on indirect measures, to our knowledge, this study was the first randomized controlled trial to compare adherence rates of all 3 DOACs (dabigatran, rivaroxaban, and apixaban) and warfarin together based on daily real-time monitoring against a control group and verified by plasma sampling. Suboptimal adherence across all DOACs confirms previous findings although this study suggests that adherence might be lower than previously recognized; high adherence to warfarin underlines the value of routine laboratory tests to, in effect, ensure adherence. Absolute improvement of 67% in patients taking DOACs and monitored by the AI app—and confirmed by drug levels—demonstrates the potential value of daily real-time monitoring to measure and maximize adherence. Few studies have deployed smartphone apps in middle-aged or elderly populations.13 Consistent use and general likability of the AI app over 12 weeks underscores the possibility of harnessing new technologies to optimize adherence in patients on DOACs for whom routine laboratory tests are not good indicators of adherence. AI platforms have the potential to accurately monitor medication ingestion and change patient behavior.

Acknowledgments

We acknowledge Aubri Charboneau of Sage Scientific Writing, LLC, for editorial support and John E. Hinkle of EarlyPhase Sciences, Inc, for database support and statistical analyses.

Supplemental Material

File (str_stroke-2016-016281_supp1.pdf)
File (str_stroke-2016-016281_supp2.pdf)

References

1.
Bauer KA. Pros and cons of new oral anticoagulants. Hematology Am Soc Hematol Educ Program. 2013;2013:464–470. doi: 10.1182/asheducation-2013.1.464.
2.
Ten Cate H. New oral anticoagulants: discussion on monitoring and adherence should start now! Thromb J. 2013;11:8. doi: 10.1186/1477-9560-11-8.
3.
Favaloro EJ, Lippi G. The new oral anticoagulants and the future of haemostasis laboratory testing. Biochem Med (Zagreb). 2012;22:329–341.
4.
Yao X, Abraham NS, Alexander GC, Crown W, Montori VM, Sangaralingham LR, et al. Effect of adherence to oral anticoagulants on risk of stroke and major bleeding among patients with atrial fibrillation. J Am Heart Assoc. 2016;5:e003074.
5.
Song X, Sander SD, Varker H, Amin A. Patterns and predictors of use of warfarin and other common long-term medications in patients with atrial fibrillation. Am J Cardiovasc Drugs. 2012;12:245–253. doi: 10.2165/11632540-000000000-00000.
6.
Zhou M, Chang HY, Segal JB, Alexander GC, Singh S. Adherence to a novel oral anticoagulant among patients with atrial fibrillation. J Manag Care Spec Pharm. 2015;21:1054–1062. doi: 10.18553/jmcp.2015.21.11.1054.
7.
Marrazzo JM, Ramjee G, Richardson BA, Gomez K, Mgodi N, Nair G, et al.; VOICE Study Team. Tenofovir-based preexposure prophylaxis for HIV infection among African women. N Engl J Med. 2015;372:509–518. doi: 10.1056/NEJMoa1402269.
8.
Blaschke TF, Osterberg L, Vrijens B, Urquhart J. Adherence to medications: insights arising from studies on the unreliable link between prescribed and actual drug dosing histories. Annu Rev Pharmacol Toxicol. 2012;52:275–301. doi: 10.1146/annurev-pharmtox-011711-113247.
9.
Checchi KD, Huybrechts KF, Avorn J, Kesselheim AS. Electronic medication packaging devices and medication adherence: a systematic review. JAMA. 2014;312:1237–1247. doi: 10.1001/jama.2014.10059.
10.
Wei J, Hollin I, Kachnowski S. A review of the use of mobile phone text messaging in clinical and healthy behaviour interventions. J Telemed Telecare. 2011;17:41–48. doi: 10.1258/jtt.2010.100322.
11.
Wu YP, Pai AL. Health care provider-delivered adherence promotion interventions: a meta-analysis. Pediatrics. 2014;133:e1698–e1707. doi: 10.1542/peds.2013-3639.
12.
Shemesh E, Fine RN. Is calculating the standard deviation of tacrolimus blood levels the new gold standard for evaluating non-adherence to medications in transplant recipients? Pediatr Transplant. 2010;14:940–943. doi: 10.1111/j.1399-3046.2010.01396.x.
13.
Mira JJ, Navarro I, Botella F, Borrás F, Nuño-Solinís R, Orozco D, et al. A Spanish pillbox app for elderly patients taking multiple medications: randomized controlled trial. J Med Internet Res. 2014;16:e99. doi: 10.2196/jmir.3269.

eLetters(0)

eLetters should relate to an article recently published in the journal and are not a forum for providing unpublished data. Comments are reviewed for appropriate use of tone and language. Comments are not peer-reviewed. Acceptable comments are posted to the journal website only. Comments are not published in an issue and are not indexed in PubMed. Comments should be no longer than 500 words and will only be posted online. References are limited to 10. Authors of the article cited in the comment will be invited to reply, as appropriate.

Comments and feedback on AHA/ASA Scientific Statements and Guidelines should be directed to the AHA/ASA Manuscript Oversight Committee via its Correspondence page.

Information & Authors

Information

Published In

Go to Stroke
Go to Stroke

The image is taken from an article in this issue, “Intracranial Dural Arteriovenous Fistulae” by Reynolds et al (Stroke. 2017;48:1424–1431. doi: 10.1161/STROKEAHA.116.012784). The image is Figure 1.

Stroke
Pages: 1416 - 1419
PubMed: 28386037

Versions

You are viewing the most recent version of this article.

History

Received: 5 December 2016
Revision received: 7 February 2017
Accepted: 16 February 2017
Published online: 6 April 2017
Published in print: May 2017

Permissions

Request permissions for this article.

Keywords

  1. anticoagulants
  2. artificial intelligence
  3. patient compliance
  4. patient outcome assessment
  5. stroke

Subjects

Authors

Affiliations

Daniel L. Labovitz, MD
From the Montefiore Medical Center, Bronx, New York (D.L.L., M.R.G., D.V.); and AiCure, New York, NY (L.S., A.H.).
Laura Shafner, MSc
From the Montefiore Medical Center, Bronx, New York (D.L.L., M.R.G., D.V.); and AiCure, New York, NY (L.S., A.H.).
Morayma Reyes Gil, PhD
From the Montefiore Medical Center, Bronx, New York (D.L.L., M.R.G., D.V.); and AiCure, New York, NY (L.S., A.H.).
Deepti Virmani, MBBS
From the Montefiore Medical Center, Bronx, New York (D.L.L., M.R.G., D.V.); and AiCure, New York, NY (L.S., A.H.).
Adam Hanina, MBA
From the Montefiore Medical Center, Bronx, New York (D.L.L., M.R.G., D.V.); and AiCure, New York, NY (L.S., A.H.).

Notes

Presented in part at the Connected Health Symposium, Boston, MA, October 20–21, 2016.
The online-only Data Supplement is available with this article at http://stroke.ahajournals.org/lookup/suppl/doi:10.1161/STROKEAHA.116.016281/-/DC1.
Correspondence to Laura Shafner, MSc, AiCure, 19 W 24th St, 11th floor, New York, NY 10010. E-mail [email protected]

Disclosures

Dr Labovitz, Dr Virmani, and Dr Gil are employees of Montefiore Medical Center, Bronx, NY. L. Shafner and A. Hanina are employees of AiCure, New York, NY.

Sources of Funding

Funding was received from the National Center for Advancing Translational Sciences grant number: 9R44 TR000873-02.
This study was sponsored by AiCure, New York, NY.

Metrics & Citations

Metrics

Citations

Download Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Select your manager software from the list below and click Download.

  1. Satisfaction and Usability of a Commercially Available Medication Adherence App (Medisafe) Among Medically Underserved Patients With Chronic Illnesses: Survey Study, JMIR Human Factors, 12, (e63653), (2025).https://doi.org/10.2196/63653
    Crossref
  2. Patient reported tools for assessing potential medicine-related symptoms: A systematic review, Research in Social and Administrative Pharmacy, (2025).https://doi.org/10.1016/j.sapharm.2025.01.002
    Crossref
  3. Anxiety about artificial intelligence from patient and doctor-physician, Patient Education and Counseling, 133, (108619), (2025).https://doi.org/10.1016/j.pec.2024.108619
    Crossref
  4. Effectiveness of Mobile Health Intervention in Medication Adherence: a Systematic Review and Meta-Analysis, Journal of Medical Systems, 49, 1, (2025).https://doi.org/10.1007/s10916-024-02135-2
    Crossref
  5. Medical Doctors’ Perceptions of Artificial Intelligence (AI) in Healthcare, Cureus, (2024).https://doi.org/10.7759/cureus.70508
    Crossref
  6. Assessing the Efficacy of an AI-Powered Chatbot (ChatGPT) in Providing Information on Orthopedic Surgeries: A Comparative Study With Expert Opinion, Cureus, (2024).https://doi.org/10.7759/cureus.63287
    Crossref
  7. Anticoagulation: Past, Present, and Future Therapies, Anticoagulation - An Update, (2024).https://doi.org/10.5772/intechopen.114188
    Crossref
  8. Coping with Complications that Occur after Prostate Biopsy for Satisfactory Evaluation of Call Service Using Artificial Intelligence: A Pilot Randomized Controlled Trial, The World Journal of Men's Health, 42, (2024).https://doi.org/10.5534/wjmh.240191
    Crossref
  9. Artificial intelligence and machine learning in hemostasis and thrombosis, Bleeding, Thrombosis and Vascular Biology, 2, 4, (2024).https://doi.org/10.4081/btvb.2023.105
    Crossref
  10. Promoting Emotional Well-Being in Older Adults, Physical Health, Mental Health, and Human Well-Being in the Age of AI, (137-166), (2024).https://doi.org/10.4018/979-8-3693-6190-0.ch008
    Crossref
  11. See more
Loading...

View Options

View options

PDF and All Supplements

Download PDF and All Supplements

PDF/EPUB

View PDF/EPUB
Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Personal login Institutional Login
Purchase Options

Purchase this article to access the full text.

Purchase access to this article for 24 hours

Using Artificial Intelligence to Reduce the Risk of Nonadherence in Patients on Anticoagulation Therapy
Stroke
  • Vol. 48
  • No. 5

Purchase access to this journal for 24 hours

Stroke
  • Vol. 48
  • No. 5
Restore your content access

Enter your email address to restore your content access:

Note: This functionality works only for purchases done as a guest. If you already have an account, log in to access the content to which you are entitled.

Figures

Tables

Media

Share

Share

Share article link

Share

Comment Response