Comparison of Computational Fluid Dynamics and Machine Learning–Based Fractional Flow Reserve in Coronary Artery Disease
See Article by Coenen et al
Over 16.5 million Americans >20 years of age have coronary artery disease (CAD)—the leading cause of death in the developed and developing world. Currently, the gold standard for CAD detection remains invasive X-ray invasive coronary angiography (ICA), which has been recently augmented by calculation of the fractional flow reserve (FFR),1 the ratio of flow across a stenotic artery with and without vasodilator. Although therapeutic interventions in the acute coronary space require access to the vasculature for ICA, patients with stable CAD2–6 may not derive a similar benefit at the same level of risk (eg, vascular injury7 or thromboembolic phenomena). These limitations have led to the consideration of noninvasive techniques, such as cardiac computed tomographic (CT) angiography (CCTA),8–10 as a potential surrogate for ICA in patients who are not experiencing an acute coronary syndrome.
CCTA has emerged as a reliable method in the quantification, detection, and characterization of coronary plaque.11 Advancements in the field of computational fluid dynamics (CFD)12 have enabled modeling of coronary arterial flow from CCTA images. A CT-based FFR may be estimated with existing CCTA images, thereby obviating the need for invasive procedures or additional imaging. Clinical trials, such as DISCOVER-FLOW (Diagnosis of Ischemia-Causing Stenoses Obtained via Noninvasive Fractional Flow Reserve),13 DeFACTO (Determination of Fractional Flow Reserve by Anatomic Computed Tomographic Angiography),14 and the NXT trial (Analysis of Coronary Blood Flow Using CT Angiography: Next Steps),15 have all demonstrated excellent correlation with ICA-based FFR. Nevertheless, CFD simulations of coronary arterial flow are complex because they are dependent on the contraction and relaxation of the heart. Coronary flow increases and decreases as the ventricles relax, and contract respectively, thus changing the intramyocardial pressure. Therefore, for an accurate model of coronary flow, both the heart and arterial model must be taken into consideration, leading to complex modeling, with a solution that is computationally inefficient. Preventing these delays in obtaining the diagnosis could be invaluable in patients who are at high risk for CAD, where the need for therapy may be more urgent.
Itu et al16 directly address this call by estimating a CT-based FFR via machine learning (ML)–based approaches. Once the ML model is built, it can be used to estimate the FFR in near real time. Typically, large training data sets are required to develop (train) the ML model, after which time it can be applied to new (test) data not used in model development. This scheme provides a more realistic estimation of the parameters and is less prone to erroneous results because of model overfitting. Itu et al use a deep-learning model to estimate FFR from CCTA images from 87 patients and compare ICA-FFR, CFD-FFR, and ML-FFR. To develop the training data for the ML model, a large CCTA image database was constructed using 12 000 synthetically generated coronary anatomies in 3 stages. A fully connected deep neural network with 28 input features extracted from the synthetically generated database and 4 hidden layers was used to train the model and then applied to CCTA images from patients to test to model by estimating CT-FFR. The benefits of this approach include generalizability across a wide range of pathological CAD flow conditions and take advantage of nonlinear ML algorithms (eg, deep learning) that are highly accurate and suited to a large amount of input training data. Moreover, unlike traditional ML algorithms, the performance of any model does not tend to plateau because more data are added during the model-building process.
Using this approach, Coenen et al17 present a multicenter study (comprising 351 patients with 525 vessels), comparing the detection of CAD by using CCTA alone, CFD-FFR, and the ML-FFR. The diagnostic performance of each technique was evaluated with ICA as reference. Of the 525 vessels investigated, 212 were considered to be hemodynamically significant (FFR≤0.8) using the ICA-FFR as reference. Whereas CCTA alone (with a 50% or 70% vessel stenosis cutoff) performed poorly, the CFD-based FFR and ML-based FFR detected CAD at much higher accuracy (78%; 75%–82%), with no discernable difference between the two. Of note, because nearly all the patients (≈96%) had a CCTA-defined stenosis >50%, for which they were referred to an ICA procedure, the number of false positives by CT angiography (CTA) alone is high (85 patients of 303). Impressively, using the ML-FFR, 62 patients were correctly reclassified out of the false-positive group, which indicate that not all stenoses identified by CTA contribute to hemodynamic severity. When the patients were subclassified based on their calcium scores, no appreciable difference was observed for all 3 modes of diagnosis. A substantial difference in accuracy by ML-FFR was observed, however, when the patients were grouped by their image quality; 75% (67%–83%) for the first tertile (lowest image quality) and 91% (86%–97%) for the third tertile (the highest image quality). This underscores the importance of having high-quality images both for training the ML algorithm and when it is applied to predict CAD on real-world clinical imaging data. The results indicate that the FFRs estimated from CFD and ML are indistinguishable, but the time required to perform the analysis decreased substantially. Both the ML model and the CFD used in this work are based on the same 3-dimensional segmentation model that requires 30 to 60 minutes to generate.
The ML results, which are based on anatomic features extracted from CTA, are nearly identical to the CFD results, which entails that advancements made in the CFD model of coronary arterial flow by the addition of plaque composition, minute changes in viscosity and density of blood, and other variables, such as the effect of current medications, would be faithfully reproduced in the ML model. Moreover, as shown in this multicenter study, the ML-FFR–based approach correctly reclassified 62 of 85 patients who were suspected of CAD using ICA-FFR as reference. This would, therefore, have important implications in risk stratification and subsequent referral to ICA procedures of patients suspected of having CAD. The limitations of this approach, as the authors point out, are in the CFD model that the ML model is based on; the ML model is only as accurate as the CFD model. Although the reduction in analysis time is impressive, there are several issues that have to be tackled in the clinical setting. The accuracy of detection of hemodynamically significant lesions is highly dependent on the image qualities as is shown in this work. Including a larger number and wider range of image qualities in the model-building/training phase may help ameliorate this issue. Extraction of the anatomic features from CTA still requires considerable amount of time (≈60 minutes), which currently is the rate-limiting step for instant analysis. But as more images are investigated and as ML-based image processing improves, the time required would indeed come down as well. Nevertheless, the authors need to be commended for their work demonstrating the clinical utility of using noninvasive CTA-based FFR estimation using ML methods in this multicenter trial.
De Bruyne B, Pijls NHJ, Kalesan B, Barbato E, Tonino PA, Piroth Z, Jagic N, Möbius-Winkler S, Mobius-Winckler S, Rioufol G, Witt N, Kala P, MacCarthy P, Engström T, Oldroyd KG, Mavromatis K, Manoharan G, Verlee P, Frobert O, Curzen N, Johnson JB, Jüni P, Fearon WF. Fractional flow reserve-guided PCI versus medical therapy in stable coronary disease.N Engl J Med. 2012; 367:991–1001.CrossrefMedlineGoogle Scholar
Parisi AF, Folland ED, Hartigan P. A comparison of angioplasty with medical therapy in the treatment of single-vessel coronary artery disease.N Engl J Med. 1992; 326:10–16.CrossrefMedlineGoogle Scholar
- 3. RITA-2TrialParticipants. Coronary angioplasty versus medical therapy for angina: the second Randomised Intervention Treatment of Angina (RITA-2) trial. RITA-2 trial participants.Lancet. 1997; 350:461–468.CrossrefMedlineGoogle Scholar
Pitt B, Waters D, Brown WV, van Boven AJ, Schwartz L, Title LM, Eisenberg D, Shurzinske L, McCormick LS. Aggressive lipid-lowering therapy compared with angioplasty in stable coronary artery disease. Atorvastatin versus Revascularization Treatment investigators.N Engl J Med. 1999; 341:70–76. doi: 10.1056/NEJM199907083410202.CrossrefMedlineGoogle Scholar
Hueb W, Soares PR, Gersh BJ, César LA, Luz PL, Puig LB, Martinez EM, Oliveira SA, Ramires JA. The medicine, angioplasty, or surgery study (MASS-II): a randomized, controlled clinical trial of three therapeutic strategies for multivessel coronary artery disease: one-year results.J Am Coll Cardiol. 2004; 43:1743–1751. doi: 10.1016/j.jacc.2003.08.065.CrossrefMedlineGoogle Scholar
Henderson RA, Pocock SJ, Clayton TC, Knight R, Fox KA, Julian DG, Chamberlain DA; Second Randomized Intervention Treatment of Angina (RITA-2) Trial Participants. Seven-year outcome in the RITA-2 trial: coronary angioplasty versus medical therapy.J Am Coll Cardiol. 2003; 42:1161–1170.CrossrefMedlineGoogle Scholar
Tavakol M, Ashraf S, Brener SJ. Risks and complications of coronary angiography: a comprehensive review.Glob J Health Sci. 2011; 4:65–93.CrossrefGoogle Scholar
Nieman K, Oudkerk M, Rensing BJ, van Ooijen P, Munne A, van Geuns RJ, de Feyter PJ. Coronary angiography with multi-slice computed tomography.Lancet. 2001; 357:599–603.CrossrefMedlineGoogle Scholar
Achenbach S, Ulzheimer S, Baum U, Kachelriess M, Ropers D, Giesler T, Bautz W, Daniel WG, Kalender WA, Moshage W. Noninvasive coronary angiography by retrospectively ECG-gated multislice spiral CT.Circulation. 2000; 102:2823–2828.LinkGoogle Scholar
Becker CR, Knez A, Leber A, Hong C, Treede H, Wildhirt S, Ohnesorge B, Flohr T, Schoepf UJ, Reiser MF. Initial experiences with multi-slice detector spiral CT in diagnosis of arteriosclerosis of coronary vessels.Radiologe. 2000; 40:118–122.CrossrefMedlineGoogle Scholar
Voros S, Rinehart S, Qian Z, Joshi P, Vazquez G, Fischer C, Belur P, Hulten E, Villines TC. Coronary atherosclerosis imaging by coronary CT angiography: current status, correlation with intravascular interrogation and meta-analysis.JACC Cardiovasc Imaging. 2011; 4:537–548.CrossrefMedlineGoogle Scholar
Kim HJ, Vignon-Clementel IE, Coogan JS, Figueroa CA, Jansen KE, Taylor CA. Patient-specific modeling of blood flow and pressure in human coronary arteries.Ann Biomed Eng. 2010; 38:3195–3209. doi: 10.1007/s10439-010-0083-6.CrossrefMedlineGoogle Scholar
Koo BK, Erglis A, Doh JH, Daniels DV, Jegere S, Kim HS, Dunning A, DeFrance T, Lansky A, Leipsic J, Min JK. Diagnosis of ischemia-causing coronary stenoses by noninvasive fractional flow reserve computed from coronary computed tomographic angiograms. Results from the prospective multicenter DISCOVER-FLOW (Diagnosis of Ischemia-Causing Stenoses Obtained via Noninvasive Fractional Flow Reserve) study.J Am Coll Cardiol. 2011; 58:1989–1997. doi: 10.1016/j.jacc.2011.06.066.CrossrefMedlineGoogle Scholar
Leipsic J, Yang TH, Thompson A, Koo BK, Mancini GB, Taylor C, Budoff MJ, Park HB, Berman DS, Min JK. CT angiography (CTA) and diagnostic performance of noninvasive fractional flow reserve: results from the Determination of Fractional Flow Reserve by Anatomic CTA (DeFACTO) study.AJR Am J Roentgenol. 2014; 202:989–994. doi: 10.2214/AJR.13.11441.CrossrefMedlineGoogle Scholar
Nørgaard BL, Leipsic J, Gaur S, Seneviratne S, Ko BS, Ito H, Jensen JM, Mauri L, De Bruyne B, Bezerra H, Osawa K, Marwan M, Naber C, Erglis A, Park SJ, Christiansen EH, Kaltoft A, Lassen JF, Bøtker HE, Achenbach S; NXT Trial Study Group. Diagnostic performance of noninvasive fractional flow reserve derived from coronary computed tomography angiography in suspected coronary artery disease: the NXT trial (Analysis of Coronary Blood Flow Using CT Angiography: Next Steps).J Am Coll Cardiol. 2014; 63:1145–1155. doi: 10.1016/j.jacc.2013.11.043.CrossrefMedlineGoogle Scholar
Itu L, Rapaka S, Passerini T, Georgescu B, Schwemmer C, Schoebinger M, Flohr T, Sharma P, Comaniciu D. A machine-learning approach for computation of fractional flow reserve from coronary computed tomography.J Appl Physiol. 2016; 121:42–52.CrossrefMedlineGoogle Scholar
Coenen A, Kim YH, Kruk M, Tesche C, De Geer J, Kurata A, Lubbers ML, Daemen J, Itu L, Rapaka S, Sharma P, Schwemmer C, Persson A, Schoepf UJ, Kepka C, Yang DH, Nieman K. Diagnostic accuracy of a machine-learning approach to coronary computed tomographic angiography–based fractional flow reserve: result from the MACHINE consortium.Circulation: Cardiovascular Imaging. 2018; 11:e007217. doi: 10.1161/CIRCIMAGING.117.007217.LinkGoogle Scholar