Sensitivity, Specificity, and Sex Differences in Symptoms Reported on the 13‐Item Acute Coronary Syndrome Checklist
Clinical symptoms are part of the risk stratification approaches used in the emergency department (
Methods and Results
The sample included 736 patients admitted to 4
There were more similarities than differences in symptom predictors of
Patients presenting to the emergency department (ED) with undifferentiated chest pain or other symptoms suggestive of acute coronary syndromes (ACS) account for ≈10% of all ED visits1 and present a diagnostic challenge.2, 3 ACS, an umbrella term used to denote the spectrum of myocardial ischemia, includes unstable angina, non‐ST‐elevation myocardial infarction, and ST‐elevation myocardial infarction.4 Rapid triage for this potentially life‐threatening condition is paramount for effective time‐dependent reperfusion therapies that reduce mortality and morbidity.5 Though a missed ACS diagnosis is rare (2.1% to 5.3%), consequences are serious with a 2‐fold higher risk of 30‐day mortality for patients with ACS inappropriately discharged from the ED.3, 6 Self‐reported symptoms are the primary method by which patients communicate to clinicians the nature of their problem. Therefore, symptoms have the potential to augment traditional clinical features and risk stratification tools in predicting the likelihood of ACS.
Symptoms of ACS have been widely described in the literature.7 The classic symptoms of ACS, as endorsed by the American Heart Association (AHA) and the American College of Cardiology (ACC), are chest discomfort, discomfort in other areas of the upper body, shortness of breath, cold sweat, nausea, and lightheadedness.4, 8 These symptoms have traditionally been used to aid in risk stratification and acceleration of care for patients presenting to the ED with symptoms suggestive of ACS.9 Findings from studies using predictive models to assess the value of symptoms for a diagnosis of acute myocardial infarction (AMI) or ACS have varied. Some studies found that chest pain, shoulder pain, arm pain, sweating, nausea, and vomiting are predictive of AMI/ACS, but findings are not uniform across studies.10, 11, 12, 13, 14 Attention to classic symptoms, in particular chest pain, may disadvantage women, the elderly, and individuals with diabetes, who may experience less‐typical symptoms15, 16 or suffer from silent ischemia.17 However, identification of symptoms that are sensitive and specific to ACS has the potential to reduce treatment‐seeking delay and potentially expedite triage and diagnostic testing.
Most studies examining the sensitivity of symptoms associated with ACS solely recruited patients with a confirmed diagnosis,18, 19, 20, 21 limiting the ability to assess specificity. Specificity of ACS symptoms has been assumed to be low in women, but has not been confirmed.22 In addition, the predictive value of symptoms is more useful than sensitivity from a clinical perspective because it is the probability that a person with the symptom actually has the associated illness.23 The objective of this analysis was to determine the sensitivity, specificity, and predictive values of 13 previously validated symptoms for a diagnosis of ACS in women and men presenting to the ED.
This analysis is part of a larger prospective, multicenter study examining the influence of sex on symptom characteristics during ACS. Patients were enrolled at 4 large medical centers; 1 in the Midwest, 2 in the Pacific Northwest, and 1 in the West regions of the United States. Three were academic medical centers, and the second Northwest site was a large community medical center. Approval from all 4 institutional review boards was received before the start of the study, and all participants gave written informed consent. Each institutional review board approved a waiver of initial consent for electronic screening of patients at triage and to collect initial symptom data before enrollment. A waiver of initial consent was granted because the main study aim was to evaluate symptoms on presentation to the ED and because the emergent nature of patients presenting with possible ACS precluded the provision of immediate informed consent. All patients were enrolled when they were deemed to be stable by the primary nurse or physician and had been transferred to a private examination room in either the ED or hospital. Initially collected symptom data were destroyed if the patient subsequently declined to participate.
Individuals presenting to the ED between January 2011 and March 2013 with symptoms triggering an ACS evaluation and who were ≥21 years, fluent in English, and arrived by emergency medical services, private, or public transportation were eligible. Patients were excluded if they had an underlying exacerbation of heart failure (defined as BNP ≥500 pg/mL), were transferred from a hemodialysis facility, were being evaluated for a dysrhythmia, were non‐English speaking, or had cognitive impairment (defined as the inability to understand and provide written informed consent for the study).
Because most patients presenting to the ED for symptoms suggestive of ACS will be ruled out, a targeted sampling plan was implemented for this study. Patients most likely to be ruled in were identified before enrollment based on standard ECG and troponin criteria.24 Those patients with any ECG changes suggestive of ischemia and/or with a troponin level outside the referenced norm for the institution were approached for enrollment. Ischemia was defined as new ST elevation at the J point ≥0.1 mV in 2 contiguous leads and/or new horizontal or down‐sloping ST depression ≥0.05 mV in 2 contiguous leads and/or T inversion ≥0.1 mV in 2 contiguous leads with prominent R wave.24 Discharge diagnoses (ACS versus non‐ACS) were based on the clinical judgment of the ED physician for patients discharged from the ED and the attending physician for patients who were admitted. Physicians remained unaware of the symptom data collected by the researchers. Discharge diagnoses were abstracted from the medical record by trained research associates who were clinical experts and were also blinded to the research data. Equivocal or discrepant discharge diagnoses were adjudicated by 3 of the authors (M.D., H.D., and A.R.). Clinical data on self‐reported comorbid factors, such as diabetes and hypertension, were confirmed from the medical record. If there were discrepancies, only the data from the medical record were used for the analyses.
The ACS Symptom Checklist is a 13‐item validated instrument that measures symptoms of ACS.19, 25 Participants indicate whether the symptom is present or absent. Symptoms not appearing on the checklist can be recorded in a blank space marked “other.” Each symptom is analyzed individually, and there is no summary score. The ACS Symptom Checklist is derived from the Symptoms of Acute Coronary Syndromes Index (SACSI). The SACSI, a reliable and valid instrument, has been tested in previous studies.19, 25 Participants indicated whether the symptom was present or absent. Symptoms not listed on the checklist were recorded in a blank space marked “other.” A content validity index of 1.00 (P<0.05) using Lynn's formula26 was calculated based on responses from 11 experts. One item, heat sensation, was judged irrelevant and removed from the original 14‐item checklist.
Patient baseline characteristics were collected using the ACS Patient Information Questionnaire. This demographic and clinical questionnaire was designed using the standardized reporting guidelines recommended for studies evaluating risk stratification of ED patients with potential ACS.27 These guidelines were established by the Multidisciplinary Standardized Reporting Criteria Task Force and are supported by the Society for Academic Emergency Medicine, the American College of Emergency Physicians, the AHA, and the ACC. The purpose of the questionnaire is to establish standardized reporting criteria that will allow for easier comparisons across studies and also facilitate meta‐analyses. Functional status was measured with the Duke Activity Status Index (DASI).28 The DASI is a brief 12‐item instrument that measures functional capacity. Scores range from 0 to 58.2, with higher scores representing better physical functioning. The items on the scale are weighted to reflect metabolic energy expenditure and correlate highly with peak VO2 (r=0.80; P<0.0001)28 in patients with ACS,29 ischemic heart disease,30 heart failure,31 and revascularization procedures.32
A trained member of the study research team completed the ACS symptom checklist shortly after the patient was triaged in the ED. Patients were enrolled between 0700 and 2300 every day. In most cases, symptoms were assessed within 15 minutes of ED presentation. Patients were then formally approached by the research staff for enrollment after they were deemed stable and placed in an ED examination room or in their hospital room. The study purpose was then explained, and once the patient provided written informed consent, additional clinical and individual characteristics were recorded.
To address power concerns for differences in symptoms between patients ruled in and ruled out for ACS, a sample size of 261 per group (n=522) was needed for 80% power to detect a small effect size (d=0.25) using ANOVA with a 0.05 2‐sided level of significance. Because the primary purpose of the study was sex differences in symptoms, we aimed to enroll an equal amount of women and men. Study data were entered into SAS. Significance was set at P<0.05 for all statistical procedures. Demographic and clinical characteristics were described for the total sample and also compared by groups defined by ACS diagnosis and sex using chi‐square tests for independence, independent samples t tests, and Wilcoxon rank sums tests.
Sensitivity was defined as the probability of the presence of a symptom among patients with a confirmed diagnosis of ACS. Specificity was defined as the probability of the absence of a symptom among patients ruled out for ACS. Sensitivity and specificity were computed for each of the 13 symptoms. Sensitivity and specificity are usually calculated as simple proportions using a 2×2 cross‐tabulation of symptom (present, absent) versus diagnosis (ACS, no ACS); however, data collection sites varied on the proportion of patients ruled in for ACS (P<0.0001). Therefore, mixed‐effects logistic regression models, including random intercepts to control for site differences, were used to estimate the sensitivity and specificity of each symptom for a confirmed ACS diagnosis. Models were tested for the entire sample and then stratified by sex. A sensitivity and specificity of ≥60% were considered to be moderately high for this sample based on previous studies of the sensitivity and specificity of symptoms for a diagnosis in a variety of conditions.33, 34, 35, 36 This range is also consistent with sensitivities and specificities reported in Bruyninckx's meta‐analysis.37 Similar logistic regression models were used to estimate the odds ratios (ORs) of each symptom as a predictor of an ACS diagnosis controlling for age, obesity, diabetes, functional status, and sex. A sex by symptom interaction term was evaluated to determine whether the relationship between symptoms and diagnosis varied between women and men. Potential covariates were chosen based on sex differences in previous studies and because age, obesity, functional status, and diabetes can confound the symptom experience.38, 39
The sample (n=736) included 301 patients (40.9%) ruled in and 435 (59.1%) ruled out for ACS. A total of 10 896 patients were screened. Of the 1005 patients eligible to participate, 269 (26.8%) declined ( Figure). The most common reason given was stress, discomfort, or fatigue. Of the 301 patients who ruled in for ACS, 9.6% had normal troponins and a normal ECG, 24.9% had normal troponins and an abnormal ECG, 12.6% had elevated troponins and a normal ECG, and 52.9% had elevated troponins and an abnormal ECG. Patients were predominantly Caucasian (70.6%) and had a mean age of 59.7±14.2 years. Overall, participants ruled in for ACS were older than those ruled out for ACS (61.3±12.2 versus 58.6±15.4 years, P=0.013; range 21 to 98), were more likely to have diabetes (31.8% versus 24.6%; P=0.034), more often male (74.4% versus 55.2%; P=<0.0001), and more likely to be in the middle‐income ranges. ACS was more common among the income group, ranging from $20 000 to $49 999, whereas a plurality of patients without ACS were in the lowest income group (P=0.001). Men had higher rates of current smoking than women (23.3% versus 14.7%; P=0.003). Demographic data appear in Table 1 and clinical characteristics are summarized in Table 2.
|Characteristic||ACS n=301 (41%)||No ACS n=435 (59%)||P Value||Female n=272 (37%)||Male n=464 (63%)||P Value|
|Age (SD)||61.3 (12.2)||58.6 (15.4)||0.013||60.8 (15.2)||59.1 (13.5)||0.127|
|Sex, n (%)||<0.0001|
|Female||77 (25.6)||195 (44.8)|
|Male||224 (74.4)||240 (55.2)|
|Race/ethnicity, n (%)||0.791||0.184|
|African American||41 (13.6)||67 (15.4)||47 (17.3)||61 (13.1)|
|White/Non‐Hispanic||213 (70.8)||306 (70.3)||191 (70.2)||328 (70.7)|
|Hispanic||14 (4.7)||20 (4.6)||11 (4.0)||23 (5.0)|
|Asian||9 (3.0)||13 (3.0)||10 (3.7)||12 (2.6)|
|Multiracial||11 (3.7)||9 (2.1)||6 (2.2)||14 (3.0)|
|Othera||11 (3.7)||20 (4.6)||6 (2.2)||25 (5.4)|
|Missing||2 (0.7)||0 (0.0)||1 (0.4)||1 (0.2)|
|Education, n (%)||0.730||0.879|
|<High school diploma||31 (10.3)||48 (11.0)||31 (11.4)||48 (10.3)|
|High school diploma||71 (23.6)||92 (21.1)||60 (22.1)||103 (22.2)|
|Some college||104 (34.6)||135 (31.0)||90 (33.1)||149 (32.1)|
|College degree/graduate work||51 (16.9)||85 (19.5)||54 (19.9)||82 (17.7)|
|Graduate degree||34 (11.3)||54 (12.4)||29 (10.7)||59 (12.7)|
|Missing||10 (3.3)||21 (4.8)||8 (2.9)||23 (5.0)|
|Household income, n (%)||0.001||0.784|
|<$20 000||67 (22.3)||148 (34.0)||84 (30.9)||131 (28.2)|
|$20 000 to 49 999||95 (31.6)||111 (25.5)||78 (28.7)||128 (27.6)|
|$50 000 to 99 999||62 (20.6)||65 (14.9)||43 (15.8)||84 (18.1)|
|$100 000+||31 (10.3)||59 (13.6)||32 (11.8)||58 (12.5)|
|Missing||46 (15.3)||52 (12.0)||35 (12.9)||63 (13.6)|
|Characteristic||ACS n=301 (41%)||No ACS n=435 (59%)||P Value||Female n=272 (37%)||Male n=464 (63%)||P Value|
|Diabetes, n (%)||92 (31.8)||102 (24.6)||0.034||64 (24.3)||130 (29.5)||0.139|
|Missing||12 (4.0)||20 (4.6)||9 (3.3)||23 (5.0)|
|BMI, mean (SD)||29.5 (6.6)||30.3 (7.4)||0.090||29.9 (8.5)||30.1 (6.6)||0.656|
|BMI categories, n (%)||0.206||0.359|
|Underweight||5 (1.7)||10 (2.3)||8 (2.9)||7 (1.5)|
|Normal||69 (22.9)||93 (21.4)||66 (24.3)||96 (20.7)|
|Overweight||116 (38.5)||135 (31.0)||90 (33.1)||161 (34.7)|
|Obese||98 (32.6)||164 (37.7)||92 (33.8)||170 (36.6)|
|Missing||13 (4.3)||33 (7.6)||16 (5.9)||30 (6.5)|
|Smoking status, n (%)||0.133||0.003|
|Never||142 (47.2)||235 (54.0)||161 (59.2)||216 (46.6)|
|Former||77 (25.6)||101 (23.2)||63 (23.2)||115 (24.8)|
|Current smoker||69 (22.9)||79 (18.2)||40 (14.7)||108 (23.3)|
|Missing||13 (4.3)||20 (4.6)||8 (2.9)||25 (5.4)|
|Hypertension, n (%)||195 (64.8)||253 (58.2)||0.095||156 (57.4)||292 (62.9)||0.083|
|Missing||13 (4.3)||24 (5.5)||12 (4.4)||25 (5.4)|
|Midwest (n=121)||54 (17.9)||67 (15.4)||49 (18.0)||72 (15.5)|
|Northwest 1 (n=348)||64 (21.3)||284 (65.3)||138 (50.7)||210 (45.3)|
|Northwest 2 (n=50)||45 (15.0)||5 (1.1)||10 (3.7)||40 (8.6)|
|West (n=217)||138 (45.8)||79 (18.2)||75 (27.6)||142 (30.6)|
Symptom Occurrence by Diagnosis and Sex
Patients ruled in for ACS were more likely to experience chest pain (71% versus 61%; P=0.006), but less likely to experience palpitations (19% versus 28%; P=0.008), upper back pain (19% versus 29%; P=0.001), shortness of breath (46% versus 60%; P<0.0001), unusual fatigue (34% versus 49%; P<0.0001), and lightheadedness (36% versus 46%; P=0.006), compared to patients ruled out for ACS (Table 3). Women ruled in for ACS were more likely to report arm pain (47% versus 32%; P=0.021), compared to women ruled out for ACS. Men ruled in for ACS were more likely to report chest pressure (63% versus 54%; P=0.035) and chest pain (72% versus 60%; P=0.005) and less likely to report upper back pain (13% versus 24%; P=0.004), shortness of breath (41% versus 59%; P<0.0001), and unusual fatigue (32% versus 48%; P=<0.001). The mean number of symptoms ranged from 5 to 6 across groups, and patients in each group reported the full range of symptoms (1 to 13). There were no differences between patients ruled in for ACS and those ruled out for ACS or between women and men for mean number of symptoms.
|ACS (n=77)||No ACS (n=195)||P Valuea||ACS (n=224)||No ACS (n=240)||P Valuea||ACS (n=301)||No ACS (n=435)||P Valuea|
|Upper back pain||34%||36%||0.740||13%||24%||0.004||19%||29%||0.001|
|Shortness of breath||58%||61%||0.754||41%||59%||<0.0001||46%||60%||0.000|
|Mean number of symptoms (SD)||5.91 (3.56)||5.86 (3.26)||0.907||4.82 (2.75)||5.12 (3.25)||0.276||5.10 (3.01)||5.45 (3.27)||0.136|
Sensitivity and Specificity of Symptoms for a Diagnosis
Sensitivities for individual symptoms on the checklist ranged from 27% to 67% for women and 14% to 72% for men (Table 4). Chest pressure, discomfort, and chest pain demonstrated the highest sensitivity for ACS in both women (66%, 66%, and 67%, respectively) and men (63%, 69%, and 72%, respectively). Specificities ranged from 33% to 78% for women and 34% to 78% for men. Six symptoms in particular—shoulder pain, sweating, palpitations, upper back pain, arm pain, and indigestion—had higher specificities (>60%), indicating that those patients who did not experience those symptoms were likely to be ruled out for ACS. Nausea, however, was specific for men only.
|Sensitivity (%)||Specificity (%)||Sensitivity (%)||Specificity (%)|
|Upper back pain||34||64||14||78|
|Shortness of breath||58||39||41||40|
Predictive Value of Symptoms for ACS Diagnosis
Each symptom was tested as a predictor of ACS diagnosis in models adjusted for data collection site, age, obesity, diabetes, and functional status. A symptom by sex interaction term was also tested because there have been previous reports of sex differences in symptoms.20, 21 There were significant interactions for sex and shoulder pain (P=0.034) and shortness of breath (P=0.004) (Table 5), meaning that the relationship between the symptom and ACS diagnosis differed by sex. Analyses of symptoms stratified by sex indicated that shoulder pain (OR=2.53; 95% CI=1.29 to 4.96) and arm pain (OR=2.15; 95% CI=1.10 to 4.20) were predictive of an ACS diagnosis for women, but not men (OR=1.11; 95% CI=0.67 to 1.85; OR=1.21; 95% CI=0.74 to 1.99, respectively). Shortness of breath was predictive of a non‐ACS diagnosis for men (OR=0.49; 95% CI=0.30 to 0.79), but was not predictive of a diagnosis for women (OR=1.36; 95% CI=0.68 to 2.70).
|Symptoma||Odds Ratios (CI)|
|Chest pressure||1.63 (0.81, 3.30)||1.34 (0.84, 2.15)|
|Shoulder pain||2.53 (1.29, 4.96)||1.11 (0.67, 1.85)|
|Sweating||1.81 (0.91, 3.62)||1.64 (1.00, 2.70)|
|Palpitations||0.97 (0.49, 1.92)||1.00 (0.56, 1.78)|
|Chest discomfort||1.07 (0.52, 2.23)||1.18 (0.72, 1.94)|
|Upper back pain||1.02 (0.52, 1.98)||0.76 (0.42, 1.38)|
|Shortness of breath||1.36 (0.68, 2.70)||0.49 (0.30, 0.79)|
|Arm pain||2.15 (1.10, 4.20)||1.21 (0.74, 1.99)|
|Unusual fatigue||0.94 (0.49, 1.80)||0.72 (0.45, 1.15)|
|Nausea||1.23 (0.65, 2.33)||1.02 (0.62, 1.67)|
|Lightheaded||1.22 (0.63, 2.38)||1.09 (0.68, 1.76)|
|Chest pain||1.38 (0.69, 2.74)||1.50 (0.91, 2.48)|
|Indigestion||1.87 (0.91, 3.83)||0.80 (0.45, 1.40)|
The findings that all 3 chest symptoms (pressure, discomfort, and pain) were sensitive, but not specific, for a diagnosis of ACS, whereas shoulder and arm pain were predictive of an ACS diagnosis for women only, are important findings. Goodacre et al12 also found that pain radiating to either arm was predictive of ACS. However, Goodacre's study did not include sex‐stratified analyses in the results. Swap and Nagurney10 also found that chest pain radiating to one or both shoulders or arms increased the likelihood of an ACS diagnosis. Lack of sex‐stratified analysis has been a continuing problem in understanding the influence of sex on ACS symptoms.7 Earlier findings have demonstrated that older patients and patients with diabetes report less chest pain during ACS.15 Because women are, on average, 10 years older than men4 when they develop ACS, shoulder and arm pain (particularly in women) may serve as additional prompts that aid emergency medical services and triage personnel in identifying patients with ACS—particularly in the absence of chest symptoms. Whether these findings apply to women under age 55 who are at higher risk for mortality and morbidity, but at lower risk for development of ACS, requires further study.40 As expected, chest pressure, discomfort, and pain were sensitive for a diagnosis of ACS in both women and men.
Patients ruled in for ACS were older than those ruled out for ACS, more likely to have diabetes, and more often male. This is consistent with Herlitz et al41 (OR=1.97; 95% CI=1.30 to 2.99) and Edwards et al42 (relative ratio=1.48; 95% CI=1.00 to 2.18), who found male sex to be an independent predictor of an ACS diagnosis. In a large meta‐analysis, Haasenritter et al43 found that age (likelihood ratio [LR]=1.44; 95% CI=1.19 to 1.73), diabetes (LR=1.68; 95% CI=1.35 to 2.09), and male sex (LR=1.17; 95% CI=1.08 to 1.27) were associated with an ACS diagnosis.
Income also differed significantly between the ACS and non‐ACS groups, but in an unanticipated way; patients in the middle‐income levels were more likely to have ACS than those in the lower‐income levels. It is unknown why individuals in the middle‐income ranges were more likely to be ruled in for ACS. Perhaps, the middle‐income groups lack health insurance or are underinsured. This requires further study, particularly in view of the Affordable Health Care Act.44
Shoulder pain, sweating, palpitations, upper back pain, arm pain, and indigestion had moderately high specificities for a non‐ACS diagnosis (≥60%) in both women and men. Nausea had a high specificity for men only. These findings support the editorial by Canto et al45 suggesting that it is time to standardize the collection of ACS symptoms in patients presenting to the ED in order to determine the significance of sex differences in symptoms of ACS. Lack of specificity of chest symptoms for a diagnosis of ACS requires further study, and use of a standardized tool would facilitate comparisons across studies. In addition, lack of specificity for chest symptoms could contribute to delays in patient decisions and in diagnosis because noncardiac chest pain is a common and costly occurrence.46 Specificities in the 60% to 70% range are not high enough to preclude the evaluation of ECGs and troponins in patients presenting to the ED with symptoms suggestive of ACS, but they may be high enough to design evidence‐based public health messages for the public and especially for patients at risk for ACS.
Absence of shortness of breath was predictive of a non‐ACS diagnosis in men. This further creates a diagnostic conundrum in the ED because most patients are undifferentiated on presentation, and streamlined care is an expectation for potentially life‐threatening conditions such as ACS.47 Although there were no sex differences in reports of chest pain, men with ACS were more likely to experience chest pain, compared to men without ACS. Reports of sex differences in chest pain have varied in large database studies and smaller cohort studies. Some investigators have found that women are less likely to report chest pain7, 21 and some have reported no differences between women and men.19, 48 Our results suggest that low specificities of symptoms are also likely to impact ED symptom‐based triage. The current approach, in which a wide net is cast for ACS, appears necessary to avoid missing a true ACS diagnosis.
The mean number of symptoms experienced by participants was high, which is important when planning public health messaging. Being knowledgeable about, and alert for, a single symptom such as chest pain is not sufficient to make an informed decision about proper care seeking when experiencing possible ACS. The public should be informed that multiple symptoms are likely during ACS. Because the mean number of reported symptoms exceeded 5 for both women and men, it is likely that the assessment of individual symptoms is not sufficient to improve clinical assessment and decision making.
This prospective study was well powered, and symptoms reported directly by the patients were recorded shortly after presentation to the ED. The availability of real‐time self‐report of dynamic symptoms effectively eliminates recall bias and increases the internal validity of the findings,49 which has been a limitation of previous ACS studies. Our 13‐item validated checklist contains symptoms that are empirically derived from large heterogeneous samples of patients, takes <1 minute to complete, and is suitable for research and clinical practice. The demographic and clinical characteristics of our patients suggest that this sample was representative of the US population and that there were minimal baseline differences between patients with and without ACS. Finally, we adjusted for factors well known to affect symptoms as reported in the literature.
Sampling bias is a limitation to the study. We enrolled only patients whom ED nurses and physicians deemed to be at risk for ACS. Therefore, true ACS patients may have been missed if an ACS diagnosis was not considered. Also, in order to enroll a sufficient number of patients with confirmed ACS, the sample was enriched by targeting patients with an abnormal ECG or troponin and thus may not be representative of the individuals presenting to triage. Further, though an abnormal ECG and troponin were part of the sampling plan, in the final adjudication (discharge diagnosis) clinicians felt that nearly 10% of patients with normal ECG and troponin levels did have ACS. Our 13‐item validated checklist may have missed other symptoms; however, patients were asked if they were experiencing any other symptoms not contained on the list. Whereas Canto45 has called for the use of a more comprehensive symptom instrument, our goal was to use a validated symptom tool that was suitable for use as a clinical assessment tool in prehospital and hospital triage as well as in primary care and research. Finally, patients were only enrolled between the hours of 0700 and 2300. Hence, findings may not be generalizable to patients that presented between 2300 and 0700.
Whereas we believe self‐report to be strength of the study, some have considered it a limitation because there is no way to externally validate the symptom event. However, Justice et al33 noted that patients, not providers, experience symptoms and so are best able to describe them. Self‐reported symptoms have been independently associated with quality of life and activities of daily living in patients with acquired immunodeficiency virus.50 Self‐report of symptoms may be considered superior to symptoms abstracted from the medical record because there is no way of knowing how accurate the medical record is or to independently validate which symptoms were actually reported by patients. In addition, prudence is called for in generalizing these findings outside of the ED. Patients presenting to the ED are a select group that made a conscious choice to seek care for symptoms judged to be potentially serious. Therefore, sex differences in symptoms may be attributable to selection bias in behaviors associated with a decision to seek assistance, rather than true pathophysiologic or psychosocial difference in symptoms. A considerable number of patients with undifferentiated chest pain were excluded from the study by design because the main aim was to evaluate sex differences in symptoms among patients with confirmed ACS. This may have particularly influenced the findings on specificity of individual symptoms. Finally, the predictive power of ORs between 1.0 and 2.0 may be limited and does not support discharging low‐risk patients on the basis of symptoms alone without further testing, such as ECG and cardiac biomarkers.10
There were more similarities than differences in symptom predictors of ACS for women and men. Women were twice as likely to report arm and shoulder pain, compared to men. Sex differences in symptoms require further study to help guide patients’ treatment seeking decisions. Although sex differences were minimal, shoulder pain and arm pain may be key symptoms that improve clinical prediction of ACS in women. These symptoms may help guide the clinician in deciding the extent of diagnostic workups.
The authors thank Kevin Grandfield, Publication Manager of the UIC Department of Biobehavioral Health Science, for editorial assistance.
Sources of Funding
This work was funded by the National Institute of Nursing Research (R01NR012012).
These findings were reported at AHA Scientific Sessions in Dallas, TX on November 18, 2013.
- 1 Nawar EW, Niska RW, Xu J. National hospital ambulatory medical care survey: 2005 emergency department summary. Adv Data. 2007; 386:1–32.Google Scholar
- 2 Miller CD, Fermann GJ, Lindsell CJ, Mahaffey KW, Peacock WF, Pollack CV, Hollander JE, Diercks DB, Gibler WB, Hoekstra JW. Initial risk stratification and presenting characteristics of patients with evolving myocardial infarctions. Emerg Med J. 2008; 25:492–497.Google Scholar
- 3 Pope JH, Aufderheide TP, Ruthazer R, Woolard RH, Feldman JA, Beshansky JR, Griffith JL, Selker HP. Missed diagnoses of acute cardiac ischemia in the emergency department. N Engl J Med. 2000; 342:1163–1170.Google Scholar
- 4 Go AS, Mozaffarian D, Roger VL, Benjamin EJ, Berry JD, Borden WB, Bravata DM, Dai S, Ford ES, Fox CS, Franco S, Fullerton HJ, Gillespie C, Hailpern SM, Heit JA, Howard VJ, Huffman MD, Kissela BM, Kittner SJ, Lackland DT, Lichtman JH, Lisabeth LD, Magid D, Marcus GM, Marelli A, Matchar DB, McGuire DK, Mohler ER, Moy CS, Mussolino ME, Nichol G, Paynter NP, Schreiner PJ, Sorlie PD, Stein J, Turan TN, Virani SS, Wong ND, Woo D, Turner MB; American Heart Association Statistics Committee, Stroke Statistics Subcomittee . Heart disease and stroke statistics—2013 update: a report from the American Heart Association. Circulation. 2013; 127:e6–e245.Google Scholar
- 5 Hess EP, Knoedler MA, Shah ND, Kline JA, Breslin M, Branda ME, Pencille LJ, Asplin BR, Nestler DM, Sadosty AT, Stiell IG, Ting HH, Montori VM. The chest pain choice decision aid: a randomized trial. Circ Cardiovasc Qual Outcomes. 2012; 5:251–259.Google Scholar
- 6 Christenson J, Innes G, McKnight D, Boychuk B, Grafstein E, Thompson CR, Rosenberg F, Anis AH, Gin K, Tilley J, Wong H, Singer J. Safety and efficiency of emergency department assessment of chest discomfort. CMAJ. 2004; 170:1803–1807.Google Scholar
- 7 Canto JG, Rogers WJ, Goldberg RJ, Peterson ED, Wenger NK, Vaccarino V, Kiefe CI, Frederick PD, Sopko G, Zheng ZJ; NRMI Investigators . Association of age and sex with myocardial infarction symptom presentation and in‐hospital mortality. JAMA. 2012; 307:813–822.Google Scholar
- 8 Roger VL, Go AS, Lloyd‐Jones DM, Benjamin EJ, Berry JD, Borden WB, Bravata DM, Dai S, Ford ES, Fox CS, Fullerton HJ, Gillespie C, Hailpern SM, Heit JA, Howard VJ, Kissela BM, Kittner SJ, Lackland DT, Lichtman JH, Lisabeth LD, Makuc DM, Marcus GM, Marelli A, Matchar DB, Moy CS, Mozaffarian D, Mussolino ME, Nichol G, Paynter NP, Soliman EZ, Sorlie PD, Sotoodehnia N, Turan TN, Virani SS, Wong ND, Woo D, Turner MB. Executive summary: heart disease and stroke statistics—2012 update: a report from the American Heart Association. Circulation. 2012; 125:188–197.Google Scholar
- 9 Pollack CV, Sites FD, Shofer FS, Sease KL, Hollander JE. Application of the TIMI risk score for unstable angina and non‐ST elevation acute coronary syndrome to an unselected emergency department chest pain population. Acad Emerg Med. 2006; 13:13–18.Google Scholar
- 10 Swap CJ, Nagurney JT. Value and limitations of chest pain history in the evaluation of patients with suspected acute coronary syndromes. JAMA. 2005; 294:2623–2629.Google Scholar
- 11 Eslick GD. Usefulness of chest pain character and location as diagnostic indicators of an acute coronary syndrome. Am J Cardiol. 2005; 95:1228–1231.Google Scholar
- 12 Goodacre SW, Angelini K, Arnold J, Revill S, Morris F. Clinical predictors of acute coronary syndromes in patients with undifferentiated chest pain. QJM. 2003; 96:893–898.Google Scholar
- 13 Kirchberger I, Heier M, Kuch B, von Scheidt W, Meisinger C. Presenting symptoms of myocardial infarction predict short‐ and long‐term mortality: the MONICA/KORA myocardial infarction registry. Am Heart J. 2012; 164:856–861.Google Scholar
- 14 Canto AJ, Kiefe CI, Goldberg RJ, Rogers WJ, Peterson ED, Wenger NK, Vaccarino V, Frederick PD, Sopko G, Zheng ZJ, Canto JG. Differences in symptom presentation and hospital mortality according to type of acute myocardial infarction. Am Heart J. 2012; 163:572–579.Google Scholar
- 15 DeVon HA, Penckofer S, Larimer K. The association of diabetes and older age with the absence of chest pain during acute coronary syndromes. West J Nurs Res. 2008; 30:130–144.Google Scholar
- 16 McSweeney JC, Pettey CM, Souder E, Rhoads S. Disparities in women's cardiovascular health. J Obstet Gynecol Neonatal Nurs. 2011; 40:362–371.Google Scholar
- 17 Erne P, Schoenenberger AW, Burckhardt D, Zuber M, Kiowski W, Buser PT, Dubach P, Resink TJ, Pfisterer M. Effects of percutaneous coronary interventions in silent ischemia after myocardial infarction: the SWISSI II randomized controlled trial. JAMA. 2007; 297:1985–1991.Google Scholar
- 18 Brieger D, Eagle KA, Goodman SG, Steg PG, Budaj A, White K, Montalescot G, Investigators G. Acute coronary syndromes without chest pain, an underdiagnosed and undertreated high‐risk group: insights from the global registry of acute coronary events. Chest. 2004; 126:461–469.Google Scholar
- 19 DeVon HA, Ryan CJ, Ochs AL, Shapiro M. Symptoms across the continuum of acute coronary syndromes: differences between women and men. Am J Crit Care. 2008; 17:14–24; quiz 25.Google Scholar
- 20 Arslanian‐Engoren C, Patel A, Fang J, Armstrong D, Kline‐Rogers E, Duvernoy CS, Eagle KA. Symptoms of men and women presenting with acute coronary syndromes. Am J Cardiol. 2006; 98:1177–1181.Google Scholar
- 21 Canto JG, Goldberg RJ, Hand MM, Bonow RO, Sopko G, Pepine CJ, Long T. Symptom presentation of women with acute coronary syndromes: myth vs reality. Arch Intern Med. 2007; 167:2405–2413.Google Scholar
- 22 Wiviott SD, Cannon CP, Morrow DA, Murphy SA, Gibson CM, McCabe CH, Sabatine MS, Rifai N, Giugliano RP, DiBattiste PM, Demopoulos LA, Antman EM, Braunwald E. Differential expression of cardiac biomarkers by gender in patients with unstable angina/non‐ST‐elevation myocardial infarction: a TACTICS‐TIMI 18 (treat angina with aggrastat and determine cost of therapy with an invasive or conservative strategy‐thrombolysis in myocardial infarction 18) substudy. Circulation. 2004; 109:580–586.Google Scholar
- 23 Benazzi F. Symptoms of depression as possible markers of bipolar II disorder. Prog Neuropsychopharmacol Biol Psychiatry. 2006; 30:471–477.Google Scholar
- 24 Thygesen K, Alpert JS, Jaffe AS, Simoons ML, Chaitman BR, White HD; Writing Group on behalf of the Joint ESC/ACCF/AHA/WHF Task Force for the Universal Definition of Myocardial Infarction . Third universal definition of myocardial infarction. J Am Coll Cardiol. 2012; 60:1581–1598.Google Scholar
- 25 DeVon HA, Zerwic JJ. The symptoms of unstable angina: do women and men differ?Nurs Res. 2003; 52:108–118.Google Scholar
- 26 Lynn MR. Determination and quantification of content validity. Nurs Res. 1986; 35:382–385.Google Scholar
- 27 Hollander JE, Blomkalns AL, Brogan GX, Diercks DB, Field JM, Garvey JL, Gibler WB, Henry TD, Hoekstra JW, Holroyd BR, Hong Y, Kirk JD, O'Neil BJ, Jackson RE; Multidisciplinary Standardized Reporting Criteria Task Force . Standardized reporting guidelines for studies evaluating risk stratification of ED patients with potential acute coronary syndromes. Acad Emerg Med. 2004; 11:1331–1340.Google Scholar
- 28 Hlatky MA, Boineau RE, Higginbotham MB, Lee KL, Mark DB, Califf RM, Cobb FR, Pryor DB. A brief self‐administered questionnaire to determine functional capacity (the Duke Activity Status Index). Am J Cardiol. 1989; 64:651–654.Google Scholar
- 29 Katz DA, Aufderheide TP, Bogner M, Rahko PS, Hillis SL, Selker HP. Do emergency department patients with possible acute coronary syndrome have better outcomes when admitted to cardiology versus other services?Ann Emerg Med. 2008; 51:561–570, 570 e561.Google Scholar
- 30 Krantz DS, Olson MB, Francis JL, Phankao C, Bairey Merz CN, Sopko G, Vido DA, Shaw LJ, Sheps DS, Pepine CJ, Matthews KA. Anger, hostility, and cardiac symptoms in women with suspected coronary artery disease: the women's ischemia syndrome evaluation (WISE) study. J Womens Health. 2006; 15:1214–1223.Google Scholar
- 31 Oka RK, Gortner SR, Stotts NA, Haskell WL. Predictors of physical activity in patients with chronic heart failure secondary to either ischemic or idiopathic dilated cardiomyopathy. Am J Cardiol. 1996; 77:159–163.Google Scholar
- 32 Bourassa MG, Brooks MM, Mark DB, Trudel J, Detre KM, Pitt B, Reeder GS, Rogers WJ, Ryan TJ, Smith HC, Whitlow PL, Wiens RD, Hlatky MA. Quality of life after coronary revascularization in the United States and Canada. Am J Cardiol. 2000; 85:548–553.Google Scholar
- 33 Justice AC, Rabeneck L, Hays RD, Wu AW, Bozzette SA. Sensitivity, specificity, reliability, and clinical validity of provider‐reported symptoms: a comparison with self‐reported symptoms. Outcomes Committee of the AIDS Clinical Trials Group. J Acquir Immune Defic Syndr. 1999; 21:126–133.Google Scholar
- 34 Paulson EK, Kalady MF, Pappas TN. Suspected appendicitis. N Engl J Med. 2003; 348:236–242.Google Scholar
- 35 Engelhard IM, Arntz A, Van den Hout MA. Low specificity of symptoms on the post‐traumatic stress disorder (PTSD) symptom scale: a comparison of individuals with PTSD, individuals with other anxiety disorders and individuals without psychopathology. Br J Clin Psychol. 2007; 46:449–456.Google Scholar
- 36 Gardner SE, Frantz RA, Doebbeling BN. The validity of the clinical signs and symptoms used to identify localized chronic wound infection. Wound Repair Regen. 2001; 9:178–186.Google Scholar
- 37 Bruyninckx R, Aertgeerts B, Bruyninckx P, Buntinx F. Signs and symptoms in diagnosing acute myocardial infarction and acute coronary syndrome: a diagnostic meta‐analysis. Br J Gen Pract. 2008; 58:e1–e8.Google Scholar
- 38 Thuresson M, Jarlöv MB, Lindahl B, Svensson L, Zedigh C, Herlitz J. Symptoms and type of symptom onset in acute coronary syndrome in relation to ST elevation, sex, age, and a history of diabetes. Am Heart J. 2005; 150:234–242.Google Scholar
- 39 Dey S, Flather MD, Devlin G, Brieger D, Gurfinkel EP, Steg PG, Fitzgerald G, Jackson EA, Eagle KA. Sex‐related differences in the presentation, treatment and outcomes among patients with acute coronary syndromes: the global registry of acute coronary events. Heart. 2009; 95:20–26.Google Scholar
- 40 Khan NA, Daskalopoulou SS, Karp I, Eisenberg MJ, Pelletier R, Tsadok MA, Dasgupta K, Norris CM, Pilote L, Team GP. Sex differences in acute coronary syndrome symptom presentation in young patients. JAMA Intern Med. 2013; 173:1863–1871.Google Scholar
- 41 Herlitz J, Starke M, Hansson E, Ringvall E, Karlson BW, Waagstein L. Early identification of patients with an acute coronary syndrome as assessed by dispatchers and the ambulance crew. Am J Emerg Med. 2002; 20:196–201.Google Scholar
- 42 Edwards M, Chang AM, Matsuura AC, Green M, Robey JM, Hollander JE. Relationship between pain severity and outcomes in patients presenting with potential acute coronary syndromes. Ann Emerg Med. 2011; 58:501–507.Google Scholar
- 43 Haasenritter J, Stanze D, Widera G, Wilimzig C, Abu Hani M, Sonnichsen AC, Bosner S, Rochon J, Donner‐Banzhoff N. Does the patient with chest pain have a coronary heart disease? Diagnostic value of single symptoms and signs—a meta‐analysisCroat Med J. 2012; 53:432–441.Google Scholar
- 44 Kocher R, Emanuel EJ, DeParle NA. The affordable care act and the future of clinical medicine: the opportunities and challenges. Ann Intern Med. 2010; 153:536–539.Google Scholar
- 45 Canto JG, Goldberg RJ, Sopko G. A call to standardize symptom presentation in acute coronary syndromes. Am Heart J. 2012; 164:801–806.Google Scholar
- 46 Eslick GD, Jones MP, Talley NJ. Non‐cardiac chest pain: prevalence, risk factors, impact and consulting–a population‐based study. Aliment Pharmacol Ther. 2003; 17:1115–1124.Google Scholar
- 47 Pines JM, Hollander JE. Emergency department crowding is associated with poor care for patients with severe pain. Ann Emerg Med. 2008; 51:1–5.Google Scholar
- 48 Noureddine S, Arevian M, Adra M, Puzantian H. Response to signs and symptoms of acute coronary syndrome: differences between Lebanese men and women. Am J Crit Care. 2008; 17:26–35.Google Scholar
- 49 Trull TJ, Ebner‐Priemer UW. Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section. Psychol Assess. 2009; 21:457–462.Google Scholar
- 50 Whalen CC, Antani M, Carey J, Landefeld CS. An index of symptoms for infection with human immunodeficiency virus: reliability and validity. J Clin Epidemiol. 1994; 47:537–546.Google Scholar