Article Figures & Data
Figures
- FIG 1.
Scatterplots with trendlines of individual raters and automated software (x-axis) versus the criterion standard (y-axis). The size of each dot is proportionate to the number of cases with that combination of scores. R indicates rater.
- FIG 2.
Score distribution plots illustrating the improvement of the interrater agreement of the 5 raters without (A) and with (B) CAD. The intraclass correlation coefficient of the raters was 0.55 (95% CI, 0.48–0.62) without CAD compared with 0.73 (95% CI, 0.68–0.78) with CAD. IQR indicates interquartile range.
Tables
Characteristics No. of patients 174 Age (yr)a 72 (33–96) Female sex (%) 94 (54%) NIHSSb 18 (13–22) Time from symptom onset to imaging (min)a 161 (5–1503) No. of patients with known time interval from symptom onset to imaging 173 0–1 hour 46 (27%) 1–2 hours 71 (41%) 2–6 hours 40 (23%) >6 hours 16 (9%) NCCT acquired at referral hospital (%) 50 (29%) - Table 2:
ASPECTS ratings overview with medians, interquartile ranges, and dichotomized score proportions
Raters Median (IQR) 0–5 6–10 Criterion standard 8 (7–10) 14% 86% RAPID ASPECTS 7 (6–9) 17% 83% Rater 1 9 (8–9) 7% 93% Rater 1 with CAD 8 (7–9) 9% 91% Rater 2 8 (6–10) 17% 83% Rater 2 with CAD 8 (6–10) 19% 81% Rater 3 9 (8–10) 8% 92% Rater 3 with CAD 8 (7–10) 12% 88% Rater 4 9 (7–10) 11% 89% Rater 4 with CAD 8 (7–10) 14% 86% Rater 5 8 (7–10) 11% 89% Rater 5 with CAD 8 (6–9) 18% 82% Note:—IQR indicates interquartile range.
Paired Agreement 0–1 Hour 1–2 Hours 2–6 Hours P Value Rater 1 versus criterion standard 0.26 0.41 0.54 .10 Rater 2 versus criterion standard 0.38 0.42 0.32 .77 Rater 3 versus criterion standard 0.27 0.34 0.58 .03 Rater 4 versus criterion standard 0.72 0.68 0.84 .04 Rater 5 versus criterion standard 0.55 0.46 0.50 .71 Automated ASPECTS versus criterion standard 0.37 0.66 0.67 .002 Note:—Data are weighted κ values.
- Table 4:
Overall scores agreement with the expert criterion standard for readings without and with CAD
Overall Scores Weighted κ without CAD Weighted κ with CAD P Value Rater 1 versus criterion standard 0.41 (0.04) 0.58 (0.03) <.001 Rater 2 versus criterion standard 0.38 (0.05) 0.52 (0.05) .001 Rater 3 versus criterion standard 0.42 (0.04) 0.68 (0.03) <.001 Rater 4 versus criterion standard 0.76 (0.03) 0.84 (0.02) <.001 Rater 5 versus criterion standard 0.49 (0.04) 0.57 (0.04) .04 Note:—Standard errors of the κ coefficients are in parentheses.
- Table 5:
Dichotomized scores agreement with the criterion standard for readings without and with CAD
Dichotomized Scores Cohen κ without CAD Cohen κ with CAD P Value Rater 1 versus criterion standard 0.43 (0.11) 0.61 (0.09) .12 Rater 2 versus criterion standard 0.42 (0.09) 0.63 (0.08) .02 Rater 3 versus criterion standard 0.40 (0.10) 0.55 (0.09) .19 Rater 4 versus criterion standard 0.74 (0.08) 0.86 (0.06) .07 Rater 5 versus criterion standard 0.43 (0.10) 0.58 (0.09) .14 Note:—Standard errors of the κ coefficients are in parentheses.
