Deep Learning–Based ASPECTS Algorithm Enhances Reader Performance and Reduces Interpretation Time

References

1. 1.↵
   1. Donkor ES

   . Stroke in the 21 st Century: A Snapshot of the Burden, Epidemiology, and Quality of Life. Stroke Res Treat 2018;2018:1–10. doi:10.1155/2018/3238165 pmid:30598741

   CrossRefPubMed
2. 2.↵
   1. Feigin VL,
   2. Stark BA,
   3. Johnson CO, et al

   . Global, regional, and national burden of stroke and its risk factors, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet Neurol 2021;20:795–820. doi:10.1016/S1474-4422(21)00252-0

   CrossRefPubMed
3. 3.↵
   1. Saini V,
   2. Guada L,
   3. Yavagal DR

   . Global Epidemiology of Stroke and Access to Acute Ischemic Stroke Interventions. Neurology 2021;97:S6–16. doi:10.1212/WNL.0000000000012781 pmid:34785599

   CrossRefPubMed
4. 4.↵
   1. Hasan TF,
   2. Hasan H,
   3. Kelley RE

   . Overview of Acute Ischemic Stroke Evaluation and Management. Biomedicines 2021;9:1486. doi:10.3390/biomedicines9101486 pmid:34680603

   CrossRefPubMed
5. 5.↵
   1. Pu L,
   2. Wang L,
   3. Zhang R, et al

   . Projected Global Trends in Ischemic Stroke Incidence, Deaths and Disability-Adjusted Life Years From 2020 to 2030. Stroke 2023;54:1330–9. doi:10.1161/STROKEAHA.122.040073 pmid:37094034

   CrossRefPubMed
6. 6.↵
   1. Dhand S,
   2. O’Connor P,
   3. Hughes C, et al

   . Acute Ischemic Stroke: Acute Management and Selection for Endovascular Therapy. Semin Interv Radiol 2020;37:109–18. doi:10.1055/s-0040-1709152 pmid:32419723

   CrossRefPubMed
7. 7.↵
   1. Barber PA,
   2. Demchuk AM,
   3. Zhang J, et al

   . Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. The Lancet 2000;355:1670–4. doi:10.1016/s0140-6736(00)02237-6 pmid:10905241

   CrossRefPubMed
8. 8.↵
   1. Puig J,
   2. Shankar J,
   3. Liebeskind D, et al

   . From “Time is Brain” to “Imaging is Brain”: A Paradigm Shift in the Management of Acute Ischemic Stroke. J Neuroimaging 2020;30:562–71. doi:10.1111/jon.12693 pmid:32037629

   CrossRefPubMed
9. 9.↵
   1. Lei C,
   2. Zhou X,
   3. Chang X, et al

   . Mechanical Thrombectomy in Patients with Acute Ischemic Stroke and ASPECTS ≤5. J Stroke Cerebrovasc Dis 2021;30:105748. doi:10.1016/j.jstrokecerebrovasdis.2021.105748 pmid:33784521

   CrossRefPubMed
10. 10.↵
    1. Hao Y,
    2. Yang D,
    3. Wang H, et al

    . Predictors for Symptomatic Intracranial Hemorrhage After Endovascular Treatment of Acute Ischemic Stroke. Stroke 2017;48:1203–9. doi:10.1161/STROKEAHA.116.016368 pmid:28373302

    Abstract/FREE Full Text
11. 11.↵
    1. Naylor J,
    2. Churilov L,
    3. Chen Z, et al

    . Reliability, Reproducibility and Prognostic Accuracy of the Alberta Stroke Program Early CT Score on CT Perfusion and Non-Contrast CT in Hyperacute Stroke. Cerebrovasc Dis 2017;44:195–202. doi:10.1159/000479707 pmid:28810259

    CrossRefPubMed
12. 12.↵
    1. Menon BK,
    2. Puetz V,
    3. Kochar P, et al

    . ASPECTS and Other Neuroimaging Scores in the Triage and Prediction of Outcome in Acute Stroke Patients. Neuroimaging Clin N Am 2011;21:407–23. doi:10.1016/j.nic.2011.01.007 pmid:21640307

    CrossRefPubMed
13. 13.↵
    1. Gupta AC,
    2. Schaefer PW,
    3. Chaudhry ZA, et al

    . Interobserver Reliability of Baseline Noncontrast CT Alberta Stroke Program Early CT Score for Intra-Arterial Stroke Treatment Selection. Am J Neuroradiol 2012;33:1046–9. doi:10.3174/ajnr.A2942 pmid:22322602

    Abstract/FREE Full Text
14. 14.↵
    1. Huo X,
    2. Raynald,
    3. Jin H, et al

    . Performance of automated CT ASPECTS in comparison to physicians at different levels on evaluating acute ischemic stroke at a single institution in China. Chin Neurosurg J 2021;7:40.

    CrossRefPubMed
15. 15.↵
    1. Farzin B,
    2. Fahed R,
    3. Guilbert F, et al

    . Early CT changes in patients admitted for thrombectomy: Intrarater and interrater agreement. Neurology 2016;87:249–56. doi:10.1212/WNL.0000000000002860 pmid:27316243

    CrossRefPubMed
16. 16.↵
    1. Nicholson P,
    2. Hilditch CA,
    3. Neuhaus A, et al

    . Per-region interobserver agreement of Alberta Stroke Program Early CT Scores (ASPECTS). J NeuroInterventional Surg 2020;12:1069–71. doi:10.1136/neurintsurg-2019-015473 pmid:32024784

    Abstract/FREE Full Text
17. 17.↵
    1. Radhiana H

    . Non-contrast Computed Tomography in Acute Ischaemic Stroke: A Pictorial Review. 2013;68:8.
18. 18.↵
    1. Herweh C,
    2. Ringleb PA,
    3. Rauch G, et al

    . Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 2016;11:438–45. doi:10.1177/1747493016632244 pmid:26880058

    CrossRefPubMed
19. 19.↵
    1. Nagel S,
    2. Sinha D,
    3. Day D, et al

    . e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 2017;12:615–22. doi:10.1177/1747493016681020 pmid:27899743

    CrossRefPubMed
20. 20.↵
    1. Cimflova P,
    2. Volny O,
    3. Mikulik ProfR, et al

    . Detection of ischemic changes on baseline multimodal computed tomography: expert reading vs. Brainomix and RAPID software. J Stroke Cerebrovasc Dis 2020;29:104978. doi:10.1016/j.jstrokecerebrovasdis.2020.104978 pmid:32807415

    CrossRefPubMed
21. 21.↵
    1. Naganuma M,
    2. Tachibana A,
    3. Fuchigami T, et al

    . Alberta Stroke Program Early CT Score Calculation Using the Deep Learning-Based Brain Hemisphere Comparison Algorithm. J Stroke Cerebrovasc Dis 2021;30:105791. doi:10.1016/j.jstrokecerebrovasdis.2021.105791 pmid:33878549

    CrossRefPubMed
22. 22.↵
    1. VESPRINI A

    . Intelligenza Artificiale nella valutazione TC dell’ictus. 2023 Feb 20. [Epub ahead of print].
23. 23.↵
    1. Hassan AE,
    2. Ringheanu VM,
    3. Rabah RR, et al

    . Early experience utilizing artificial intelligence shows significant reduction in transfer times and length of stay in a hub and spoke model. Interv Neuroradiol 2020;26:615–22. doi:10.1177/1591019920953055 pmid:32847449

    CrossRefPubMed
24. 24.↵
    1. Hassan AE,
    2. Ringheanu VM,
    3. Preston L, et al

    . Artificial Intelligence–Parallel Stroke Workflow Tool Improves Reperfusion Rates and Door‐In to Puncture Interval. Stroke Vasc Interv Neurol 2022;2:e000224.
25. 25.↵
    1. Elijovich L,
    2. Dornbos III D,
    3. Nickele C, et al

    . Automated emergent large vessel occlusion detection by artificial intelligence improves stroke workflow in a hub and spoke stroke system of care. J NeuroInterventional Surg 2022;14:704–8. doi:10.1136/neurintsurg-2021-017714 pmid:34417344

    Abstract/FREE Full Text
26. 26.↵
    1. Goebel J,
    2. Stenzel E,
    3. Guberina N, et al

    . Automated ASPECT rating: comparison between the Frontier ASPECT Score software and the Brainomix software. Neuroradiology 2018;60:1267–72. doi:10.1007/s00234-018-2098-x pmid:30219935

    CrossRefPubMed
27. 27.↵
    1. Austein F,
    2. Wodarg F,
    3. Jürgensen N, et al

    . Automated versus manual imaging assessment of early ischemic changes in acute stroke: comparison of two software packages and expert consensus. Eur Radiol 2019;29:6285–92. doi:10.1007/s00330-019-06252-2 pmid:31076862

    CrossRefPubMed
28. 28.↵
    1. Hoelter P,
    2. Muehlen I,
    3. Goelitz P, et al

    . Automated ASPECT scoring in acute ischemic stroke: comparison of three software tools. Neuroradiology 2020;62:1231–8. doi:10.1007/s00234-020-02439-3 pmid:32382795

    CrossRefPubMed
29. 29.↵
    1. Guberina N,
    2. Dietrich U,
    3. Radbruch A, et al

    . Detection of early infarction signs with machine learning-based diagnosis by means of the Alberta Stroke Program Early CT score (ASPECTS) in the clinical routine. Neuroradiology 2018;60:889–901. doi:10.1007/s00234-018-2066-5 pmid:30066278

    CrossRefPubMed
30. 30.↵
    1. Brinjikji W,
    2. Abbasi M,
    3. Arnold C, et al

    . e-ASPECTS software improves interobserver agreement and accuracy of interpretation of aspects score. Interv Neuroradiol 2021;27:781–7. doi:10.1177/15910199211011861 pmid:33853441

    CrossRefPubMed
31. 31.↵
    1. Delio PR,
    2. Wong ML,
    3. Tsai JP, et al

    . Assistance from Automated ASPECTS Software Improves Reader Performance. J Stroke Cerebrovasc Dis 2021;30:105829. doi:10.1016/j.jstrokecerebrovasdis.2021.105829 pmid:33989968

    CrossRefPubMed
32. 32.↵
    1. Kobeissi H,
    2. Kallmes DF,
    3. Benson J, et al

    . Impact of e-ASPECTS software on the performance of physicians compared to a consensus ground truth: a multi-reader, multi-case study. Front Neurol 2023;14:1221255. doi:10.3389/fneur.2023.1221255 pmid:37745671

    CrossRefPubMed
33. 33.↵
    1. Lambert J,
    2. Demeestere J,
    3. Dewachter B, et al

    . Performance of Automated ASPECTS Software and Value as a Computer-Aided Detection Tool. Am J Neuroradiol 2023;44:894–900. doi:10.3174/ajnr.A7956 pmid:37500286

    Abstract/FREE Full Text
34. 34.↵
    1. Scopelliti G,
    2. Karam A,
    3. Labreuche J, et al

    . Internal carotid artery patency after mechanical thrombectomy for stroke due to occlusive dissection: Impact on outcome. Eur Stroke J 2023;8:199–207. doi:10.1177/23969873221140649 pmid:37021179

    CrossRefPubMed
35. 35.↵
    1. Orscelik A,
    2. Matsukawa H,
    3. Elawady SS, et al

    . Comparative Outcomes of Mechanical Thrombectomy in Acute Ischemic Stroke Patients with ASPECTS 2-3 vs. 4-5. J Stroke Cerebrovasc Dis 2024;33:107528. doi:10.1016/j.jstrokecerebrovasdis.2023.107528 pmid:38134550

    CrossRefPubMed
36. 36.↵
    1. Almallouhi E,
    2. Al Kasab S,
    3. Hubbard Z, et al

    . Outcomes of Mechanical Thrombectomy for Patients With Stroke Presenting With Low Alberta Stroke Program Early Computed Tomography Score in the Early and Extended Window. JAMA Netw Open 2021;4:e2137708. doi:10.1001/jamanetworkopen.2021.37708 pmid:34878550

    CrossRefPubMed
37. 37.
    1. Chang PD,
    2. Kuoy E,
    3. Grinband J, et al

    . Hybrid 3D/2D Convolutional Neural Network for Hemorrhage Evaluation on Head CT. Am J Neuroradiol 2018;39:1609–16. doi:10.3174/ajnr.A5742 pmid:30049723

    Abstract/FREE Full Text
38. 38.↵
    1. Ronneberger O,
    2. Fischer P,
    3. Brox T. U-Net

    : Convolutional Networks for Biomedical Image Segmentation. 2015 May 18. [Epub ahead of print].
39. 39.↵
    1. Ayobi A,
    2. Chang PD,
    3. Chow D, et al

    . Validation of a Deep Learning AI-based Software for Automated ASPECTS Assessment. ECR 2023 EPOS doi:10.26044/ecr2023/C-19206.

    CrossRef
40. 40.↵
    1. Cohen J

    . A coefficient of agreement for nominal scales. Educ Psychol Meas 1960;20:37–46. doi:10.1177/001316446002000104

    CrossRefWeb of Science
41. 41.↵
    1. Ying G-S,
    2. Maguire MG,
    3. Glynn RJ, et al

    . Calculating Sensitivity, Specificity, and Predictive Values for Correlated Eye Data. Investig Opthalmology Vis Sci 2020;61:29. doi:10.1167/iovs.61.11.29 pmid:32936302

    CrossRefPubMed
42. 42.↵
    1. Obuchowski NA,
    2. Rockette HE

    . Hypothesis testing of diagnostic accuracy for multiple readers and multiple tests an anova approach with dependent observations. Commun Stat - Simul Comput 1995;24:285–308. doi:10.1080/03610919508813243

    CrossRef
43. ↵
    1. Shao J,
    2. Tu D

    43. Shao J, Tu D. The Jackknife and Bootstrap. New York, NY: Springer New York; 1995.
44. 44.↵
    1. Samuelson FW,
    2. Taylor-Phillips S

    1. Smith BJ,
    2. Hillis SL

    . Multi-reader multi-case analysis of variance software for diagnostic performance comparison of imaging modalities. In: Samuelson FW, Taylor-Phillips S, eds. Medical Imaging 2020: Image Perception, Observer Performance, and Technology Assessment. Houston, United States: SPIE; 2020:18. doi:10.1117/12.2549075

    CrossRef
45. 45.↵
    1. Koo TK,
    2. Li MY

    . A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med 2016;15:155–63. doi:10.1016/j.jcm.2016.02.012 pmid:27330520

    CrossRefPubMed
46. 46.↵
    1. Demaerschalk BM,
    2. Scharf EL,
    3. Cloft H, et al

    . Contemporary Management of Acute Ischemic Stroke Across the Continuum: From TeleStroke to Intra-Arterial Management. Mayo Clin Proc 2020;95:1512–29. doi:10.1016/j.mayocp.2020.04.002 pmid:32622453

    CrossRefPubMed
47. 47.↵
    1. Saver JL

    . Time Is Brain—Quantified. Stroke 2006;37:263–6. doi:10.1161/01.STR.0000196957.55928.ab pmid:16339467

    Abstract/FREE Full Text
48. 48.↵
    1. Saver JL,
    2. Goyal M,
    3. van der Lugt A, et al

    . Time to Treatment With Endovascular Thrombectomy and Outcomes From Ischemic Stroke: A Meta-analysis. JAMA 2016;316:1279–89. doi:10.1001/jama.2016.13647 pmid:27673305

    CrossRefPubMed