RT Journal Article
SR Electronic
T1 Automated Detection of Steno-Occlusive Lesion on Time-of-Flight MR Angiography: An Observer Performance Study
JF American Journal of Neuroradiology
JO Am. J. Neuroradiol.
FD American Society of Neuroradiology
SP 1253
OP 1259
DO 10.3174/ajnr.A8334
VO 45
IS 9
A1 Lim, Hunjong
A1 Choi, Dongjun
A1 Sunwoo, Leonard
A1 Jung, Jae Hyeop
A1 Baik, Sung Hyun
A1 Cho, Se Jin
A1 Jang, Jinhee
A1 Kim, Tackeun
A1 Lee, Kyong Joon
YR 2024
UL http://www.ajnr.org/content/45/9/1253.abstract
AB BACKGROUND AND PURPOSE: Intracranial steno-occlusive lesions are responsible for acute ischemic stroke. However, the clinical benefits of artificial intelligence (AI)-based methods for detecting pathologic lesions in intracranial arteries have not been evaluated. We aimed to validate the clinical utility of an AI model for detecting steno-occlusive lesions in the intracranial arteries.MATERIALS AND METHODS: Overall, 138 TOF-MRA images were collected from 2 institutions, which served as internal (n = 62) and external (n = 76) test sets, respectively. Each study was reviewed by 5 radiologists (2 neuroradiologists and 3 radiology residents) to compare the usage and nonusage of our proposed AI model for TOF-MRA interpretation. They identified the steno-occlusive lesions and recorded their reading time. Observer performance was assessed by using the area under the jackknife free-response receiver operating characteristic curve (AUFROC) and reading time for comparison.RESULTS: The average AUFROC for the 5 radiologists demonstrated an improvement from 0.70 without AI to 0.76 with AI (P = .027). Notably, this improvement was most pronounced among the 3 radiology residents, whose performance metrics increased from 0.68 to 0.76 (P = .002). Despite an increased reading time by using AI, there was no significant change among the readings by radiology residents. Moreover, the use of AI resulted in improved interobserver agreement among the reviewers (the intraclass correlation coefficient increased from 0.734 to 0.752).CONCLUSIONS: Our proposed AI model offers a supportive tool for radiologists, potentially enhancing the accuracy of detecting intracranial steno-occlusion lesions on TOF-MRA. Less experienced readers may benefit the most from this model.AIartificial intelligenceAUCarea under the receiver operating characteristic curveAUFROCarea under the jackknife free-response receiver operating characteristic curveICCintraclass correlation coefficientJAFROCjackknife free-response receiver operating characteristic