Skip to main content
Advertisement

Main menu

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • Low-Field MRI
    • Alzheimer Disease
    • ASNR Foundation Special Collection
    • Photon-Counting CT
    • View All
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home

User menu

  • Alerts
  • Log in

Search

  • Advanced search
American Journal of Neuroradiology
American Journal of Neuroradiology

American Journal of Neuroradiology

ASHNR American Society of Functional Neuroradiology ASHNR American Society of Pediatric Neuroradiology ASSR
  • Alerts
  • Log in

Advanced Search

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • Low-Field MRI
    • Alzheimer Disease
    • ASNR Foundation Special Collection
    • Photon-Counting CT
    • View All
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home
  • Follow AJNR on Twitter
  • Visit AJNR on Facebook
  • Follow AJNR on Instagram
  • Join AJNR on LinkedIn
  • RSS Feeds

AJNR Awards, New Junior Editors, and more. Read the latest AJNR updates

Research ArticleAdult Brain
Open Access

Deep Learning–Based Software Improves Clinicians’ Detection Sensitivity of Aneurysms on Brain TOF-MRA

B. Sohn, K.-Y. Park, J. Choi, J.H. Koo, K. Han, B. Joo, S.Y. Won, J. Cha, H.S. Choi and S.-K. Lee
American Journal of Neuroradiology August 2021, DOI: https://doi.org/10.3174/ajnr.A7242
B. Sohn
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for B. Sohn
K.-Y. Park
bResearch Institute of Radiological Science and Center for Clinical Imaging Data Science, and Department of Neurosurgery (K.-Y.P.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for K.-Y. Park
J. Choi
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
cNeurology (J.C.), Yonsei University College of Medicine, Seoul, South Korea
dDepartments of Neurology (J.C.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J. Choi
J.H. Koo
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J.H. Koo
K. Han
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for K. Han
B. Joo
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for B. Joo
S.Y. Won
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for S.Y. Won
J. Cha
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J. Cha
H.S. Choi
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
eRadiology (H.S.C.), Seoul Medical Center, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for H.S. Choi
S.-K. Lee
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for S.-K. Lee
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • FIG 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 1.

    Patient-selection flow diagram.

  • FIG 2.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 2.

    Change in individual diagnostic performance of clinicians. Arrow lines depict the change in diagnostic performance for each clinician without (red dot) and with (blue dot) software augmentation. The radiology resident showed no change in specificity between the 2 occasions (black dot). FP indicates false-positive.

  • FIG 3.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 3.

    Source (A) and MIP image (B) from TOF-MRA of 75-year-old female patient. There was a basilar top aneurysm, <3 mm. Human readers detected this lesion, but the computer-assisted detection software did not.

  • FIG 4.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 4.

    Source (A) and MIP (B) images from TOF-MRA of a 35-year-old female patient. Some human readers missed this lesion at first, but computer-assisted detection software detected it. C, During the second interpretation, human readers accepted the diagnosis of the software.

Tables

  • Figures
    • View popup
    Table 1:

    Patient demographics

    Positive for AneurysmNegative for AneurysmP Value
    No. of patients135197
    Age (range)62 (52–69)62 (53–73)P = .5a
    Sex (male ratio)36 (26.7%)84 (42.6%)P = .0029b
    No. of lesions1690
    • ↵a Mann-Whitney U test.

    • ↵b χ2 test.

    • View popup
    Table 2:

    Reader-individual diagnostic performances with/without CAD assistance

    ReaderHuman without CAD AssistanceHuman with CAD AssistanceHuman without vs with
    CAD Assistance (P Value)
    Sensitivity (%) (95% CI)Neurologist56.3 (47.9–64.7)84.4 (78.3–90.6)<.001
    Neurosurgeon74.8 (67.5–82.1)85.2 (79.2–91.2).032
    Radiologist86.7 (80.9–92.4)83.7 (77.5–89.9).493
    Resident76.3 (69.1–83.5)92.6 (88.2–97).001
    Specificity (%) (95% CI)Neurologist90.9 (86.8–94.9)92.9 (89.3–96.5).460
    Neurosurgeon92.9 (89.3–96.5)93.4 (89.9–96.9).842
    Radiologist95.9 (93.2–98.7)94.9 (91.9–98).629
    Resident99.5 (98.5–100)99.5 (98.5–100)>.999
    Sensitivity per lesion (%) (95% CI)Neurologist60.4 (53–67.7)91.7 (87.2–96.3)<.001
    Neurosurgeon82.2 (76–88.5)96.4 (93.7–99.2)<.001
    Radiologist90.5 (85.7–95.3)95.3 (92.2–98.3).070
    Resident80.5 (74.6–86.4)96.4 (93.7–99.2)<.001
    No. of false-positives per case (95% CI)Neurologist0.066 (0.044–0.099)0.072 (0.048–0.108).751
    Neurosurgeon0.069 (0.047–0.103)0.09 (0.062–0.132).200
    Radiologist0.039 (0.022–0.07)0.075 (0.051–0.112).028
    Resident0.006 (0.002–0.024)0.018 (0.008–0.04).179
PreviousNext
Back to top
Advertisement
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Deep Learning–Based Software Improves Clinicians’ Detection Sensitivity of Aneurysms on Brain TOF-MRA
(Your Name) has sent you a message from American Journal of Neuroradiology
(Your Name) thought you would like to see the American Journal of Neuroradiology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Cite this article
B. Sohn, K.-Y. Park, J. Choi, J.H. Koo, K. Han, B. Joo, S.Y. Won, J. Cha, H.S. Choi, S.-K. Lee
Deep Learning–Based Software Improves Clinicians’ Detection Sensitivity of Aneurysms on Brain TOF-MRA
American Journal of Neuroradiology Aug 2021, DOI: 10.3174/ajnr.A7242

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
0 Responses
Respond to this article
Share
Bookmark this article
Deep Learning–Based Software Improves Clinicians’ Detection Sensitivity of Aneurysms on Brain TOF-MRA
B. Sohn, K.-Y. Park, J. Choi, J.H. Koo, K. Han, B. Joo, S.Y. Won, J. Cha, H.S. Choi, S.-K. Lee
American Journal of Neuroradiology Aug 2021, DOI: 10.3174/ajnr.A7242
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Purchase

Jump to section

  • Article
    • Abstract
    • ABBREVIATIONS:
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSIONS
    • Footnotes
    • References
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Automation Bias in AI-Assisted Detection of Cerebral Aneurysms on Time-of-Flight MR-Angiography
  • Automated Detection of Cerebral Aneurysms on TOF-MRA Using a Deep Learning Approach: An External Validation Study
  • Crossref
  • Google Scholar

This article has not yet been cited by articles in journals that are participating in Crossref Cited-by Linking.

More in this TOC Section

Adult Brain

  • Diagnostic Neuroradiology of Monoclonal Antibodies
  • NCCT vs. MRI for Brain Atrophy in Acute Stroke
  • Clinical Outcomes After Chiari I Decompression
Show more Adult Brain

Functional

  • Kurtosis and Epileptogenic Tubers: A Pilot Study
  • Glutaric Aciduria Type 1: DK vs. Conventional MRI
  • Choroid Plexus Calcification&Microglial Activation
Show more Functional

Similar Articles

Advertisement

Indexed Content

  • Current Issue
  • Accepted Manuscripts
  • Article Preview
  • Past Issues
  • Editorials
  • Editor's Choice
  • Fellows' Journal Club
  • Letters to the Editor
  • Video Articles

Cases

  • Case Collection
  • Archive - Case of the Week
  • Archive - Case of the Month
  • Archive - Classic Case

More from AJNR

  • Trainee Corner
  • Imaging Protocols
  • MRI Safety Corner
  • Book Reviews

Multimedia

  • AJNR Podcasts
  • AJNR Scantastics

Resources

  • Turnaround Time
  • Submit a Manuscript
  • Submit a Video Article
  • Submit an eLetter to the Editor/Response
  • Manuscript Submission Guidelines
  • Statistical Tips
  • Fast Publishing of Accepted Manuscripts
  • Graphical Abstract Preparation
  • Imaging Protocol Submission
  • Evidence-Based Medicine Level Guide
  • Publishing Checklists
  • Author Policies
  • Become a Reviewer/Academy of Reviewers
  • News and Updates

About Us

  • About AJNR
  • Editorial Board
  • Editorial Board Alumni
  • Alerts
  • Permissions
  • Not an AJNR Subscriber? Join Now
  • Advertise with Us
  • Librarian Resources
  • Feedback
  • Terms and Conditions
  • AJNR Editorial Board Alumni

American Society of Neuroradiology

  • Not an ASNR Member? Join Now

© 2025 by the American Society of Neuroradiology All rights, including for text and data mining, AI training, and similar technologies, are reserved.
Print ISSN: 0195-6108 Online ISSN: 1936-959X

Powered by HighWire