Assessing the Performance of Artificial Intelligence Models: Insights from the American Society of Functional Neuroradiology Artificial Intelligence Competition

Bin Jiang; Burak B. Ozkara; Guangming Zhu; Derek Boothroyd; Jason W. Allen; Daniel P. Barboriak; Peter Chang; Cynthia Chan; Ruchir Chaudhari; Hui Chen; Anjeza Chukus; Victoria Ding; David Douglas; Christopher G. Filippi; Adam E. Flanders; Ryan Godwin; Syed Hashmi; Christopher Hess; Kevin Hsu; Yvonne W. Lui; Joseph A. Maldjian; Patrik Michel; Sahil S. Nalawade; Vishal Patel; Prashant Raghavan; Haris I. Sair; Jody Tanabe; Kirk Welker; Christopher T. Whitlow; Greg Zaharchuk; Max Wintermark

doi:10.3174/ajnr.A8317

Research ArticleArtificial Intelligence

Assessing the Performance of Artificial Intelligence Models: Insights from the American Society of Functional Neuroradiology Artificial Intelligence Competition

Bin Jiang, Burak B. Ozkara, Guangming Zhu, Derek Boothroyd, Jason W. Allen, Daniel P. Barboriak, Peter Chang, Cynthia Chan, Ruchir Chaudhari, Hui Chen, Anjeza Chukus, Victoria Ding, David Douglas, Christopher G. Filippi, Adam E. Flanders, Ryan Godwin, Syed Hashmi, Christopher Hess, Kevin Hsu, Yvonne W. Lui, Joseph A. Maldjian, Patrik Michel, Sahil S. Nalawade, Vishal Patel, Prashant Raghavan, Haris I. Sair, Jody Tanabe, Kirk Welker, Christopher T. Whitlow, Greg Zaharchuk and Max Wintermark

American Journal of Neuroradiology September 2024, 45 (9) 1276-1283; DOI: https://doi.org/10.3174/ajnr.A8317

Bin Jiang

aFrom the Department of Radiology (B.J., C.C., R.C., A.C., D.D., S.H., G.Zaharchuk), Neuroradiology Division, Stanford University, Stanford, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Bin Jiang

Burak B. Ozkara

bDepartment of Neuroradiology (B.B.O., H.C., M.W.), MD Anderson Cancer Center, Houston, Texas

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Guangming Zhu

cDepartment of Neurology (G.Zhu), The University of Arizona, Tucson, Arizona

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Derek Boothroyd

dDepartment of Medicine (D.B., V.D.), Stanford University School of Medicine, Stanford, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Jason W. Allen

eDepartment of Radiology and Imaging Sciences (J.W.A.), Indiana University School of Medicine, Indianapolis, Indiana

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Daniel P. Barboriak

fDepartment of Radiology (D.P.B.), Duke University Medical Center, Durham, North Carolina

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Daniel P. Barboriak

Peter Chang

gDepartment of Radiological Sciences (P.C.), University of California, Irvine, Irvine, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Cynthia Chan

aFrom the Department of Radiology (B.J., C.C., R.C., A.C., D.D., S.H., G.Zaharchuk), Neuroradiology Division, Stanford University, Stanford, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Ruchir Chaudhari

aFrom the Department of Radiology (B.J., C.C., R.C., A.C., D.D., S.H., G.Zaharchuk), Neuroradiology Division, Stanford University, Stanford, California

hSutter Imaging (R.C.), Sutter Health, Sacramento, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Hui Chen

bDepartment of Neuroradiology (B.B.O., H.C., M.W.), MD Anderson Cancer Center, Houston, Texas

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Anjeza Chukus

aFrom the Department of Radiology (B.J., C.C., R.C., A.C., D.D., S.H., G.Zaharchuk), Neuroradiology Division, Stanford University, Stanford, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Victoria Ding

dDepartment of Medicine (D.B., V.D.), Stanford University School of Medicine, Stanford, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

David Douglas

aFrom the Department of Radiology (B.J., C.C., R.C., A.C., D.D., S.H., G.Zaharchuk), Neuroradiology Division, Stanford University, Stanford, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for David Douglas

Christopher G. Filippi

iDepartment of Radiology (C.G.F.), Tufts University, Boston, Massachusetts

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Christopher G. Filippi

Adam E. Flanders

jDepartment of Radiology (A.E.F.), Thomas Jefferson University, Philadelphia, Pennsylvania

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Adam E. Flanders

Ryan Godwin

kDepartment of Radiology (R.G.), University of Alabama at Birmingham, Birmingham, Alabama

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Syed Hashmi

aFrom the Department of Radiology (B.J., C.C., R.C., A.C., D.D., S.H., G.Zaharchuk), Neuroradiology Division, Stanford University, Stanford, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Syed Hashmi

Christopher Hess

lDepartment of Radiology and Biomedical Imaging (C.H.), University of California, San Francisco, San Francisco, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Christopher Hess

Kevin Hsu

mDepartment of Radiology (K.H., Y.W.L), New York University Grossman School of Medicine, New York, New York

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Kevin Hsu

Yvonne W. Lui

mDepartment of Radiology (K.H., Y.W.L), New York University Grossman School of Medicine, New York, New York

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Yvonne W. Lui

Joseph A. Maldjian

nDepartment of Radiology (J.A.M., S.S.N.), University of Texas Southwestern Medical Center, Dallas, Texas

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Joseph A. Maldjian

Patrik Michel

oDepartment of Clinical Neurosciences (P.M.), Lausanne University Hospital, Lausanne, Switzerland

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Patrik Michel

Sahil S. Nalawade

nDepartment of Radiology (J.A.M., S.S.N.), University of Texas Southwestern Medical Center, Dallas, Texas

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Sahil S. Nalawade

Vishal Patel

pDepartment of Radiology (V.P.), Mayo Clinic, Jacksonville, Florida

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Prashant Raghavan

qDepartment of Diagnostic Radiology and Nuclear Medicine (P.R.), University of Maryland School of Medicine, Baltimore, Maryland

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Haris I. Sair

rThe Russell H. Morgan Department of Radiology and Radiological Science (H.I.S.), Johns Hopkins University, Baltimore, Maryland

sThe Malone Center for Engineering in Healthcare (H.I.S.), Whiting School of Engineering, Johns Hopkins University, Baltimore, Maryland

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Haris I. Sair

Jody Tanabe

tDepartment of Radiology (J.T.), University of Colorado, Aurora, Colorado

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Jody Tanabe

Kirk Welker

uDepartment of Radiology (K.W.), Mayo Clinic, Rochester, Minnesota

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Kirk Welker

Christopher T. Whitlow

vDepartment of Radiology (C.T.W), Wake Forest University School of Medicine, Winston-Salem, North Carolina

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Christopher T. Whitlow

Greg Zaharchuk

aFrom the Department of Radiology (B.J., C.C., R.C., A.C., D.D., S.H., G.Zaharchuk), Neuroradiology Division, Stanford University, Stanford, California

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Max Wintermark

bDepartment of Neuroradiology (B.B.O., H.C., M.W.), MD Anderson Cancer Center, Houston, Texas

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Max Wintermark

Article
Figures & Data
Supplemental
Info & Metrics
Responses
References
PDF

Submit a Response to This Article

Compose eLetter

Title *

Contents

More information about text formats

Plain text

No HTML tags allowed.
Web page addresses and e-mail addresses turn into links automatically.
Lines and paragraphs break automatically.

Author Information

Contributors
First Name and Middle Initial * First or given name, e.g. 'Peter'. Last Name * Your last, or family, name, e.g. 'MacMoody'. Email Address * Your email address, e.g. [email protected] Occupation * Your role and/or occupation, e.g. 'Orthopedic Surgeon'. Affiliation * Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.

Statement of Competing Interests

Competing interests? *

Yes

Please describe the competing interests

Vertical Tabs

Jump to comment:

No eLetters have been published for this article.

PreviousNext

In this issue

American Journal of Neuroradiology

Vol. 45, Issue 9

1 Sep 2024

Table of Contents
Index by author
Complete Issue (PDF)

Download PDF

Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Your Email *

Your Name *

Send To *

Enter multiple addresses on separate lines or separate them with commas.

You are going to email the following Assessing the Performance of Artificial Intelligence Models: Insights from the American Society of Functional Neuroradiology Artificial Intelligence Competition

Message Subject (Your Name) has sent you a message from American Journal of Neuroradiology

Message Body (Your Name) thought you would like to see the American Journal of Neuroradiology web site.

Your Personal Message

CAPTCHA

This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Cite this article

Assessing the Performance of Artificial Intelligence Models: Insights from the American Society of Functional Neuroradiology Artificial Intelligence Competition

American Journal of Neuroradiology Sep 2024, 45 (9) 1276-1283; DOI: 10.3174/ajnr.A8317

Citation Manager Formats

BibTeX
Bookends
EasyBib
EndNote (tagged)
EndNote 8 (xml)
Medlars
Mendeley
Papers
RefWorks Tagged
Ref Manager
RIS
Zotero

0 Responses

Respond to this article

Bookmark this article

User Name *

Password *

Remember my user name & password.

AI Models Performance: ASFN Competition Insights

American Journal of Neuroradiology Sep 2024, 45 (9) 1276-1283; DOI: 10.3174/ajnr.A8317

Share This Article:

Tweet Widget
Facebook Like
Google Plus One

Purchase

Jump to section

Article
Figures & Data
Supplemental
Info & Metrics
Responses
References
PDF

PubMed
Google Scholar

Cited By...

Real-World Adoption of Artificial Intelligence in Radiology: Opportunities and Barriers

Crossref (2)
Google Scholar

This article has been cited by the following articles in journals that are participating in Crossref Cited-by Linking.

Pitfalls and Best Practices in Evaluation of AI Algorithmic Biases in Radiology

Paul H. Yi, Preetham Bachina, Beepul Bharti, Sean P. Garin, Adway Kanhere, Pranav Kulkarni, David Li, Vishwa S. Parekh, Samantha M. Santomartino, Linda Moy, Jeremias Sulam

Radiology 2025 315 2
Real-World Adoption of Artificial Intelligence in Radiology: Opportunities and Barriers

Reza Forghani

American Journal of Neuroradiology 2024 45 9

Main menu

User menu

Search

American Journal of Neuroradiology

Assessing the Performance of Artificial Intelligence Models: Insights from the American Society of Functional Neuroradiology Artificial Intelligence Competition

Plain text

Vertical Tabs

Jump to comment:

In this issue

Citation Manager Formats

Related Articles

Cited By...

More in this TOC Section

Similar Articles

Indexed Content

Cases

More from AJNR

Multimedia

Resources

About Us

American Society of Neuroradiology