Skip to main content
Advertisement

Main menu

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • Low-Field MRI
    • Alzheimer Disease
    • ASNR Foundation Special Collection
    • Photon-Counting CT
    • View All
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home

User menu

  • Alerts
  • Log in

Search

  • Advanced search
American Journal of Neuroradiology
American Journal of Neuroradiology

American Journal of Neuroradiology

ASHNR American Society of Functional Neuroradiology ASHNR American Society of Pediatric Neuroradiology ASSR
  • Alerts
  • Log in

Advanced Search

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • Low-Field MRI
    • Alzheimer Disease
    • ASNR Foundation Special Collection
    • Photon-Counting CT
    • View All
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home
  • Follow AJNR on Twitter
  • Visit AJNR on Facebook
  • Follow AJNR on Instagram
  • Join AJNR on LinkedIn
  • RSS Feeds

AJNR Awards, New Junior Editors, and more. Read the latest AJNR updates

Research ArticleBrain Tumor Imaging

Interrater Agreement of BT-RADS for Evaluation of Follow-up MRI in Patients with Treated Primary Brain Tumor

Michael Essien, Maxwell E. Cooper, Ashwani Gore, Taejin L. Min, Benjamin B. Risk, Gelareh Sadigh, Ranliang Hu, Michael J. Hoch and Brent D. Weinberg
American Journal of Neuroradiology September 2024, 45 (9) 1308-1315; DOI: https://doi.org/10.3174/ajnr.A8322
Michael Essien
aFrom the Department of Radiology and Imaging Sciences (M.E., M.E.C., A.G., T.L.M., R.H., B.D.W.),
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Michael Essien
Maxwell E. Cooper
aFrom the Department of Radiology and Imaging Sciences (M.E., M.E.C., A.G., T.L.M., R.H., B.D.W.),
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Maxwell E. Cooper
Ashwani Gore
aFrom the Department of Radiology and Imaging Sciences (M.E., M.E.C., A.G., T.L.M., R.H., B.D.W.),
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ashwani Gore
Taejin L. Min
aFrom the Department of Radiology and Imaging Sciences (M.E., M.E.C., A.G., T.L.M., R.H., B.D.W.),
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Taejin L. Min
Benjamin B. Risk
bRollins School of Public Health (B.B.R.), Emory University, Atlanta, Georgia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Benjamin B. Risk
Gelareh Sadigh
bRollins School of Public Health (B.B.R.), Emory University, Atlanta, Georgia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Gelareh Sadigh
Ranliang Hu
aFrom the Department of Radiology and Imaging Sciences (M.E., M.E.C., A.G., T.L.M., R.H., B.D.W.),
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ranliang Hu
Michael J. Hoch
cDepartment of Radiological Sciences (G.S.), University of California Irvine, Orange, California
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Michael J. Hoch
Brent D. Weinberg
aFrom the Department of Radiology and Imaging Sciences (M.E., M.E.C., A.G., T.L.M., R.H., B.D.W.),
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Brent D. Weinberg
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF
Loading

This article requires a subscription to view the full text. If you have a subscription you may use the login form below to view the article. Access to this article can also be purchased.

Abstract

BACKGROUND AND PURPOSE: The Brain Tumor Reporting and Data System (BT-RADS) is a structured radiology reporting algorithm that was introduced to provide uniformity in posttreatment primary brain tumor follow-up and reporting, but its interrater reliability (IRR) assessment has not been widely studied. Our goal is to evaluate the IRR among neuroradiologists and radiology residents in the use of BT-RADS.

MATERIALS AND METHODS: This retrospective study reviewed 103 consecutive MR studies in 98 adult patients previously diagnosed with and treated for primary brain tumor (January 2019 to February 2019). Six readers with varied experience (4 neuroradiologists and 2 radiology residents) independently evaluated each case and assigned a BT-RADS score. Readers were blinded to the original score reports and the reports from other readers. Cases in which at least 1 neuroradiologist scored differently were subjected to consensus scoring. After the study, a post hoc reference score was also assigned by 2 readers by using future imaging and clinical information previously unavailable to readers. The interrater reliabilities were assessed by using the Gwet AC2 index with ordinal weights and percent agreement.

RESULTS: Of the 98 patients evaluated (median age, 53 years; interquartile range, 41–66 years), 53% were men. The most common tumor type was astrocytoma (77%) of which 56% were grade 4 glioblastoma. Gwet index for interrater reliability among all 6 readers was 0.83 (95% CI: 0.78–0.87). The Gwet index for the neuroradiologists’ group (0.84 [95% CI: 0.79–0.89]) was not statistically different from that for the residents’ group (0.79 [95% CI: 0.72–0.86]) (χ2 = 0.85; P = .36). All 4 neuroradiologists agreed on the same BT-RADS score in 57 of the 103 studies, 3 neuroradiologists agreed in 21 of the 103 studies, and 2 neuroradiologists agreed in 21 of the 103 studies. Percent agreement between neuroradiologist blinded scores and post hoc reference scores ranged from 41%–52%.

CONCLUSIONS: A very good interrater agreement was found when tumor reports were interpreted by independent blinded readers by using BT-RADS criteria. Further study is needed to determine if this high overall agreement can translate into greater consistency in clinical care.

ABBREVIATIONS:

BI-RADS
Breast Imaging Reporting and Data System
BT-RADS
Brain Tumor Reporting and Data System
IDH
isocitrate dehydrogenase
IQR
interquartile range
IRR
interrater reliability
WHO
World Health Organization
  • © 2024 by American Journal of Neuroradiology
View Full Text

Log in using your username and password

Forgot your user name or password?

Log in through your institution

You may be able to gain access using your login credentials for your institution. Contact your library if you do not have a username and password.
PreviousNext
Back to top

In this issue

American Journal of Neuroradiology: 45 (9)
American Journal of Neuroradiology
Vol. 45, Issue 9
1 Sep 2024
  • Table of Contents
  • Index by author
  • Complete Issue (PDF)
Advertisement
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Interrater Agreement of BT-RADS for Evaluation of Follow-up MRI in Patients with Treated Primary Brain Tumor
(Your Name) has sent you a message from American Journal of Neuroradiology
(Your Name) thought you would like to see the American Journal of Neuroradiology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Cite this article
Michael Essien, Maxwell E. Cooper, Ashwani Gore, Taejin L. Min, Benjamin B. Risk, Gelareh Sadigh, Ranliang Hu, Michael J. Hoch, Brent D. Weinberg
Interrater Agreement of BT-RADS for Evaluation of Follow-up MRI in Patients with Treated Primary Brain Tumor
American Journal of Neuroradiology Sep 2024, 45 (9) 1308-1315; DOI: 10.3174/ajnr.A8322

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
0 Responses
Respond to this article
Share
Bookmark this article
BTRADS Agreement in Follow-Up MRI for Brain Tumors
Michael Essien, Maxwell E. Cooper, Ashwani Gore, Taejin L. Min, Benjamin B. Risk, Gelareh Sadigh, Ranliang Hu, Michael J. Hoch, Brent D. Weinberg
American Journal of Neuroradiology Sep 2024, 45 (9) 1308-1315; DOI: 10.3174/ajnr.A8322
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Purchase

Jump to section

  • Article
    • Abstract
    • ABBREVIATIONS:
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSIONS
    • Footnotes
    • References
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Crossref (3)
  • Google Scholar

This article has been cited by the following articles in journals that are participating in Crossref Cited-by Linking.

  • Brain Tumor Reporting and Data System (BT-RADS) for the Surveillance of Adult-Type Diffuse Gliomas after Surgery
    Marco Parillo, Carlo Cosimo Quattrocchi
    Surgeries 2024 5 3
  • RANO 2.0 criteria: concepts applicable to the neuroradiologist's clinical practice
    Francesco Sanvito, Antonella Castellano, Timothy F. Cloughesy, Patrick Y. Wen, Benjamin M. Ellingson
    Current Opinion in Oncology 2024 36 6
  • Interrater Reliability Assessment of the Brain Tumor Reporting and Data System (BT-RADS)
    Netanja I. Harlianto
    Radiology: Imaging Cancer 2024 6 5

More in this TOC Section

  • Cognitive Control in Tumor Language Plasticity
  • Temporal Evolution of Vestibular schwannoma
  • CE MRI for Brain Metastasis Detection
Show more Brain Tumor Imaging

Similar Articles

Advertisement

Indexed Content

  • Current Issue
  • Accepted Manuscripts
  • Article Preview
  • Past Issues
  • Editorials
  • Editor's Choice
  • Fellows' Journal Club
  • Letters to the Editor
  • Video Articles

Cases

  • Case Collection
  • Archive - Case of the Week
  • Archive - Case of the Month
  • Archive - Classic Case

More from AJNR

  • Trainee Corner
  • Imaging Protocols
  • MRI Safety Corner

Multimedia

  • AJNR Podcasts
  • AJNR Scantastics

Resources

  • Turnaround Time
  • Submit a Manuscript
  • Submit a Video Article
  • Submit an eLetter to the Editor/Response
  • Manuscript Submission Guidelines
  • Statistical Tips
  • Fast Publishing of Accepted Manuscripts
  • Graphical Abstract Preparation
  • Imaging Protocol Submission
  • Evidence-Based Medicine Level Guide
  • Publishing Checklists
  • Author Policies
  • Become a Reviewer/Academy of Reviewers
  • News and Updates

About Us

  • About AJNR
  • Editorial Board
  • Editorial Board Alumni
  • Alerts
  • Permissions
  • Not an AJNR Subscriber? Join Now
  • Advertise with Us
  • Librarian Resources
  • Feedback
  • Terms and Conditions
  • AJNR Editorial Board Alumni

American Society of Neuroradiology

  • Not an ASNR Member? Join Now

© 2025 by the American Society of Neuroradiology All rights, including for text and data mining, AI training, and similar technologies, are reserved.
Print ISSN: 0195-6108 Online ISSN: 1936-959X

Powered by HighWire