Skip to main content
Advertisement

Main menu

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • Low-Field MRI
    • Alzheimer Disease
    • ASNR Foundation Special Collection
    • Photon-Counting CT
    • View All
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home

User menu

  • Alerts
  • Log in

Search

  • Advanced search
American Journal of Neuroradiology
American Journal of Neuroradiology

American Journal of Neuroradiology

ASHNR American Society of Functional Neuroradiology ASHNR American Society of Pediatric Neuroradiology ASSR
  • Alerts
  • Log in

Advanced Search

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • Low-Field MRI
    • Alzheimer Disease
    • ASNR Foundation Special Collection
    • Photon-Counting CT
    • View All
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home
  • Follow AJNR on Twitter
  • Visit AJNR on Facebook
  • Follow AJNR on Instagram
  • Join AJNR on LinkedIn
  • RSS Feeds

AJNR Awards, New Junior Editors, and more. Read the latest AJNR updates

Research ArticleORIGINAL RESEARCH

Artificial Intelligence-Generated Editorials in Radiology: Can Expert Editors Detect Them?

Burak Berksu Ozkara, Alexandre Boutet, Bryan A. Comstock, Johan Van Goethem, Thierry A.G.M. Huisman, Jeffrey S. Ross, Luca Saba, Lubdha M. Shah, Max Wintermark and Mauricio Castillo
American Journal of Neuroradiology September 2024, ajnr.A8505; DOI: https://doi.org/10.3174/ajnr.A8505
Burak Berksu Ozkara
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexandre Boutet
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bryan A. Comstock
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Johan Van Goethem
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thierry A.G.M. Huisman
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jeffrey S. Ross
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Luca Saba
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lubdha M. Shah
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Max Wintermark
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mauricio Castillo
From the Department of Neuroradiology (B.B.O., M.W.), MD Anderson Cancer Center, Houston, TX, USA; Joint Department of Medical Imaging (A.B.), University of Toronto, Toronto, ON, Canada; Department of Biostatistics (B.A. C.), University of Washington, Seattle, WA, USA; Department of Radiology (J.V.G.), Antwerp University Hospital, Antwerp, Belgium; Department of Radiology (T.A.G.M.H.), Texas Children's Hospital and Baylor College of Medicine, Houston, TX, USA; Department of Radiology (J.S.R.), Mayo Clinic Arizona, Phoenix, AZ, USA; Department of Radiology (L.S.), University of Cagliari, Cagliari, Italy; Department of Radiology (L.M.S.), University of Utah, Salt Lake City, UT, USA; Department of Radiology (M.C.), University of North Carolina School of Medicine, Chapel Hill, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Supplemental
  • Info & Metrics
  • Responses
  • PDF
Loading

This article requires a subscription to view the full text. If you have a subscription you may use the login form below to view the article. Access to this article can also be purchased.

ABSTRACT

BACKGROUND AND PURPOSE: We aimed to evaluate GPT-4's ability to write radiology editorials and to compare these with human-written counterparts, thereby determining their real-world applicability for scientific writing.

MATERIALS AND METHODS: Sixteen editorials from eight journals were included. To generate the AI-written editorials, the summary of 16 human-written editorials was fed into GPT-4. Six experienced editors reviewed the articles. First, an unpaired approach was used. The raters were asked to evaluate the content of each article using a 1-5 Likert scale across specified metrics. Then, they determined whether the editorials were written by humans or AI. The articles were then evaluated in pairs to determine which article was generated by AI and which should be published. Finally, the articles were analyzed with an AI detector and for plagiarism.

RESULTS: The human-written articles had a median AI probability score of 2.0%, whereas the AI-written articles had 58%. The median similarity score among AI-written articles was 3%. 58% of unpaired articles were correctly classified regarding authorship. Rating accuracy was increased to 70% in the paired setting. AI-written articles received slightly higher scores in most metrics. When stratified by perception, human-written perceived articles were rated higher in most categories. In the paired setting, raters strongly preferred publishing the article they perceived as human-written (82%).

CONCLUSIONS: GPT-4 can write high-quality articles that iThenticate does not flag as plagiarized, which may go undetected by editors, and that detection tools can detect to a limited extent. Editors showed a positive bias toward human-written articles.

ABBREVIATIONS: AI = Artificial intelligence; LLM = large language model; SD = standard deviation.

Footnotes

  • The authors declare no conflicts of interest related to the content of this article.

  • © 2024 by American Journal of Neuroradiology

Log in using your username and password

Forgot your user name or password?

Log in through your institution

You may be able to gain access using your login credentials for your institution. Contact your library if you do not have a username and password.
PreviousNext
Back to top
Advertisement
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Artificial Intelligence-Generated Editorials in Radiology: Can Expert Editors Detect Them?
(Your Name) has sent you a message from American Journal of Neuroradiology
(Your Name) thought you would like to see the American Journal of Neuroradiology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Cite this article
Accepted Manuscript
Burak Berksu Ozkara, Alexandre Boutet, Bryan A. Comstock, Johan Van Goethem, Thierry A.G.M. Huisman, Jeffrey S. Ross, Luca Saba, Lubdha M. Shah, Max Wintermark, Mauricio Castillo
Artificial Intelligence-Generated Editorials in Radiology: Can Expert Editors Detect Them?
American Journal of Neuroradiology Sep 2024, ajnr.A8505; DOI: 10.3174/ajnr.A8505

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
0 Responses
Respond to this article
Share
Bookmark this article
Accepted Manuscript
Artificial Intelligence-Generated Editorials in Radiology: Can Expert Editors Detect Them?
Burak Berksu Ozkara, Alexandre Boutet, Bryan A. Comstock, Johan Van Goethem, Thierry A.G.M. Huisman, Jeffrey S. Ross, Luca Saba, Lubdha M. Shah, Max Wintermark, Mauricio Castillo
American Journal of Neuroradiology Sep 2024, ajnr.A8505; DOI: 10.3174/ajnr.A8505
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Purchase

Jump to section

  • Article
  • Supplemental
  • Info & Metrics
  • Responses
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Crossref (1)
  • Google Scholar

This article has been cited by the following articles in journals that are participating in Crossref Cited-by Linking.

  • The Surge of Artificial Intelligence (AI) in Scientific Writing: Who Will Hold the Rudder, You or AI?
    Kee Hyung Rhyu
    Hip & Pelvis 2024 36 4

More in this TOC Section

  • CT Perfusion Map Generation from Multi-phase CT Angiography Using Generative adversarial model for Acute Ischemic Stroke
  • Digital Subtraction Myelography for the Detection of Type 1 Spinal CSF Leaks: Evaluation of Temporal Characteristics and Diagnostic Value
  • Glymphatic Function as a Moderator in White Matter Injury and Cognitive Impairment: A Community-Dwelling Cohort Study
Show more ORIGINAL RESEARCH

Similar Articles

Advertisement

Indexed Content

  • Current Issue
  • Accepted Manuscripts
  • Article Preview
  • Past Issues
  • Editorials
  • Editor's Choice
  • Fellows' Journal Club
  • Letters to the Editor
  • Video Articles

Cases

  • Case Collection
  • Archive - Case of the Week
  • Archive - Case of the Month
  • Archive - Classic Case

More from AJNR

  • Trainee Corner
  • Imaging Protocols
  • MRI Safety Corner

Multimedia

  • AJNR Podcasts
  • AJNR Scantastics

Resources

  • Turnaround Time
  • Submit a Manuscript
  • Submit a Video Article
  • Submit an eLetter to the Editor/Response
  • Manuscript Submission Guidelines
  • Statistical Tips
  • Fast Publishing of Accepted Manuscripts
  • Graphical Abstract Preparation
  • Imaging Protocol Submission
  • Evidence-Based Medicine Level Guide
  • Publishing Checklists
  • Author Policies
  • Become a Reviewer/Academy of Reviewers
  • News and Updates

About Us

  • About AJNR
  • Editorial Board
  • Editorial Board Alumni
  • Alerts
  • Permissions
  • Not an AJNR Subscriber? Join Now
  • Advertise with Us
  • Librarian Resources
  • Feedback
  • Terms and Conditions
  • AJNR Editorial Board Alumni

American Society of Neuroradiology

  • Not an ASNR Member? Join Now

© 2025 by the American Society of Neuroradiology All rights, including for text and data mining, AI training, and similar technologies, are reserved.
Print ISSN: 0195-6108 Online ISSN: 1936-959X

Powered by HighWire