Affordable Access

Publisher Website

A comparison of ChatGPT-generated articles with human-written articles.

Authors
  • Ariyaratne, Sisith1
  • Iyengar, Karthikeyan P2
  • Nischal, Neha3
  • Chitti Babu, Naparla4
  • Botchu, Rajesh5
  • 1 Department of Musculoskeletal Radiology, The Royal Orthopedic Hospital, Bristol Road South, Northfield, Birmingham, UK.
  • 2 Department of Orthopedics, Southport and Ormskirk Hospital, Southport, UK.
  • 3 Department of Radiology, Holy Family Hospital, New Delhi, India. , (India)
  • 4 Department of Radiology, Srinivas Institute of Medical Sciences & Research Centre, Mukka, Mangalore, India. , (India)
  • 5 Department of Musculoskeletal Radiology, The Royal Orthopedic Hospital, Bristol Road South, Northfield, Birmingham, UK. [email protected].
Type
Published Article
Journal
Skeletal Radiology
Publisher
Springer-Verlag
Publication Date
Sep 01, 2023
Volume
52
Issue
9
Pages
1755–1758
Identifiers
DOI: 10.1007/s00256-023-04340-5
PMID: 37059827
Source
Medline
Keywords
Language
English
License
Unknown

Abstract

ChatGPT (Generative Pre-trained Transformer) is an artificial intelligence language tool developed by OpenAI that utilises machine learning algorithms to generate text that closely mimics human language. It has recently taken the internet by storm. There have been several concerns regarding the accuracy of documents it generates. This study compares the accuracy and quality of several ChatGPT-generated academic articles with those written by human authors. We performed a study to assess the accuracy of ChatGPT-generated radiology articles by comparing them with the published or written, and under review articles. These were independently analysed by two fellowship-trained musculoskeletal radiologists and graded from 1 to 5 (1 being bad and inaccurate to 5 being excellent and accurate). In total, 4 of the 5 articles written by ChatGPT were significantly inaccurate with fictitious references. One of the papers was well written, with a good introduction and discussion; however, all references were fictitious. ChatGPT is able to generate coherent research articles, which on initial review may closely resemble authentic articles published by academic researchers. However, all of the articles we assessed were factually inaccurate and had fictitious references. It is worth noting, however, that the articles generated may appear authentic to an untrained reader. © 2023. The Author(s), under exclusive licence to International Skeletal Society (ISS).

Report this publication

Statistics

Seen <100 times