healthneutral

ChatGPT's Role in Spinal Surgery Education: A Mixed Bag

Friday, July 11, 2025
Advertisement

The Challenge

  • Adult Spinal Deformity (ASD) affects 68% of older adults.
  • Surgery can help, but complications occur in up to 50% of cases.
  • Patient education is crucial, but doctors have limited time.

The Solution? ChatGPT-3.5

  • A language learning model tested on 19 common patient questions about ASD surgery.
  • Three spine surgeons evaluated the answers for accuracy and readability.

Topics Covered

  1. Preparation for Surgery
  2. Recovery
  3. Lifestyle Changes
  4. Post-Surgery Outcomes

The Results

  • Preparation & Recovery Answers:
  • Average Scores: 1.67 & 1.33 (respectively).
  • Post-Surgery Answers:
  • Average Score: 2.0.
  • Overall Accuracy:
  • 59.7% Excellent
  • 26.3% Satisfactory
  • 12.3% Needed Clarification
  • 1.8% Unsatisfactory
  • One Answer (about pain recurrence) was deemed inaccurate by all reviewers.

Readability Issues

  • Flesch-Kincaid Grade Level showed all responses were too complex.
  • Average Reading Level: 5.91 grades above the recommended 8th-grade level.

The Verdict

  • Potential as a patient education tool, but not perfect.
  • Varying accuracy and complex language may limit usefulness for those with lower health literacy.
  • Not a replacement for doctor-patient communication.

Actions