How Good Is ChatGPT for Medication Evidence Synthesis? Academic Article uri icon

Overview

abstract

  • With its seeming competence to mimic human responses, ChatGPT, an emerging AI-powered chatbot, has spurred great interest. This study aims to explore the role of ChatGPT in synthesizing medication literature and compare it with a hybrid summarization system. We tested ten medications' effectiveness with reference to their definitions and descriptions extracted from DrugBank. ChatGPT could generate coherent summaries that are not backed by evidence. In contrast, our approach can provide a highly structured and concise synthesis of related evidence, but the resulting summary is not as fluent and convincing as ChatGPT. Therefore, we recommend integrating both techniques to achieve the best performance.

publication date

  • May 18, 2023

Research

keywords

  • Artificial Intelligence
  • Software

Identity

Scopus Document Identifier

  • 85159768320

Digital Object Identifier (DOI)

  • 10.3233/SHTI230347

PubMed ID

  • 37203581

Additional Document Info

volume

  • 302