Deiana, Giovanna; Dettori, Marco; Arghittu, Antonella; Azara, Antonio; Gabutti, Giovanni; Castiglia, Paolo (2023). Artificial Intelligence and Public Health: Evaluating ChatGPT Responses to Vaccination Myths and Misconceptions. Vaccines, 11(7) MDPI 10.3390/vaccines11071217
|
Text
vaccines-11-01217-v3.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (301kB) | Preview |
Artificial intelligence (AI) tools, such as ChatGPT, are the subject of intense debate regarding their possible applications in contexts such as health care. This study evaluates the Correctness, Clarity, and Exhaustiveness of the answers provided by ChatGPT on the topic of vaccination. The World Health Organization's 11 "myths and misconceptions" about vaccinations were administered to both the free (GPT-3.5) and paid version (GPT-4.0) of ChatGPT. The AI tool's responses were evaluated qualitatively and quantitatively, in reference to those myth and misconceptions provided by WHO, independently by two expert Raters. The agreement between the Raters was significant for both versions (p of K < 0.05). Overall, ChatGPT responses were easy to understand and 85.4% accurate although one of the questions was misinterpreted. Qualitatively, the GPT-4.0 responses were superior to the GPT-3.5 responses in terms of Correctness, Clarity, and Exhaustiveness (Δ = 5.6%, 17.9%, 9.3%, respectively). The study shows that, if appropriately questioned, AI tools can represent a useful aid in the health care field. However, when consulted by non-expert users, without the support of expert medical advice, these tools are not free from the risk of eliciting misleading responses. Moreover, given the existing social divide in information access, the improved accuracy of answers from the paid version raises further ethical issues.
Item Type: |
Journal Article (Original Article) |
|---|---|
Division/Institute: |
04 Faculty of Medicine > School of Dental Medicine > Department of Preventive, Restorative and Pediatric Dentistry |
Subjects: |
600 Technology > 610 Medicine & health |
ISSN: |
2076-393X |
Publisher: |
MDPI |
Language: |
English |
Submitter: |
Pubmed Import |
Date Deposited: |
31 Jul 2023 13:00 |
Last Modified: |
01 Aug 2023 10:46 |
Publisher DOI: |
10.3390/vaccines11071217 |
PubMed ID: |
37515033 |
Uncontrolled Keywords: |
ChatGPT artificial intelligence immunization myths and misconceptions public health vaccines |
BORIS DOI: |
10.48350/185126 |
URI: |
https://boris.unibe.ch/id/eprint/185126 |
Actions (login required)
 |
Edit item |