Abstract:
The chatbot Chat Generative Pretrained Transformer (ChatGPT) is becoming increasingly popular among patients for searching health-related information. Prior studies have raised concerns regarding accuracy in offering nutritional advice. We investigated in November 2023 ChatGPT\'s potential as a tool for providing nutritional guidance in relation to different non-communicable diseases (NCDs). First, the dietary advice given by ChatGPT (version 3.5) for various NCDs was compared with guidelines; then, the chatbot\'s capacity to manage a complex case with several diseases was investigated. A panel of nutrition experts assessed ChatGPT\'s responses. Overall, ChatGPT offered clear advice, with appropriateness of responses ranging from 55.5% (sarcopenia) to 73.3% (NAFLD). Only two recommendations (one for obesity, one for non-alcoholic-fatty-liver disease) contradicted guidelines. A single suggestion for T2DM was found to be \"unsupported\", while many recommendations for various NCDs were deemed to be \"not fully matched\" to the guidelines despite not directly contradicting them. However, when the chatbot handled overlapping conditions, limitations emerged, resulting in some contradictory or inappropriate advice. In conclusion, although ChatGPT exhibited a reasonable accuracy in providing general dietary advice for NCDs, its efficacy decreased in complex situations necessitating customized strategies; therefore, the chatbot is currently unable to replace a healthcare professional\'s consultation.
摘要:
聊天机器人聊天生成预训练变压器(ChatGPT)在患者中越来越受欢迎,用于搜索与健康相关的信息。先前的研究已经引起了人们对提供营养建议的准确性的担忧。我们在2023年11月调查了ChatGPT作为一种针对不同非传染性疾病(NCDs)提供营养指导的工具的潜力。首先,将ChatGPT(3.5版)针对各种非传染性疾病提供的饮食建议与指南进行比较;然后,chatbot的能力,以管理一个复杂的病例与几种疾病进行了调查。一组营养专家评估了ChatGPT的反应。总的来说,ChatGPT提供了明确的建议,反应的适当性范围从55.5%(肌少症)到73.3%(NAFLD)。只有两个建议(一个针对肥胖,一种用于非酒精性脂肪性肝病)与指南相矛盾。发现T2DM的单个建议为“不受支持”,虽然许多关于各种非传染性疾病的建议被认为与指南“不完全匹配”,尽管它们没有直接矛盾。然而,当聊天机器人处理重叠条件时,局限性出现了,导致一些矛盾或不恰当的建议。总之,尽管ChatGPT在为非传染性疾病提供一般饮食建议方面表现出合理的准确性,在需要定制策略的复杂情况下,其功效下降;因此,聊天机器人目前无法取代医疗保健专业的咨询。