Abstract:
We evaluated whether the artificial intelligence chatbot ChatGPT can adequately answer patient questions related to [18F]FDG PET/CT in common clinical indications before and after scanning. Methods: Thirteen questions regarding [18F]FDG PET/CT were submitted to ChatGPT. ChatGPT was also asked to explain 6 PET/CT reports (lung cancer, Hodgkin lymphoma) and answer 6 follow-up questions (e.g., on tumor stage or recommended treatment). To be rated \"useful\" or \"appropriate,\" a response had to be adequate by the standards of the nuclear medicine staff. Inconsistency was assessed by regenerating responses. Results: Responses were rated \"appropriate\" for 92% of 25 tasks and \"useful\" for 96%. Considerable inconsistencies were found between regenerated responses for 16% of tasks. Responses to 83% of sensitive questions (e.g., staging/treatment options) were rated \"empathetic.\" Conclusion: ChatGPT might adequately substitute for advice given to patients by nuclear medicine staff in the investigated settings. Improving the consistency of ChatGPT would further increase reliability.
摘要:
我们评估了人工智能聊天机器人ChatGPT是否可以在扫描前后充分回答与[18F]FDGPET/CT相关的患者问题。方法:向ChatGPT提交关于[18F]FDGPET/CT的13个问题。ChatGPT还被要求解释6份PET/CT报告(肺癌,霍奇金淋巴瘤)并回答6个后续问题(例如,在肿瘤分期或推荐治疗中)。被评为“有用”或“适当”,“按照核医学工作人员的标准,回应必须是足够的。通过再生反应评估不一致性。结果:在25项任务中,92%的响应被评为“适当”,96%的响应被评为“有用”。在16%的任务的再生响应之间发现了相当大的不一致。回答83%的敏感问题(例如,分期/治疗方案)被评为“同情”。“结论:ChatGPT可能足以替代核医学人员在被调查环境中给予患者的建议。改善ChatGPT的一致性将进一步提高可靠性。