PDF(Pubmed)
Abstract：
BACKGROUND: Guidelines must be interpreted comprehensively and correctly to standardize the clinical process. However, this process is challenging and requires interpreters to have a medical background and qualifications. In this study, the accuracy of ChatGPT3.5 in answering clinical questions related to the 2019 guidelines for severe acute pancreatitis was evaluated.
RESULTS: An observational study was conducted using the 2019 guidelines for severe acute pancreatitis. The study compared the accuracy of ChatGPT3.5 in English versus Chinese and found that it was more accurate in English (71%) than in Chinese (59%) (P value: 0.203). Additionally, the study assessed the accuracy of ChatGPT3.5 in answering short-answer questions versus true/false questions and found that it was more accurate in answering short-answer questions (76%) than in answering true/false questions (60%) (P value: 0.405).
CONCLUSIONS: For clinicians managing severe acute pancreatitis, ChatGPT3.5 may have potential value. However, it should not be relied upon excessively for clinical decision making.
RESULTS: An observational study was conducted using the 2019 guidelines for severe acute pancreatitis. The study compared the accuracy of ChatGPT3.5 in English versus Chinese and found that it was more accurate in English (71%) than in Chinese (59%) (P value: 0.203). Additionally, the study assessed the accuracy of ChatGPT3.5 in answering short-answer questions versus true/false questions and found that it was more accurate in answering short-answer questions (76%) than in answering true/false questions (60%) (P value: 0.405).
CONCLUSIONS: For clinicians managing severe acute pancreatitis, ChatGPT3.5 may have potential value. However, it should not be relied upon excessively for clinical decision making.
摘要：
背景：必须全面，正确地解释指南，以规范临床过程。然而,这一过程具有挑战性，需要口译员具有医学背景和资格。在这项研究中,评估了ChatGPT3.5回答与2019年重症急性胰腺炎指南相关的临床问题的准确性.
结果：使用2019年重症急性胰腺炎指南进行了一项观察性研究。该研究比较了ChatGPT3.5在英语和汉语中的准确性，发现它在英语中（71％）比在汉语中（59％）更准确（P值：0.203）。此外,该研究评估了ChatGPT3.5回答简答题与真/假问题的准确性,发现它回答简答题(76%)比回答真/假问题(60%)更准确(P值:0.405).
结论：对于重症急性胰腺炎的临床医生，ChatGPT3.5可能具有潜在价值。然而,临床决策不应过分依赖它。
结果：使用2019年重症急性胰腺炎指南进行了一项观察性研究。该研究比较了ChatGPT3.5在英语和汉语中的准确性，发现它在英语中（71％）比在汉语中（59％）更准确（P值：0.203）。此外,该研究评估了ChatGPT3.5回答简答题与真/假问题的准确性,发现它回答简答题(76%)比回答真/假问题(60%)更准确(P值:0.405).
结论：对于重症急性胰腺炎的临床医生，ChatGPT3.5可能具有潜在价值。然而,临床决策不应过分依赖它。
