METHODS: Ten frequently asked questions (FAQ) about the IPP procedure were presented to the ChatGPT chatbot in separate conversational sessions without follow up questions or repetitions. An evidence-based approach was employed to assess the accuracy of the chatbot\'s responses. Responses were categorized as \"excellent response not requiring clarification,\" \"satisfactory requiring minimal clarification,\" \"satisfactory requiring moderate clarification,\" or \"unsatisfactory requiring substantial clarification.\"
RESULTS: Upon review, 70% of ChatGPT\'s answers to questions regarding the IPP procedure were rated as \"excellent,\" not necessitating further clarification. Twenty percent were considered \"satisfactory,\" requiring minimal clarification, notably on the omission of statistical data and the depth of discussion on certain topics. Ten percent of the responses were \"unsatisfactory,\" requiring substantial clarification, including a failure to provide a definitive answer when necessary.
CONCLUSIONS: This study reveals that ChatGPT has a substantial capability to produce evidence-based, understandable responses to a majority of common questions related to the IPP procedure. While there is room for improvement, ChatGPT can serve as an advantageous tool for patient education, enhancing preoperative understanding and contributing to informed decision-making during urological consultations for IPP.
方法:关于IPP程序的十个常见问题(FAQ)在单独的会话中呈现给ChatGPT聊天机器人,没有后续问题或重复。采用基于证据的方法来评估聊天机器人响应的准确性。回应被归类为“优秀的回应,不需要澄清,“\”令人满意,需要最少的澄清,“\”令人满意,需要适度澄清,“或”不令人满意,需要大量澄清。\"
结果:经审核,ChatGPT对有关IPP程序的问题的回答中有70%被评为“优秀”,“不需要进一步澄清。20%的人认为“令人满意”,“需要最少的澄清,特别是对统计数据的遗漏和对某些主题的深入讨论。百分之十的回答是“不满意,“需要大量澄清,包括在必要时未能提供明确的答案。
结论:这项研究表明,ChatGPT具有足够的能力来产生基于证据的,对与IPP程序相关的大多数常见问题的可理解的回答。虽然还有改进的空间,ChatGPT可以作为患者教育的有利工具,加强术前理解,并有助于在IPP泌尿外科会诊期间做出知情决策。