PDF(Pubmed)
Abstract：
BACKGROUND: Patients find technology tools to be more approachable for seeking sensitive health-related information, such as reproductive health information. The inventive conversational ability of artificial intelligence (AI) chatbots, such as ChatGPT (OpenAI Inc), offers a potential means for patients to effectively locate answers to their health-related questions digitally.
OBJECTIVE: A pilot study was conducted to compare the novel ChatGPT with the existing Google Search technology for their ability to offer accurate, effective, and current information regarding proceeding action after missing a dose of oral contraceptive pill.
METHODS: A sequence of 11 questions, mimicking a patient inquiring about the action to take after missing a dose of an oral contraceptive pill, were input into ChatGPT as a cascade, given the conversational ability of ChatGPT. The questions were input into 4 different ChatGPT accounts, with the account holders being of various demographics, to evaluate potential differences and biases in the responses given to different account holders. The leading question, \"what should I do if I missed a day of my oral contraception birth control?\" alone was then input into Google Search, given its nonconversational nature. The results from the ChatGPT questions and the Google Search results for the leading question were evaluated on their readability, accuracy, and effective delivery of information.
RESULTS: The ChatGPT results were determined to be at an overall higher-grade reading level, with a longer reading duration, less accurate, less current, and with a less effective delivery of information. In contrast, the Google Search resulting answer box and snippets were at a lower-grade reading level, shorter reading duration, more current, able to reference the origin of the information (transparent), and provided the information in various formats in addition to text.
CONCLUSIONS: ChatGPT has room for improvement in accuracy, transparency, recency, and reliability before it can equitably be implemented into health care information delivery and provide the potential benefits it poses. However, AI may be used as a tool for providers to educate their patients in preferred, creative, and efficient ways, such as using AI to generate accessible short educational videos from health care provider-vetted information. Larger studies representing a diverse group of users are needed.
OBJECTIVE: A pilot study was conducted to compare the novel ChatGPT with the existing Google Search technology for their ability to offer accurate, effective, and current information regarding proceeding action after missing a dose of oral contraceptive pill.
METHODS: A sequence of 11 questions, mimicking a patient inquiring about the action to take after missing a dose of an oral contraceptive pill, were input into ChatGPT as a cascade, given the conversational ability of ChatGPT. The questions were input into 4 different ChatGPT accounts, with the account holders being of various demographics, to evaluate potential differences and biases in the responses given to different account holders. The leading question, \"what should I do if I missed a day of my oral contraception birth control?\" alone was then input into Google Search, given its nonconversational nature. The results from the ChatGPT questions and the Google Search results for the leading question were evaluated on their readability, accuracy, and effective delivery of information.
RESULTS: The ChatGPT results were determined to be at an overall higher-grade reading level, with a longer reading duration, less accurate, less current, and with a less effective delivery of information. In contrast, the Google Search resulting answer box and snippets were at a lower-grade reading level, shorter reading duration, more current, able to reference the origin of the information (transparent), and provided the information in various formats in addition to text.
CONCLUSIONS: ChatGPT has room for improvement in accuracy, transparency, recency, and reliability before it can equitably be implemented into health care information delivery and provide the potential benefits it poses. However, AI may be used as a tool for providers to educate their patients in preferred, creative, and efficient ways, such as using AI to generate accessible short educational videos from health care provider-vetted information. Larger studies representing a diverse group of users are needed.
摘要：
背景：患者发现技术工具更容易获取敏感的健康相关信息，如生殖健康信息。人工智能(AI)聊天机器人的创造性对话能力，比如ChatGPT,为患者提供了一种潜在的方法，可以在线有效地找到与健康相关的问题的答案。
目的：进行了一项初步研究，将新型ChatGPT与现有的Google搜索技术进行比较，有效,以及关于在错过口服避孕药（OCP）剂量后继续行动的最新信息。
方法：十一个问题的序列，模仿患者在错过一定剂量的OCP后询问要采取的行动，作为级联输入到ChatGPT中，考虑到ChatGPT的会话能力。这些问题被输入到四个不同的ChatGPT帐户中，帐户持有人具有各种人口统计特征，评估给予不同账户持有人的答复中的潜在差异和偏见。最主要的问题，“如果我错过了一天的口服避孕药，我该怎么办？”然后将其单独输入到Google搜索中，考虑到它的非对话性质。ChatGPT问题的结果和Google搜索结果对主要问题的可读性进行了评估，准确度,和有效的信息传递。
结果：ChatGPT结果被确定为整体较高年级阅读水平，更长的读取持续时间(表2)，不太准确，较小的电流,和一个不太有效的信息传递。相比之下,谷歌搜索结果答案框和片段处于较低的阅读水平，较短的阅读持续时间，电流更大,能够参考信息的来源(透明)，并提供了除文本之外的各种格式的信息。
结论：ChatGPT在准确性方面还有改进的空间，透明度，最近，和可靠性之前，它可以公平地实施到医疗保健信息交付，并提供潜在的好处，它带来。然而,AI可以用作提供者优先教育患者的工具，创造性,和有效的方法，例如使用AI从医疗保健提供者审查的信息中生成可访问的短教育视频。需要代表不同用户群的更大研究。
背景：
目的：进行了一项初步研究，将新型ChatGPT与现有的Google搜索技术进行比较，有效,以及关于在错过口服避孕药（OCP）剂量后继续行动的最新信息。
方法：十一个问题的序列，模仿患者在错过一定剂量的OCP后询问要采取的行动，作为级联输入到ChatGPT中，考虑到ChatGPT的会话能力。这些问题被输入到四个不同的ChatGPT帐户中，帐户持有人具有各种人口统计特征，评估给予不同账户持有人的答复中的潜在差异和偏见。最主要的问题，“如果我错过了一天的口服避孕药，我该怎么办？”然后将其单独输入到Google搜索中，考虑到它的非对话性质。ChatGPT问题的结果和Google搜索结果对主要问题的可读性进行了评估，准确度,和有效的信息传递。
结果：ChatGPT结果被确定为整体较高年级阅读水平，更长的读取持续时间(表2)，不太准确，较小的电流,和一个不太有效的信息传递。相比之下,谷歌搜索结果答案框和片段处于较低的阅读水平，较短的阅读持续时间，电流更大,能够参考信息的来源(透明)，并提供了除文本之外的各种格式的信息。
结论：ChatGPT在准确性方面还有改进的空间，透明度，最近，和可靠性之前，它可以公平地实施到医疗保健信息交付，并提供潜在的好处，它带来。然而,AI可以用作提供者优先教育患者的工具，创造性,和有效的方法，例如使用AI从医疗保健提供者审查的信息中生成可访问的短教育视频。需要代表不同用户群的更大研究。
背景：
