Background The integration of ChatGPT, a large language model (LLM) developed by OpenAI, into healthcare has sparked significant interest due to its potential to enhance patient care and medical education. With the increasing trend of patients accessing laboratory results online, there is a pressing need to evaluate the effectiveness of ChatGPT in providing accurate laboratory medicine information. Our study evaluates ChatGPT's effectiveness in addressing patient questions in this area, comparing its performance with that of medical professionals on social media. Methods This study sourced patient questions and medical professional responses from Reddit and Quora, comparing them with responses generated by ChatGPT versions 3.5 and 4.0. Experienced laboratory medicine professionals evaluated the responses for quality and preference. Evaluation results were further analyzed using R software. Results The study analyzed 49 questions, with evaluators reviewing responses from both medical professionals and ChatGPT. ChatGPT's responses were preferred by 75.9% of evaluators and generally received higher ratings for quality. They were noted for their comprehensive and accurate information, whereas responses from medical professionals were valued for their conciseness. The interrater agreement was fair, indicating some subjectivity but a consistent preference for ChatGPT's detailed responses. Conclusions ChatGPT demonstrates potential as an effective tool for addressing queries in laboratory medicine, often surpassing medical professionals in response quality. These results support the need for further research to confirm ChatGPT's utility and explore its integration into healthcare settings.

中文翻译：

---

ChatGPT vs Medical Professional：分析社交媒体上对实验室医学问题的回答


背景由 OpenAI 开发的大型语言模型 ChatGPT （LLM） 集成到医疗保健中，由于其在增强患者护理和医学教育方面的潜力而引起了人们的极大兴趣。随着患者在线访问实验室结果的趋势越来越多，迫切需要评估 ChatGPT 在提供准确的实验室医学信息方面的有效性。我们的研究评估了 ChatGPT 在解决该领域患者问题方面的有效性，将其与医疗专业人员在社交媒体上的表现进行了比较。方法 本研究从 Reddit 和 Quora 获取患者问题和医疗专业人员的回答，将它们与 ChatGPT 3.5 和 4.0 版生成的回答进行比较。经验丰富的实验室医学专业人员评估了反应的质量和偏好。使用 R 软件进一步分析评估结果。结果 该研究分析了 49 个问题，评估人员审查了医疗专业人员和 ChatGPT 的回答。75.9% 的评估者更喜欢 ChatGPT 的回答，并且通常获得更高的质量评分。它们以其全面和准确的信息而受到关注，而医疗专业人员的回答则因其简洁而受到重视。评分者之间的一致性是公平的，表明存在一些主观性，但始终倾向于 ChatGPT 的详细回答。结论 ChatGPT 显示出作为解决实验室医学查询的有效工具的潜力，在响应质量方面通常超过医疗专业人员。这些结果支持需要进一步研究以确认 ChatGPT 的效用并探索其与医疗保健环境的整合。