Division of General Pediatrics, Boston Children's Hospital, Boston, MA, United States.
Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States.
JMIR Form Res. 2024 Sep 12;8:e56797. doi: 10.2196/56797.
The public launch of OpenAI's ChatGPT platform generated immediate interest in the use of large language models (LLMs). Health care institutions are now grappling with establishing policies and guidelines for the use of these technologies, yet little is known about how health care providers view LLMs in medical settings. Moreover, there are no studies assessing how pediatric providers are adopting these readily accessible tools.
The aim of this study was to determine how pediatric providers are currently using LLMs in their work as well as their interest in using a Health Insurance Portability and Accountability Act (HIPAA)-compliant version of ChatGPT in the future.
A survey instrument consisting of structured and unstructured questions was iteratively developed by a team of informaticians from various pediatric specialties. The survey was sent via Research Electronic Data Capture (REDCap) to all Boston Children's Hospital pediatric providers. Participation was voluntary and uncompensated, and all survey responses were anonymous.
Surveys were completed by 390 pediatric providers. Approximately 50% (197/390) of respondents had used an LLM; of these, almost 75% (142/197) were already using an LLM for nonclinical work and 27% (52/195) for clinical work. Providers detailed the various ways they are currently using an LLM in their clinical and nonclinical work. Only 29% (n=105) of 362 respondents indicated that ChatGPT should be used for patient care in its present state; however, 73.8% (273/368) reported they would use a HIPAA-compliant version of ChatGPT if one were available. Providers' proposed future uses of LLMs in health care are described.
Despite significant concerns and barriers to LLM use in health care, pediatric providers are already using LLMs at work. This study will give policy makers needed information about how providers are using LLMs clinically.
OpenAI 的 ChatGPT 平台的公开推出立即引起了人们对大型语言模型（LLM）的使用兴趣。医疗机构现在正在努力制定这些技术的使用政策和指南，但对于医疗环境中医疗保健提供者如何看待 LLM 知之甚少。此外，尚无研究评估儿科医生如何采用这些易于访问的工具。
本研究旨在确定儿科医生目前在工作中如何使用 LLM，以及他们对未来使用符合《健康保险流通与责任法案》（HIPAA）的 ChatGPT 的兴趣。
由来自各种儿科专业的信息学人员组成的团队迭代开发了一份包含结构化和非结构化问题的调查工具。该调查通过 Research Electronic Data Capture（REDCap）发送给所有波士顿儿童医院的儿科医生。参与是自愿的，没有报酬，所有调查回复都是匿名的。
共有 390 名儿科医生完成了调查。约 50%（197/390）的受访者使用过 LLM；其中，近 75%（142/197）已经将 LLM 用于非临床工作，27%（52/195）用于临床工作。医生详细介绍了他们目前在临床和非临床工作中使用 LLM 的各种方式。只有 29%（n=105）的 362 名受访者表示，在目前的状态下，ChatGPT 应该用于患者护理；然而，如果有符合 HIPAA 的 ChatGPT，73.8%（273/368）的人表示他们会使用。还描述了提供者对 LLM 在医疗保健中的未来使用的建议。
尽管在医疗保健中使用 LLM 存在重大问题和障碍，但儿科医生已经在工作中使用 LLM。这项研究将为决策者提供有关提供者如何在临床实践中使用 LLM 的必要信息。
