Weinstein Julien B, Hogan Cainnear K, Whittington Taylor, Cano Jennifer, Seelye Sarah M, Sussman Jeremy B, Bernstein Steven J, Prescott Hallie C
Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, USA.
Veterans Affairs Center for Clinical Management Research, Ann Arbor, MI, USA.
BMC Res Notes. 2025 Jul 31;18(1):337. doi: 10.1186/s13104-025-07409-7.
The Modified Delphi panel process involves iterative ratings, often with lengthy lags between rounds to allow time for data analysis. We sought to develop, implement, and evaluate an approach for real-time data analysis and presentation to complete multiple rounds of ratings in a single panel meeting.
We developed statistical code in Python to analyze Delphi panel ratings completed in Slido using a 9-point Likert scale. The code generates histograms of panel ratings. The median score is color-coded pink when formal disagreement criteria are met (regardless of median score), and when there is no disagreement, red for median scores of 1-3, yellow for 4-6, and green for 7-9. We implemented this approach for a Delphi panel on sepsis recovery that rated three sets of care practices. Round 1 rating, panel discussion, and round 2 rating all occurred in one day for each set of practices. Round 1 ratings were presented during discussion. This approach avoided "homework" outside meetings. All panelists either strongly agreed (57%) or agreed (43%) it was easy to understand the presentation of round 1 ratings. Most panelists either strongly agreed (50%) or agreed (21%) that they liked doing both rounds of rating during the meetings.
改良德尔菲专家小组流程涉及反复评分，各轮之间通常有较长间隔时间以便进行数据分析。我们试图开发、实施并评估一种实时数据分析和展示方法，以便在一次专家小组会议中完成多轮评分。
我们用Python编写了统计代码，以分析在Slido上使用9点李克特量表完成的德尔菲专家小组评分。该代码生成专家小组评分的直方图。当满足正式的分歧标准时（无论中位数分数如何），中位数分数用粉色编码；当不存在分歧时，1 - 3分的中位数分数用红色编码，4 - 6分用黄色编码，7 - 9分用绿色编码。我们将这种方法应用于一个关于脓毒症康复的德尔菲专家小组，该小组对三组护理措施进行了评分。对于每组措施，第一轮评分、小组讨论和第二轮评分均在一天内完成。第一轮评分在讨论期间展示。这种方法避免了会议之外的“作业”。所有小组成员要么强烈同意（57%），要么同意（43%）第一轮评分的展示很容易理解。大多数小组成员要么强烈同意（50%），要么同意（21%）他们喜欢在会议期间完成两轮评分。
