儿科心理学中接受者操作特征分析与诊断效率统计入门：我们准备好进行ROC分析了。
A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: we are ready to ROC.
作者信息
Youngstrom Eric A
机构信息
PhD, Department of Psychology, University of North Carolina at Chapel Hill, Davie Hall CB 3270, Chapel Hill, NC 27599-3270, USA.
出版信息
J Pediatr Psychol. 2014 Mar;39(2):204-21. doi: 10.1093/jpepsy/jst062. Epub 2013 Aug 21.
Abstract
OBJECTIVE
To offer a practical demonstration of receiver operating characteristic (ROC) analyses, diagnostic efficiency statistics, and their application to clinical decision making using a popular parent checklist to assess for potential mood disorder.
METHOD
Secondary analyses of data from 589 families seeking outpatient mental health services, completing the Child Behavior Checklist and semi-structured diagnostic interviews.
RESULTS
Internalizing Problems raw scores discriminated mood disorders significantly better than did age- and gender-normed T scores, or an Affective Problems score. Internalizing scores <8 had a diagnostic likelihood ratio <0.3, and scores >30 had a diagnostic likelihood ratio of 7.4.
CONCLUSIONS
This study illustrates a series of steps in defining a clinical problem, operationalizing it, selecting a valid study design, and using ROC analyses to generate statistics that support clinical decisions. The ROC framework offers important advantages for clinical interpretation. Appendices include sample scripts using SPSS and R to check assumptions and conduct ROC analyses.
摘要
目的
通过使用一份广为人知的家长清单来评估潜在的情绪障碍，对接受者操作特征（ROC）分析、诊断效率统计及其在临床决策中的应用进行实际演示。
方法
对589个寻求门诊心理健康服务、完成儿童行为清单和半结构化诊断访谈的家庭的数据进行二次分析。
结果
内化问题原始分数对情绪障碍的区分能力明显优于年龄和性别标准化T分数或情感问题分数。内化分数<8时诊断似然比<0.3，分数>30时诊断似然比为7.4。
结论
本研究阐述了定义临床问题、将其操作化、选择有效研究设计以及使用ROC分析生成支持临床决策的统计数据的一系列步骤。ROC框架为临床解释提供了重要优势。附录包括使用SPSS和R检查假设并进行ROC分析的示例脚本。
相似文献
1
A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: we are ready to ROC.儿科心理学中接受者操作特征分析与诊断效率统计入门：我们准备好进行ROC分析了。
J Pediatr Psychol. 2014 Mar;39(2):204-21. doi: 10.1093/jpepsy/jst062. Epub 2013 Aug 21.
2
Signs and symptoms to determine if a patient presenting in primary care or hospital outpatient settings has COVID-19.在基层医疗机构或医院门诊环境中，如果患者出现以下症状和体征，可判断其是否患有 COVID-19。
Cochrane Database Syst Rev. 2022 May 20;5(5):CD013665. doi: 10.1002/14651858.CD013665.pub3.
3
Hospital Anxiety and Depression Scale Anxiety subscale (HADS-A) for detecting anxiety disorders in adults.用于检测成人焦虑症的医院焦虑抑郁量表焦虑分量表（HADS-A）
Cochrane Database Syst Rev. 2025 Jul 2;7(7):CD015456. doi: 10.1002/14651858.CD015456.
4
Comparison of Two Modern Survival Prediction Tools, SORG-MLA and METSSS, in Patients With Symptomatic Long-bone Metastases Who Underwent Local Treatment With Surgery Followed by Radiotherapy and With Radiotherapy Alone.两种现代生存预测工具 SORG-MLA 和 METSSS 在接受手术联合放疗和单纯放疗治疗有症状长骨转移患者中的比较。
Clin Orthop Relat Res. 2024 Dec 1;482(12):2193-2208. doi: 10.1097/CORR.0000000000003185. Epub 2024 Jul 23.
5
Atypical antipsychotics for disruptive behaviour disorders in children and youths.用于治疗儿童和青少年破坏性行为障碍的非典型抗精神病药物。
Cochrane Database Syst Rev. 2017 Aug 9;8(8):CD008559. doi: 10.1002/14651858.CD008559.pub3.
6
Factors that influence participation in physical activity for people with bipolar disorder: a synthesis of qualitative evidence.影响双相障碍患者参与体育活动的因素：定性证据的综合分析。
Cochrane Database Syst Rev. 2024 Jun 4;6(6):CD013557. doi: 10.1002/14651858.CD013557.pub2.
7
Atypical antipsychotics for disruptive behaviour disorders in children and youths.用于儿童和青少年破坏性行为障碍的非典型抗精神病药物。
Cochrane Database Syst Rev. 2012 Sep 12(9):CD008559. doi: 10.1002/14651858.CD008559.pub2.
8
Generalized Anxiety Disorder 7-item (GAD-7) and 2-item (GAD-2) scales for detecting anxiety disorders in adults.用于检测成人焦虑症的广泛性焦虑障碍7项（GAD - 7）和2项（GAD - 2）量表。
Cochrane Database Syst Rev. 2025 Mar 25;3(3):CD015455. doi: 10.1002/14651858.CD015455.
10
Parent training interventions for Attention Deficit Hyperactivity Disorder (ADHD) in children aged 5 to 18 years.针对5至18岁儿童注意力缺陷多动障碍（ADHD）的家长培训干预措施。
Cochrane Database Syst Rev. 2011 Dec 7;2011(12):CD003018. doi: 10.1002/14651858.CD003018.pub3.
引用本文的文献
1
The Reaction to Diagnosis Questionnaire-Sibling Version: A Preliminary Study on the Psychometric Properties.《诊断反应问卷 - 兄弟姐妹版：心理测量特性的初步研究》
Eur J Investig Health Psychol Educ. 2025 Jul 29;15(8):147. doi: 10.3390/ejihpe15080147.
2
How well can commonly used anxiety scales detect treatment outcomes in the context of autism?在自闭症背景下，常用的焦虑量表对治疗效果的检测能力如何？
Autism. 2025 Jul 5:13623613251349929. doi: 10.1177/13623613251349929.
3
Accuracy of blood pressure-to-height ratio for the identification of elevated blood pressure in children: A cross-sectional study.儿童血压与身高比值用于识别高血压的准确性：一项横断面研究。
J Family Community Med. 2025 Apr-Jun;32(2):101-107. doi: 10.4103/jfcm.jfcm_251_24. Epub 2025 Apr 30.
4
Reliability and Validity of the Chinese Version of the Children's Depression Rating Scale-Revised (CDRS-R).儿童抑郁评定量表修订版（CDRS-R）中文版的信度和效度
Healthcare (Basel). 2025 Mar 26;13(7):734. doi: 10.3390/healthcare13070734.
5
Factor Analysis of the Autism Spectrum Rating Scales Parent Report 6-18 in a Complex Community Sample.复杂社区样本中自闭症谱系评定量表家长报告6 - 18的因素分析
J Autism Dev Disord. 2025 Mar 25. doi: 10.1007/s10803-025-06801-3.
6
Ready to ROC? A tutorial on simulation-based power analyses for null hypothesis significance, minimum-effect, and equivalence testing for ROC curve analyses.准备好进行ROC分析了吗？关于基于模拟的功效分析的教程，用于ROC曲线分析的零假设显著性检验、最小效应检验和等效性检验。
Behav Res Methods. 2025 Mar 18;57(4):120. doi: 10.3758/s13428-025-02646-x.
7
Validation and cutoff score for the single-item sleep quality scale.单项睡眠质量量表的验证和截断分数。
Sleep Breath. 2024 Nov 29;29(1):24. doi: 10.1007/s11325-024-03177-z.
8
Examining the clinical validity of the global psychotrauma screen in refugees.检验全球心理创伤筛查在难民中的临床效度。
Front Psychol. 2024 Jul 22;15:1394014. doi: 10.3389/fpsyg.2024.1394014. eCollection 2024.
9
Time estimation is associated with the levels of distress in patients prior to starting radiotherapy.时间预估与患者放疗开始前的痛苦程度相关。
Tech Innov Patient Support Radiat Oncol. 2024 Jul 1;31:100258. doi: 10.1016/j.tipsro.2024.100258. eCollection 2024 Sep.
10
Estimating classification consistency of machine learning models for screening measures.估算筛查措施的机器学习模型分类一致性。
Psychol Assess. 2024 Jun-Jul;36(6-7):395-406. doi: 10.1037/pas0001313.
本文引用的文献
1
Screening Efficiency of the Child Behavior Checklist and Strengths and Difficulties Questionnaire: A Systematic Review.儿童行为量表和长处与困难问卷的筛查效率：一项系统评价
Child Adolesc Ment Health. 2008 Sep;13(3):140-147. doi: 10.1111/j.1475-3588.2007.00461.x. Epub 2007 Jul 23.
2
Psychological Science Can Improve Diagnostic Decisions.心理科学可以改善诊断决策。
Psychol Sci Public Interest. 2000 May;1(1):1-26. doi: 10.1111/1529-1006.001. Epub 2000 May 1.
3
Decision curve analysis for assessing the usefulness of tests for making decisions to treat: an application to tests for prodromal psychosis.决策曲线分析在评估用于治疗决策的测试的有用性：一项针对前驱期精神病测试的应用。
Psychol Assess. 2013 Sep;25(3):730-7. doi: 10.1037/a0032394. Epub 2013 Apr 1.
4
Future directions in psychological assessment: combining evidence-based medicine innovations with psychology's historical strengths to enhance utility.未来心理评估的方向：结合循证医学的创新和心理学的历史优势，以提高实用性。
J Clin Child Adolesc Psychol. 2013;42(1):139-59. doi: 10.1080/15374416.2012.736358. Epub 2012 Nov 15.
5
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies.QUADAS-2：用于诊断准确性研究质量评估的修订工具。
Ann Intern Med. 2011 Oct 18;155(8):529-36. doi: 10.7326/0003-4819-155-8-201110180-00009.
6
Evidence-Based Strategies Improve Assessment of Pediatric Bipolar Disorder by Community Practitioners.循证策略改善社区医生对儿童双相情感障碍的评估。
Prof Psychol Res Pr. 2011 Apr;42(2):121-129. doi: 10.1037/a0022506.
7
pROC: an open-source package for R and S+ to analyze and compare ROC curves.pROC：一个用于 R 和 S+的开源软件包，用于分析和比较 ROC 曲线。
BMC Bioinformatics. 2011 Mar 17;12:77. doi: 10.1186/1471-2105-12-77.
8
Validity of the CBCL/YSR DSM-IV scales Anxiety Problems and Affective Problems.儿童行为检查表/青少年自我报告表（CBCL/YSR）DSM-IV量表中焦虑问题和情感问题的效度。
J Anxiety Disord. 2008;22(1):126-34. doi: 10.1016/j.janxdis.2007.01.008. Epub 2007 Feb 3.
9
Comparing the effects of sampling designs on the diagnostic accuracy of eight promising screening algorithms for pediatric bipolar disorder.比较抽样设计对八种有前景的小儿双相情感障碍筛查算法诊断准确性的影响。
Biol Psychiatry. 2006 Nov 1;60(9):1013-9. doi: 10.1016/j.biopsych.2006.06.023.
10
Comparing diagnostic checklists for pediatric bipolar disorder in academic and community mental health settings.比较学术性和社区心理健康环境中儿童双相情感障碍的诊断清单。
Bipolar Disord. 2005 Dec;7(6):507-17. doi: 10.1111/j.1399-5618.2005.00269.x.
Zotero 插件