Orygen, Melbourne, Australia.
Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia.
PLoS One. 2022 Jul 20;17(7):e0271023. doi: 10.1371/journal.pone.0271023. eCollection 2022.
This study aimed to explore current data collection and feedback practice, in the form of monitoring and evaluation, among youth mental health (YMH) services and healthcare commissioners; and to identify barriers and enablers to this practice.
Qualitative semi-structured interviews were conducted via Zoom videoconferencing software. Data collection and analysis were informed by the Theoretical Domains Framework (TDF). Data were deductively coded to the 14 domains of the TDF and inductively coded to generate belief statements.
Healthcare commissioning organisations and YMH services in Australia.
Twenty staff from healthcare commissioning organisations and twenty staff from YMH services.
The umbrella behaviour 'monitoring and evaluation' (ME) can be sub-divided into 10 specific sub-behaviours (e.g. planning and preparing, providing technical assistance, reviewing and interpreting data) performed by healthcare commissioners and YMH services. One hundred belief statements relating to individual, social, or environmental barriers and enablers were generated. Both participant groups articulated a desire to improve the use of ME for quality improvement and had particular interest in understanding the experiences of young people and families. Identified enablers included services and commissioners working in partnership, data literacy (including the ability to set appropriate performance indicators), relational skills, and provision of meaningful feedback. Barriers included data that did not adequately depict service performance, problems with data processes and tools, and the significant burden that data collection places on YMH services with the limited resources they have to do it.
Importantly, this study illustrated that the use of ME could be improved. YMH services, healthcare commissioners should collaborate on ME plans and meaningfully involve young people and families where possible. Targets, performance indicators, and outcome measures should explicitly link to YMH service quality improvement; and ME plans should include qualitative data. Streamlined data collection processes will reduce unnecessary burden, and YMH services should have the capability to interrogate their own data and generate reports. Healthcare commissioners should also ensure that they provide meaningful feedback to their commissioned services, and local and national organisations collecting youth mental health data should facilitate the sharing of this data. The results of the study should be used to design theory-informed strategies to improve ME use.
本研究旨在探索青年心理健康 (YMH) 服务和医疗保健委托方目前的数据收集和反馈实践形式，即监测和评估；并确定实践中存在的障碍和促进因素。
采用 Zoom 视频会议软件进行定性半结构式访谈。数据收集和分析以理论领域框架（TDF）为指导。数据采用 TDF 的 14 个领域进行演绎编码，并进行归纳编码以生成信念陈述。
澳大利亚的医疗保健委托方组织和 YMH 服务。
20 名来自医疗保健委托方组织的工作人员和 20 名来自 YMH 服务的工作人员。
“监测和评估”（ME）这一总括行为可细分为医疗保健委托方和 YMH 服务执行的 10 项具体子行为（如计划和准备、提供技术援助、审查和解释数据）。共生成了 100 条与个人、社会或环境障碍和促进因素相关的信念陈述。两组参与者都表示希望改进 ME 在质量改进方面的使用，并特别关注了解年轻人和家庭的体验。确定的促进因素包括服务和委托方之间的合作、数据素养（包括设置适当绩效指标的能力）、关系技能以及提供有意义的反馈。障碍包括数据不能充分反映服务绩效、数据流程和工具存在问题，以及数据收集给 YMH 服务带来的巨大负担，而 YMH 服务的资源有限。
重要的是，本研究表明可以改进 ME 的使用。YMH 服务和医疗保健委托方应共同制定 ME 计划，并尽可能让年轻人和家庭参与进来。目标、绩效指标和结果衡量标准应明确与 YMH 服务质量改进相关联；ME 计划应包括定性数据。简化数据收集流程将减少不必要的负担，并且 YMH 服务应具备查询自身数据和生成报告的能力。医疗保健委托方还应确保向其委托服务提供有意义的反馈，收集青年心理健康数据的地方和国家组织应促进数据共享。应利用研究结果设计基于理论的策略来改进 ME 的使用。
