Corbière M, Lesage A, Lauzon S, Ricard N, Reinharz D
Research Associate Mental Health Evaluation & Community Consultation Unit (MHECCU), University of British Columbia, Dept. of Psychiatry, St Paul's Hospital, 1081 Burrard Street, Comox Building, Room 306, Vancouver, BC, V6Z 1Y6 Canada.
Encephale. 2003 Mar-Apr;29(2):110-8.
The Verona Service Satisfaction Scale-French version (13) was translated and adapted from the Italian version of Verona Service Satisfaction Scale (27). The VSSS makes it possible to evaluate the satisfaction of people with serious mental illness with respect to the services. The original VSSS-54 contained 7 dimensions: 1) Overall satisfaction, 2) Professionals' skills and behaviour, 3) Information, 4) Access to services, 5) Services efficacy, 6) Relatives' involvement and 7) Types of interventions. According to factorial analyses carried out by Ruggeri et al., the dimensions Information and Access to services were aggregated. However, no factorial analysis was carried out in order to verify the six dimension-structure of the VSSS. From an international perspective, the study entitled "The European Psychiatric Services: Inputs linked to Outcome Domains and Needs (EPSILON)" achieved the standardisation of different questionnaires in several languages (2). A new version of the VSSS entitled "Verona Service Satisfaction Scale-European version" (VSSS-EU) was developed and is now available in the following languages: Italian, Danish, German, English and Spanish. In order to compare in different countries the satisfaction of people with serious mental illness with respect to services, we undertook from 1998 to ascertain the psychometrical properties of the French version of the VSSS. (13). Confirmatory Factorial Analysis (CFA) was carried out on the six dimension-structure of the VSSS-54F: 1) Overall satisfaction, 2) Professionals' skills and behaviour, 3) Information and Access to services, 4) Services efficacy, 5) Relatives involvement and 6) Types of interventions. For each dimension, consistency analysis (Cronbach's alpha) was computed in order to bring forth additional psychometrical properties of the VSSS-54F.
150 clients involved in an intensive case management program and supported by 30 mental health workers, filled out the VSSS-54F questionnaire. These clients were comprised of 110 women and 40 men, their ages ranging from 22 to 90 years (M = 51.7, SD = 14.7). Among them, 65 (43.3%) had a diagnosis of schizophrenia or another form of psychosis, 56 (37.3%) had an affective disorder, 17 (11.3%) had anxious disorders and 7 (7.7%) other.
Using the EQS Software (3), Confirmatory Factor Analyses (CFA) were carried out in this study. Thus, 'the evaluation of the models' fit with the empirical data was carried out by taking into account various statistical indices. In addition to the Chi square/df ratio, the indices of adjustment such as the "NonNormed Fit Index" (NNFI), the Comparative Fit Index (CFI), robust CFI (calculated starting from the Satorra-Bentler Chi Square) as well as the RMSEA (Root Mean Standard Error of Approximation) were used to measure the fit of the models. Moreover, the estimation method "Maximum Likelihood-Robust" was carried out in order to evaluate the models.
The original model with 6 dimensions (M1) does not present satisfactory fit indices. Indeed, the Chi Square/df ratio is above 2, the NNFI, CFI and CFI robust indices are lower than. 90 and the RMSEA is higher than. 08. Most items from Types of intervention dimension presented saturation lower than.30, and consequently indicate that these items are not correlated significantly with their dimension. We notice also some correlations between error terms of the three items of Overall Satisfaction scale and other items of the VSSS questionnaire. Considering these last results and the direction taken in VSSS-EU by breaking down by profession items of Professionals' skills and behaviour scale, we obtained a new model (M2). The five dimensions of this model are as follow: 1) Psychiatrists/Psychologists' skills and behaviour (7 items), 2) Nursing staff/social workers' skills and behaviour (7 items), 3) Information and access to services (3 items), 4) Services efficacy (5 items), 5) Relatives' involvement (3 items). When we test this model, the fit indices are satisfactory: the Chi Square/df is 1.36, the NNFI, CFI and robust CFI indices are near or higher than 0.90, respectively 0.88, 0.89 and 0.94. Finally, the RMSEA index is 0.08. In addition, the correlations between five dimensions are significant and vary from 0.58 to 0.87 (p < 0.05). The internal consistency coefficients for each new scale are all satisfactory, and vary from .83 to .91, except for the Information and access to services scales. But this latter finding shall be evaluated knowing that acceptable alpha can be close to .60 when scales count less than four items (16).
This study confirms with some adjustments the factorial structure of the VSSS. The results indicate five dimensions (25 items): Psychiatrists/Psychologists' skills and behaviour, Nursing staff/social workers' skills and behaviour, Information and access to services, Services efficacy, Relatives' involvement. Even if the Type of interventions dimension was not retained in the model, we suggest preserving it for eventual clinical evaluation based on each item. We also suggest, for future studies, the adaptation of the VSSS-54F to the European version, VSSS-EU. Indeed, the results of our study sustain the European version because the VSSS-EU is more focused since it separates the skills and behaviour of psychiatrists, psychologists, nurses and social workers (e.g. items 3a and 3b or items 22a and 22b). The next step in the validation process would be to measure Inter-rater and test-retest reliability as well as concurrent, convergent and discriminant validity of the VSSS-EU. Furthermore, a multicultural comparison of the VSSS-EU would be required if the instrument is used for interesting comparisons of survey.
《维罗纳服务满意度量表》法语版(13)是从《维罗纳服务满意度量表》意大利版(27)翻译并改编而来。《维罗纳服务满意度量表》(VSSS)能够评估重度精神疾病患者对服务的满意度。最初的VSSS - 54包含7个维度:1)总体满意度,2)专业人员的技能与行为,3)信息,4)服务可及性,5)服务效果,6)亲属参与度,7)干预类型。根据鲁杰里等人进行的因子分析,信息和服务可及性这两个维度被合并。然而,未进行因子分析以验证VSSS的六维度结构。从国际视角来看,名为“欧洲精神科服务:与结果领域和需求相关的投入(EPSILON)”的研究实现了多种语言不同问卷的标准化(2)。一个名为“维罗纳服务满意度量表 - 欧洲版”(VSSS - EU)的VSSS新版本被开发出来,目前有意大利语、丹麦语、德语、英语和西班牙语版本。为了在不同国家比较重度精神疾病患者对服务的满意度,我们从1998年开始确定VSSS法语版的心理测量特性(13)。对VSSS - 54F的六维度结构进行了验证性因子分析(CFA):1)总体满意度,2)专业人员的技能与行为,3)信息和服务可及性,4)服务效果,5)亲属参与度,6)干预类型。对于每个维度,计算了一致性分析(克朗巴哈系数)以揭示VSSS - 54F的其他心理测量特性。
150名参与强化个案管理项目并由30名心理健康工作者提供支持的服务对象填写了VSSS - 54F问卷。这些服务对象包括110名女性和40名男性,年龄范围为22至90岁(M = 51.7,SD = 14.)。其中,65人(43.3%)被诊断为精神分裂症或其他形式的精神病,56人(37.3%)患有情感障碍,17人(11.3%)患有焦虑症,7人(7.7%)患有其他疾病。
本研究使用EQS软件(3)进行验证性因子分析(CFA)。因此,通过考虑各种统计指标来评估模型与实证数据的拟合度。除了卡方/自由度比之外,还使用了诸如“非标准化拟合指数”(NNFI)、比较拟合指数(CFI)、稳健CFI(从萨托拉 - 本特勒卡方计算得出)以及RMSEA(近似均方根误差)等调整指数来衡量模型的拟合度。此外,采用“稳健最大似然估计法”来评估模型。
具有6个维度的原始模型(M1)的拟合指标并不理想。实际上,卡方/自由度比高于2,NNFI、CFI和稳健CFI指数低于0.90,RMSEA高于0.08。干预类型维度中的大多数项目呈现出低于0.30的饱和度,因此表明这些项目与其维度的相关性不显著。我们还注意到总体满意度量表的三个项目的误差项与VSSS问卷的其他项目之间存在一些相关性。考虑到这些结果以及VSSS - EU中通过按专业分解专业人员的技能与行为量表所采取的方向,我们得到了一个新模型(M2)。该模型的五个维度如下:1)精神科医生/心理学家的技能与行为(7个项目),2)护理人员/社会工作者的技能与行为(7个项目),3)信息和服务可及性(3个项目),4)服务效果(5个项目),5)亲属参与度(3个项目)。当我们对该模型进行测试时,拟合指标令人满意:卡方/自由度为1.36,NNFI、CFI和稳健CFI指数分别接近或高于0.90,即0.88、0.89和0.94。最后,RMSEA指数为0.08。此外,五个维度之间的相关性显著,范围从0.58到0.87(p < 0.05)。每个新量表的内部一致性系数都令人满意,除了信息和服务可及性量表外,范围从0.83到0.91。但考虑到当量表项目少于四个时,可接受的系数可能接近0.60(16),后一结果应进行评估。
本研究在进行一些调整后确认了VSSS的因子结构。结果表明有五个维度(25个项目):精神科医生/心理学家的技能与行为、护理人员/社会工作者的技能与行为、信息和服务可及性、服务效果、亲属参与度。即使干预类型维度未保留在模型中,我们建议基于每个项目保留它以供最终的临床评估。我们还建议,对于未来的研究,将VSSS - 54F改编为欧洲版VSSS - EU。实际上,我们的研究结果支持欧洲版,因为VSSS - EU更具针对性,它区分了精神科医生、心理学家、护士和社会工作者的技能与行为(例如项目3a和3b或项目22a和22b)。验证过程的下一步将是测量VSSS - EU的评分者间信度和重测信度以及同时效度、收敛效度和区分效度。此外,如果该工具用于有趣的调查比较,则需要对VSSS - EU进行多文化比较。