Barzegari Saeed, Sharifi Kia Ali, Bardus Marco, Stoyanov Stoyan R, GhaziSaeedi Marjan, Rafizadeh Mouna
Department of Paramedicine, Faculty of Paramedical Sciences, Mazandaran University of Medical Sciences, Sari, Iran.
Department of Health Information Management, School of Health Management and Information Science, Iran University of Medical Sciences, Tehran, Iran.
JMIR Form Res. 2022 Dec 5;6(12):e42225. doi: 10.2196/42225.
Approximately 110 million Farsi speakers worldwide have access to a growing mobile app market. Despite restrictions and international sanctions, Iran's internal mobile health app market is growing, especially for Android-based apps. However, there is a need for guidelines for developing health apps that meet international quality standards. There are also no tools in Farsi that assess health app quality. Developers and researchers who operate in Farsi could benefit from such quality assessment tools to improve their outputs.
This study aims to translate and culturally adapt the Mobile Application Rating Scale in Farsi (MARS-Fa). This study also evaluates the validity and reliability of the newly developed MARS-Fa tool.
We used a well-established method to translate and back translate the MARS-Fa tool with a group of Iranian and international experts in Health Information Technology and Psychology. The final translated version of the tool was tested on a sample of 92 apps addressing smartphone addiction. Two trained reviewers completed an independent assessment of each app in Farsi and English. We reported reliability and construct validity estimates for the objective scales (engagement, functionality, aesthetics, and information quality). Reliability was based on the evaluation of intraclass correlation coefficients, Cronbach α and Spearman-Brown split-half reliability indicators (for internal consistency), as well as Pearson correlations for test-retest reliability. Construct validity included convergent and discriminant validity (through item-total correlations within the objective scales) and concurrent validity using Pearson correlations between the objective and subjective scores.
After completing the translation and cultural adaptation, the MARS-Fa tool was used to assess the selected apps for smartphone addiction. The MARS-Fa total scale showed good interrater reliability (intraclass correlation coefficient=0.83, 95% CI 0.74-0.89) and good internal consistency (Cronbach α=.84); Spearman-Brown split-half reliability for both raters was 0.79 to 0.93. The instrument showed excellent test-retest reliability (r=0.94). The correlations among the MARS-Fa subdomains and the total score were all significant and above r=0.40, suggesting good convergent and discriminant validity. The MARS-Fa was positively and significantly correlated with subjective quality (r=0.90, P<.001), and so were the objective subdomains of engagement (r=0.85, P<.001), information quality (r=0.80, P<.001), aesthetics (r=0.79, P<.001), and functionality (r=0.57, P<.001), indicating concurrent validity.
The MARS-Fa is a reliable and valid instrument to assess mobile health apps. This instrument could be adopted by Farsi-speaking researchers and developers who want to evaluate the quality of mobile apps. While we tested the tool with a sample of apps addressing smartphone addiction, the MARS-Fa could assess other domains or issues since the Mobile App Rating Scale has been used to rate apps in different contexts and languages.
全球约有1.1亿讲波斯语的人可以使用不断发展的移动应用市场。尽管受到限制和国际制裁,但伊朗国内的移动健康应用市场仍在增长,尤其是基于安卓系统的应用。然而,需要制定符合国际质量标准的健康应用开发指南。目前也没有波斯语的工具来评估健康应用的质量。使用波斯语的开发者和研究人员可以从这种质量评估工具中受益,以提高他们的成果。
本研究旨在将移动应用评分量表翻译成波斯语(MARS-Fa)并进行文化调适。本研究还评估新开发的MARS-Fa工具的有效性和可靠性。
我们采用一种成熟的方法,与一组伊朗和国际健康信息技术与心理学专家对MARS-Fa工具进行翻译和回译。该工具的最终翻译版本在92个针对智能手机成瘾的应用样本上进行了测试。两名经过培训的评审员分别用波斯语和英语对每个应用进行独立评估。我们报告了客观量表(参与度、功能、美学和信息质量)的可靠性和结构效度估计值。可靠性基于组内相关系数、克朗巴哈α系数和斯皮尔曼-布朗分半可靠性指标(用于内部一致性)的评估,以及重测信度的皮尔逊相关系数。结构效度包括收敛效度和区分效度(通过客观量表内的项目-总分相关)以及使用客观分数与主观分数之间的皮尔逊相关的同时效度。
完成翻译和文化调适后,MARS-Fa工具用于评估所选的智能手机成瘾应用。MARS-Fa总量表显示出良好的评分者间信度(组内相关系数=0.83,95%CI 0.74-0.89)和良好的内部一致性(克朗巴哈α系数=0.84);两名评分者的斯皮尔曼-布朗分半信度为0.79至0.93。该工具显示出出色的重测信度(r=0.94)。MARS-Fa子领域与总分之间的相关性均显著且高于r=0.40,表明具有良好的收敛效度和区分效度。MARS-Fa与主观质量呈正相关且显著相关(r=0.90,P<0.001),参与度(r=0.85,P<0.001)、信息质量(r=0.80,P<0.001)、美学(r=0.79,P<0.001)和功能(r=0.57,P<0.001)的客观子领域也是如此,表明具有同时效度。
MARS-Fa是评估移动健康应用的可靠且有效的工具。该工具可供希望评估移动应用质量的讲波斯语的研究人员和开发者采用。虽然我们用一组针对智能手机成瘾的应用样本测试了该工具,但由于移动应用评分量表已被用于在不同背景和语言下对应用进行评分,MARS-Fa可以评估其他领域或问题。