Mukherjee Debarati, Bhavnani Supriya, Swaminathan Akshay, Verma Deepali, Parameshwaran Dhanya, Divan Gauri, Dasgupta Jayashree, Sharma Kamalkant, Thiagarajan Tara C, Patel Vikram
Centre for Chronic Conditions and Injuries, Public Health Foundation of India, Gurugram, India.
Child Development Group, Sangath, Goa, India.
Front Psychol. 2020 Jun 10;11:1202. doi: 10.3389/fpsyg.2020.01202. eCollection 2020.
Over 250 million children in developing countries are at risk of not achieving their developmental potential, and unlikely to receive timely interventions because existing developmental assessments that help identify children who are faltering are prohibitive for use in low resource contexts. To bridge this "detection gap," we developed a tablet-based, gamified cognitive assessment tool named DEvelopmental assessment on an E-Platform (DEEP), which is feasible for delivery by non-specialists in rural Indian households and acceptable to all end-users. Here we provide proof-of-concept of using a supervised machine learning (ML) approach benchmarked to the Bayley's Scale of Infant and Toddler Development, 3rd Edition (BSID-III) cognitive scale, to predict a child's cognitive development using metrics derived from gameplay on DEEP. Two-hundred children aged 34-40 months recruited from rural Haryana, India were concurrently assessed using DEEP and BSID-III. Seventy percent of the sample was used for training the ML algorithms using a 10-fold cross validation approach and ensemble modeling, while 30% was assigned to the "test" dataset to evaluate the algorithm's accuracy on novel data. Of the 522 features that computationally described children's performance on DEEP, 31 features which together represented all nine games of DEEP were selected in the final model. The predicted DEEP scores were in good agreement (ICC [2,1] > 0.6) and positively correlated (Pearson's = 0.67) with BSID-cognitive scores, and model performance metrics were highly comparable between the training and test datasets. Importantly, the mean absolute prediction error was less than three points (<10% error) on a possible range of 31 points on the BSID-cognitive scale in both the training and test datasets. Leveraging the power of ML which allows iterative improvements as more diverse data become available for training, DEEP, pending further validation, holds promise to serve as an acceptable and feasible cognitive assessment tool to bridge the detection gap and support optimum child development.
发展中国家超过2.5亿儿童面临无法充分发挥其发育潜能的风险,且不太可能获得及时干预,因为现有的有助于识别发育迟缓儿童的发育评估方法在资源匮乏的环境中使用成本过高。为了弥合这一“检测差距”,我们开发了一种基于平板电脑的、游戏化的认知评估工具,名为电子平台发育评估(DEEP),该工具由印度农村家庭的非专业人员进行操作是可行的,并且所有终端用户都能接受。在此,我们提供了一个概念验证,即使用一种以贝利婴幼儿发展量表第三版(BSID-III)认知量表为基准的监督式机器学习(ML)方法,通过从DEEP游戏玩法中得出的指标来预测儿童的认知发展。从印度哈里亚纳邦农村招募的200名34至40个月大的儿童同时接受了DEEP和BSID-III评估。70%的样本用于使用10倍交叉验证方法和集成建模来训练ML算法,而30%被分配到“测试”数据集,以评估算法在新数据上的准确性。在计算得出的描述儿童在DEEP上表现的522个特征中,最终模型选择了共同代表DEEP所有九个游戏的31个特征。预测的DEEP分数与BSID-认知分数具有良好的一致性(组内相关系数[2,1]>0.6)且呈正相关(皮尔逊相关系数=0.67),并且训练数据集和测试数据集之间的模型性能指标具有高度可比性。重要的是,在训练数据集和测试数据集中,在BSID-认知量表31分的可能范围内,平均绝对预测误差均小于3分(<10%误差)。利用ML的强大功能,随着更多样化的数据可用于训练,它允许进行迭代改进,在进一步验证之前,DEEP有望成为一种可接受且可行的认知评估工具,以弥合检测差距并支持儿童的最佳发育。