College of Electrical Engineering and Computer Science, National Taipei University of Technology, Taipei City 106, Taiwan.
Department of Computer Science and Information Engineering, National Taipei University of Technology, Taipei City 106, Taiwan.
Int J Environ Res Public Health. 2022 Oct 7;19(19):12857. doi: 10.3390/ijerph191912857.
Autistic spectrum disorder (ASD) is one of the most complex groups of neurobehavioral and developmental conditions. The reason is the presence of three different impaired domains, such as social interaction, communication, and restricted repetitive behaviors. Some children with ASD may not be able to communicate using language or speech. Many experts propose that continued therapy in the form of software training in this area might help to bring improvement. In this work, we propose a design of software speech therapy system for ASD. We combined different devices, technologies, and features with techniques of home rehabilitation. We used TensorFlow for Image Classification, ArKit for Text-to-Speech, Cloud Database, Binary Search, Natural Language Processing, Dataset of Sentences, and Dataset of Images with two different Operating Systems designed for Smart Mobile devices in daily life. This software is a combination of different Deep Learning Technologies and makes Human-Computer Interaction Therapy very easy to conduct. In addition, we explain the way these were connected and put to work together. Additionally, we explain in detail the architecture of software and how each component works together as an integrated Therapy System. Finally, it allows the patient with ASD to perform the therapy anytime and everywhere, as well as transmitting information to a medical specialist.
自闭症谱系障碍(ASD)是最复杂的神经行为和发育障碍群体之一。原因是存在三个不同的受损领域,如社交互动、沟通和受限的重复行为。一些自闭症谱系障碍儿童可能无法使用语言或言语进行交流。许多专家提出,在该领域继续进行软件培训形式的治疗可能有助于改善。在这项工作中,我们提出了一种用于自闭症谱系障碍的软件语言治疗系统的设计。我们将不同的设备、技术和功能与家庭康复技术相结合。我们使用 TensorFlow 进行图像分类、ArKit 进行文本转语音、云数据库、二进制搜索、自然语言处理、句子数据集和具有两个不同操作系统的图像数据集,这些都是为日常生活中的智能移动设备设计的。该软件是不同深度学习技术的结合,使得人机交互治疗非常容易进行。此外,我们解释了这些技术是如何连接并协同工作的。此外,我们详细解释了软件的架构以及每个组件如何作为一个集成的治疗系统协同工作。最后,它允许自闭症谱系障碍患者随时随地进行治疗,并将信息传输给医疗专家。