Kim Youn-Hee, Oh You-Kyung
Department of Convergence Design and Technology, Kookmin University, Seoul 02707, Republic of Korea.
Sensors (Basel). 2025 Jul 9;25(14):4270. doi: 10.3390/s25144270.
Herein, an integrated system is developed based on knitted strain sensors for real-time translation of sign language into text and audio voices. To investigate how the structural characteristics of the knit affect the electrical performance, the position of the conductive yarn and the presence or absence of elastic yarn are set as experimental variables, and five distinct sensors are manufactured. A comprehensive analysis of the electrical and mechanical performance, including sensitivity, responsiveness, reliability, and repeatability, reveals that the sensor with a plain-plated-knit structure, no elastic yarn included, and the conductive yarn positioned uniformly on the back exhibits the best performance, with a gauge factor (GF) of 88. The sensor exhibited a response time of less than 0.1 s at 50 cycles per minute (cpm), demonstrating that it detects and responds promptly to finger joint bending movements. Moreover, it exhibits stable repeatability and reliability across various angles and speeds, confirming its optimization for sign language recognition applications. Based on this design, an integrated textile-based system is developed by incorporating the sensor, interconnections, snap connectors, and a microcontroller unit (MCU) with built-in Bluetooth Low Energy (BLE) technology into the knitted glove. The complete system successfully recognized 12 Korean Sign Language (KSL) gestures in real time and output them as both text and audio through a dedicated application, achieving a high recognition accuracy of 98.67%. Thus, the present study quantitatively elucidates the structure-performance relationship of a knitted sensor and proposes a wearable system that accounts for real-world usage environments, thereby demonstrating the commercialization potential of the technology.
在此,基于针织应变传感器开发了一种集成系统,用于将手语实时翻译成文本和语音。为了研究针织结构特征如何影响电学性能,将导电纱的位置和弹性纱的有无设置为实验变量,并制造了五种不同的传感器。对包括灵敏度、响应性、可靠性和可重复性在内的电学和力学性能进行综合分析表明,具有平针编织结构、不含弹性纱且导电纱均匀分布在背面的传感器表现最佳,应变片系数(GF)为88。该传感器在每分钟50次循环(cpm)时的响应时间小于0.1秒,表明它能对手指关节弯曲运动迅速检测并做出响应。此外,它在各种角度和速度下都表现出稳定的可重复性和可靠性,证实了其在手语识别应用中的优化。基于此设计,通过将传感器、互连、卡扣连接器以及具有内置蓝牙低功耗(BLE)技术的微控制器单元(MCU)集成到针织手套中,开发了一种基于纺织品的集成系统。整个系统成功实时识别了12种韩国手语(KSL)手势,并通过专用应用程序将其输出为文本和音频,识别准确率高达98.67%。因此,本研究定量阐明了针织传感器的结构-性能关系,并提出了一种考虑实际使用环境的可穿戴系统,从而展示了该技术的商业化潜力。