Wang Shan, Wang Xiaoyu, Wang Qi, Ma Shuqi, Xiao Jianliang, Liu Haitao, Pan Jing, Zhang Zhang, Zhang Lei
Research Center for Humanoid Sensing, Zhejiang Lab, Hangzhou, 311100, China.
State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China.
Adv Mater. 2023 Dec;35(49):e2304701. doi: 10.1002/adma.202304701. Epub 2023 Nov 5.
Multimodal tactile sensors are a crucial part of intelligent human-machine interaction and collaboration. Simultaneous detection of proximity, pressure, and temperature on a single sensor can greatly promote the safety, interactivity, and compactness of interaction systems. However, severe signal interference and complex decoupling algorithms hinder the actual applications. Here, this work reports a flexible optoelectronic multimodal sensor capable of detecting and decoupling proximity/pressure/temperature by integrating a light waveguide and an interdigital electrode (IDE) into a compact fibrous sensor. Negligible signal interference is realized by combining heterogeneous sensing mechanisms of optics and electronics, which encodes proximity into capacitance, pressure into light intensity and temperature into resistance. The sensor exhibits a large sensing distance of 225 mm with fast responses for proximity detection, a pressure sensitivity of 0.42 N , and a temperature sensitivity of 7% °C . As a proof of concept, a doll equipped with the sensor can accurately discriminate and detect various stimuli, thus achieving safe and immersive interactions with the user. This work opens up promising paths for self-decoupled multimodal sensors and related human/machine/environment interaction applications.
多模态触觉传感器是智能人机交互与协作的关键部分。在单个传感器上同时检测接近度、压力和温度，可极大地提升交互系统的安全性、交互性和紧凑性。然而，严重的信号干扰和复杂的解耦算法阻碍了其实际应用。在此，本工作报道了一种灵活的光电多模态传感器，通过将光波导和叉指电极（IDE）集成到紧凑的纤维传感器中，能够检测并解耦接近度/压力/温度。通过结合光学和电子学的异质传感机制实现了可忽略不计的信号干扰，该机制将接近度编码为电容、压力编码为光强、温度编码为电阻。该传感器在接近度检测方面具有225毫米的大检测距离和快速响应，压力灵敏度为0.42 N，温度灵敏度为7%/°C。作为概念验证，配备该传感器的玩偶能够准确区分和检测各种刺激，从而实现与用户的安全且沉浸式交互。这项工作为自解耦多模态传感器及相关人机环境交互应用开辟了广阔前景。
