Bianco Simone, Celona Luigi, Ciocca Gianluigi, Marelli Davide, Napoletano Paolo, Yu Stefano, Schettini Raimondo
Department of Informatics, Systems and Communication, University of Milano-Bicocca, Viale Sarca 336, 20126 Milano, Italy.
Sensors (Basel). 2021 Nov 9;21(22):7453. doi: 10.3390/s21227453.
Smart mirrors are devices that can display any kind of information and can interact with the user using touch and voice commands. Different kinds of smart mirrors exist: general purpose, medical, fashion, and other task specific ones. General purpose smart mirrors are suitable for home environments but the exiting ones offer similar, limited functionalities. In this paper, we present a general-purpose smart mirror that integrates several functionalities, standard and advanced, to support users in their everyday life. Among the advanced functionalities are the capabilities of detecting a person's emotions, the short- and long-term monitoring and analysis of the emotions, a double authentication protocol to preserve the privacy, and the integration of Alexa Skills to extend the applications of the smart mirrors. We exploit a deep learning technique to develop most of the smart functionalities. The effectiveness of the device is demonstrated by the performances of the implemented functionalities, and the evaluation in terms of its usability with real users.
智能镜子是一种能够显示任何类型信息并可通过触摸和语音指令与用户进行交互的设备。存在不同种类的智能镜子:通用型、医疗型、时尚型以及其他特定任务型。通用智能镜子适用于家庭环境,但现有的此类镜子提供的功能相似且有限。在本文中,我们展示了一款集成了多种标准和高级功能的通用智能镜子,以在日常生活中为用户提供支持。高级功能包括检测人的情绪的能力、对情绪的短期和长期监测与分析、用于保护隐私的双重认证协议,以及集成Alexa技能以扩展智能镜子的应用。我们利用深度学习技术来开发大多数智能功能。所实现功能的性能以及与真实用户进行的可用性评估证明了该设备的有效性。