Nguyen Thao-Nhu, Le Tu-Khiem, Ninh Van-Tu, Caputo Annalina, Healy Graham, Smyth Sinéad, Tran Minh-Triet, Binh Nguyen Thanh
Dublin City University, Dublin, Ireland.
University of Science, Vietnam National University Ho Chi Minh city, Ho Chi Minh, Vietnam.
Multimed Tools Appl. 2023;82(24):37855-37876. doi: 10.1007/s11042-023-15317-w. Epub 2023 Aug 1.
Lifelogging was introduced as the process of passively capturing personal daily events via wearable devices. It ultimately creates a visual diary encoding every aspect of one's life with the aim of future sharing or recollecting. In this paper, we present LifeSeeker, a lifelog image retrieval system participating in the Lifelog Search Challenge (LSC) for 3 years, since 2019. Our objective is to support users to seek specific life moments using a combination of textual descriptions, spatial relationships, location information, and image similarities. In addition to the LSC challenge results, a further experiment was conducted in order to evaluate the power retrieval of our system on both expert and novice users. This experiment informed us about the effectiveness of the user's interaction with the system when involving non-experts.
生活记录被定义为通过可穿戴设备被动捕捉个人日常事件的过程。它最终创建了一个视觉日记,对一个人生活的方方面面进行编码,目的是供未来分享或回忆。在本文中,我们介绍了LifeSeeker,这是一个自2019年起连续三年参加生活记录搜索挑战赛(LSC)的生活记录图像检索系统。我们的目标是支持用户通过结合文本描述、空间关系、位置信息和图像相似度来查找特定的生活瞬间。除了LSC挑战赛的结果外,我们还进行了一项进一步的实验,以评估我们的系统在专家用户和新手用户身上的检索能力。该实验让我们了解了在涉及非专家用户时,用户与系统交互的有效性。