Suppr超能文献

LifeSeeker:一种用于生活日志数据的基于概念的交互式检索系统。

LifeSeeker: an interactive concept-based retrieval system for lifelog data.

作者信息

Nguyen Thao-Nhu, Le Tu-Khiem, Ninh Van-Tu, Caputo Annalina, Healy Graham, Smyth Sinéad, Tran Minh-Triet, Binh Nguyen Thanh

机构信息

Dublin City University, Dublin, Ireland.

University of Science, Vietnam National University Ho Chi Minh city, Ho Chi Minh, Vietnam.

出版信息

Multimed Tools Appl. 2023;82(24):37855-37876. doi: 10.1007/s11042-023-15317-w. Epub 2023 Aug 1.

Abstract

Lifelogging was introduced as the process of passively capturing personal daily events via wearable devices. It ultimately creates a visual diary encoding every aspect of one's life with the aim of future sharing or recollecting. In this paper, we present LifeSeeker, a lifelog image retrieval system participating in the Lifelog Search Challenge (LSC) for 3 years, since 2019. Our objective is to support users to seek specific life moments using a combination of textual descriptions, spatial relationships, location information, and image similarities. In addition to the LSC challenge results, a further experiment was conducted in order to evaluate the power retrieval of our system on both expert and novice users. This experiment informed us about the effectiveness of the user's interaction with the system when involving non-experts.

摘要

生活记录被定义为通过可穿戴设备被动捕捉个人日常事件的过程。它最终创建了一个视觉日记,对一个人生活的方方面面进行编码,目的是供未来分享或回忆。在本文中,我们介绍了LifeSeeker,这是一个自2019年起连续三年参加生活记录搜索挑战赛(LSC)的生活记录图像检索系统。我们的目标是支持用户通过结合文本描述、空间关系、位置信息和图像相似度来查找特定的生活瞬间。除了LSC挑战赛的结果外,我们还进行了一项进一步的实验,以评估我们的系统在专家用户和新手用户身上的检索能力。该实验让我们了解了在涉及非专家用户时,用户与系统交互的有效性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a68d/10547623/53e58c1fae5b/11042_2023_15317_Fig1_HTML.jpg

相似文献

1
LifeSeeker: an interactive concept-based retrieval system for lifelog data.
Multimed Tools Appl. 2023;82(24):37855-37876. doi: 10.1007/s11042-023-15317-w. Epub 2023 Aug 1.
2
Lifelog Retrieval From Daily Digital Data: Narrative Review.
JMIR Mhealth Uhealth. 2022 May 2;10(5):e30517. doi: 10.2196/30517.
3
A tale of two interfaces: vitrivr at the lifelog search challenge.
Multimed Tools Appl. 2023;82(24):37829-37853. doi: 10.1007/s11042-023-15082-w. Epub 2023 Apr 6.
4
MELLO: Medical lifelog ontology for data terms from self-tracking and lifelog devices.
Int J Med Inform. 2015 Dec;84(12):1099-110. doi: 10.1016/j.ijmedinf.2015.08.005. Epub 2015 Aug 17.
5
Feature-First Add-On for Trajectory Simplification in Lifelog Applications.
Sensors (Basel). 2020 Mar 27;20(7):1852. doi: 10.3390/s20071852.
6
Toward Health Exercise Behavior Change for Teams Using Lifelog Sharing Models.
IEEE J Biomed Health Inform. 2016 May;20(3):775-786. doi: 10.1109/JBHI.2015.2478903. Epub 2015 Sep 15.
7
Lifelog agent for human activity pattern analysis on health avatar platform.
Healthc Inform Res. 2014 Jan;20(1):69-75. doi: 10.4258/hir.2014.20.1.69. Epub 2014 Jan 31.
9
Intelligent Healthcare Service Using Health Lifelog Analysis.
J Med Syst. 2016 Aug;40(8):188. doi: 10.1007/s10916-016-0534-1. Epub 2016 Jun 28.
10
On Curating Multimodal Sensory Data for Health and Wellness Platforms.
Sensors (Basel). 2016 Jun 27;16(7):980. doi: 10.3390/s16070980.

本文引用的文献

1
Places: A 10 Million Image Database for Scene Recognition.
IEEE Trans Pattern Anal Mach Intell. 2018 Jun;40(6):1452-1464. doi: 10.1109/TPAMI.2017.2723009. Epub 2017 Jul 4.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验