Institute of Electronics and Informatics Engineering of Aveiro, University of Aveiro, Aveiro, Portugal.
JMIR Mhealth Uhealth. 2022 May 2;10(5):e30517. doi: 10.2196/30517.
Over the past decade, the wide availability and small size of different types of sensors, together with the decrease in pricing, have allowed the acquisition of a substantial amount of data about a person's life in real time. These sensors can be incorporated into personal electronic devices available at a reasonable cost, such as smartphones and small wearable devices. They allow the acquisition of images, audio, location, physical activity, and physiological signals among other data. With these data, usually denoted as lifelog data, we can then analyze and understand personal experiences and behaviors. This process is called lifelogging.
The objective of this paper was to present a narrative review of the existing literature about lifelogging over the past decade. To achieve this goal, we analyzed lifelogging applications used to retrieve relevant information from daily digital data, some of them with the purpose of monitoring and assisting people with memory issues and others designed for memory augmentation. We aimed for this review to be used by researchers to obtain a broad idea of the type of data used, methodologies, and applications available in this research field.
We followed a narrative review methodology to conduct a comprehensive search for relevant publications in Google Scholar and Scopus databases using lifelog topic-related keywords. A total of 411 publications were retrieved and screened. Of these 411 publications, 114 (27.7%) publications were fully reviewed. In addition, 30 publications were manually included based on our bibliographical knowledge of this research field.
From the 144 reviewed publications, a total of 113 (78.5%) were selected and included in this narrative review based on content analysis. The findings of this narrative review suggest that lifelogs are prone to become powerful tools to retrieve memories or increase knowledge about an individual's experiences or behaviors. Several computational tools are already available for a considerable range of applications. These tools use multimodal data of different natures, with visual lifelogs being one of the most used and rich sources of information. Different approaches and algorithms to process these data are currently in use, as this review will unravel. Moreover, we identified several open questions and possible lines of investigation in lifelogging.
The use of personal lifelogs can be beneficial to improve the quality of our life, as they can serve as tools for memory augmentation or for providing support to people with memory issues. Through the acquisition and analysis of lifelog data, lifelogging systems can create digital memories that can be potentially used as surrogate memory. Through this narrative review, we understand that contextual information can be extracted from lifelogs, which provides an understanding of the daily life of a person based on events, experiences, and behaviors.
在过去的十年中,不同类型传感器的广泛可用性和体积小,以及价格的降低,使得人们能够实时获取大量关于个人生活的数据。这些传感器可以整合到个人电子设备中,价格合理,例如智能手机和小型可穿戴设备。它们可以获取图像、音频、位置、身体活动和生理信号等数据。有了这些数据,通常被称为生活记录数据,我们就可以分析和理解个人的经历和行为。这个过程被称为生活记录。
本文旨在对过去十年中关于生活记录的现有文献进行叙述性回顾。为了实现这一目标,我们分析了用于从日常数字数据中检索相关信息的生活记录应用程序,其中一些旨在监测和帮助有记忆问题的人,而另一些则旨在增强记忆。我们希望本综述能为研究人员提供一个广泛的视角,了解该研究领域中可用的数据类型、方法和应用。
我们采用叙述性综述方法,在 Google Scholar 和 Scopus 数据库中使用与生活记录主题相关的关键字进行了全面的文献检索。共检索到 411 篇出版物,并进行了筛选。在这 411 篇出版物中,有 114 篇(27.7%)出版物进行了全面审查。此外,根据我们对该研究领域的文献知识,手动纳入了 30 篇出版物。
从 144 篇综述性出版物中,根据内容分析,共有 113 篇(78.5%)被选择并纳入本叙述性综述。本叙述性综述的研究结果表明,生活记录很可能成为检索记忆或增加个人经历或行为知识的有力工具。已经有许多计算工具可用于相当广泛的应用。这些工具使用不同性质的多模态数据,其中视觉生活记录是使用最多和最丰富的信息来源之一。目前正在使用不同的方法和算法来处理这些数据,本综述将对此进行阐述。此外,我们确定了生活记录中的几个开放性问题和可能的研究方向。
使用个人生活记录可以提高我们的生活质量,因为它们可以作为增强记忆或为有记忆问题的人提供支持的工具。通过获取和分析生活记录数据,生活记录系统可以创建数字记忆,这些记忆可以作为替代记忆。通过本叙述性综述,我们了解到可以从生活记录中提取上下文信息,从而根据事件、经历和行为来了解一个人的日常生活。