Reeves Byron, Ram Nilam, Robinson Thomas N, Cummings James J, Giles C Lee, Pan Jennifer, Chiatti Agnese, Cho M J, Roehrick Katie, Yang Xiao, Gagneja Anupriya, Brinberg Miriam, Muise Daniel, Lu Yingdan, Luo Mufan, Fitzgerald Andrew, Yeykelis Leo
Stanford University.
Pennsylvannia State University.
Hum Comput Interact. 2021;36(2):150-201. doi: 10.1080/07370024.2019.1578652. Epub 2019 Mar 13.
Digital experiences capture an increasingly large part of life, making them a preferred, if not required, method to describe and theorize about human behavior. Digital media also shape behavior by enabling people to switch between different content easily, and create unique threads of experiences that pass quickly through numerous information categories. Current methods of recording digital experiences provide only partial reconstructions of digital lives that weave - often within seconds - among multiple applications, locations, functions and media. We describe an end-to-end system for capturing and analyzing the "screenome" of life in media, i.e., the record of individual experiences represented as a sequence of screens that people view and interact with over time. The system includes software that collects screenshots, extracts text and images, and allows searching of a screenshot database. We discuss how the system can be used to elaborate current theories about psychological processing of technology, and suggest new theoretical questions that are enabled by multiple time scale analyses. Capabilities of the system are highlighted with eight research examples that analyze screens from adults who have generated data within the system. We end with a discussion of future uses, limitations, theory and privacy.
数字体验在生活中所占的比重越来越大,这使它成为一种描述人类行为并进行理论化的首选方法,即便不是必需的方法。数字媒体还通过让人们轻松切换不同内容,塑造行为,并创造独特的体验脉络,这些体验脉络会在众多信息类别中迅速传递。当前记录数字体验的方法仅能部分重建数字生活,这些数字生活往往在数秒内穿梭于多个应用程序、地点、功能和媒体之间。我们描述了一个端到端系统,用于捕捉和分析媒体生活中的“屏幕组”,即随着时间推移,人们观看和交互的一系列屏幕所代表的个人体验记录。该系统包括收集截图、提取文本和图像并允许搜索截图数据库的软件。我们讨论了该系统如何用于完善当前关于技术心理加工的理论,并提出由多时间尺度分析引发的新理论问题。通过八个研究示例突出了该系统的功能,这些示例分析了在系统内生成数据的成年人的屏幕。最后我们讨论了未来的用途、局限性、理论和隐私问题。