Dinges David F, Rider Robert L, Dorrian Jillian, McGlinchey Eleanor L, Rogers Naomi L, Cizman Ziga, Goldenstein Siome K, Vogler Christian, Venkataraman Sundara, Metaxas Dimitris N
Unit for Experimental Psychiatry, Department of Psychiatry, University of Pennsylvania School of Medicine, Philadelphia, PA 19104-6021, USA.
Aviat Space Environ Med. 2005 Jun;76(6 Suppl):B172-82.
Application of computer vision to track changes in human facial expressions during long-duration spaceflight may be a useful way to unobtrusively detect the presence of stress during critical operations. To develop such an approach, we applied optical computer recognition (OCR) algorithms for detecting facial changes during performance while people experienced both low- and high-stressor performance demands. Workload and social feedback were used to vary performance stress in 60 healthy adults (29 men, 31 women; mean age 30 yr). High-stressor scenarios involved more difficult performance tasks, negative social feedback, and greater time pressure relative to low workload scenarios. Stress reactions were tracked using self-report ratings, salivary cortisol, and heart rate. Subjects also completed personality, mood, and alexithymia questionnaires. To bootstrap development of the OCR algorithm, we had a human observer, blind to stressor condition, identify the expressive elements of the face of people undergoing high- vs. low-stressor performance. Different sets of videos of subjects' faces during performance conditions were used for OCR algorithm training. Subjective ratings of stress, task difficulty, effort required, frustration, and negative mood were significantly increased during high-stressor performance bouts relative to low-stressor bouts (all p < 0.01). The OCR algorithm was refined to provide robust 3-d tracking of facial expressions during head movement. Movements of eyebrows and asymmetries in the mouth were extracted. These parameters are being used in a Hidden Markov model to identify high- and low-stressor conditions. Preliminary results suggest that an OCR algorithm using mouth and eyebrow regions has the potential to discriminate high- from low-stressor performance bouts in 75-88% of subjects. The validity of the workload paradigm to induce differential levels of stress in facial expressions was established. The paradigm also provided the basic stress-related facial expressions required to establish a prototypical OCR algorithm to detect such changes. Efforts are underway to further improve the OCR algorithm by adding facial touching and automating application of the deformable masks and OCR algorithms to video footage of the moving faces as a prelude to blind validation of the automated approach.
应用计算机视觉技术追踪长期太空飞行期间人类面部表情的变化,可能是在关键操作过程中悄然检测压力存在的一种有用方法。为了开发这样一种方法,我们应用光学计算机识别(OCR)算法来检测人们在经历低压力和高压力性能要求时表现过程中的面部变化。工作量和社会反馈被用来改变60名健康成年人(29名男性,31名女性;平均年龄30岁)的性能压力。相对于低工作量场景,高压力场景涉及更困难的性能任务、负面社会反馈和更大的时间压力。使用自我报告评分、唾液皮质醇和心率来追踪压力反应。受试者还完成了性格、情绪和述情障碍问卷。为了推动OCR算法的开发,我们让一位对压力源状况不知情的人类观察者识别经历高压力与低压力性能表现的人的面部表情元素。在性能条件下受试者面部的不同视频集用于OCR算法训练。与低压力时段相比,高压力性能表现时段的压力、任务难度、所需努力、挫折感和负面情绪的主观评分显著增加(所有p < 0.01)。OCR算法经过改进,以在头部运动期间对面部表情进行稳健的三维追踪。提取了眉毛的运动和嘴巴的不对称性。这些参数正在用于隐马尔可夫模型中,以识别高压力和低压力状况。初步结果表明,使用嘴巴和眉毛区域的OCR算法有潜力在75%至88%的受试者中区分高压力和低压力性能表现时段。确立了工作量范式在诱导面部表情不同程度压力方面的有效性。该范式还提供了建立原型OCR算法以检测此类变化所需的基本压力相关面部表情。目前正在努力通过添加面部触摸以及将可变形掩码和OCR算法自动应用于移动面部的视频片段来进一步改进OCR算法,作为对自动方法进行盲法验证的前奏。