IEEE Trans Image Process. 2015 Dec;24(12):6034-47. doi: 10.1109/TIP.2015.2496314. Epub 2015 Oct 30.
Micro-expressions are brief involuntary facial expressions that reveal genuine emotions and, thus, help detect lies. Because of their many promising applications, they have attracted the attention of researchers from various fields. Recent research reveals that two perceptual color spaces (CIELab and CIELuv) provide useful information for expression recognition. This paper is an extended version of our International Conference on Pattern Recognition paper, in which we propose a novel color space model, tensor independent color space (TICS), to help recognize micro-expressions. In this paper, we further show that CIELab and CIELuv are also helpful in recognizing micro-expressions, and we indicate why these three color spaces achieve better performance. A micro-expression color video clip is treated as a fourth-order tensor, i.e., a four-dimension array. The first two dimensions are the spatial information, the third is the temporal information, and the fourth is the color information. We transform the fourth dimension from RGB into TICS, in which the color components are as independent as possible. The combination of dynamic texture and independent color components achieves a higher accuracy than does that of RGB. In addition, we define a set of regions of interests (ROIs) based on the facial action coding system and calculated the dynamic texture histograms for each ROI. Experiments are conducted on two micro-expression databases, CASME and CASME 2, and the results show that the performances for TICS, CIELab, and CIELuv are better than those for RGB or gray.
微表情是短暂的、无意识的面部表情,能揭示真实的情感,因此有助于识别谎言。由于其具有许多很有前途的应用,吸引了来自不同领域的研究人员的关注。最近的研究表明,两个感知颜色空间(CIELab 和 CIELuv)为表情识别提供了有用的信息。本文是我们在国际模式识别会议上论文的扩展版本,提出了一种新的颜色空间模型——张量独立颜色空间(TICS),以帮助识别微表情。本文进一步表明,CIELab 和 CIELuv 也有助于识别微表情,并指出这三个颜色空间为何能取得更好的性能。微表情彩色视频片段被视为四阶张量,即四维数组。前两个维度是空间信息,第三个是时间信息,第四个是颜色信息。我们将第四个维度从 RGB 转换为 TICS,其中颜色分量尽可能独立。动态纹理和独立颜色分量的组合比 RGB 实现更高的准确性。此外,我们根据面部动作编码系统定义了一组感兴趣区域(ROI),并为每个 ROI 计算了动态纹理直方图。在两个微表情数据库 CASME 和 CASME 2 上进行了实验,结果表明 TICS、CIELab 和 CIELuv 的性能优于 RGB 或灰度。