How Brow Rotation Affects Emotional Expression Utilizing Artificial Intelligence,Aesthetic Plastic Surgery

当前位置： X-MOL 学术 › Aesth. Plast. Surg. › 论文详情

Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)

How Brow Rotation Affects Emotional Expression Utilizing Artificial Intelligence
Aesthetic Plastic Surgery ( IF 2.0 ) Pub Date : 2023-08-25 , DOI: 10.1007/s00266-023-03615-5
Agnes Zhu ₁ , Thanapoom Boonipat ₂ , Sai Cherukuri ₂ , Jason Lin ₃ , Uldis Bite ₂

Affiliation

Background

It is well known that brow position affects emotional expression. However, there is little literature on how and to what degree this change in emotional expression happens. Previous studies on this topic have utilized manual rating; this method of study remains small and labor intensive. Our objective is to correlate manual brow rotations with emotional outcomes using artificial intelligence to objectively determine how specific brow manipulations affected human expression.

Methods

We included 53 brow-lift patients in this study. Pre-operative patients’ brows were rotated to − 20, − 10, +10, and +20 degrees in respect to the central axis of their existing brow using PIXLR, a cloud-based set of image editing tools and utilities. These images were analyzed using FaceReader, a validated software package that uses computer vision technology for facial expression recognition. The primary facial emotion and intensity of facial action units (0 = no action unit detected to 4 = most intense action unit detected) generated by the software were recorded.

Results

265 total images [5 images (pre-operative, − 20 degree brow rotation, − 10, +10, and +20) per patient] were analyzed using FaceReader. The primary emotion detected in the majority of images was neutral. The percentage of disgust in patients’ expressions, as detected by FaceReader, increased with increased positive brow rotation (1.76% disgust detected at − 20 degrees, 2.09% at − 10 degrees, 2.65% at neutral, 2.61% at +10 degrees, and 2.95% at +20 degrees). In contrast, the percentage of sadness in patients’ expressions decreased with increased positive brow rotation (29.92% sadness detected at − 20 degrees, 21.5% at − 10 degrees, 11.42% at neutral, 15.75% at +10 degrees, and 12.86% at +20 degrees).

Our facial action unit analysis corresponded with primary emotion analysis. The intensity of the inner brow raiser decreased with increased positive brow rotation 8.54% at − 20 degrees, 4.21% at − 10 degrees, 1.48% at neutral, 0.84% at +10 degrees, and 0.76% at +20 degrees). The intensity of the outer brow raiser increased with increased positive brow rotation (0.97% at − 20 degrees, 0.45% at − 10 degrees, 1.12% at neutral, 5.45% at +10 degrees, and 11.19% at +20 degrees).

Conclusion

We demonstrated that increasing the degree of brow rotation correlated positively with the percentage of disgust and inversely with the percentage of sadness detected by FaceReader. This study demonstrated how different manipulated brow positions affected emotional outcomes using artificial intelligence. Physicians can use these findings to better understand how brow-lifts can affect the perceived emotion of their patients.

Level of Evidence III

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266.

中文翻译：

眉毛旋转如何利用人工智能影响情绪表达

背景

众所周知，眉毛的位置影响情绪表达。然而，关于这种情绪表达的变化如何以及在多大程度上发生的文献却很少。先前关于该主题的研究采用了手动评级；这种研究方法仍然规模较小且劳动密集。我们的目标是使用人工智能将手动眉毛旋转与情绪结果相关联，以客观地确定特定的眉毛操作如何影响人类表达。

方法

我们在这项研究中纳入了 53 名提眉患者。使用 PIXLR（一组基于云的图像编辑工具和实用程序）将术前患者的眉毛相对于现有眉毛的中心轴旋转至 − 20、− 10、+10 和 +20 度。这些图像使用 FaceReader 进行分析，FaceReader 是一种经过验证的软件包，使用计算机视觉技术进行面部表情识别。记录软件生成的主要面部情绪和面部动作单元的强度（0 = 未检测到动作单元，4 = 检测到最强烈的动作单元）。

结果

使用 FaceReader 分析了总共 265 张图像 [每位患者 5 张图像（术前，− 20 度眉毛旋转，− 10、+10 和 +20）]。大多数图像中检测到的主要情绪是中性的。 FaceReader 检测到的患者表情中厌恶的百分比随着眉毛正旋转的增加而增加（在 - 20 度时检测到 1.76% 的厌恶，在 - 10 度时检测到 2.09%，在中性时检测到 2.65%，在 +10 度时检测到 2.61%，在+20 度时为 2.95%）。相比之下，患者表情中悲伤的百分比随着眉毛正向旋转的增加而减少（在-20度时检测到悲伤为29.92%，在-10度时检测到21.5%，在中性时检测到11.42%，在+10度时检测到15.75%，在+10度时检测到12.86%） +20 度）。

我们的面部动作单元分析与主要情绪分析相对应。内眉毛提升器的强度随着眉毛正向旋转的增加而降低（-20 度时为 8.54%，-10 度时为 4.21%，中性时为 1.48%，+10 度时为 0.84%，+20 度时为 0.76%）。外侧眉毛提升器的强度随着眉毛正旋转的增加而增加（-20 度时为 0.97%，-10 度时为 0.45%，中性时为 1.12%，+10 度时为 5.45%，+20 度时为 11.19%）。