Suppr超能文献

揭示 ChatGPT 和 YOLOv7 在利用儿童艺术表达评估其情绪方面的潜力。

Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children's Emotions Using Their Artistic Expressions.

机构信息

College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar.

出版信息

Stud Health Technol Inform. 2024 Aug 22;316:409-413. doi: 10.3233/SHTI240434.

Abstract

Recent advancements in large language models (LLMs) have sparked considerable interest in their potential applications across various healthcare domains. One promising prospect is leveraging these generative models to accurately predict children's emotions by combining computer vision and natural language processing techniques. However, understanding children's emotional states based on their artistic expressions is equally crucial. To address this challenge, this paper presents a pipelined architecture comprising YOLOv7 and the powerful GPT-3.5 Turbo language model, where YOLOv7 is employed for object detection using art therapy imaging annotations, while GPT-3.5 interprets the sketches. After rigorously evaluating the proposed framework through a series of comprehensive experiments, we observed that our model achieved high confidence scores for both object detection and emotion interpretation. The robust performance of the proposed framework not only aids in explaining children's art but also provides valuable insights for parents and therapists. This capability enables them to better understand children's emotional states based on their artistic expressions, ultimately facilitating improved support and care.

摘要

最近,大型语言模型(LLM)的发展引起了人们对其在各个医疗保健领域应用的极大兴趣。一个很有前途的前景是利用这些生成模型,通过结合计算机视觉和自然语言处理技术,准确预测儿童的情绪。然而,基于儿童的艺术表达来理解他们的情绪状态同样至关重要。为了解决这一挑战,本文提出了一个由 YOLOv7 和强大的 GPT-3.5 Turbo 语言模型组成的流水线架构,其中 YOLOv7 用于使用艺术治疗成像注释进行对象检测,而 GPT-3.5 则解释草图。通过一系列全面的实验,对所提出的框架进行了严格的评估,我们观察到我们的模型在对象检测和情感解释方面都获得了很高的置信度得分。该框架的稳健性能不仅有助于解释儿童的艺术,还为家长和治疗师提供了有价值的见解。这种能力使他们能够根据儿童的艺术表达更好地理解他们的情绪状态,最终为提供更好的支持和护理提供帮助。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验