Gonzalez Bryan, Garcia Gonzalo, Velastin Sergio A, GholamHosseini Hamid, Tejeda Lino, Farias Gonzalo
Escuela de Ingenieria Electrica, Pontificia Universidad Catolica de Valparaıso, Valparaíso 2340025, Chile.
College of Engineering, Virginia Commonwealth University, Richmond, VA 23220, USA.
Sensors (Basel). 2024 Nov 29;24(23):7660. doi: 10.3390/s24237660.
The work aims to leverage computer vision and artificial intelligence technologies to quantify key components in food distribution services. Specifically, it focuses on dish counting, content identification, and portion size estimation in a dining hall setting. An RGB camera is employed to capture the tray delivery process in a self-service restaurant, providing test images for plate counting and content identification algorithm comparison, using standard evaluation metrics. The approach utilized the YOLO architecture, a widely recognized deep learning model for object detection and computer vision. The model is trained on labeled image data, and its performance is assessed using a precision-recall curve at a confidence threshold of 0.5, achieving a mean average precision (mAP) of 0.873, indicating robust overall performance. The weight estimation procedure combines computer vision techniques to measure food volume using both RGB and depth cameras. Subsequently, density models specific to each food type are applied to estimate the detected food weight. The estimation model's parameters are calibrated through experiments that generate volume-to-weight conversion tables for different food items. Validation of the system was conducted using rice and chicken, yielding error margins of 5.07% and 3.75%, respectively, demonstrating the feasibility and accuracy of the proposed method.
这项工作旨在利用计算机视觉和人工智能技术对食品配送服务中的关键要素进行量化。具体而言,它聚焦于食堂环境中的菜品计数、内容识别和分量估计。使用RGB摄像头在自助餐厅中捕捉托盘配送过程,为餐盘计数和内容识别算法比较提供测试图像,并采用标准评估指标。该方法利用了YOLO架构,这是一种广泛认可的用于目标检测和计算机视觉的深度学习模型。该模型在有标签的图像数据上进行训练,并在置信阈值为0.5时使用精确率-召回率曲线评估其性能,平均精度均值(mAP)达到0.873,表明整体性能稳健。重量估计过程结合计算机视觉技术,使用RGB摄像头和深度摄像头测量食物体积。随后,应用针对每种食物类型的密度模型来估计检测到的食物重量。通过实验为不同食物生成体积与重量转换表,对估计模型的参数进行校准。使用米饭和鸡肉对系统进行验证,误差率分别为5.07%和3.75%,证明了所提方法的可行性和准确性。