Liyanarachchi Rashini, Wijekoon Janaka, Premathilaka Manujaya, Vidhanaarachchi Samitha
National University of Singapore, Singapore.
Military Technological College, Muscat, Oman.
Eng Appl Artif Intell. 2023 Jun 28:106709. doi: 10.1016/j.engappai.2023.106709.
The COVID-19 pandemic disrupted regular global activities in every possible way. This pandemic, caused by the transmission of the infectious Coronavirus, is characterized by main symptoms such as fever, fatigue, cough, and loss of smell. A current key focus of the scientific community is to develop automated methods that can effectively identify COVID-19 patients and are also adaptable for foreseen future virus outbreaks. To classify COVID-19 suspects, it is required to use contactless automatic measurements of more than one symptom. This study explores the effectiveness of using Deep Learning combined with a hardware-emulated system to identify COVID-19 patients in Sri Lanka based on two main symptoms: cough and shortness of breath. To achieve this, a Convolutional Neural Network (CNN) based on Transfer Learning was employed to analyze and compare the features of a COVID-19 cough with other types of coughs. Real-time video footage was captured using a FLIR C2 thermal camera and a web camera and subsequently processed using OpenCV image processing algorithms. The objective was to detect the nasal cavities in the video frames and measure the breath cycles per minute, thereby identifying instances of shortness of breath. The proposed method was first tested on crowd-sourced datasets (Coswara, Coughvid, ESC-50, and a dataset from Kaggle) obtained online. It was then applied and verified using a dataset obtained from local hospitals in Sri Lanka. The accuracy of the developed methodologies in diagnosing cough resemblance and recognizing shortness of breath was found to be 94% and 95%, respectively.
新冠疫情以各种可能的方式扰乱了全球正常活动。这场由传染性冠状病毒传播引发的疫情,主要症状包括发热、乏力、咳嗽和嗅觉丧失。科学界当前的一个关键重点是开发能够有效识别新冠患者且适用于未来可预见病毒爆发的自动化方法。为了对新冠疑似病例进行分类,需要使用对多种症状进行非接触式自动测量的方法。本研究探讨了结合深度学习与硬件模拟系统,基于咳嗽和呼吸急促这两种主要症状来识别斯里兰卡新冠患者的有效性。为此,采用了基于迁移学习的卷积神经网络(CNN)来分析和比较新冠咳嗽与其他类型咳嗽的特征。使用FLIR C2热成像相机和网络摄像头捕获实时视频画面,随后使用OpenCV图像处理算法进行处理。目的是在视频帧中检测鼻腔并测量每分钟的呼吸周期,从而识别呼吸急促的情况。所提出的方法首先在网上获取的众包数据集(Coswara、Coughvid、ESC - 50以及来自Kaggle的一个数据集)上进行测试。然后使用从斯里兰卡当地医院获得的数据集进行应用和验证。结果发现,所开发方法在诊断咳嗽相似度和识别呼吸急促方面的准确率分别为94%和95%。