Aslam Asra, Curry Edward
Insight Centre for Data Analytics, NUI Galway, Galway, Ireland.
Multimed Tools Appl. 2021;80(9):13021-13057. doi: 10.1007/s11042-020-10277-x. Epub 2021 Jan 9.
The enormous growth of multimedia content in the field of the Internet of Things (IoT) leads to the challenge of processing multimedia streams in real-time. Event-based systems are constructed to process event streams. They cannot natively consume multimedia event types produced by the Internet of Multimedia Things (IoMT) generated data to answer multimedia-based user subscriptions. Machine learning-based techniques have enabled rapid progress in solving real-world problems and need to be optimised for the low response time of the multimedia event processing paradigm. In this paper, we describe a classifier construction approach for the training of online classifiers, that can handle dynamic subscriptions with low response time and provide reasonable accuracy for the multimedia event processing. We find that the current object detection methods can be configured dynamically for the construction of classifiers in real-time, by tuning hyperparameters even when training from scratch. Our experiments demonstrate that deep neural network-based object detection models, with hyperparameter tuning, can improve the performance within less training time for the answering of previously unknown user subscriptions. The results from this study show that the proposed online classifier training based model can achieve accuracy of 79.00% with 15-min of training and 84.28% with 1-hour training from scratch on a single GPU for the processing of multimedia events.
物联网(IoT)领域中多媒体内容的巨大增长带来了实时处理多媒体流的挑战。基于事件的系统旨在处理事件流。它们无法原生处理由多媒体物联网(IoMT)生成的数据所产生的多媒体事件类型,以响应基于多媒体的用户订阅。基于机器学习的技术在解决现实世界问题方面取得了快速进展,并且需要针对多媒体事件处理范式的低响应时间进行优化。在本文中,我们描述了一种用于训练在线分类器的分类器构建方法,该方法可以处理具有低响应时间的动态订阅,并为多媒体事件处理提供合理的准确性。我们发现,当前的目标检测方法可以通过调整超参数,甚至在从头开始训练时,动态配置以实时构建分类器。我们的实验表明,基于深度神经网络的目标检测模型,通过超参数调整,可以在更短的训练时间内提高性能,以响应先前未知的用户订阅。这项研究的结果表明,所提出的基于在线分类器训练的模型在单个GPU上处理多媒体事件时,从零开始训练15分钟可达到79.00%的准确率,训练1小时可达到84.28%的准确率。