Faber Kamil, Pietron Marcin, Zurek Dominik
Department of Computer Science, AGH University of Science and Technology, Adama Mickiewicza 30, 30-059 Krakow, Poland.
Entropy (Basel). 2021 Nov 6;23(11):1466. doi: 10.3390/e23111466.
Multivariate time series anomaly detection is a widespread problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anomaly detection process quite difficult for humans. Algorithms that automate the process of detecting anomalies are crucial in modern failure prevention systems. Therefore, many machine learning models have been designed to address this problem. Mostly, they are autoencoder-based architectures with some generative adversarial elements. This work shows a framework that incorporates neuroevolution methods to boost the anomaly detection scores of new and already known models. The presented approach adapts evolution strategies for evolving an ensemble model, in which every single model works on a subgroup of data sensors. The next goal of neuroevolution is to optimize the architecture and hyperparameters such as the window size, the number of layers, and the layer depths. The proposed framework shows that it is possible to boost most anomaly detection deep learning models in a reasonable time and a fully automated mode. We ran tests on the SWAT and WADI datasets. To the best of our knowledge, this is the first approach in which an ensemble deep learning anomaly detection model is built in a fully automatic way using a neuroevolution strategy.
多变量时间序列异常检测是故障预防领域中一个普遍存在的问题。快速预防意味着更低的维修成本和损失。新型工业系统中的传感器数量众多,这使得异常检测过程对人类来说相当困难。能够自动执行异常检测过程的算法在现代故障预防系统中至关重要。因此,人们设计了许多机器学习模型来解决这个问题。大多数情况下,它们是基于自动编码器的架构,并带有一些生成对抗元素。这项工作展示了一个框架,该框架结合了神经进化方法来提高新模型和已知模型的异常检测分数。所提出的方法采用进化策略来演化一个集成模型,其中每个单独的模型处理数据传感器的一个子组。神经进化的下一个目标是优化架构和超参数,如窗口大小、层数和层深度。所提出的框架表明,有可能在合理的时间内以完全自动化的模式提高大多数异常检测深度学习模型的性能。我们在SWAT和WADI数据集上进行了测试。据我们所知,这是第一种使用神经进化策略以全自动方式构建集成深度学习异常检测模型的方法。