• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

DA-LSTM-VAE:用于关键绩效指标异常检测的基于双阶段注意力机制的长短期记忆变分自编码器

DA-LSTM-VAE: Dual-Stage Attention-Based LSTM-VAE for KPI Anomaly Detection.

作者信息

Zhao Yun, Zhang Xiuguo, Shang Zijing, Cao Zhiying

机构信息

School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China.

出版信息

Entropy (Basel). 2022 Nov 5;24(11):1613. doi: 10.3390/e24111613.

DOI:10.3390/e24111613
PMID:36359702
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9689873/
Abstract

To ensure the normal operation of the system, the enterprise's operations engineer will monitor the system through the KPI (key performance indicator). For example, web page visits, server memory utilization, etc. KPI anomaly detection is a core technology, which is of great significance for rapid fault detection and repair. This paper proposes a novel dual-stage attention-based LSTM-VAE (DA-LSTM-VAE) model for KPI anomaly detection. Firstly, in order to capture time correlation in KPI data, long-short-term memory (LSTM) units are used to replace traditional neurons in the variational autoencoder (VAE). Then, in order to improve the effect of KPI anomaly detection, an attention mechanism is introduced into the input stage of the encoder and decoder, respectively. During the input stage of the encoder, a time attention mechanism is adopted to assign different weights to different time points, which can adaptively select important input sequences to avoid the influence of noise in the data. During the input stage of the decoder, a feature attention mechanism is adopted to adaptively select important latent variable representations, which can capture the long-term dependence of time series better. In addition, this paper proposes an adaptive threshold method based on anomaly scores measured by reconstruction probability, which can minimize false positives and false negatives and avoid adjustment of the threshold manually. Experimental results in a public dataset show that the proposed method in this paper outperforms other baseline methods.

摘要

为确保系统正常运行,企业的运维工程师将通过关键绩效指标(KPI)来监控系统。例如,网页访问量、服务器内存利用率等。KPI异常检测是一项核心技术,对于快速故障检测和修复具有重要意义。本文提出了一种用于KPI异常检测的新型基于双阶段注意力的长短期记忆变分自编码器(DA-LSTM-VAE)模型。首先,为了捕捉KPI数据中的时间相关性,在变分自编码器(VAE)中使用长短期记忆(LSTM)单元来取代传统神经元。然后,为了提高KPI异常检测的效果,在编码器和解码器的输入阶段分别引入注意力机制。在编码器的输入阶段,采用时间注意力机制为不同时间点分配不同权重,能够自适应地选择重要的输入序列,避免数据中噪声的影响。在解码器的输入阶段,采用特征注意力机制自适应地选择重要的潜在变量表示,能够更好地捕捉时间序列的长期依赖性。此外,本文提出了一种基于重构概率测量的异常分数的自适应阈值方法,该方法可以最小化误报和漏报,并避免手动调整阈值。在一个公共数据集上的实验结果表明,本文提出的方法优于其他基线方法。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/638db6820304/entropy-24-01613-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/4fb11c64260c/entropy-24-01613-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/efbbf3682b7a/entropy-24-01613-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/c852a73c38cc/entropy-24-01613-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/949131aca5fc/entropy-24-01613-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/beaa2e469f48/entropy-24-01613-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/e96a4af13d65/entropy-24-01613-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/8f7b85500bbf/entropy-24-01613-g007a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/4b92a2214d5c/entropy-24-01613-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/e44de8f39fb1/entropy-24-01613-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/c66371280769/entropy-24-01613-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/638db6820304/entropy-24-01613-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/4fb11c64260c/entropy-24-01613-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/efbbf3682b7a/entropy-24-01613-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/c852a73c38cc/entropy-24-01613-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/949131aca5fc/entropy-24-01613-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/beaa2e469f48/entropy-24-01613-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/e96a4af13d65/entropy-24-01613-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/8f7b85500bbf/entropy-24-01613-g007a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/4b92a2214d5c/entropy-24-01613-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/e44de8f39fb1/entropy-24-01613-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/c66371280769/entropy-24-01613-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e7b/9689873/638db6820304/entropy-24-01613-g011.jpg

相似文献

1
DA-LSTM-VAE: Dual-Stage Attention-Based LSTM-VAE for KPI Anomaly Detection.DA-LSTM-VAE:用于关键绩效指标异常检测的基于双阶段注意力机制的长短期记忆变分自编码器
Entropy (Basel). 2022 Nov 5;24(11):1613. doi: 10.3390/e24111613.
2
LSTM-Based VAE-GAN for Time-Series Anomaly Detection.基于长短期记忆网络的变分自编码器生成对抗网络用于时间序列异常检测。
Sensors (Basel). 2020 Jul 3;20(13):3738. doi: 10.3390/s20133738.
3
Attention Autoencoder for Generative Latent Representational Learning in Anomaly Detection.注意自编码器在异常检测中的生成潜在表示学习。
Sensors (Basel). 2021 Dec 24;22(1):123. doi: 10.3390/s22010123.
4
Multi-Channel Multi-Scale Convolution Attention Variational Autoencoder (MCA-VAE): An Interpretable Anomaly Detection Algorithm Based on Variational Autoencoder.多通道多尺度卷积注意力变分自编码器(MCA-VAE):一种基于变分自编码器的可解释异常检测算法。
Sensors (Basel). 2024 Aug 16;24(16):5316. doi: 10.3390/s24165316.
5
Multi-mode non-Gaussian variational autoencoder network with missing sources for anomaly detection of complex electromechanical equipment.用于复杂机电设备异常检测的具有缺失源的多模态非高斯变分自编码器网络
ISA Trans. 2023 Mar;134:144-158. doi: 10.1016/j.isatra.2022.09.009. Epub 2022 Sep 12.
6
Fault Detection and Diagnosis in Industrial Processes with Variational Autoencoder: A Comprehensive Study.基于变分自编码器的工业过程故障检测与诊断:综合研究。
Sensors (Basel). 2021 Dec 29;22(1):227. doi: 10.3390/s22010227.
7
Adaptive prediction for effluent quality of wastewater treatment plant: Improvement with a dual-stage attention-based LSTM network.基于双阶段注意力机制 LSTM 网络的污水处理厂出水水质自适应预测方法
J Environ Manage. 2024 May;359:120887. doi: 10.1016/j.jenvman.2024.120887. Epub 2024 Apr 27.
8
ResNet-AE for Radar Signal Anomaly Detection.用于雷达信号异常检测的残差神经网络自动编码器
Sensors (Basel). 2022 Aug 19;22(16):6249. doi: 10.3390/s22166249.
9
ACVAE: A novel self-adversarial variational auto-encoder combined with contrast learning for time series anomaly detection.ACVAE:一种新颖的自对抗变分自动编码器,结合对比学习用于时间序列异常检测。
Neural Netw. 2024 Mar;171:383-395. doi: 10.1016/j.neunet.2023.12.023. Epub 2023 Dec 15.
10
Nonlinear quality-related fault detection using combined deep variational information bottleneck and variational autoencoder.基于深度变分信息瓶颈与变分自编码器相结合的非线性质量相关故障检测
ISA Trans. 2021 Aug;114:444-454. doi: 10.1016/j.isatra.2021.01.002. Epub 2021 Jan 11.

本文引用的文献

1
LSTM-Based VAE-GAN for Time-Series Anomaly Detection.基于长短期记忆网络的变分自编码器生成对抗网络用于时间序列异常检测。
Sensors (Basel). 2020 Jul 3;20(13):3738. doi: 10.3390/s20133738.
2
A dual-stage two-phase model of selective attention.一种两阶段双相选择性注意模型。
Psychol Rev. 2010 Jul;117(3):759-84. doi: 10.1037/a0019471.
3
Reducing the dimensionality of data with neural networks.使用神经网络降低数据维度。
Science. 2006 Jul 28;313(5786):504-7. doi: 10.1126/science.1127647.
4
Time series modeling for syndromic surveillance.用于症状监测的时间序列建模
BMC Med Inform Decis Mak. 2003 Jan 23;3:2. doi: 10.1186/1472-6947-3-2.
5
Long short-term memory.长短期记忆
Neural Comput. 1997 Nov 15;9(8):1735-80. doi: 10.1162/neco.1997.9.8.1735.