• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于机器学习的实时异常检测,利用服务器场遥测中的数据预处理。

Machine learning-based real-time anomaly detection using data pre-processing in the telemetry of server farms.

作者信息

Vajda Dániel László, Do Tien Van, Bérczes Tamás, Farkas Károly

机构信息

Department of Networked Systems and Services, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Magyar tudósok krt. 2, 1117, Budapest, Hungary.

Faculty of Informatics, University of Debrecen, Kassai út 26, 4028, Debrecen, Hungary.

出版信息

Sci Rep. 2024 Oct 7;14(1):23288. doi: 10.1038/s41598-024-72982-z.

DOI:10.1038/s41598-024-72982-z
PMID:39375416
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11458768/
Abstract

Fast and accurate anomaly detection is critical in telemetry systems because it helps operators take appropriate actions in response to abnormal behaviours. However, recent techniques are accurate but not fast enough to deal with real-time data. There is a need to reduce the anomaly detection time, which motivates us to propose two new algorithms called AnDePeD (Anomaly Detector on Periodic Data) and AnDePed Pro. The novelty of the proposed algorithms lies in exploiting the periodic nature of data in anomaly detection. Our proposed algorithms apply a variational mode decomposition technique to find and extract periodic components from the original data before using Long Short-Term Memory neural networks to detect anomalies in the remainder time series. Furthermore, our methods include advanced techniques to eliminate prediction errors and automatically tune operational parameters. Extensive numerical results show that the proposed algorithms achieve comparable performance in terms of Precision, Recall, F-score, and MCC metrics while outperforming most of the state-of-the-art anomaly detection approaches in terms of initialisation delay and detection delay, which is favourable for practical applications.

摘要

在遥测系统中,快速准确的异常检测至关重要,因为它能帮助操作人员针对异常行为采取适当行动。然而,最近的技术虽然准确,但处理实时数据的速度不够快。有必要减少异常检测时间,这促使我们提出两种新算法,即AnDePeD(周期性数据异常检测器)和AnDePed Pro。所提出算法的新颖之处在于在异常检测中利用数据的周期性。我们提出的算法应用变分模态分解技术,在使用长短期记忆神经网络检测剩余时间序列中的异常之前,从原始数据中找到并提取周期性成分。此外,我们的方法包括消除预测误差和自动调整操作参数的先进技术。大量数值结果表明,所提出的算法在精度、召回率、F值和MCC指标方面取得了可比的性能,同时在初始化延迟和检测延迟方面优于大多数现有异常检测方法,这有利于实际应用。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/e74648ca8823/41598_2024_72982_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/b798277148ea/41598_2024_72982_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/41f90e03988b/41598_2024_72982_Figa_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/4b026c8afa82/41598_2024_72982_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/65cec9341cb9/41598_2024_72982_Figb_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/1f88534ade13/41598_2024_72982_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/0b4449589aa0/41598_2024_72982_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/5dfa9b4d1d83/41598_2024_72982_Figc_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/8c1d2c9f6f7b/41598_2024_72982_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/387b8924d80d/41598_2024_72982_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/e74648ca8823/41598_2024_72982_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/b798277148ea/41598_2024_72982_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/41f90e03988b/41598_2024_72982_Figa_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/4b026c8afa82/41598_2024_72982_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/65cec9341cb9/41598_2024_72982_Figb_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/1f88534ade13/41598_2024_72982_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/0b4449589aa0/41598_2024_72982_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/5dfa9b4d1d83/41598_2024_72982_Figc_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/8c1d2c9f6f7b/41598_2024_72982_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/387b8924d80d/41598_2024_72982_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fe0/11458768/e74648ca8823/41598_2024_72982_Fig7_HTML.jpg

相似文献

1
Machine learning-based real-time anomaly detection using data pre-processing in the telemetry of server farms.基于机器学习的实时异常检测,利用服务器场遥测中的数据预处理。
Sci Rep. 2024 Oct 7;14(1):23288. doi: 10.1038/s41598-024-72982-z.
2
Anomaly Detection in Satellite Telemetry Data Using a Sparse Feature-Based Method.基于稀疏特征的卫星遥测数据异常检测方法。
Sensors (Basel). 2022 Aug 24;22(17):6358. doi: 10.3390/s22176358.
3
An Evaluation of Anomaly Detection and Diagnosis in Multivariate Time Series.多变量时间序列中的异常检测与诊断评估。
IEEE Trans Neural Netw Learn Syst. 2022 Jun;33(6):2508-2517. doi: 10.1109/TNNLS.2021.3105827. Epub 2022 Jun 1.
4
Unsupervised Anomaly Detection for Cars CAN Sensors Time Series Using Small Recurrent and Convolutional Neural Networks.基于小型递归和卷积神经网络的汽车 CAN 传感器时间序列的无监督异常检测。
Sensors (Basel). 2023 May 23;23(11):5013. doi: 10.3390/s23115013.
5
Unsupervised Anomaly Detection in Stream Data with Online Evolving Spiking Neural Networks.基于在线进化尖峰神经网络的流数据无监督异常检测。
Neural Netw. 2021 Jul;139:118-139. doi: 10.1016/j.neunet.2021.02.017. Epub 2021 Feb 25.
6
Anomaly detection in multivariate time series data using deep ensemble models.基于深度集成模型的多元时间序列数据异常检测。
PLoS One. 2024 Jun 6;19(6):e0303890. doi: 10.1371/journal.pone.0303890. eCollection 2024.
7
Anomaly Detection Using an Ensemble of Multi-Point LSTMs.使用多点长短期记忆网络集成进行异常检测
Entropy (Basel). 2023 Oct 26;25(11):1480. doi: 10.3390/e25111480.
8
LSTM-Based VAE-GAN for Time-Series Anomaly Detection.基于长短期记忆网络的变分自编码器生成对抗网络用于时间序列异常检测。
Sensors (Basel). 2020 Jul 3;20(13):3738. doi: 10.3390/s20133738.
9
FedLGAN: a method for anomaly detection and repair of hydrological telemetry data based on federated learning.联邦学习生成对抗网络(FedLGAN):一种基于联邦学习的水文遥测数据异常检测与修复方法。
PeerJ Comput Sci. 2023 Nov 7;9:e1664. doi: 10.7717/peerj-cs.1664. eCollection 2023.
10
A Three-Dimensional ResNet and Transformer-Based Approach to Anomaly Detection in Multivariate Temporal-Spatial Data.一种基于三维残差网络和Transformer的多元时空数据异常检测方法。
Entropy (Basel). 2023 Jan 17;25(2):180. doi: 10.3390/e25020180.

本文引用的文献

1
The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation.马修斯相关系数(MCC)在二分类评估中优于 F1 得分和准确率的优势。
BMC Genomics. 2020 Jan 2;21(1):6. doi: 10.1186/s12864-019-6413-7.
2
A multi-source dataset of urban life in the city of Milan and the Province of Trentino.米兰市和特伦蒂诺省的城市生活多源数据集。
Sci Data. 2015 Oct 27;2:150055. doi: 10.1038/sdata.2015.55. eCollection 2015.
3
Long short-term memory.长短期记忆
Neural Comput. 1997 Nov 15;9(8):1735-80. doi: 10.1162/neco.1997.9.8.1735.