Academic Journal

LogMS: a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation

التفاصيل البيبلوغرافية
العنوان: LogMS: a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation
المؤلفون: Zhongjiang Yu, Shaoping Yang, Zhongtai Li, Ligang Li, Hui Luo, Fan Yang
المصدر: Frontiers in Physics, Vol 12 (2024)
بيانات النشر: Frontiers Media S.A., 2024.
سنة النشر: 2024
المجموعة: LCC:Physics
مصطلحات موضوعية: log anomaly detection, multi-source information fusion, probability label estimation, long short-term memory, gate recurrent unit, Physics, QC1-999
الوصف: Introduction: Log anomaly detection is essential for monitoring and maintaining the normal operation of systems. With the rapid development and maturation of deep learning technologies, deep learning-based log anomaly detection has become a prominent research area. However, existing methods primarily concentrate on directly detecting log data in a single stage using specific anomaly information, such as log sequential information or log semantic information. This leads to a limited understanding of log data, resulting in low detection accuracy and poor model robustness.Methods: To tackle this challenge, we propose LogMS, a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation. Before anomaly detection, the logs undergo parsing and vectorization to capture semantic information. Subsequently, we propose a multi-source information fusion-based long short-term memory (MSIF-LSTM) network for the initial stage of anomaly log detection. By fusing semantic information, sequential information, and quantitative information, MSIF-LSTM enhances the anomaly detection capability. Furthermore, we introduce a probability label estimation-based gate recurrent unit (PLE-GRU) network, which leverages easily obtainable normal log labels to construct pseudo-labeled data and train a GRU for further detection. PLE-GRU enhances the detection capability from the perspective of label information. To ensure the overall efficiency of the LogMS, the second-stage will only be activated when anomalies are not detected in the first stage.Results and Discussion: Experimental results demonstrate that LogMS outperforms baseline models across various log anomaly detection datasets, exhibiting superior performance in robustness testing.
نوع الوثيقة: article
وصف الملف: electronic resource
اللغة: English
تدمد: 2296-424X
Relation: https://www.frontiersin.org/articles/10.3389/fphy.2024.1401857/full; https://doaj.org/toc/2296-424X
DOI: 10.3389/fphy.2024.1401857
URL الوصول: https://doaj.org/article/7a479750fe5d4998836bdef7f420d465
رقم الانضمام: edsdoj.7a479750fe5d4998836bdef7f420d465
قاعدة البيانات: Directory of Open Access Journals
الوصف
تدمد:2296424X
DOI:10.3389/fphy.2024.1401857