Academic Journal
On the Influence of Data Resampling for Deep Learning-Based Log Anomaly Detection: Insights and Recommendations
| العنوان: | On the Influence of Data Resampling for Deep Learning-Based Log Anomaly Detection: Insights and Recommendations |
|---|---|
| المؤلفون: | Ma, X, Zou, H, He, P, Keung, J, Li, Y, Yu, X, Sarro, F |
| المصدر: | IEEE Transactions on Software Engineering pp. 1-18. (2024) (In press). |
| بيانات النشر: | Institute of Electrical and Electronics Engineers (IEEE) |
| سنة النشر: | 2024 |
| المجموعة: | University College London: UCL Discovery |
| مصطلحات موضوعية: | Deep Learning-Based Log Anomaly Detection, Data Resampling Methods, Class Imbalance, Empirical Analysis |
| الوصف: | DLLAD methods may underperform in severely imbalanced datasets. Although data resampling has proven effective in other software engineering tasks, it has not been explored in LAD. This study aims to fill this gap by providing an in-depth analysis of the impact of diverse data resampling methods on existing DLLAD approaches from two distinct perspectives. Firstly, we assess the performance of these DLLAD approaches across four datasets with different levels of class imbalance, and we explore the impact of resampling ratios of normal to abnormal data on DLLAD approaches. Secondly, we evaluate the effectiveness of the data resampling methods when utilizing optimal resampling ratios of normal to abnormal data. Our findings indicate that oversampling methods generally outperform undersampling and hybrid sampling methods. Data resampling on raw data yields superior results compared to data resampling in the feature space. These improvements are attributed to the increased attention given to important tokens. By exploring the resampling ratio of normal to abnormal data, we suggest generating more data for minority classes through oversampling while removing less data from majority classes through undersampling. In conclusion, our study provides valuable insights into the intricate relationship between data resampling methods and DLLAD. By addressing the challenge of class imbalance, researchers and practitioners can enhance DLLAD performance. |
| نوع الوثيقة: | article in journal/newspaper |
| وصف الملف: | text |
| اللغة: | English |
| Relation: | https://discovery.ucl.ac.uk/id/eprint/10203078/ |
| الاتاحة: | https://discovery.ucl.ac.uk/id/eprint/10203078/1/On_the_Influence_of_Data_Resampling_for_Deep_Learning-Based_Log_Anomaly_Detection_Insights_and_Recommendations.pdf https://discovery.ucl.ac.uk/id/eprint/10203078/ |
| Rights: | open |
| رقم الانضمام: | edsbas.403AA7BB |
| قاعدة البيانات: | BASE |
| الوصف غير متاح. |