Academic Journal

Zero-Inflated Binary Classification Model with Elastic Net Regularization

التفاصيل البيبلوغرافية
العنوان: Zero-Inflated Binary Classification Model with Elastic Net Regularization
المؤلفون: Hua Xin, Yuhlong Lio, Hsien-Ching Chen, Tzong-Ru Tsai
المصدر: Mathematics, Vol 12, Iss 19, p 2990 (2024)
بيانات النشر: MDPI AG, 2024.
سنة النشر: 2024
المجموعة: LCC:Mathematics
مصطلحات موضوعية: expectation-maximization algorithm, gradient descent method, learning rate, maximum likelihood estimation, zero-inflated model, Mathematics, QA1-939
الوصف: Zero inflation and overfitting can reduce the accuracy rate of using machine learning models for characterizing binary data sets. A zero-inflated Bernoulli (ZIBer) model can be the right model to characterize zero-inflated binary data sets. When the ZIBer model is used to characterize zero-inflated binary data sets, overcoming the overfitting problem is still an open question. To improve the overfitting problem for using the ZIBer model, the minus log-likelihood function of the ZIBer model with the elastic net regularization rule for an overfitting penalty is proposed as the loss function. An estimation procedure to minimize the loss function is developed in this study using the gradient descent method (GDM) with the momentum term as the learning rate. The proposed estimation method has two advantages. First, the proposed estimation method can be a general method that simultaneously uses L1- and L2-norm terms for penalty and includes the ridge and least absolute shrinkage and selection operator methods as special cases. Second, the momentum learning rate can accelerate the convergence of the GDM and enhance the computation efficiency of the proposed estimation procedure. The parameter selection strategy is studied, and the performance of the proposed method is evaluated using Monte Carlo simulations. A diabetes example is used as an illustration.
نوع الوثيقة: article
وصف الملف: electronic resource
اللغة: English
تدمد: 2227-7390
Relation: https://www.mdpi.com/2227-7390/12/19/2990; https://doaj.org/toc/2227-7390
DOI: 10.3390/math12192990
URL الوصول: https://doaj.org/article/49e958e20ed2483a881e2f8f0b799c3e
رقم الانضمام: edsdoj.49e958e20ed2483a881e2f8f0b799c3e
قاعدة البيانات: Directory of Open Access Journals
الوصف
تدمد:22277390
DOI:10.3390/math12192990