Report
Task-recency bias strikes back: Adapting covariances in Exemplar-Free Class Incremental Learning
| العنوان: | Task-recency bias strikes back: Adapting covariances in Exemplar-Free Class Incremental Learning |
|---|---|
| المؤلفون: | Rypeść, Grzegorz, Cygert, Sebastian, Trzciński, Tomasz, Twardowski, Bartłomiej |
| سنة النشر: | 2024 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Machine Learning, Computer Science - Computer Vision and Pattern Recognition |
| الوصف: | Exemplar-Free Class Incremental Learning (EFCIL) tackles the problem of training a model on a sequence of tasks without access to past data. Existing state-of-the-art methods represent classes as Gaussian distributions in the feature extractor's latent space, enabling Bayes classification or training the classifier by replaying pseudo features. However, we identify two critical issues that compromise their efficacy when the feature extractor is updated on incremental tasks. First, they do not consider that classes' covariance matrices change and must be adapted after each task. Second, they are susceptible to a task-recency bias caused by dimensionality collapse occurring during training. In this work, we propose AdaGauss -- a novel method that adapts covariance matrices from task to task and mitigates the task-recency bias owing to the additional anti-collapse loss function. AdaGauss yields state-of-the-art results on popular EFCIL benchmarks and datasets when training from scratch or starting from a pre-trained backbone. The code is available at: https://github.com/grypesc/AdaGauss. Comment: Accepted for NeurIPS 2024 |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2409.18265 |
| رقم الانضمام: | edsarx.2409.18265 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |