From Obstacles to Resources: Semi-supervised Learning Faces Synthetic Data Contamination

التفاصيل البيبلوغرافية
العنوان: From Obstacles to Resources: Semi-supervised Learning Faces Synthetic Data Contamination
المؤلفون: Wang, Zerun, Mao, Jiafeng, Xiang, Liuyu, Yamasaki, Toshihiko
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computer Vision and Pattern Recognition
الوصف: Semi-supervised learning (SSL) can improve model performance by leveraging unlabeled images, which can be collected from public image sources with low costs. In recent years, synthetic images have become increasingly common in public image sources due to rapid advances in generative models. Therefore, it is becoming inevitable to include existing synthetic images in the unlabeled data for SSL. How this kind of contamination will affect SSL remains unexplored. In this paper, we introduce a new task, Real-Synthetic Hybrid SSL (RS-SSL), to investigate the impact of unlabeled data contaminated by synthetic images for SSL. First, we set up a new RS-SSL benchmark to evaluate current SSL methods and found they struggled to improve by unlabeled synthetic images, sometimes even negatively affected. To this end, we propose RSMatch, a novel SSL method specifically designed to handle the challenges of RS-SSL. RSMatch effectively identifies unlabeled synthetic data and further utilizes them for improvement. Extensive experimental results show that RSMatch can transfer synthetic unlabeled data from `obstacles' to `resources.' The effectiveness is further verified through ablation studies and visualization.
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2405.16930
رقم الانضمام: edsarx.2405.16930
قاعدة البيانات: arXiv