Deep Video Frame Interpolation Using Cyclic Frame Generation

التفاصيل البيبلوغرافية
العنوان: Deep Video Frame Interpolation Using Cyclic Frame Generation
المؤلفون: Yi Tung Liao, Yu-Lun Liu, Yen-Yu Lin, Yung-Yu Chuang
المصدر: AAAI
بيانات النشر: Association for the Advancement of Artificial Intelligence (AAAI), 2019.
سنة النشر: 2019
مصطلحات موضوعية: Computer science, Frame (networking), Interpolation (computer graphics), ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION, 020206 networking & telecommunications, 02 engineering and technology, General Medicine, Frame rate, Consistency (database systems), 0202 electrical engineering, electronic engineering, information engineering, 020201 artificial intelligence & image processing, Enhanced Data Rates for GSM Evolution, Motion interpolation, Algorithm, Interpolation
الوصف: Video frame interpolation algorithms predict intermediate frames to produce videos with higher frame rates and smooth view transitions given two consecutive frames as inputs. We propose that: synthesized frames are more reliable if they can be used to reconstruct the input frames with high quality. Based on this idea, we introduce a new loss term, the cycle consistency loss. The cycle consistency loss can better utilize the training data to not only enhance the interpolation results, but also maintain the performance better with less training data. It can be integrated into any frame interpolation network and trained in an end-to-end manner. In addition to the cycle consistency loss, we propose two extensions: motion linearity loss and edge-guided training. The motion linearity loss approximates the motion between two input frames to be linear and regularizes the training. By applying edge-guided training, we further improve results by integrating edge information into training. Both qualitative and quantitative experiments demonstrate that our model outperforms the state-of-the-art methods. The source codes of the proposed method and more experimental results will be available at https://github.com/alex04072000/CyclicGen.
تدمد: 2374-3468
2159-5399
DOI: 10.1609/aaai.v33i01.33018794
URL الوصول: https://explore.openaire.eu/search/publication?articleId=doi_________::4fb2f5c45824d76cd73d944d26390013
https://doi.org/10.1609/aaai.v33i01.33018794
Rights: OPEN
رقم الانضمام: edsair.doi...........4fb2f5c45824d76cd73d944d26390013
قاعدة البيانات: OpenAIRE
الوصف
تدمد:23743468
21595399
DOI:10.1609/aaai.v33i01.33018794