Investigating Event-Based Cameras for Video Frame Interpolation in Sports

التفاصيل البيبلوغرافية
العنوان: Investigating Event-Based Cameras for Video Frame Interpolation in Sports
المؤلفون: Deckyvere, Antoine, Cioppa, Anthony, Giancola, Silvio, Ghanem, Bernard, Van Droogenbroeck, Marc
المساهمون: Montefiore Institute - Montefiore Institute of Electrical Engineering and Computer Science - ULiège, BE, TELIM
المصدر: International Workshop on Sport, Technology and Research (STAR), Lecco, Italy [IT], du 8 juillet 2024 au 10 juillet 2024
سنة النشر: 2024
مصطلحات موضوعية: Sports, Tennis, Frame interpolation, Event-based camera, Slow-motion, Video understanding, Sports analysis, Engineering, computing & technology, Electrical & electronics engineering, Ingénierie, informatique & technologie, Ingénierie électrique & électronique
الوصف: Slow-motion replays provide a thrilling perspective on pivotal moments within sports games, offering a fresh and captivating visual experience. However, capturing slow-motion footage typically demands high-tech, expensive cameras and infrastructures. Deep learning Video Frame Interpolation (VFI) techniques have emerged as a promising avenue, capable of generating high-speed footage from regular camera feeds. Moreover, the utilization of event-based cameras has recently gathered attention as they provide valuable motion information between frames, further enhancing the VFI performances. In this work, we present a first investigation of event-based VFI models for generating sports slow-motion videos. Particularly, we design and implement a bi-camera recording setup, including an RGB and an event-based camera to capture sports videos, to temporally align and spatially register both cameras. Our experimental validation demonstrates that TimeLens, an off-the-shelf event-based VFI model, can effectively generate slow-motion footage for sports videos. This first investigation underscores the practical utility of event-based cameras in producing sports slow-motion content and lays the groundwork for future research endeavors in this domain.
نوع الوثيقة: conference paper
http://purl.org/coar/resource_type/c_5794
conferenceObject
peer reviewed
اللغة: English
Relation: http://xplorestaging.ieee.org/ielx8/10635100/10635908/10635973.pdf?arnumber=10635973
DOI: 10.1109/star62027.2024.10635973
URL الوصول: https://orbi.uliege.be/handle/2268/321654
Rights: open access
http://purl.org/coar/access_right/c_abf2
info:eu-repo/semantics/openAccess
رقم الانضمام: edsorb.321654
قاعدة البيانات: ORBi
الوصف
DOI:10.1109/star62027.2024.10635973