Report
Creatures great and SMAL: Recovering the shape and motion of animals from video
العنوان: | Creatures great and SMAL: Recovering the shape and motion of animals from video |
---|---|
المؤلفون: | Biggs, Benjamin, Roddick, Thomas, Fitzgibbon, Andrew, Cipolla, Roberto |
سنة النشر: | 2018 |
المجموعة: | Computer Science |
مصطلحات موضوعية: | Computer Science - Computer Vision and Pattern Recognition |
الوصف: | We present a system to recover the 3D shape and motion of a wide variety of quadrupeds from video. The system comprises a machine learning front-end which predicts candidate 2D joint positions, a discrete optimization which finds kinematically plausible joint correspondences, and an energy minimization stage which fits a detailed 3D model to the image. In order to overcome the limited availability of motion capture training data from animals, and the difficulty of generating realistic synthetic training images, the system is designed to work on silhouette data. The joint candidate predictor is trained on synthetically generated silhouette images, and at test time, deep learning methods or standard video segmentation tools are used to extract silhouettes from real data. The system is tested on animal videos from several species, and shows accurate reconstructions of 3D shape and pose. Comment: 17 pages, ACCV 2018 oral paper |
نوع الوثيقة: | Working Paper |
URL الوصول: | http://arxiv.org/abs/1811.05804 |
رقم الانضمام: | edsarx.1811.05804 |
قاعدة البيانات: | arXiv |
الوصف غير متاح. |