Prototyping and Evaluating Sensory Substitution Devices by Spatial Immersion in Virtual Environments
| العنوان: | Prototyping and Evaluating Sensory Substitution Devices by Spatial Immersion in Virtual Environments |
|---|---|
| المؤلفون: | Sylvain Huet, Denis Pellerin, Christian Graff, Aziliz Guezou-Philippe |
| المساهمون: | GIPSA - Architecture, Géométrie, Perception, Images, Gestes (GIPSA-AGPIG), Département Images et Signal (GIPSA-DIS), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Laboratoire de Psychologie et NeuroCognition (LPNC ), Université Savoie Mont Blanc (USMB [Université de Savoie] [Université de Chambéry])-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), ANR-11-LABX-0025,PERSYVAL-lab,Systemes et Algorithmes Pervasifs au confluent des mondes physique et numérique(2011) |
| المصدر: | VISIGRAPP 2018-13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications VISIGRAPP 2018-13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Jan 2018, Funchal, Portugal. ⟨10.5220/0006637705960602⟩ VISIGRAPP (4: VISAPP) |
| بيانات النشر: | HAL CCSD, 2018. |
| سنة النشر: | 2018 |
| مصطلحات موضوعية: | Exploit, Computer science, business.industry, Virtual Environments, [SCCO.NEUR]Cognitive science/Neuroscience, Eye Tracking, Pointing device, Transcoding, computer.software_genre, Motion capture, [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], Sight, Software, Sensory substitution, Human–computer interaction, Motion Capture, [SCCO.PSYC]Cognitive science/Psychology, Eye tracking, Sensory Substitution, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], business, [STAT.CO]Statistics [stat]/Computation [stat.CO], computer |
| الوصف: | International audience; Various audio-vision Sensory Substitution Devices (SSDs) are in development to assist people without sight. They all convert optical information extracted from a camera, into sound parameters but are evaluated for different tasks in different contexts. The use of 3D environments is proposed here to compare the advantages and disadvantages of not only software (transcoding) solutions but also of hardware (component) specifics, in various situations and activities. By use of a motion capture system, the whole person, not just a guided avatar, was immersed in virtual places that were modelled and that could be replicated at will. We evaluated the ability to hear depth for various tasks: detecting and locating an open window, moving and crossing an open door. Participants directed the modelled depth-camera with a real pointing device that was either held in the hand or fastened on the head. Mixed effects on response delays were analyzed with a linear model to highlight the respective importance of the pointing device, the target specifics and the individual participants. Results are encouraging to further exploit our prototyping set-up and test many solutions by implementing e.g., environments, sensor devices, transcoding rules, and pointing devices including the use of an eye-tracker. |
| اللغة: | English |
| DOI: | 10.5220/0006637705960602⟩ |
| URL الوصول: | https://explore.openaire.eu/search/publication?articleId=doi_dedup___::80f89bb021f24ca6b13abb463aed64c6 https://hal.archives-ouvertes.fr/hal-01663686 |
| Rights: | OPEN |
| رقم الانضمام: | edsair.doi.dedup.....80f89bb021f24ca6b13abb463aed64c6 |
| قاعدة البيانات: | OpenAIRE |
| DOI: | 10.5220/0006637705960602⟩ |
|---|