Academic Journal

A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays

التفاصيل البيبلوغرافية
العنوان: A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays
المؤلفون: Nils Krahnstoever, Sanszhar Kettebekov, S. Kettebekov, Rajeev Sharma, Mohammed Yeasin, R. Sharma
المساهمون: The Pennsylvania State University CiteSeerX Archives
المصدر: http://vision.cse.psu.edu/kettebek/academ/docs/icmi_Nils.pdf.
سنة النشر: 2002
المجموعة: CiteSeerX
مصطلحات موضوعية: Continuous Gesture Recognition, Multimodal HCI, Speech-Gesture Co-Analysis, Visual Tracking, Real-Time Systems
الوصف: This paper presents a framework for designing a natural multimodal human computer interaction (HCI) system. The core of the proposed framework is a principled method for combining information derived from audio and visual cues. To achieve natural interaction, both audio and visual modalities are fused along with feedback through a large screen display. Careful design along with due considerations of possible aspects of a systems interaction cycle and integration has resulted in a successful system. The performance of the proposed framework has been validated through the development of several prototype systems as well as commercial applications for the retail and entertainment industry. To assess the impact of these multimodal systems (MMS), informal studies have been conducted. It was found that the system performed according to its specifications in 95% of the cases and that users showed adhoc proficiency, indicating natural acceptance of such systems.
نوع الوثيقة: text
وصف الملف: application/pdf
اللغة: English
Relation: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.5719; http://vision.cse.psu.edu/kettebek/academ/docs/icmi_Nils.pdf
الاتاحة: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.5719
http://vision.cse.psu.edu/kettebek/academ/docs/icmi_Nils.pdf
Rights: Metadata may be used without restrictions as long as the oai identifier remains attached to it.
رقم الانضمام: edsbas.EB46AD8B
قاعدة البيانات: BASE