Audio-visual deep learning regression of apparent personality
| العنوان: | Audio-visual deep learning regression of apparent personality |
|---|---|
| المؤلفون: | Alfonso Hernández, Alejandro |
| المساهمون: | Escalera Guerrero, Sergio, Palmero Cantariño, Cristina, Jacques Junior, Julio, Jacques Junior, Julio C. S. |
| المصدر: | Dipòsit Digital de la UB Universidad de Barcelona |
| سنة النشر: | 2020 |
| مصطلحات موضوعية: | Facial expression, Programari, Bachelor's thesis, Nonverbal communication, Comunicació no verbal, Bachelor's theses, Expressió facial, Treballs de fi de grau, Neural networks (Computer science), Percepció, Xarxes neuronals (Informàtica), Perception, Computer software, Personalitat, Personality |
| الوصف: | Treballs Finals de Grau d'Enginyeria Informàtica, Facultat de Matemàtiques, Universitat de Barcelona, Any: 2020, Director: Sergio Escalera Guerrero, Cristina Palmero Cantariño i Julio Jacques Junior [en] Personality perception is based on the relationship of the human being with the individuals of his surroundings. This kind of perception allows to obtain conclusions based on the analysis and interpretation of the observable, mainly face expressions, tone of voice and other nonverbal signals, allowing the construction of an apparent personality (or first impression) of people. Apparent personality (or first impressions) are subjective, and subjectivity is an inherent property of perception based exclusively on the point of view of each individual. In this project, we approximate such subjectivity using a multi-modal deep neural network with audiovisual signals as input and a late fusion strategy of handcrafted features, achieving accurate results. The aim of this work is to perform an analysis of the influence of automatic prediction for apparent personality (based on the Big-Five model), of the following characteristics: raw audio, visual information (sequence of face images) and high-level features, including Ekman's universal basic emotions, gender and age. To this end, we have defined different modalities, performing combinations of them and determining how much they contribute to the regression of apparent personality traits. The most remarkable results obtained through the experiments performed are as follows: in all modalities, females have a higher average accuracy than men, except in the modality with only audio; for happy emotion, the best accuracy score is found in the Conscientiousness trait; Extraversion and Conscientiousness traits get the highest accuracy scores in almost all emotions; visual information is the one that most positively influences the results; the combination of high-level features chosen slightly improves the accuracy performance for predictions. |
| وصف الملف: | application/pdf |
| URL الوصول: | https://explore.openaire.eu/search/publication?articleId=dedup_wf_001::3f509b90aa685ca6c8d69f8e91f8823b http://hdl.handle.net/2445/167099 |
| Rights: | OPEN |
| رقم الانضمام: | edsair.dedup.wf.001..3f509b90aa685ca6c8d69f8e91f8823b |
| قاعدة البيانات: | OpenAIRE |
| الوصف غير متاح. |