التفاصيل البيبلوغرافية
العنوان: |
m_AutNet–A Framework for Personalized Multimodal Emotion Recognition in Autistic Children |
المؤلفون: |
Asha Kurian, Shikha Tripathi |
المصدر: |
IEEE Access, Vol 13, Pp 1651-1662 (2025) |
بيانات النشر: |
IEEE, 2025. |
سنة النشر: |
2025 |
المجموعة: |
LCC:Electrical engineering. Electronics. Nuclear engineering |
مصطلحات موضوعية: |
Autism, affective computing, domain adaptation, data fusion, generative adversarial network, multimodal neural network, Electrical engineering. Electronics. Nuclear engineering, TK1-9971 |
الوصف: |
Challenges associated with autism spectrum disorder (ASD) include deficits in interpersonal communication, social interaction skills, and behavior. Autistic children experience difficulties in recognizing emotions and expressing emotions, along with intense emotional upheavals called meltdowns. These outbreaks lead to immense physical and emotional distress in children with autism. Generalized emotion recognition classifiers cannot handle the variations in the prototypical display of affect experienced by ASD children. This paper looks at developing a personalized multimodal neural framework, m_AutNet, that can effectively identify the emotions of autistic children by combining data from their facial and vocal expression modalities. The proposed network includes a personalized facial feature extraction module (that incorporates a distance metric to cluster embeddings with similar labels together and marginalizes dissimilar embeddings), and an audio modality CNN feature extractor that works on speech expression samples of autistic children. Domain adaptation of the multimodal features is achieved through a generative adversarial network tuned with the Wasserstein metric to form a domain-invariant distribution alignment of the feature vectors. A classifier performs emotion classification on this domain space following adaptation. The proposed algorithm shows higher performance than state-of-the-art affect recognition classifiers for autistic children, with an accuracy of 88.25%. |
نوع الوثيقة: |
article |
وصف الملف: |
electronic resource |
اللغة: |
English |
تدمد: |
2169-3536 |
Relation: |
https://ieeexplore.ieee.org/document/10535108/; https://doaj.org/toc/2169-3536 |
DOI: |
10.1109/ACCESS.2024.3403087 |
URL الوصول: |
https://doaj.org/article/16e054bf7dfc4c17a3f6be289505a9fe |
رقم الانضمام: |
edsdoj.16e054bf7dfc4c17a3f6be289505a9fe |
قاعدة البيانات: |
Directory of Open Access Journals |