Academic Journal

m_AutNet–A Framework for Personalized Multimodal Emotion Recognition in Autistic Children

التفاصيل البيبلوغرافية
العنوان: m_AutNet–A Framework for Personalized Multimodal Emotion Recognition in Autistic Children
المؤلفون: Asha Kurian, Shikha Tripathi
المصدر: IEEE Access, Vol 13, Pp 1651-1662 (2025)
بيانات النشر: IEEE, 2025.
سنة النشر: 2025
المجموعة: LCC:Electrical engineering. Electronics. Nuclear engineering
مصطلحات موضوعية: Autism, affective computing, domain adaptation, data fusion, generative adversarial network, multimodal neural network, Electrical engineering. Electronics. Nuclear engineering, TK1-9971
الوصف: Challenges associated with autism spectrum disorder (ASD) include deficits in interpersonal communication, social interaction skills, and behavior. Autistic children experience difficulties in recognizing emotions and expressing emotions, along with intense emotional upheavals called meltdowns. These outbreaks lead to immense physical and emotional distress in children with autism. Generalized emotion recognition classifiers cannot handle the variations in the prototypical display of affect experienced by ASD children. This paper looks at developing a personalized multimodal neural framework, m_AutNet, that can effectively identify the emotions of autistic children by combining data from their facial and vocal expression modalities. The proposed network includes a personalized facial feature extraction module (that incorporates a distance metric to cluster embeddings with similar labels together and marginalizes dissimilar embeddings), and an audio modality CNN feature extractor that works on speech expression samples of autistic children. Domain adaptation of the multimodal features is achieved through a generative adversarial network tuned with the Wasserstein metric to form a domain-invariant distribution alignment of the feature vectors. A classifier performs emotion classification on this domain space following adaptation. The proposed algorithm shows higher performance than state-of-the-art affect recognition classifiers for autistic children, with an accuracy of 88.25%.
نوع الوثيقة: article
وصف الملف: electronic resource
اللغة: English
تدمد: 2169-3536
Relation: https://ieeexplore.ieee.org/document/10535108/; https://doaj.org/toc/2169-3536
DOI: 10.1109/ACCESS.2024.3403087
URL الوصول: https://doaj.org/article/16e054bf7dfc4c17a3f6be289505a9fe
رقم الانضمام: edsdoj.16e054bf7dfc4c17a3f6be289505a9fe
قاعدة البيانات: Directory of Open Access Journals
الوصف
تدمد:21693536
DOI:10.1109/ACCESS.2024.3403087