Real-Time Emotion Recognition in Intelligent Tutoring Systems
Journal
Advances in Soft Computing : 24th Mexican International Conference on Artificial Intelligence, MICAI 2025, Guanajuato, Mexico, November 3, 2025, Proceedings, Part II
ISSN
0302-9743
1611-3349
Publisher
Springer Nature Switzerland
Date Issued
2025
Author(s)
Alcauter, Iara
Type
text::book::book part
Abstract
This study investigates the integration of facial emotion recognition (FER) into Intelligent Tutoring Systems (ITS), with the aim of identifying the emotions that emerge throughout the learning process. Building on prior research, we argue that understanding students’ emotional states enables the delivery of more adaptive and effective feedback, thereby improving learning outcomes. A Deep Convolutional Neural Network (DCNN) was trained on the FER2013+ dataset, achieving a top-3 accuracy of 95.24% in classifying facial expressions across eight emotion categories. The model was integrated with MediaPipe to enable real-time emotion detection from video streams using a standard laptop camera, facilitating practical deployment in educational settings. Thirteen high school and early university students interacted with OATutor—an open-source ITS—while their facial expressions and on-screen activities were recorded. Emotional data from each frame was synchronized with an academic event log documenting actions such as starting a lesson, requesting help, or submitting answers. Results show that “surprise” was the most frequently observed emotion (over 85% of instances), whereas “anger,” “sadness,” and “contempt” appeared only in specific learning scenarios, particularly when students faced cognitive challenges or achieved multiple correct responses. Despite the absence of affective feedback from the system, students’ emotions fluctuated dynamically, suggesting active self-regulation processes. These findings demonstrate the feasibility of FER-enhanced ITS in real-world educational environments and underscore the need for future work integrating multimodal data and personalization strategies to optimize affective responsiveness in intelligent learning contexts. ©The authors ©Springer.
License
Acceso Restringido
How to cite
Alcauter, I., Martinez-Villaseńor, L. (2026). Real-Time Emotion Recognition in Intelligent Tutoring Systems. In: Martínez-Villaseñor, L., Vázquez, R.A., Ochoa-Ruiz, G. (eds) Advances in Soft Computing. MICAI 2025. Lecture Notes in Computer Science(), vol 16222. Springer, Cham. https://doi.org/10.1007/978-3-032-09044-7_26