Determining emotions from students' facial expressions using CNN
Keywords:
Convolutional Neural Networks, Facial Expression Recognition, Emotion Recognition, Deep Learning, Educational Settings.Abstract
Recognizing and understanding human emotions, particularly in educational settings, is of great importance. This research focuses on utilizing Convolutional Neural Networks (CNNs) to accurately identify students' emotions based on their facial expressions. By leveraging facial cues, an automated system can be developed to effectively recognize and interpret emotions in educational contexts.
A diverse dataset of facial images featuring students expressing various emotions is carefully curated for this study. Facial landmarks and action units are extracted to capture essential information from different facial regions. These images are meticulously annotated with ground truth labels, ensuring precise training and evaluation of the CNN model.
CNNs are chosen as the core technology for feature extraction and emotion classification due to their ability to learn intricate spatial patterns and hierarchical representations. Extensive training, including techniques like data augmentation and transfer learning, enables the model to generalize and adapt to a wide range of emotional expressions.
The performance of the CNN model is evaluated using metrics such as accuracy, precision, recall, and F1 score. Thorough experiments compare the proposed CNN approach with existing methods for facial emotion recognition, demonstrating the superior performance of the CNN model in accurately identifying students' emotions from facial expressions.
References
REFERENCES
Tang, Chuangao, et al. «Automatic facial expression analysis of students in teaching environments». Biometric Recognition: 10th Chinese Conference, CCBR 2015, / Tianjin, China, November 13-15, 2015, Proceedings 10. Springer International Publishing, – 2015.
Kim, Yelin, Tolga Soyata, and Reza Feyzi Behnagh. «Towards emotionally aware AI smart classroom: Current issues and directions for engineering and education». IEEE Access 6 (2018): 5308-5331.
Lv, Yadan, Zhiyong Feng, and Chao Xu. «Facial expression recognition via deep learning». 2014 international conference on smart computing. IEEE, – 2014.
Viola, Paul, and Michael Jones. "Rapid object detection using a boosted cascade of simple features." Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001. Vol. 1. Ieee, – 2001.
Albawi, Saad, Tareq Abed Mohammed, and Saad Al-Zawi. «Understanding of a convolutional neural network». 2017 international conference on engineering and technology (ICET). Ieee, –2017.
Freund, Yoav, and Robert E. Schapire. «A decision-theoretic generalization of on-line learning and an application to boosting». Journal of computer and system sciences 55.1 (1997): 119–139.
Harper, Robert G., Arthur N. Wiens, and Joseph D. Matarazzo. Nonverbal communication: The state of the art. John Wiley & Sons, – 1978.
Tang, Xiao-Yu, et al. «Classroom teaching evaluation based on facial expression recognition». Proceedings of the 2020 9th International Conference on Educational and Information Technology. – 2020.
Wu, Haobang. «Real Time Facial Expression Recognition for Online Lecture». Wireless Communications and Mobile Computing 2022 – (2022).
Guo, Xiaoxu, Juxiang Zhou, and Tianwei Xu. «Evaluation of teaching effectiveness based on classroom micro-expression recognition». International Journal of Performability Engineering 14.11 (2018): 2877.
