Analyzing students' emotions from classroom videos can help both teachers and parents quickly know the engagement of students in class. The availability of high-definition cameras creates opportunities to record class scenes. However, watching videos is time-consuming, and it is challenging to gain a quick overview of the emotion distribution and find abnormal emotions. In this article, we propose EmotionCues, a visual analytics system to easily analyze classroom videos from the perspective of emotion summary and detailed analysis, which integrates emotion recognition algorithms with visualizations. It consists of three coordinated views: a summary view depicting the overall emotions and their dynamic evolution, a character view presenting the detailed emotion status of an individual, and a video view enhancing the video analysis with further details. Considering the possible inaccuracy of emotion recognition, we also explore several factors affecting the emotion analysis, such as face size and occlusion. They provide hints for inferring the possible inaccuracy and the corresponding reasons. Two use cases and interviews with end users and domain experts are conducted to show that the proposed system could be useful and effective for analyzing emotions in the classroom videos.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TVCG.2019.2963659DOI Listing

Publication Analysis

Top Keywords

classroom videos
16
emotions classroom
8
emotion recognition
8
emotion
6
videos
5
emotioncues emotion-oriented
4
emotion-oriented visual
4
visual summarization
4
classroom
4
summarization classroom
4

Similar Publications

In order to solve the limitations of flipped classroom in personalized teaching and interactive effect improvement, this paper designs a new model of flipped classroom in colleges and universities based on Virtual Reality (VR) by combining the algorithm of Contrastive Language-Image Pre-Training (CLIP). Through cross-modal data fusion, the model deeply combines students' operation behavior with teaching content, and improves teaching effect through intelligent feedback mechanism. The test data shows that the similarity between video and image modes reaches 0.

View Article and Find Full Text PDF

Objective: Community engagement is an increasingly important component of ancient DNA (aDNA) research, especially when it involves archeological individuals connected to contemporary descendants or other invested communities. However, effectively explaining methods to non-specialist audiences can be challenging due to the intricacies of aDNA laboratory work. To overcome this challenge, the Anson Street African Burial Ground (ASABG) Project employed a GoPro camera to visually document the process of aDNA extraction for use in community engagement and education events.

View Article and Find Full Text PDF

Background: Remaking Recess (RR) is a school-based evidence-based peer social engagement intervention for autistic students. RR involves direct training and coaching with educators; however, educators face several barriers to implementation at both the individual- and organizational-levels. This protocol paper describes a multi-site study that will test whether an educator-level implementation strategy, coaching, with or without a school-level implementation strategy, school-based teams, will maximize educators' use (fidelity and sustainment) of RR for autistic students and their peers who are socially-isolated, rejected, or peripheral and may need additional support during recess.

View Article and Find Full Text PDF

Purpose: Estimating the sequential associations between educators' and children's talk during language learning interactions requires careful consideration of factors that may impact measurement stability and resultant inferences. This research note will describe a preliminary study that used generalizability theory to understand the contribution of two measurement conditions- and -on estimates of sequential associations between educator talk and autistic preschooler talk in inclusive preschool classrooms.

Method: We used an existing data set of four 15-min video-recorded occasions of educator-child interactions for 11 autistic preschoolers during free-play in their inclusive classroom.

View Article and Find Full Text PDF

Background: Much is known about the positive effects of teachers' self-efficacy on instruction and student outcomes, but the processes underlying these relations are unknown.

Aims: We aimed to examine the effects of teacher self-efficacy for student engagement (TSESE) before a lesson on teachers' nonverbal immediacy (NVI) and their enthusiastic teaching. Furthermore, we examined how NVI and enthusiastic teaching affected students' interest after the lesson, controlling for prior interest.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!