Please use this identifier to cite or link to this item:

http://hdl.handle.net/10609/102446
Title: Visual scene context in emotion perception
Author: Kosti, Ronak  
Director: Lapedriza Garcia, Àgata  
Keywords: computer vision
emotion recognition
Issue Date: 19-Sep-2019
Publisher: Universitat Oberta de Catalunya (UOC)
Abstract: Psychological studies show that the context of a setting, in addition to facial expression and body language, lends important information that conditions our perception of people's emotions. However, context's processing in the case of automatic emotion recognition has not been explored in depth, partly due to the lack of sufficient data. In this thesis we present EMOTIC, a dataset of images of people in various natural scenarios annotated with their apparent emotion. The EMOTIC database combines two different types of emotion representation: (1) a set of 26 emotion categories, and (2) the continuous dimensions of valence, arousal and dominance. We also present a detailed statistical and algorithmic analysis of the dataset along with the annotators' agreement analysis. CNN models are trained using EMOTIC, combining a person's features with those of the setting (context). Our results not only show how the context of a setting contributes important information for automatically recognizing emotional states but also promote further research in this direction.
Language: English
URI: http://hdl.handle.net/10609/102446
Appears in Collections:Doctoral Thesis

Share:
Export:
Files in This Item:
File Description SizeFormat 
thesis_manuscript_ronak_kosti.pdfKosti_dissertation78.97 MBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons