Please use this identifier to cite or link to this item:
Title: Visual scene context in emotion perception
Author: Kosti, Ronak
Director: Lapedriza García, Àgata
Keywords: computer vision
emotion recognition
Issue Date: 19-Sep-2019
Publisher: Universitat Oberta de Catalunya (UOC)
Abstract: Psychological studies show that the context of a setting, in addition to facial expression and body language, lends important information that conditions our perception of people's emotions. However, context's processing in the case of automatic emotion recognition has not been explored in depth, partly due to the lack of sufficient data. In this thesis we present EMOTIC, a dataset of images of people in various natural scenarios annotated with their apparent emotion. The EMOTIC database combines two different types of emotion representation: (1) a set of 26 emotion categories, and (2) the continuous dimensions of valence, arousal and dominance. We also present a detailed statistical and algorithmic analysis of the dataset along with the annotators' agreement analysis. CNN models are trained using EMOTIC, combining a person's features with those of the setting (context). Our results not only show how the context of a setting contributes important information for automatically recognizing emotional states but also promote further research in this direction.
Language: English
Appears in Collections:Tesis doctorals

Files in This Item:
File Description SizeFormat 
thesis_manuscript_ronak_kosti.pdfKosti_dissertation78,97 MBAdobe PDFThumbnail