Empreu aquest identificador per citar o enllaçar aquest ítem:
http://hdl.handle.net/10609/137009
Títol: | End-to-end global to local convolutional neural network learning for hand pose recovery in depth data |
Autoria: | Madadi, Meysam Escalera, Sergio Baró, Xavier González, Jordi |
Altres: | Universitat Oberta de Catalunya (UOC) |
Citació: | Madadi, M., et al.: End-to-end global to local convolutional neural network learning for hand pose recovery in depth data. IET Comput. Vis. 1-17 (2021). https://doi.org/10.1049/cvi2.12064 |
Resum: | Despite recent advances in 3-D pose estimation of human hands, thanks to the advent of convolutional neural networks (CNNs) and depth cameras, this task is still far from being solved in uncontrolled setups. This is mainly due to the highly non-linear dynamics of fingers and self-occlusions, which make hand model training a challenging task. In this study, a novel hierarchical tree-like structured CNN is exploited, in which branches are trained to become specialised in predefined subsets of hand joints called local poses. Further, local pose features, extracted from hierarchical CNN branches, are fused to learn higher order dependencies among joints in the final pose by end-to-end training. Lastly, the loss function used is also defined to incorporate appearance and physical constraints about doable hand motions and deformations. Finally, a non-rigid data augmentation approach is introduced to increase the amount of training depth data. Experimental results suggest that feeding a tree-shaped CNN, specialised in local poses, into a fusion network for modelling joints' correlations and dependencies, helps to increase the precision of final estimations, showing competitive results on NYU, MSRA, Hands17 and SyntheticHand datasets. |
Paraules clau: | computer vision data acquisition human computer interaction learning (artificial-intelligence) pose estimation |
DOI: | https://doi.org/10.1049/cvi2.12064 |
Tipus de document: | info:eu-repo/semantics/article |
Data de publicació: | 12-ago-2021 |
Llicència de publicació: | http://creativecommons.org/licenses/by-nc/3.0/es/ |
Apareix a les col·leccions: | Articles cientÍfics Articles |
Arxius per aquest ítem:
Arxiu | Descripció | Mida | Format | |
---|---|---|---|---|
IET Computer Vision - 2021 - Madadi - End¿to¿end global to local convolutional neural network learning for hand pose.pdf | 2,73 MB | Adobe PDF | Veure/Obrir |
Comparteix:
Aquest ítem està subjecte a una llicència de Creative Commons Llicència Creative Commons