Gesture Recognition in Images Using Neural Networks




Artificial intelligence; Machine learning; Identification of body expressions; Image Recognition; Sentiment analysis.


Artificial Intelligence is an area of computer research that is focused on developing mechanisms and devices to simulate human reasoning. Within this, an important subarea is the recognition of images. This article aims to describe the initial part of a research that aims to analyze and identify registered feelings of body expressions in videos of product reviews. Experimental tests have been planned to identify the best technique to solve the problem. Some forms of gesture identification through the use of neural networks were analyzed and tested.


Acharya, T., Mitra, S. (2007). Gesture Recognition: a survey. IEEE Transaction onSystems, Man, And cybernetics – Part C: Applications and reviews, 37(1): 3. Acess on: August, 01, 2019.

Bar, K. (2013). Sentiment Analysis of Movie Reviews and Twitter Statuses. Machine Learning–Final Project. Pp. 1-12. Available from: <>. Acess on: August, 2nd, 2019.

Bay, H., Tuytelaars, T., Van Gool, L. J. (2006). SURF: Speeded up robust features. In: Anal of The 9th European Conference on Computer Vision (ECCV 2006). Graz, Austria, pp. 404-417.

Bittencourt, J. R. & Osório, F. S. (2002). O uso de redes neurais artificiais na detecção de pele em imagens digitais visando o reconhecimento de gestos. In: XI SEMINCO – Seminário de Computação 2002 da UNISINOS. Disponível em: <>. Acesso em: 02 ago 2019.

Braga, A. P., Carvalho, A. C. P. L. F. & Ludemir, T. B. (2000). Redes neurais artificiais: teoria e aplicações. Ed. LTC, Rio de Janeiro/RJ.

Canny, J. (1986). A Computational Approach to Edge Detection. IEEE Transactions on PatternAnalysis and Machine Intelligence, 8(6): 679-698.

Duan, D., Qian, W., Pan, S., Shi, L. & Lin, C. (2012). VISA: A Visual Sentiment AnalysisSystem. In: VINCI '12 Proceedings of the 5th International Symposium on Visual Information Communication and Interaction. pp. 22-28. ACM, New York. Available from: <>. Acess on: Aug., 2nd, 2019.

Haykin, S. (2001). Redes neurais: princípios e prática. Ed. Bookman, Porto Alegre/RS.

Jaques, P.A., Vicari, R. M. (2005). Estado da Arte em Ambientes Inteligentes de Aprendizagem que Consideram a Afetividade do Aluno. Revista Informática na Educação: Teoria e Prática, 8(1).

Maynard, D., Dupplaw, D., Hare, J. (2013). Multimodal Sentiment Analysis of SocialMedia. University of Sheffield, Sheffield. Available from: <>. Acess on: 1st. Aug. 2019.

Pereira, A.S, Shitsuka, D.M., Parreira, F.J. & Shitsuka, R. (2018). Metodologia da pesquisa científica. [e-book]. Ed. UAB/NTE/UFSM, Santa Maria/RS. Disponível em: Acesso em: 02 ago. 2019.

Picard, R. W. (1997). Affective Computing. M.I.T Media Laboratory Perceptual Computing Section Technical Report. Disponível em: <>. Acesso em: 01 ago. 2019.

Prabowo, R., Thelwall, M. (2014). Sentiment Analysis: A Combined Approach. Jan.2009. Disponível em: <>. Acesso em: August, 2nd. 2019.

Santos, H. C. (2010). Investigação e implementação de técnicas em Análise de Sentimentos. 35 f. Monografia apresentada como requisito parcial para obtenção do Grau em Engenharia da Computação, Universidade Federal de Pernambuco, Recife.

Siersodorfer, S., Minack, E., Deng, F. & Hare, J. (2010). Analyzing and Predicting Sentiment of Images on the Social Web. Article published in Siersdorfer Sources. Available from: <>. Acess on: August, 2nd, 2019.

Sikandar, M. (2014). A Survey for Multimodal Sentiment Analysis Methods. Int. J. Computer Technology & Applications, 5(1): 1470-1476, Jul. 2014. Disponível em: <>. Acess on: August, 1st, 2019.

Wollmer, M., Weninger, F., Knaup, T., Schuller, B., Sun, C., Sagae, K. & Morency, L. (2013). Youtube Movie Reviews: Sentiment Analysis in na Audio-Visual Context. Intelligent Systems, IEEE, 28(3), Marc. 2013. Available from: <>. Acess on: August, 1st, 2019.



How to Cite

NEVES, A. R. N. das; OKADA, H. K. R.; SHITSUKA, R. Gesture Recognition in Images Using Neural Networks. Research, Society and Development, [S. l.], v. 8, n. 11, p. e278111470, 2019. DOI: 10.33448/rsd-v8i11.1470. Disponível em: Acesso em: 24 may. 2022.



Exact and Earth Sciences