Scientific and Technical Journal


ISSN Print 2221-3937
ISSN Online 2221-3805

The paper is devoted to solving actual scientific and technical problem of increasing interactivity of user’s interaction with sensor human-computer systems.

A new emotion state model of user of human-computer systems with natural user interface Kinect is proposed in this paper. The emotion assessmentis done in two phases. In the first phase, the data from the SDK Kinect is interpreted as main features of user’s emotion –head pose angle, expression of face and position of twenty joints of the user's body. As for the second phase, the selected features of emotion are determined as fuzzy variables in accordance of cognitive psychology. Problems of features’uncertainty are solved with the help of developed discrete interval type-2 fuzzy logic system.

The proposed model allows us to organize effective feedback, timely and appropriate response of human-computer system to changesof emotional state of user.

The main areas of use of the model areindustry of videogamesand entertainments, robotic systems, operator stations, social networks, etc.

  1. Wigdor D., and Wixon D., (2011), Brave NUI World: Designing Natural User Interfaces for Touch and Gesture, 1st ed., Morgan Kaufmann (In English).
  2. Solso R.L., MacLin, M.K., and MacLin O.H., (2005), Cognitive Psychology, 8th ed., Pearson (In English).
  3. Keltner D., and Ekman P., (2003), Facial Expression of Emotion (In English), available at: (accessed 4 March 2014).
  4. Halder A., Konar A., Mandal R., and others., (2013), General and Interval Type-2 Fuzzy Face-Space Approach to Emotion Recognition, IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 43, No. 3, pp. 587 – 605 (In English).
  5. Kolakowska A., Landowska A., Szwoch M., and others., (2013), Emotion Recognition and its Application in Software Engineering, Proceedings of the 6th International Conference on Human System Interaction (HSI), June 6–8, 2013, Sopot, Poland, pp. 532 – 539 (In English).
  6. Sadeghian A., Mendel J., and Tahayori H., (2013), Advances in Type-2 Fuzzy Sets and Systems: Theory and Applications, Springer (In English).
  7. Borenstein G. (2012), Making Things See: 3D Vision with Kinect, Processing, Arduino, and MakerBot, Make (In English).
  8. Kinect for Windows. Developer downloads (In English), available at: (accessed 4 March 2014).
  9. Petrenko T., and Tymchuk O. Package Library and Toolbox for Discrete Interval Type-2 Fuzzy Logic Systems,(2012),Proceedings of the 18th International Conference on Soft Computing (MENDEL),June 27–29, 2012, Brno, Czech Republic, pp. 233 – 238(In English).
  10. Petrenko T., and Tymchuk O. Adaptive Behavior Control Model of Non Player Character, (2013),Proceedings of the 15th International Conference on Computer Modelling and Simulation (UKSim-AMSS), April 10–12, 2013, Cambridge, United Kingdom, pp. 39 – 44(In English).
Last download:
25 Jan 2020

[ © KarelWintersky ] [ All articles ] [ All authors ]
[ © Odessa National Polytechnic University, 2014-2018. Any use of information from the site is possible only under the condition that the source link! ]