Human Pose Recovery and Behavior Analysis
Human Action/Gesture recognition is a challenging area of research that deals with the problem of recognizing people in images, detecting and describing body parts, including hand pose and facial expressions, inferring their spatial configuration, and performing action/gesture recognition from still images or image sequences, also including multi-modal data. Because of huge space of human configurations, body pose recovery is a difficult problem that involves dealing with several distortions: illumination changes, partial occlusions, changes in the point of view, rigid and elastic deformations, or high inter and intra-class variability, just to mention a few. Even with the high difficulty of the problem, modern Computer Vision techniques and new tendencies deserve further attention, and promising results are expected in the next years. Moreover, several subareas have been recently defined, such as Affective Computing, Social Signal Processing, Human Behavior Analysis, or Social Robotics. The effort involved in this area of research will be compensated by its potential applications: social robotics, TV production, home entertainment (multimedia content analysis), education purposes, sociology research, surveillance and security, improved quality live by means of monitoring or automatic artificial assistance, etc.
Projects and Research Applications
|Sign recognition deals with the problem of detecting hand locations and analyze their structure and movement to determine actions and gestures.
Medical Imaging in 3D PET/CT Human data and GPGPU:
-Mental disorder analysis
ental disorder analysis
In this project we monitorize impaired people in order to automatically detect behaviors of patients in hospitals, such as pain or agitation, and consequently send a report to the psysician.
| Social networks
Conversational indicators related to Social Signal Processing.
|Hyperactivity disorder analysis: in this project we automatically extract a set of pose and behavior indicators in order to support diagnostic of hyperactivity desorder.Video sample||Physiotherapy and sports corporal analysis: in this project we automatically extract a set of human landmarks and measure corporal indicators from RGBD data for physiotherapy, rehabilitation, and fitness conditioning. ADiBAS project webpage|
|3D HuPBA avatars in Virtual and Augmented Reality
||Facial analysis and affective computing|
|HUPBA in Sports
|Multi-modal and multi-view surveillance||Social robotics|
|Multi-modal Assisted Living Video sample – Taking a pill||Human Computer Interacttion and Smart Cities (Living labs and smart environments)|
|Multi-modal biometry analysis
||Human analysis from pressure maps|