Multimodal Interaction Analysis and exploration of Users within a Controlled Environment (MIAUCE)

MIAUCE DIT-PRJ-09-005

Status NOT active project
DISI role Partner
Project type Research Project
Dimension International
Acquisition date 2008-12-01
Start date 2008-12-01
End date 2009-08-31

Project details

Project astract The project aims to investigate and develop techniques to analyse the multi-modal behaviour of users within the context of real applications. The multi-modal behaviour takes the form of eye gaze/fixation, eye blink and body move. We will study and develop techniques that capture and analyse multi-modal behaviour in controlled environments (e.g., supermarket, bank). As a result of such analysis, information will be adapted to the user needs and situation (e,g., suggesting dynamically on output devices the most interesting products to the user on the basis of his current location in the supermarket). We will study the usage and effectiveness of our techniques in three different applications.<br/><br/>These applications are: Security (e.g.,. alerting of suspiciously behaving individuals), customized marketing and Interactive web TV (monitoring the eye gaze of Web TV users to assist them in their task). This will enable us to develop generalisable techniques and open routes for industrial exploitation. The applications will be developed with industrial involvement and supports. More generally, the technology investigated here is an useful tool to give people, another alternative to interact with their environment (computer systems, supermarket) in a meaningful way that requires minimal effort.<br/><br/>The key innovation of the project concerns the tracking and analysis of user behaviour, mainly eye gaze, eye fixation and eye blink, in a multi-user environment (by opposition to personal environment). In such an environment, we need to deal with several users, and in addition user behaviour is unrestricted (user heads and bodies are allowed to move freely yielding partial or complete occlusions).<br/><br/>It is an essential theme of the project to investigate the legal, social and ethical requirements necessary to design these new applications. The social acceptability of these technologies (multi-modal behaviour capture) will be investigated in order to guarantee the success of their implementation. Recommendations will be formulated and will be presented to the policy makers (private and public).
Keywords multi-modal behaviour
Fundings 2350070 €
Partners
  • DIT - UniTN
  • Centre National de la Recherche Scientifique (FRANCE)
  • Facultés Universitaires Notre Dame de la Paix (Namur, BELGIUM).
  • University of Amsterdam (NETHERLANDS)
  • University of Glasgow (UNITED KINGDOM)
  • Sylis (FRANCE)
  • Tilde (LATVIA)
  • VISUAL TOOLS S.A. (SPAIN)
  • Facultés Universitaires Notre Dame de la Paix (Namur

DISI Sub-project details

Project astract The project aims to investigate and develop techniques to analyse the multi-modal behaviour of users within the context of real applications. The multi-modal behaviour takes the form of eye gaze/fixation, eye blink and body move. We will study and develop techniques that capture and analyse multi-modal behaviour in controlled environments (e.g., supermarket, bank). As a result of such analysis, information will be adapted to the user needs and situation (e,g., suggesting dynamically on output devices the most interesting products to the user on the basis of his current location in the supermarket). We will study the usage and effectiveness of our techniques in three different applications.<br/><br/>These applications are: Security (e.g.,. alerting of suspiciously behaving individuals), customized marketing and Interactive web TV (monitoring the eye gaze of Web TV users to assist them in their task). This will enable us to develop generalisable techniques and open routes for industrial exploitation. The applications will be developed with industrial involvement and supports. More generally, the technology investigated here is an useful tool to give people, another alternative to interact with their environment (computer systems, supermarket) in a meaningful way that requires minimal effort.<br/><br/>The key innovation of the project concerns the tracking and analysis of user behaviour, mainly eye gaze, eye fixation and eye blink, in a multi-user environment (by opposition to personal environment). In such an environment, we need to deal with several users, and in addition user behaviour is unrestricted (user heads and bodies are allowed to move freely yielding partial or complete occlusions).<br/><br/>It is an essential theme of the project to investigate the legal, social and ethical requirements necessary to design these new applications. The social acceptability of these technologies (multi-modal behaviour capture) will be investigated in order to guarantee the success of their implementation. Recommendations will be formulated and will be presented to the policy makers (private and public).
Keywords Multi-modal behaviour
Fundings 35000 €
Manager Nicu Sebe