One of the aims in building multimodal user interfaces and combining them with technical devices is to make the interaction between user and system as natural as possible. The most natural form of interaction may be how we interact with other humans. Current technology is far from human-like, and systems can reflect a wide range of technical solutions.
Transferring the insights for analysis of human-human communication to human-machine interactions remains challenging. It requires that the multimodal inputs from the user (e.g., speech, gaze, facial expressions) are recorded and interpreted. This interpretation has to occur at both the semantic and affective levels, including aspects such as the personality, mood, or intentions of the user. These processes have to be performed in real-time in order for the system to respond without delays ensuring that the interaction is smooth.
The MA3HMI workshop aims at bringing together researchers working on the analysis of multimodal data as a means to develop technical devices that can interact with humans. In particular, artificial agents can be regarded in their broadest sense, including virtual chat agents, empathic speech interfaces and life-style coaches on a smart-phone. More general, multimodal analyses support any technical system in the research area of human-machine interaction. We focus on the real-time aspects of human-machine interaction. We address the development and evaluation of multimodal, real-time systems.
We solicit papers that concern the different phases of the development of such interfaces. Tools and systems that address real-time conversations with artificial agents and technical systems are also within the scope of the workshop.