Interact: Tightly-coupling Multimodal Dialog with an Interactive Virtual Assistant Demonstrations / Selfridge, Ethan / Johnston, Michael Proceedings of the 2015 International Conference on Multimodal Interaction 2015-11-09 p.381-382
ACM Digital Library Link
Summary: Interact is a mobile virtual assistant that uses multimodal dialog to enable an interactive concierge experience over multiple application domains including hotel, restaurants, events, and TV search. Interact demonstrates how multimodal interaction combined with conversational dialog enables a richer and more natural user experience. This demonstration will highlight incremental recognition and understanding, multimodal speech and gesture input, context tracking over multiple simultaneous domains, and the use of multimodal interface techniques to enable disambiguation of errors and online personalization.