HCI Bibliography Home | HCI Conferences | ICMI Archive | Detailed Records | RefWorks | EndNote | Show Abstracts
ICMI Tables of Contents: 0203040506070809101112131415

Proceedings of the 2014 International Conference on Multimodal Interaction

Fullname:Proceedings of the 16th ACM International Conference on Multimodal Interaction
Editors:Albert Ali Salah; Jeffrey Cohn; Björn Schuller; Oya Aran; Louis-Philippe Morency; Philip R. Cohen
Location:Istanbul, Turkey
Dates:2014-Nov-12 to 2014-Nov-16
Publisher:ACM
Standard No:ISBN: 978-1-4503-2885-2; ACM DL: Table of Contents; hcibib: ICMI14
Papers:95
Pages:538
Links:Conference Website
  1. Keynote Address
  2. Oral Session 1: Dialogue and Social Interaction
  3. Oral Session 2: Multimodal Fusion
  4. Demo Session 1
  5. Poster Session 1
  6. Keynote Address 2
  7. Oral Session 3: Affect and Cognitive Modeling
  8. Oral Session 4: Nonverbal Behaviors
  9. Doctoral Spotlight Session
  10. Keynote Address 3
  11. Oral Session 5: Mobile and Urban Interaction
  12. Oral Session 6: Healthcare and Assistive Technologies
  13. Keynote Address 4
  14. The Second Emotion Recognition In The Wild Challenge
  15. Workshop Overviews

Keynote Address

Bursting our Digital Bubbles: Life Beyond the App BIBAFull-Text 1
  Yvonne Rogers

Oral Session 1: Dialogue and Social Interaction

Managing Human-Robot Engagement with Forecasts and... um... Hesitations BIBAFull-Text 2-9
  Dan Bohus; Eric Horvitz
Written Activity, Representations and Fluency as Predictors of Domain Expertise in Mathematics BIBAFull-Text 10-17
  Sharon Oviatt; Adrienne Cohen
Analysis of Respiration for Prediction of "Who Will Be Next Speaker and When?" in Multi-Party Meetings BIBAFull-Text 18-25
  Ryo Ishii; Kazuhiro Otsuka; Shiro Kumano; Junji Yamato
A Multimodal In-Car Dialogue System That Tracks The Driver's Attention BIBAFull-Text 26-33
  Spyros Kousidis; Casey Kennington; Timo Baumann; Hendrik Buschmeier; Stefan Kopp; David Schlangen

Oral Session 2: Multimodal Fusion

Deep Multimodal Fusion: Combining Discrete Events and Continuous Signals BIBAFull-Text 34-41
  Héctor P. Martínez; Georgios N. Yannakakis
The Additive Value of Multimodal Features for Predicting Engagement, Frustration, and Learning during Tutoring BIBAFull-Text 42-49
  Joseph F. Grafsgaard; Joseph B. Wiggins; Alexandria Katarina Vail; Kristy Elizabeth Boyer; Eric N. Wiebe; James C. Lester
Computational Analysis of Persuasiveness in Social Multimedia: A Novel Dataset and Multimodal Prediction Approach BIBAFull-Text 50-57
  Sunghyun Park; Han Suk Shim; Moitreya Chatterjee; Kenji Sagae; Louis-Philippe Morency
Deception detection using a multimodal approach BIBAFull-Text 58-65
  Mohamed Abouelenien; Veronica Pérez-Rosas; Rada Mihalcea; Mihai Burzo

Demo Session 1

Multimodal Interaction for Future Control Centers: An Interactive Demonstrator BIBAFull-Text 66-67
  Ferdinand Fuhrmann; Rene Kaiser
Emotional Charades BIBAFull-Text 68-69
  Stefano Piana; Alessandra Staglianò; Francesca Odone; Antonio Camurri
Glass Shooter: Exploring First-Person Shooter Game Control with Google Glass BIBAFull-Text 70-71
  Chun-Yen Hsu; Ying-Chao Tung; Han-Yu Wang; Silvia Chyou; Jer-Wei Lin; Mike Y. Chen
Orchestration for Group Videoconferencing: An Interactive Demonstrator BIBAFull-Text 72-73
  Wolfgang Weiss; Rene Kaiser; Manolis Falelakis
Integrating Remote PPG in Facial Expression Analysis Framework BIBAFull-Text 74-75
  H. Emrah Tasli; Amogh Gudi; Marten Den Uyl
Context-Aware Multimodal Robotic Health Assistant BIBAFull-Text 76-77
  Vidyavisal Mangipudi; Raj Tumuluri
WebSanyog: A Portable Assistive Web Browser for People with Cerebral Palsy BIBAFull-Text 78-79
  Tirthankar Dasgupta; Manjira Sinha; Gagan Kandra; Anupam Basu
The hybrid Agent MARCO BIBAFull-Text 80-81
  Nicolas Riesterer; Christian Becker Asano; Julien Hué; Christian Dornhege; Bernhard Nebel
Towards Supporting Non-linear Navigation in Educational Videos BIBAFull-Text 82-83
  Kuldeep Yadav; Kundan Shrivastava; Om Deshmukh

Poster Session 1

Detecting conversing groups with a single worn accelerometer BIBAFull-Text 84-91
  Hayley Hung; Gwenn Englebienne; Laura Cabrera Quiros
Identification of the Driver's Interest Point using a Head Pose Trajectory for Situated Dialog Systems BIBAFull-Text 92-95
  Young-Ho Kim; Teruhisa Misu
An Explorative Study on Crossmodal Congruence Between Visual and Tactile Icons Based on Emotional Responses BIBAFull-Text 96-103
  Taekbeom Yoo; Yongjae Yoo; Seungmoon Choi
Why We Watch the News: A Dataset for Exploring Sentiment in Broadcast Video News BIBAFull-Text 104-111
  Joseph G. Ellis; Brendan Jou; Shih-Fu Chang
Dyadic Behavior Analysis in Depression Severity Assessment Interviews BIBAFull-Text 112-119
  Stefan Scherer; Zakia Hammal; Ying Yang; Louis-Philippe Morency; Jeffrey F. Cohn
Touching the Void -- Introducing CoST: Corpus of Social Touch BIBAFull-Text 120-127
  Merel M. Jung; Ronald Poppe; Mannes Poel; Dirk K. J. Heylen
Unsupervised Domain Adaptation for Personalized Facial Emotion Recognition BIBAFull-Text 128-135
  Gloria Zen; Enver Sangineto; Elisa Ricci; Nicu Sebe
Predicting Influential Statements in Group Discussions using Speech and Head Motion Information BIBAFull-Text 136-143
  Fumio Nihei; Yukiko I. Nakano; Yuki Hayashi; Hung-Hsuan Hung; Shogo Okada
The Relation of Eye Gaze and Face Pose: Potential Impact on Speech Recognition BIBAFull-Text 144-147
  Malcolm Slaney; Andreas Stolcke; Dilek Hakkani-Tür
Speech-Driven Animation Constrained by Appropriate Discourse Functions BIBAFull-Text 148-155
  Najmeh Sadoughi; Yang Liu; Carlos Busso
Many Fingers Make Light Work: Non-Visual Capacitive Surface Exploration BIBAFull-Text 156-163
  Martin Halvey; Andy Crossan
Multimodal Interaction History and its use in Error Detection and Recovery BIBAFull-Text 164-171
  Felix Schüssel; Frank Honold; Miriam Schmidt; Nikola Bubalo; Anke Huckauf; Michael Weber
Gesture Heatmaps: Understanding Gesture Performance with Colorful Visualizations BIBAFull-Text 172-179
  Radu-Daniel Vatavu; Lisa Anthony; Jacob O. Wobbrock
Personal Aesthetics for Soft Biometrics: A Generative Multi-resolution Approach BIBAFull-Text 180-187
  Cristina Segalin; Alessandro Perina; Marco Cristani
Synchronising Physiological and Behavioural Sensors in a Driving Simulator BIBAFull-Text 188-195
  Ronnie Taib; Benjamin Itzstein; Kun Yu
Data-Driven Model of Nonverbal Behavior for Socially Assistive Human-Robot Interactions BIBAFull-Text 196-199
  Henny Admoni; Brian Scassellati
Towards Automated Assessment of Public Speaking Skills Using Multimodal Cues BIBAFull-Text 200-203
  Lei Chen; Gary Feng; Jilliam Joe; Chee Wee Leong; Christopher Kitchen; Chong Min Lee
Increasing Customers' Attention using Implicit and Explicit Interaction in Urban Advertisement BIBAFull-Text 204-207
  Matthias Wölfel; Luigi Bucchino
System for Presenting and Creating Smell Effects to Video BIBAFull-Text 208-215
  Risa Suzuki; Shutaro Homma; Eri Matsuura; Ken-ichi Okada
CrossMotion: Fusing Device and Image Motion for User Identification, Tracking and Device Association BIBAFull-Text 216-223
  Andrew D. Wilson; Hrvoje Benko
Statistical Analysis of Personality and Identity in Chats Using a Keylogging Platform BIBAFull-Text 224-231
  Giorgio Roffo; Cinzia Giorgetta; Roberta Ferrario; Walter Riviera; Marco Cristani
Understanding Users' Perceived Difficulty of Multi-Touch Gesture Articulation BIBAFull-Text 232-239
  Yosra Rekik; Radu-Daniel Vatavu; Laurent Grisoni
A Multimodal Context-based Approach for Distress Assessment BIBAFull-Text 240-246
  Sayan Ghosh; Moitreya Chatterjee; Louis-Philippe Morency
Exploring a Model of Gaze for Grounding in Multimodal HRI BIBAFull-Text 247-254
  Gregor Mehlmann; Markus Häring; Kathrin Janowski; Tobias Baur; Patrick Gebhard; Elisabeth André
Predicting Learning and Engagement in Tutorial Dialogue: A Personality-Based Model BIBAFull-Text 255-262
  Alexandria Katarina Vail; Joseph F. Grafsgaard; Joseph B. Wiggins; James C. Lester; Kristy Elizabeth Boyer
Eye Gaze for Spoken Language Understanding in Multi-modal Conversational Interactions BIBAFull-Text 263-266
  Dilek Hakkani-Tür; Malcolm Slaney; Asli Celikyilmaz; Larry Heck
SoundFLEX: Designing Audio to Guide Interactions with Shape-Retaining Deformable Interfaces BIBAFull-Text 267-274
  Koray Tahiroglu; Thomas Svedström; Valtteri Wikström; Simon Overstall; Johan Kildal; Teemu Ahmaniemi
Investigating Intrusiveness of Workload Adaptation BIBAFull-Text 275-281
  Felix Putze; Tanja Schultz

Keynote Address 2

Smart Multimodal Interaction through Big Data BIBAFull-Text 282
  Cafer Tosun

Oral Session 3: Affect and Cognitive Modeling

Natural Communication about Uncertainties in Situated Interaction BIBAFull-Text 283-290
  Tomislav Pejsa; Dan Bohus; Michael F. Cohen; Chit W. Saw; James Mahoney; Eric Horvitz
The SWELL Knowledge Work Dataset for Stress and User Modeling Research BIBAFull-Text 291-298
  Saskia Koldijk; Maya Sappelli; Suzan Verberne; Mark A. Neerincx; Wessel Kraaij
Rhythmic Body Movements of Laughter BIBAFull-Text 299-306
  Radoslaw Niewiadomski; Maurizio Mancini; Yu Ding; Catherine Pelachaud; Gualtiero Volpe
Automatic Blinking Detection towards Stress Discovery BIBAFull-Text 307-310
  Alvaro Marcos-Ramiro; Daniel Pizarro-Perez; Marta Marron-Romera; Daniel Gatica-Perez

Oral Session 4: Nonverbal Behaviors

Mid-air Authentication Gestures: An Exploration of Authentication Based on Palm and Finger Motions BIBAFull-Text 311-318
  Ilhan Aslan; Andreas Uhl; Alexander Meschtscherjakov; Manfred Tscheligi
Automatic Detection of Naturalistic Hand-over-Face Gesture Descriptors BIBAFull-Text 319-326
  Marwa M. Mahmoud; Tadas Baltrušaitis; Peter Robinson
Capturing Upper Body Motion in Conversation: An Appearance Quasi-Invariant Approach BIBAFull-Text 327-334
  Alvaro Marcos-Ramiro; Daniel Pizarro-Perez; Marta Marron-Romera; Daniel Gatica-Perez
User Independent Gaze Estimation by Exploiting Similarity Measures in the Eye Pair Appearance Eigenspace BIBAFull-Text 335-338
  Nanxiang Li; Carlos Busso

Doctoral Spotlight Session

Exploring multimodality for translator-computer interaction BIBAFull-Text 339-343
  Julián Zapata
Towards Social Touch Intelligence: Developing a Robust System for Automatic Touch Recognition BIBAFull-Text 344-348
  Merel M. Jung
Facial Expression Analysis for Estimating Pain in Clinical Settings BIBAFull-Text 349-353
  Karan Sikka
Realizing Robust Human-Robot Interaction under Real Environments with Noises BIBAFull-Text 354-358
  Takaaki Sugiyama
Speaker- and Corpus-Independent Methods for Affect Classification in Computational Paralinguistics BIBAFull-Text 359-363
  Heysem Kaya
The Impact of Changing Communication Practices BIBAFull-Text 364-368
  Ailbhe N. Finnerty
Multi-Resident Human Behaviour Identification in Ambient Assisted Living Environments BIBAFull-Text 369-373
  Hande Alemdar
Gaze-Based Proactive User Interface for Pen-Based Systems BIBAFull-Text 374-378
  Çagla Çig
Appearance based user-independent gaze estimation BIBAFull-Text 379-383
  Nanxiang Li
Affective Analysis of Abstract Paintings Using Statistical Analysis and Art Theory BIBAFull-Text 384-388
  Andreza Sartori
The Secret Language of Our Body: Affect and Personality Recognition Using Physiological Signals BIBAFull-Text 389-393
  Julia Wache
Perceptions of Interpersonal Behavior are Influenced by Gender, Facial Expression Intensity, and Head Pose BIBAFull-Text 394-398
  Jeffrey M. Girard
Authoring Communicative Behaviors for Situated, Embodied Characters BIBAFull-Text 399-403
  Tomislav Pejsa
Multimodal Analysis and Modeling of Nonverbal Behaviors during Tutoring BIBAFull-Text 404-408
  Joseph F. Grafsgaard

Keynote Address 3

Computation of Emotions BIBAFull-Text 409-410
  Peter Robinson

Oral Session 5: Mobile and Urban Interaction

Non-Visual Navigation Using Combined Audio Music and Haptic Cues BIBAFull-Text 411-418
  Emily Fujimoto; Matthew Turk
Tactile Feedback for Above-Device Gesture Interfaces: Adding Touch to Touchless Interactions BIBAFull-Text 419-426
  Euan Freeman; Stephen Brewster; Vuokko Lantz
Once Upon a Crime: Towards Crime Prediction from Demographics and Mobile Data BIBAFull-Text 427-434
  Andrey Bogomolov; Bruno Lepri; Jacopo Staiano; Nuria Oliver; Fabio Pianesi; Alex Pentland
Impact of Coordinate Systems on 3D Manipulations in Mobile Augmented Reality BIBAFull-Text 435-438
  Philipp Tiefenbacher; Steven Wichert; Daniel Merget; Gerhard Rigoll

Oral Session 6: Healthcare and Assistive Technologies

Digital Reading Support for The Blind by Multimodal Interaction BIBAFull-Text 439-446
  Yasmine N. El-Glaly; Francis Quek
Measuring Child Visual Attention using Markerless Head Tracking from Color and Depth Sensing Cameras BIBAFull-Text 447-454
  Jonathan Bidwell; Irfan A. Essa; Agata Rozga; Gregory D. Abowd
Bi-Modal Detection of Painful Reaching for Chronic Pain Rehabilitation Systems BIBAFull-Text 455-458
  Temitayo A. Olugbade; M. S. Hane Aung; Nadia Bianchi-Berthouze; Nicolai Marquardt; Amanda C. Williams

Keynote Address 4

A World without Barriers: Connecting the World across Languages, Distances and Media BIBAFull-Text 459-460
  Alexander Waibel

The Second Emotion Recognition In The Wild Challenge

Emotion Recognition In The Wild Challenge 2014: Baseline, Data and Protocol BIBAFull-Text 461-466
  Abhinav Dhall; Roland Goecke; Jyoti Joshi; Karan Sikka; Tom Gedeon
Neural Networks for Emotion Recognition in the Wild BIBAFull-Text 467-472
  Michal Grosicki
Emotion Recognition in the Wild: Incorporating Voice and Lip Activity in Multimodal Decision-Level Fusion BIBAFull-Text 473-480
  Fabien Ringeval; Shahin Amiriparian; Florian Eyben; Klaus Scherer; Björn Schuller
Combining Multimodal Features with Hierarchical Classifier Fusion for Emotion Recognition in the Wild BIBAFull-Text 481-486
  Bo Sun; Liandong Li; Tian Zuo; Ying Chen; Guoyan Zhou; Xuewen Wu
Combining Modality-Specific Extreme Learning Machines for Emotion Recognition in the Wild BIBAFull-Text 487-493
  Heysem Kaya; Albert Ali Salah
Combining Multiple Kernel Methods on Riemannian Manifold for Emotion Recognition in the Wild BIBAFull-Text 494-501
  Mengyi Liu; Ruiping Wang; Shaoxin Li; Shiguang Shan; Zhiwu Huang; Xilin Chen
Enhanced Autocorrelation in Real World Emotion Recognition BIBAFull-Text 502-507
  Sascha Meudt; Friedhelm Schwenker
Emotion Recognition in the Wild with Feature Fusion and Multiple Kernel Learning BIBAFull-Text 508-513
  JunKai Chen; Zenghai Chen; Zheru Chi; Hong Fu
Improved Spatiotemporal Local Monogenic Binary Pattern for Emotion Recognition in The Wild BIBAFull-Text 514-520
  Xiaohua Huang; Qiuhai He; Xiaopeng Hong; Guoying Zhao; Matti Pietikainen
Emotion Recognition in Real-world Conditions with Acoustic and Visual Features BIBAFull-Text 521-524
  Maxim Sidorov; Wolfgang Minker

Workshop Overviews

ERM4HCI 2014: The 2nd Workshop on Emotion Representation and Modelling in Human-Computer-Interaction-Systems BIBAFull-Text 525-526
  Kim Hartmann; Björn Schuller; Ronald Böck
Gaze-in 2014: the 7th Workshop on Eye Gaze in Intelligent Human Machine Interaction BIBAFull-Text 527-528
  Hung-Hsuan Huang; Roman Bednarik; Kristiina Jokinen; Yukiko I. Nakano
MAPTRAITS 2014 -- The First Audio/Visual Mapping Personality Traits Challenge -- An Introduction: Perceived Personality and Social Dimensions BIBAFull-Text 529-530
  Oya Celiktutan; Florian Eyben; Evangelos Sariyanidi; Hatice Gunes; Björn Schuller
MLA'14: Third Multimodal Learning Analytics Workshop and Grand Challenges BIBAFull-Text 531-532
  Xavier Ochoa; Marcelo Worsley; Katherine Chiluiza; Saturnino Luz
ICMI 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction BIBAFull-Text 533-534
  Mary Ellen Foster; Manuel Giuliani; Ronald Petrick
An Outline of Opportunities for Multimodal Research BIBAFull-Text 535-536
  Dirk Heylen; Alessandro Vinciarelli
UM3I 2014: International Workshop on Understanding and Modeling Multiparty, Multimodal Interactions BIBAFull-Text 537-538
  Samer Al Moubayed; Dan Bohus; Anna Esposito; Dirk Heylen; Maria Koutsombogera; Harris Papageorgiou; Gabriel Skantze