HCI Bibliography Home | HCI Conferences | ICMI Archive | Detailed Records | RefWorks | EndNote | Show Abstracts
ICMI Tables of Contents: 0203040506070809101112131415

Proceedings of the 2015 International Conference on Multimodal Interaction

Fullname:Proceedings of the 17th ACM International Conference on Multimodal Interaction
Editors:Zhengyou Zhang; Phil Cohen; Dan Bohus; Radu Horaud; Helen Meng
Location:Seattle, Washington
Dates:2015-Nov-09 to 2015-Nov-13
Publisher:ACM
Standard No:ISBN: 978-1-4503-3912-4; ACM DL: Table of Contents; hcibib: ICMI15
Papers:106
Pages:655
Links:Conference Website
  1. Keynote Address 1
  2. Keynote Address 2
  3. Keynote Address 3 (Sustained Accomplishment Award Talk)
  4. Oral Session 1: Machine Learning in Multimodal Systems
  5. Oral Session 2: Audio-Visual, Multimodal Inference
  6. Oral Session 3: Language, Speech and Dialog
  7. Oral Session 4: Communication Dynamics
  8. Oral Session 5: Interaction Techniques
  9. Oral Session 6: Mobile and Wearable
  10. Poster Session
  11. Demonstrations
  12. Grand Challenge 1: Recognition of Social Touch Gestures Challenge 2015
  13. Grand Challenge 2: Emotion Recognition in the Wild Challenge 2015
  14. Grand Challenge 3: Multimodal Learning and Analytics Grand Challenge 2015
  15. Doctoral Consortium

Keynote Address 1

Sharing Representations for Long Tail Computer Vision Problems BIBAFull-Text 1
  Samy Bengio

Keynote Address 2

Interaction Studies with Social Robots BIBAFull-Text 3
  Kerstin Dautenhahn

Keynote Address 3 (Sustained Accomplishment Award Talk)

Connections: 2015 ICMI Sustained Accomplishment Award Lecture BIBAFull-Text 5
  Eric Horvitz

Oral Session 1: Machine Learning in Multimodal Systems

Combining Two Perspectives on Classifying Multimodal Data for Recognizing Speaker Traits BIBAFull-Text 7-14
  Moitreya Chatterjee; Sunghyun Park; Louis-Philippe Morency; Stefan Scherer
Personality Trait Classification via Co-Occurrent Multiparty Multimodal Event Discovery BIBAFull-Text 15-22
  Shogo Okada; Oya Aran; Daniel Gatica-Perez
Evaluating Speech, Face, Emotion and Body Movement Time-series Features for Automated Multimodal Presentation Scoring BIBAFull-Text 23-30
  Vikram Ramanarayanan; Chee Wee Leong; Lei Chen; Gary Feng; David Suendermann-Oeft
Gender Representation in Cinematic Content: A Multimodal Approach BIBAFull-Text 31-34
  Tanaya Guha; Che-Wei Huang; Naveen Kumar; Yan Zhu; Shrikanth S. Narayanan

Oral Session 2: Audio-Visual, Multimodal Inference

Effects of Good Speaking Techniques on Audience Engagement BIBAFull-Text 35-42
  Keith Curtis; Gareth J. F. Jones; Nick Campbell
Multimodal Public Speaking Performance Assessment BIBAFull-Text 43-50
  Torsten Wörtwein; Mathieu Chollet; Boris Schauerte; Louis-Philippe Morency; Rainer Stiefelhagen; Stefan Scherer
I Would Hire You in a Minute: Thin Slices of Nonverbal Behavior in Job Interviews BIBAFull-Text 51-58
  Laurent Son Nguyen; Daniel Gatica-Perez
Deception Detection using Real-life Trial Data BIBAFull-Text 59-66
  Verónica Pérez-Rosas; Mohamed Abouelenien; Rada Mihalcea; Mihai Burzo

Oral Session 3: Language, Speech and Dialog

Exploring Turn-taking Cues in Multi-party Human-robot Discussions about Objects BIBAFull-Text 67-74
  Gabriel Skantze; Martin Johansson; Jonas Beskow
Visual Saliency and Crowdsourcing-based Priors for an In-car Situated Dialog System BIBAFull-Text 75-82
  Teruhisa Misu
Leveraging Behavioral Patterns of Mobile Applications for Personalized Spoken Language Understanding BIBAFull-Text 83-86
  Yun-Nung Chen; Ming Sun; Alexander I. Rudnicky; Anatole Gershman
Who's Speaking?: Audio-Supervised Classification of Active Speakers in Video BIBAFull-Text 87-90
  Punarjay Chakravarty; Sayeh Mirzaei; Tinne Tuytelaars; Hugo Van hamme

Oral Session 4: Communication Dynamics

Predicting Participation Styles using Co-occurrence Patterns of Nonverbal Behaviors in Collaborative Learning BIBAFull-Text 91-98
  Yukiko I. Nakano; Sakiko Nihonyanagi; Yutaka Takase; Yuki Hayashi; Shogo Okada
Multimodal Fusion using Respiration and Gaze for Predicting Next Speaker in Multi-Party Meetings BIBAFull-Text 99-106
  Ryo Ishii; Shiro Kumano; Kazuhiro Otsuka
Deciphering the Silent Participant: On the Use of Audio-Visual Cues for the Classification of Listener Categories in Group Discussions BIBAFull-Text 107-114
  Catharine Oertel; Kenneth A. Funes Mora; Joakim Gustafson; Jean-Marc Odobez
Retrieving Target Gestures Toward Speech Driven Animation with Meaningful Behaviors BIBAFull-Text 115-122
  Najmeh Sadoughi; Carlos Busso

Oral Session 5: Interaction Techniques

Look & Pedal: Hands-free Navigation in Zoomable Information Spaces through Gaze-supported Foot Input BIBAFull-Text 123-130
  Konstantin Klamka; Andreas Siegel; Stefan Vogt; Fabian Göbel; Sophie Stellmach; Raimund Dachselt
Gaze+Gesture: Expressive, Precise and Targeted Free-Space Interactions BIBAFull-Text 131-138
  Ishan Chatterjee; Robert Xiao; Chris Harrison
Digital Flavor: Towards Digitally Simulating Virtual Flavors BIBAFull-Text 139-146
  Nimesha Ranasinghe; Gajan Suthokumar; Kuan-Yi Lee; Ellen Yi-Luen Do
Different Strokes and Different Folks: Economical Dynamic Surface Sensing and Affect-Related Touch Recognition BIBAFull-Text 147-154
  Xi Laura Cang; Paul Bucci; Andrew Strang; Jeff Allen; Karon MacLean; H. Y. Sean Liu

Oral Session 6: Mobile and Wearable

MPHA: A Personal Hearing Doctor Based on Mobile Devices BIBAFull-Text 155-162
  Yuhao Wu; Jia Jia; WaiKim Leung; Yejun Liu; Lianhong Cai
Towards Attentive, Bi-directional MOOC Learning on Mobile Devices BIBAFull-Text 163-170
  Xiang Xiao; Jingtao Wang
An Experiment on the Feasibility of Spatial Acquisition using a Moving Auditory Cue for Pedestrian Navigation BIBAFull-Text 171-174
  Yeseul Park; Kyle Koh; Heonjin Park; Jinwook Seo
A Wearable Multimodal Interface for Exploring Urban Points of Interest BIBAFull-Text 175-182
  Antti Jylhä; Yi-Ta Hsieh; Valeria Orso; Salvatore Andolina; Luciano Gamberini; Giulio Jacucci

Poster Session

ECA Control using a Single Affective User Dimension BIBAFull-Text 183-190
  Fred Charles; Florian Pecune; Gabor Aranyi; Catherine Pelachaud; Marc Cavazza
Multimodal Interaction with a Bifocal View on Mobile Devices BIBAFull-Text 191-198
  Sebastien Pelurson; Laurence Nigay
NaLMC: A Database on Non-acted and Acted Emotional Sequences in HCI BIBAFull-Text 199-202
  Kim Hartmann; Julia Krüger; Jörg Frommer; Andreas Wendemuth
Exploiting Multimodal Affect and Semantics to Identify Politically Persuasive Web Videos BIBAFull-Text 203-210
  Behjat Siddiquie; Dave Chisholm; Ajay Divakaran
Toward Better Understanding of Engagement in Multiparty Spoken Interaction with Children BIBAFull-Text 211-218
  Samer Al Moubayed; Jill Lehman
Gestimator: Shape and Stroke Similarity Based Gesture Recognition BIBAFull-Text 219-226
  Yina Ye; Petteri Nurmi
Classification of Children's Social Dominance in Group Interactions with Robots BIBAFull-Text 227-234
  Sarah Strohkorb; Iolanda Leite; Natalie Warren; Brian Scassellati
Spectators' Synchronization Detection based on Manifold Representation of Physiological Signals: Application to Movie Highlights Detection BIBAFull-Text 235-238
  Michal Muszynski; Theodoros Kostoulas; Guillaume Chanel; Patrizia Lombardo; Thierry Pun
Implicit User-centric Personality Recognition Based on Physiological Responses to Emotional Videos BIBAFull-Text 239-246
  Julia Wache; Ramanathan Subramanian; Mojtaba Khomami Abadi; Radu-Laurentiu Vieriu; Nicu Sebe; Stefan Winkler
Detecting Mastication: A Wearable Approach BIBAFull-Text 247-250
  Abdelkareem Bedri; Apoorva Verlekar; Edison Thomaz; Valerie Avva; Thad Starner
Exploring Behavior Representation for Learning Analytics BIBAFull-Text 251-258
  Marcelo Worsley; Stefan Scherer; Louis-Philippe Morency; Paulo Blikstein
Multimodal Human Activity Recognition for Industrial Manufacturing Processes in Robotic Workcells BIBAFull-Text 259-266
  Alina Roitberg; Nikhil Somani; Alexander Perzylo; Markus Rickert; Alois Knoll
Accuracy vs. Availability Heuristic in Multimodal Affect Detection in the Wild BIBAFull-Text 267-274
  Nigel Bosch; Huili Chen; Sidney D'Mello; Ryan Baker; Valerie Shute
Dynamic Active Learning Based on Agreement and Applied to Emotion Recognition in Spoken Interactions BIBAFull-Text 275-278
  Yue Zhang; Eduardo Coutinho; Zixing Zhang; Caijiao Quan; Bjoern Schuller
Sharing Touch Interfaces: Proximity-Sensitive Touch Targets for Tablet-Mediated Collaboration BIBAFull-Text 279-286
  Ilhan Aslan; Thomas Meneweger; Verena Fuchsberger; Manfred Tscheligi
Analyzing Multimodality of Video for User Engagement Assessment BIBAFull-Text 287-290
  Fahim A. Salim; Fasih Haider; Owen Conlan; Saturnino Luz; Nick Campbell
Adjacent Vehicle Collision Warning System using Image Sensor and Inertial Measurement Unit BIBAFull-Text 291-298
  Asif Iqbal; Carlos Busso; Nicholas R. Gans
Automatic Detection of Mind Wandering During Reading Using Gaze and Physiology BIBAFull-Text 299-306
  Robert Bixler; Nathaniel Blanchard; Luke Garrison; Sidney D'Mello
Multimodal Detection of Depression in Clinical Interviews BIBAFull-Text 307-310
  Hamdi Dibeklioglu; Zakia Hammal; Ying Yang; Jeffrey F. Cohn
Spoken Interruptions Signal Productive Problem Solving and Domain Expertise in Mathematics BIBAFull-Text 311-318
  Sharon Oviatt; Kevin Hang; Jianlong Zhou; Fang Chen
Active Haptic Feedback for Touch Enabled TV Remote BIBAFull-Text 319-322
  Anton Treskunov; Mike Darnell; Rongrong Wang
A Visual Analytics Approach to Finding Factors Improving Automatic Speaker Identifications BIBAFull-Text 323-326
  Pierrick Bruneau; Mickaël Stefas; Hervé Bredin; Johann Poignant; Thomas Tamisier; Claude Barras
The Influence of Visual Cues on Passive Tactile Sensations in a Multimodal Immersive Virtual Environment BIBAFull-Text 327-334
  Nina Rosa; Wolfgang Hürst; Wouter Vos; Peter Werkhoven
Detection of Deception in the Mafia Party Game BIBAFull-Text 335-342
  Sergey Demyanov; James Bailey; Kotagiri Ramamohanarao; Christopher Leckie
Individuality-Preserving Voice Reconstruction for Articulation Disorders Using Text-to-Speech Synthesis BIBAFull-Text 343-346
  Reina Ueda; Tetsuya Takiguchi; Yasuo Ariki
Behavioral and Emotional Spoken Cues Related to Mental States in Human-Robot Social Interaction BIBAFull-Text 347-350
  Lucile Bechade; Guillaume Dubuisson Duplessis; Mohamed Sehili; Laurence Devillers
Viewpoint Integration for Hand-Based Recognition of Social Interactions from a First-Person View BIBAFull-Text 351-354
  Sven Bambach; David J. Crandall; Chen Yu
A Multimodal System for Real-Time Action Instruction in Motor Skill Learning BIBAFull-Text 355-362
  Iwan de Kok; Julian Hough; Felix Hülsmann; Mario Botsch; David Schlangen; Stefan Kopp

Demonstrations

The Application of Word Processor UI paradigms to Audio and Animation Editing BIBAFull-Text 363-364
  Andre D. Milota
CuddleBits: Friendly, Low-cost Furballs that Respond to Touch BIBAFull-Text 365-366
  Laura Cang; Paul Bucci; Karon E. MacLean
Public Speaking Training with a Multimodal Interactive Virtual Audience Framework BIBAFull-Text 367-368
  Mathieu Chollet; Kalin Stefanov; Helmut Prendinger; Stefan Scherer
A Multimodal System for Public Speaking with Real Time Feedback BIBAFull-Text 369-370
  Fiona Dermody; Alistair Sutherland
Model of Personality-Based, Nonverbal Behavior in Affective Virtual Humanoid Character BIBAFull-Text 371-372
  Maryam Saberi; Ulysses Bernardet; Steve DiPaola
AttentiveLearner: Adaptive Mobile MOOC Learning via Implicit Cognitive States Inference BIBAFull-Text 373-374
  Xiang Xiao; Phuong Pham; Jingtao Wang
Interactive Web-based Image Sonification for the Blind BIBAFull-Text 375-376
  Torsten Wörtwein; Boris Schauerte; Karin E. Müller; Rainer Stiefelhagen
Nakama: A Companion for Non-verbal Affective Communication BIBAFull-Text 377-378
  Christian J. A. M. Willemse; Gerald M. Munters; Jan B. F. van Erp; Dirk Heylen
Wir im Kiez: Multimodal App for Mutual Help Among Elderly Neighbours BIBAFull-Text 379-380
  Sven Schmeier; Aaron Ruß; Norbert Reithinger
Interact: Tightly-coupling Multimodal Dialog with an Interactive Virtual Assistant BIBAFull-Text 381-382
  Ethan Selfridge; Michael Johnston
The UTEP AGENT System BIBAFull-Text 383-384
  David Novick; Iván Gris Sepulveda; Diego A. Rivera; Adriana Camacho; Alex Rayon; Mario Gutierrez
A Distributed Architecture for Interacting with NAO BIBAFull-Text 385-386
  Fabien Badeig; Quentin Pelorson; Soraya Arias; Vincent Drouard; Israel Gebru; Xiaofei Li; Georgios Evangelidis; Radu Horaud

Grand Challenge 1: Recognition of Social Touch Gestures Challenge 2015

Touch Challenge '15: Recognizing Social Touch Gestures BIBAFull-Text 387-390
  Merel M. Jung; Xi Laura Cang; Mannes Poel; Karon E. MacLean
The Grenoble System for the Social Touch Challenge at ICMI 2015 BIBAFull-Text 391-398
  Viet-Cuong Ta; Wafa Johal; Maxime Portaz; Eric Castelli; Dominique Vaufreydaz
Social Touch Gesture Recognition using Random Forest and Boosting on Distinct Feature Sets BIBAFull-Text 399-406
  Yona Falinie A. Gaus; Temitayo Olugbade; Asim Jan; Rui Qin; Jingxin Liu; Fan Zhang; Hongying Meng; Nadia Bianchi-Berthouze
Recognizing Touch Gestures for Social Human-Robot Interaction BIBAFull-Text 407-413
  Tugce Balli Altuglu; Kerem Altun
Detecting and Identifying Tactile Gestures using Deep Autoencoders, Geometric Moments and Gesture Level Features BIBAFull-Text 415-422
  Dana Hughes; Nicholas Farrow; Halley Profita; Nikolaus Correll

Grand Challenge 2: Emotion Recognition in the Wild Challenge 2015

Video and Image based Emotion Recognition Challenges in the Wild: EmotiW 2015 BIBAFull-Text 423-426
  Abhinav Dhall; O. V. Ramana Murthy; Roland Goecke; Jyoti Joshi; Tom Gedeon
Hierarchical Committee of Deep CNNs with Exponentially-Weighted Decision Fusion for Static Facial Expression Recognition BIBAFull-Text 427-434
  Bo-Kyeong Kim; Hwaran Lee; Jihyeon Roh; Soo-Young Lee
Image based Static Facial Expression Recognition with Multiple Deep Network Learning BIBAFull-Text 435-442
  Zhiding Yu; Cha Zhang
Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning BIBAFull-Text 443-449
  Hong-Wei Ng; Viet Dung Nguyen; Vassilios Vonikakis; Stefan Winkler
Capturing AU-Aware Facial Features and Their Latent Relations for Emotion Recognition in the Wild BIBAFull-Text 451-458
  Anbang Yao; Junchao Shao; Ningning Ma; Yurong Chen
Contrasting and Combining Least Squares Based Learners for Emotion Recognition in the Wild BIBAFull-Text 459-466
  Heysem Kaya; Furkan Gürpinar; Sadaf Afshar; Albert Ali Salah
Recurrent Neural Networks for Emotion Recognition in Video BIBAFull-Text 467-474
  Samira Ebrahimi Kahou; Vincent Michalski; Kishore Konda; Roland Memisevic; Christopher Pal
Multiple Models Fusion for Emotion Recognition in the Wild BIBAFull-Text 475-481
  Jianlong Wu; Zhouchen Lin; Hongbin Zha
A Deep Feature based Multi-kernel Learning Approach for Video Emotion Recognition BIBAFull-Text 483-490
  Wei Li; Farnaz Abtahi; Zhigang Zhu
Transductive Transfer LDA with Riesz-based Volume LBP for Emotion Recognition in The Wild BIBAFull-Text 491-496
  Yuan Zong; Wenming Zheng; Xiaohua Huang; Jingwei Yan; Tong Zhang
Combining Multimodal Features within a Fusion Network for Emotion Recognition in the Wild BIBAFull-Text 497-502
  Bo Sun; Liandong Li; Guoyan Zhou; Xuewen Wu; Jun He; Lejun Yu; Dongxue Li; Qinglan Wei
Emotion Recognition in the Wild via Convolutional Neural Networks and Mapped Binary Patterns BIBAFull-Text 503-510
  Gil Levi; Tal Hassner
Quantification of Cinematography Semiotics for Video-based Facial Emotion Recognition in the EmotiW 2015 Grand Challenge BIBAFull-Text 511-518
  Albert C. Cruz
Affect Recognition using Key Frame Selection based on Minimum Sparse Reconstruction BIBAFull-Text 519-524
  Mehmet Kayaoglu; Cigdem Eroglu Erdem

Grand Challenge 3: Multimodal Learning and Analytics Grand Challenge 2015

2015 Multimodal Learning and Analytics Grand Challenge BIBAFull-Text 525-529
  Marcelo Worsley; Katherine Chiluiza; Joseph F. Grafsgaard; Xavier Ochoa
Providing Real-time Feedback for Student Teachers in a Virtual Rehearsal Environment BIBAFull-Text 531-537
  Roghayeh Barmaki; Charles E. Hughes
Presentation Trainer, your Public Speaking Multimodal Coach BIBAFull-Text 539-546
  Jan Schneider; Dirk Börner; Peter van Rosmalen; Marcus Specht
Utilizing Depth Sensors for Analyzing Multimodal Presentations: Hardware, Software and Toolkits BIBAFull-Text 547-556
  Chee Wee Leong; Lei Chen; Gary Feng; Chong Min Lee; Matthew Mulholland
Multimodal Capture of Teacher-Student Interactions for Automated Dialogic Analysis in Live Classrooms BIBAFull-Text 557-566
  Sidney K. D'Mello; Andrew M. Olney; Nathan Blanchard; Borhan Samei; Xiaoyi Sun; Brooke Ward; Sean Kelly
Multimodal Selfies: Designing a Multimodal Recording Device for Students in Traditional Classrooms BIBAFull-Text 567-574
  Federico Domínguez; Katherine Chiluiza; Vanessa Echeverria; Xavier Ochoa

Doctoral Consortium

Temporal Association Rules for Modelling Multimodal Social Signals BIBAFull-Text 575-579
  Thomas Janssoone
Detecting and Synthesizing Synchronous Joint Action in Human-Robot Teams BIBAFull-Text 581-585
  Tariq Iqbal; Laurel D. Riek
Micro-opinion Sentiment Intensity Analysis and Summarization in Online Videos BIBAFull-Text 587-591
  Amir Zadeh
Attention and Engagement Aware Multimodal Conversational Systems BIBAFull-Text 593-597
  Zhou Yu
Implicit Human-computer Interaction: Two Complementary Approaches BIBAFull-Text 599-603
  Julia Wache
Instantaneous and Robust Eye-Activity Based Task Analysis BIBAFull-Text 605-609
  Hoe Kin Wong
Challenges in Deep Learning for Multimodal Applications BIBAFull-Text 611-615
  Sayan Ghosh
Exploring Intent-driven Multimodal Interface for Geographical Information System BIBAFull-Text 617-621
  Feng Sun
Software Techniques for Multimodal Input Processing in Realtime Interactive Systems BIBAFull-Text 623-627
  Martin Fischbach
Gait and Postural Sway Analysis, A Multi-Modal System BIBAFull-Text 629-633
  Hafsa Ismail
A Computational Model of Culture-Specific Emotion Detection for Artificial Agents in the Learning Domain BIBAFull-Text 635-639
  Ganapreeta R. Naidu
Record, Transform & Reproduce Social Encounters in Immersive VR: An Iterative Approach BIBAFull-Text 641-644
  Jan Kolkmeier
Multimodal Affect Detection in the Wild: Accuracy, Availability, and Generalizability BIBAFull-Text 645-649
  Nigel Bosch
Multimodal Assessment of Teaching Behavior in Immersive Rehearsal Environment-TeachLivE BIBAFull-Text 651-655
  Roghayeh Barmaki