Wir im Kiez: Multimodal App for Mutual Help Among Elderly Neighbours
Demonstrations
/
Schmeier, Sven
/
Ruß, Aaron
/
Reithinger, Norbert
Proceedings of the 2015 International Conference on Multimodal Interaction
2015-11-09
p.379-380
© Copyright 2015 ACM
Summary: Elderly people often need support in everyday situations -- e.g. common
daily life activities like taking care of house and garden, or caring for an
animal are often not possible without a larger support circle. However,
especially in larger western cities, local social networks may not be very
tight, friends may have moved away or died, and the traditional support
structures found in so-called multi-generational families do not exist anymore.
As a result, the quality of life for elderly people suffers crucially. On the
other hand, people from the broader neighborhood would often gladly help and
respond quickly. With the project Wir im Kiez we developed and tested a
multimodal social network app equipped with a conversational interface that
addresses these issues. In the demonstration, we especially focus on the needs
and restrictions of seniors, both in their physical and psychological
limitations.
A Barrier-Free Platform to Help Elderly People to Help Themselves
Design for Aging
/
Schmeier, Sven
/
Reithinger, Norbert
HCI International 2014: 16th International Conference on HCI: Posters'
Extended Abstracts, Part II
2014-06-22
v.5
p.316-321
Keywords: Barrier-free; seniors; conversational interface
© Copyright 2014 Springer International Publishing
Summary: The proportion of elderly people in German society has been increasing for
decades. As a result Germany, and other industrial countries as well, are
currently facing large demographic changes in terms of age structure and
population size, changes that will only increase in the future. Furthermore,
especially in bigger cities, the traditional family structures with more
generations living together are disappearing.
Starting from these observations, the project Barrierefreie Cloud für
Senioren -- WirlmKiez (translated: A barrier-free Cloud for Seniors -- We in
our neighbourhood), funded by the German Ministry of Education and Research,
aims to develop a platform where elderly people can get in touch with and help
each other with everyday problems and issues. We plan to realise a virtual
neighbourly help especially for elderly people who have no or very little
social contact. Persons using the platform will be able to either provide
support to others ("I can help to hang curtains", "I can help gardening", ...)
or they can request for help ("I need to go to hospital for 4 days, who can
take care of my cat"). The app will run on computers, smartphones, and tablets
and will be very simple to use and appropriate for seniors. Its main features
are creating a proposal or request by using natural language. Behind the scenes
we will use shallow information extraction (IE) to extract the core
information. After this we store the extracted information plus additional meta
information like time and location on a central server (cloud). In the final
step a generated request or proposal is offered to adequate users of the
system, e.g. people who live nearby and are able to help or need help and
connecting the persons in the end.
EDITED BOOK
Natural Interaction with Robots, Knowbots and Smartphones: Putting Spoken
Dialog Systems into Practice
/
Mariani, Joseph
/
Rosset, Sophie
/
Garnier-Rizet, Martine
/
Devillers, Laurence
2014
p.397
Springer New York
== Spoken Dialog Systems in Everyday Applications ==
Spoken Language Understanding for Natural Interaction: The Siri Experience (3-14)
+ Bellegarda, Jerome R.
Development of Speech-Based In-Car HMI Concepts for Information Exchange Internet Apps (15-28)
+ Hofmann, Hansjörg
+ Silberstein, Anna
+ Ehrlich, Ute
+ Berton, André
+ Müller, Christian
+ Mahr, Angela
Real Users and Real Dialog Systems: The Hard Challenge for SDS (29-36)
+ Black, Alan W.
+ Eskenazi, Maxine
A Multimodal Multi-device Discourse and Dialogue Infrastructure for Collaborative Decision-Making in Medicine (37-47)
+ Sonntag, Daniel
+ Schulz, Christian
== Spoken Dialog Prototypes and Products ==
Yochina: Mobile Multimedia and Multimodal Crosslingual Dialogue System (51-57)
+ Xu, Feiyu
+ Schmeier, Sven
+ Ai, Renlong
+ Uszkoreit, Hans
Walk This Way: Spatial Grounding for City Exploration (59-67)
+ Boye, Johan
+ Fredriksson, Morgan
+ Götze, Jana
+ Gustafson, Joakim
+ Königsmann, Jürgen
Multimodal Dialogue System for Interaction in AmI Environment by Means of File-Based Services (69-77)
+ Ábalos, Nieves
+ Espejo, Gonzalo
+ López-Cózar, Ramón
+ Ballesteros, Francisco J.
+ Soriano, Enrique
+ Guardiola, Gorka
Development of a Toolkit Handling Multiple Speech-Oriented Guidance Agents for Mobile Applications (79-85)
+ Hara, Sunao
+ Kawanami, Hiromichi
+ Saruwatari, Hiroshi
+ Shikano, Kiyohiro
Providing Interactive and User-Adapted E-City Services by Means of Voice Portals (87-98)
+ Griol, David
+ García-Jiménez, María
+ Callejas, Zoraida
+ López-Cózar, Ramón
== Multi-domain, Crosslingual Spoken Dialog Systems ==
Efficient Language Model Construction for Spoken Dialog Systems by Inducting Language Resources of Different Languages (101-110)
+ Misu, Teruhisa
+ Matsuda, Shigeki
+ Mizukami, Etsuo
+ Kashioka, Hideki
+ Li, Haizhou
Towards Online Planning for Dialogue Management with Rich Domain Knowledge (111-123)
+ Lison, Pierre
A Two-Step Approach for Efficient Domain Selection in Multi-Domain Dialog Systems (125-131)
+ Lee, Injae
+ Kim, Seokhwan
+ Kim, Kyungduk
+ Lee, Donghyeon
+ Choi, Junhwi
+ Ryu, Seonghan
+ Lee, Gary Geunbae
== Human-Robot Interaction ==
From Informative Cooperative Dialogues to Long-Term Social Relation with a Robot (135-151)
+ Buendia, Axel
+ Devillers, Laurence
Integration of Multiple Sound Source Localization Results for Speaker Identification in Multiparty Dialogue System (153-165)
+ Nakashima, Taichi
+ Komatani, Kazunori
+ Sato, Satoshi
Investigating the Social Facilitation Effect in Human--Robot Interaction (167-177)
+ Wechsung, Ina
+ Ehrenbrink, Patrick
+ Schleicher, Robert
+ Möller, Sebastian
More Than Just Words: Building a Chatty Robot (179-185)
+ Gilmartin, Emer
+ Campbell, Nick
Predicting When People Will Speak to a Humanoid Robot (187-198)
+ Sugiyama, Takaaki
+ Komatani, Kazunori
+ Sato, Satoshi
Designing an Emotion Detection System for a Socially Intelligent Human-Robot Interaction (199-211)
+ Chastagnol, Clément
+ Clavel, Céline
+ Courgeon, Matthieu
+ Devillers, Laurence
Multimodal Open-Domain Conversations with the Nao Robot (213-224)
+ Jokinen, Kristiina
+ Wilcock, Graham
Component Pluggable Dialogue Framework and Its Application to Social Robots (225-237)
+ Jiang, Ridong
+ Tan, Yeow Kee
+ Limbu, Dilip Kumar
+ Dung, Tran Anh
+ Li, Haizhou
== Spoken Dialog Systems Components ==
Visual Contribution to Word Prominence Detection in a Playful Interaction Setting (241-247)
+ Heckmann, Martin
Label Noise Robustness and Learning Speed in a Self-Learning Vocal User Interface (249-259)
+ Ons, Bart
+ Gemmeke, Jort F.
+ Van hamme, Hugo
Topic Classification of Spoken Inquiries Using Transductive Support Vector Machine (261-267)
+ Torres, Rafael
+ Kawanami, Hiromichi
+ Matsui, Tomoko
+ Saruwatari, Hiroshi
+ Shikano, Kiyohiro
Frame-Level Selective Decoding Using Native and Non-native Acoustic Models for Robust Speech Recognition to Native and Non-native Speech (269-274)
+ Oh, Yoo Rhee
+ Chung, Hoon
+ Kang, Jeom-ja
+ Lee, Yun Keun
Analysis of Speech Under Stress and Cognitive Load in USAR Operations (275-281)
+ Charfuelan, Marcela
+ Kruijff, Geert-Jan
== Dialog Management ==
Does Personality Matter? Expressive Generation for Dialogue Interaction (285-301)
+ Walker, Marilyn A.
+ Sawyer, Jennifer
+ Lin, Grace
+ Wing, Sam
Application and Evaluation of a Conditioned Hidden Markov Model for Estimating Interaction Quality of Spoken Dialogue Systems (303-312)
+ Ultes, Stefan
+ ElChab, Robert
+ Minker, Wolfgang
FLoReS: A Forward Looking, Reward Seeking, Dialogue Manager (313-325)
+ Morbini, Fabrizio
+ DeVault, David
+ Sagae, Kenji
+ Gerten, Jillian
+ Nazarian, Angela
+ Traum, David
A Clustering Approach to Assess Real User Profiles in Spoken Dialogue Systems (327-334)
+ Callejas, Zoraida
+ Griol, David
+ Engelbrecht, Klaus-Peter
+ López-Cózar, Ramón
What Are They Achieving Through the Conversation? Modeling Guide--Tourist Dialogues by Extended Grounding Networks (335-341)
+ Mizukami, Etsuo
+ Kashioka, Hideki
Co-adaptation in Spoken Dialogue Systems (343-353)
+ Chandramohan, Senthilkumar
+ Geist, Matthieu
+ Lefèvre, Fabrice
+ Pietquin, Olivier
Developing Non-goal Dialog System Based on Examples of Drama Television (355-361)
+ Nio, Lasguido
+ Sakti, Sakriani
+ Neubig, Graham
+ Toda, Tomoki
+ Adriani, Mirna
+ Nakamura, Satoshi
A User Model for Dialog System Evaluation Based on Activation of Subgoals (363-374)
+ Engelbrecht, Klaus-Peter
Real-Time Feedback System for Monitoring and Facilitating Discussions (375-387)
+ Sarda, Sanat
+ Constable, Martin
+ Dauwels, Justin
+ Shoko Dauwels (Okutsu), +
+ Elgendi, Mohamed
+ Mengyu, Zhou
+ Rasheed, Umer
+ Tahir, Yasir
+ Thalmann, Daniel
+ Magnenat-Thalmann, Nadia
Evaluation of Invalid Input Discrimination Using Bag-of-Words for Speech-Oriented Guidance System (389-397)
+ Majima, Haruka
+ Torres, Rafael
+ Kawanami, Hiromichi
+ Hara, Sunao
+ Matsui, Tomoko
+ Saruwatari, Hiroshi
+ Shikano, Kiyohiro
Computer Assistance in Bilingual Task-Oriented Human-Human Dialogues
Voice, Natural Language and Dialogue
/
Schmeier, Sven
/
Rebel, Matthias
/
Ai, Renlong
HCI International 2011: 14th International Conference on Human-Computer
Interaction, Part II: Interaction Techniques and Environments
2011-07-09
v.2
p.387-395
Keywords: language barriers; human-human dialogue system; health care
Copyright © 2011 Springer-Verlag
Summary: In 2008, the percentage of people with a migration background in Germany had
already reached more than 15% (12 Million people). Among that 15%, the ratio of
seniors aged 50 years or older was 30% [1]. In most cases, their competence of
the German language is adequate for dealing with everyday situations. However
sometimes in emergency or medical situations, their knowledge of German is not
sufficient to communicate with medical professionals and vice versa. These
seniors are part of the main target group within the German Ministry of
Research and Education (BMBF) research project SmartSenior [2] and we have
developed a software system that assists multilingual doctor-patient
conversations to overcome language and cultural barriers. The main requirements
of such a system are robustness, accurate translations in respect to context
and mobility, adaptability to new languages and topics and of course an
appropriate user interface. Furthermore, we have equipped the system with
additional information to convey cultural facts about different countries. In
this paper, we present the architecture and ideas behind the system as a whole
as well as related work in the area of computer aided translation and a first
evaluation of the system.
DiLiA -- The Digital Library Assistant
Demos
/
Eichler, Kathrin
/
Hemsen, Holmer
/
Neumann, Günter
/
Reithinger, Norbert
/
Schmeier, Sven
/
Schumacher, Kinga
/
Seifert, Inessa
ECDL 2010: Proceedings of the European Conference on Digital Libraries
2010-09-06
p.534-537
© Copyright 2010 Springer-Verlag
Summary: In this paper we present the digital library assistant (DiLiA). The system
aims at augmenting the search in digital libraries in several dimensions. In
the project advanced information visualisation methods are developed for user
controlled interactive search. The interaction model has been designed in a way
that it is transparent to the user and easy to use. In addition, information
extraction (IE) methods have been developed in DiLiA to make the content more
easily accessible, this includes the identification and extraction of technical
terms (TTs) -- single and multi word terms -- as well as the extraction of
binary relations based on the extracted terms. In DiLiA we follow a hybrid
information extraction approach -- a combination of metadata and document
processing.