TY - GEN
T1 - Estimating user satisfaction impact in cities using physical reaction sensing and multimodal dialogue system
AU - Matsuda, Yuki
AU - Fedotov, Dmitrii
AU - Takahashi, Yuta
AU - Arakawa, Yutaka
AU - Yasumoto, Keiichi
AU - Minker, Wolfgang
N1 - Funding Information:
Acknowledgements This work was supported by JSPS KAKENHI Grant Number 16J09670, 16H01721.
Publisher Copyright:
© Springer Nature Singapore Pte Ltd 2019.
PY - 2019
Y1 - 2019
N2 - Following the increase in use of smart devices, various real-time environmental information becomes available everywhere. To provide more context-aware information, we also need to know emotion and a satisfaction level in a viewpoint of users. In this paper, we define it as “a user satisfaction impact (USI)” and propose a method to estimate USI by combining dialogue features and physical reaction features. As dialogue features, facial expression and acoustic feature are extracted from multimodal dialogue system on a smartphone. As physical reactions, head motion, eye motion, and heartbeat are collected by wearable devices. We conducted the preliminary experiments in the real-world to confirm the feasibility of this study in the tourism domain. Among various features, we confirmed that eye motion correlates with satisfaction level up to 0.36.
AB - Following the increase in use of smart devices, various real-time environmental information becomes available everywhere. To provide more context-aware information, we also need to know emotion and a satisfaction level in a viewpoint of users. In this paper, we define it as “a user satisfaction impact (USI)” and propose a method to estimate USI by combining dialogue features and physical reaction features. As dialogue features, facial expression and acoustic feature are extracted from multimodal dialogue system on a smartphone. As physical reactions, head motion, eye motion, and heartbeat are collected by wearable devices. We conducted the preliminary experiments in the real-world to confirm the feasibility of this study in the tourism domain. Among various features, we confirmed that eye motion correlates with satisfaction level up to 0.36.
UR - http://www.scopus.com/inward/record.url?scp=85076176589&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85076176589&partnerID=8YFLogxK
U2 - 10.1007/978-981-13-9443-0_15
DO - 10.1007/978-981-13-9443-0_15
M3 - Conference contribution
AN - SCOPUS:85076176589
SN - 9789811394423
T3 - Lecture Notes in Electrical Engineering
SP - 177
EP - 183
BT - 9th International Workshop on Spoken Dialogue System Technology, IWSDS 2018
A2 - D’Haro, Luis Fernando
A2 - Banchs, Rafael E.
A2 - Li, Haizhou
PB - Springer
T2 - 9th International Workshop on Spoken Dialogue System Technology, IWSDS 2018
Y2 - 18 April 2018 through 20 April 2018
ER -