TY - GEN
T1 - Emotour
T2 - 2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018
AU - Matsuda, Yuki
AU - Fedotov, Dmitrii
AU - Takahashi, Yuta
AU - Arakawa, Yutaka
AU - Yasumoto, Keiichi
AU - Minker, Wolfgang
N1 - Funding Information:
This work was supported by JSPS KAKENHI Grant Number 16J09670, 16H01721.
Publisher Copyright:
© Copyright held by the owner/author(s).
PY - 2018/10/8
Y1 - 2018/10/8
N2 - To design more context-aware systems for smart environments, especially smart cities, the psychological user status such as emotion should be considered in addition to environmental information. In this study, we focus on the tourism domain as a typical use case, and propose a multimodal tourist emotion recognition method during the sightseeing. We employ behavioural cues (eye and head/body movements) and audio-visual features to recognise emotion. As a result of real-world experiments with tourists, we achieved up to 0.71 of average recall score in 3-class emotion recognition task with feature level fusion.
AB - To design more context-aware systems for smart environments, especially smart cities, the psychological user status such as emotion should be considered in addition to environmental information. In this study, we focus on the tourism domain as a typical use case, and propose a multimodal tourist emotion recognition method during the sightseeing. We employ behavioural cues (eye and head/body movements) and audio-visual features to recognise emotion. As a result of real-world experiments with tourists, we achieved up to 0.71 of average recall score in 3-class emotion recognition task with feature level fusion.
UR - http://www.scopus.com/inward/record.url?scp=85058336138&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85058336138&partnerID=8YFLogxK
U2 - 10.1145/3267305.3267687
DO - 10.1145/3267305.3267687
M3 - Conference contribution
AN - SCOPUS:85058336138
T3 - UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers
SP - 946
EP - 951
BT - UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers
PB - Association for Computing Machinery, Inc
Y2 - 8 October 2018 through 12 October 2018
ER -
