Temporal-Spatial Features of Intention Understanding Based on EEG-fNIRS Bimodal Measurement

Sheng Ge; Meng Yuan Ding; Zheng Zhang; Pan Lin; Jun Feng Gao; Rui Min Wang; Gao Peng Sun; Keiji Iramina; Hui Hua Deng; Yuan Kui Yang; Yue Leng

doi:10.1109/ACCESS.2017.2723428

Temporal-Spatial Features of Intention Understanding Based on EEG-fNIRS Bimodal Measurement

Sheng Ge, Meng Yuan Ding, Zheng Zhang, Pan Lin, Jun Feng Gao, Rui Min Wang, Gao Peng Sun, Keiji Iramina, Hui Hua Deng, Yuan Kui Yang, Yue Leng

Intelligence Science

Research output: Contribution to journal › Article › peer-review

14 Citations (Scopus)

Abstract

Understanding the actions of other people is a key component of social interaction. This paper used an electroencephalography and functional near infrared spectroscopy (EEG-fNIRS) bimodal system to investigate the temporal-spatial features of action intention understanding. We measured brain activation while participants observed three actions: 1) grasping a cup for drinking; 2) grasping a cup for moving; and 3) no meaningful intention. Analysis of EEG maximum standardized current density revealed that brain activation transitioned from the left to the right hemisphere. EEG-fNIRS source analysis results revealed that both the mirror neuron system and theory of mind network are involved in action intention understanding, and the extent to which these two systems are engaged appears to be determined by the clarity of the observed intention. These findings indicate that action intention understanding is a complex and dynamic process.

Original language	English
Article number	7968269
Pages (from-to)	14245-14258
Number of pages	14
Journal	IEEE Access
Volume	5
DOIs	https://doi.org/10.1109/ACCESS.2017.2723428
Publication status	Published - 2017

All Science Journal Classification (ASJC) codes

Computer Science(all)
Materials Science(all)
Engineering(all)

Access to Document

10.1109/ACCESS.2017.2723428

Cite this

@article{31601137fd76451e845a8c07d3425820,

title = "Temporal-Spatial Features of Intention Understanding Based on EEG-fNIRS Bimodal Measurement",

abstract = "Understanding the actions of other people is a key component of social interaction. This paper used an electroencephalography and functional near infrared spectroscopy (EEG-fNIRS) bimodal system to investigate the temporal-spatial features of action intention understanding. We measured brain activation while participants observed three actions: 1) grasping a cup for drinking; 2) grasping a cup for moving; and 3) no meaningful intention. Analysis of EEG maximum standardized current density revealed that brain activation transitioned from the left to the right hemisphere. EEG-fNIRS source analysis results revealed that both the mirror neuron system and theory of mind network are involved in action intention understanding, and the extent to which these two systems are engaged appears to be determined by the clarity of the observed intention. These findings indicate that action intention understanding is a complex and dynamic process.",

author = "Sheng Ge and Ding, {Meng Yuan} and Zheng Zhang and Pan Lin and Gao, {Jun Feng} and Wang, {Rui Min} and Sun, {Gao Peng} and Keiji Iramina and Deng, {Hui Hua} and Yang, {Yuan Kui} and Yue Leng",

note = "Publisher Copyright: {\textcopyright} 2013 IEEE.",

year = "2017",

doi = "10.1109/ACCESS.2017.2723428",

language = "English",

volume = "5",

pages = "14245--14258",

journal = "IEEE Access",

issn = "2169-3536",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Temporal-Spatial Features of Intention Understanding Based on EEG-fNIRS Bimodal Measurement

AU - Ge, Sheng

AU - Ding, Meng Yuan

AU - Zhang, Zheng

AU - Lin, Pan

AU - Gao, Jun Feng

AU - Wang, Rui Min

AU - Sun, Gao Peng

AU - Iramina, Keiji

AU - Deng, Hui Hua

AU - Yang, Yuan Kui

AU - Leng, Yue

PY - 2017

Y1 - 2017

N2 - Understanding the actions of other people is a key component of social interaction. This paper used an electroencephalography and functional near infrared spectroscopy (EEG-fNIRS) bimodal system to investigate the temporal-spatial features of action intention understanding. We measured brain activation while participants observed three actions: 1) grasping a cup for drinking; 2) grasping a cup for moving; and 3) no meaningful intention. Analysis of EEG maximum standardized current density revealed that brain activation transitioned from the left to the right hemisphere. EEG-fNIRS source analysis results revealed that both the mirror neuron system and theory of mind network are involved in action intention understanding, and the extent to which these two systems are engaged appears to be determined by the clarity of the observed intention. These findings indicate that action intention understanding is a complex and dynamic process.

AB - Understanding the actions of other people is a key component of social interaction. This paper used an electroencephalography and functional near infrared spectroscopy (EEG-fNIRS) bimodal system to investigate the temporal-spatial features of action intention understanding. We measured brain activation while participants observed three actions: 1) grasping a cup for drinking; 2) grasping a cup for moving; and 3) no meaningful intention. Analysis of EEG maximum standardized current density revealed that brain activation transitioned from the left to the right hemisphere. EEG-fNIRS source analysis results revealed that both the mirror neuron system and theory of mind network are involved in action intention understanding, and the extent to which these two systems are engaged appears to be determined by the clarity of the observed intention. These findings indicate that action intention understanding is a complex and dynamic process.

UR - http://www.scopus.com/inward/record.url?scp=85023203790&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85023203790&partnerID=8YFLogxK

U2 - 10.1109/ACCESS.2017.2723428

DO - 10.1109/ACCESS.2017.2723428

M3 - Article

AN - SCOPUS:85023203790

SN - 2169-3536

VL - 5

SP - 14245

EP - 14258

JO - IEEE Access

JF - IEEE Access

M1 - 7968269

ER -

Temporal-Spatial Features of Intention Understanding Based on EEG-fNIRS Bimodal Measurement

Abstract

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this