First-person Video Analysis for Evaluating Skill Level in the Humanitude Tender-Care Technique

Atsushi Nakazawa, Yu Mitsuzumi, Yuki Watanabe, Ryo Kurazume, Sakiko Yoshikawa, Miwako Honda

Research output: Contribution to journalArticlepeer-review

11 Citations (Scopus)


In this paper, we describe a wearable first-person video (FPV) analysis system for evaluating the skill levels of caregivers. This is a part of our project that aims to quantize and analyze the tender-care technique known as Humanitude by using wearable sensing and AI technology devices. Using our system, caregivers can evaluate and elevate their care levels by themselves. From the FPVs of care sessions taken by wearable cameras worn by caregivers, we obtained the 3D facial distance, pose and eye-contact states between caregivers and receivers by using facial landmark detection and deep neural network (DNN)-based eye contact detection. We applied statistical analysis to these features and developed algorithms that provide scores for tender-care skill. In experiments, we first evaluated the performance of our DNN-based eye contact detection by using eye contact datasets prepared from YouTube videos and FPVs that assume conversational scenes. We then performed skill evaluations by using Humanitude training scenes involving three novice caregivers, two Humanitude experts and seven middle-level students. The results showed that our eye contact detection outperformed existing methods and that our skill evaluations can estimate the care skill levels.

Original languageEnglish
Pages (from-to)103-118
Number of pages16
JournalJournal of Intelligent and Robotic Systems: Theory and Applications
Issue number1
Publication statusPublished - Jan 1 2019

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Mechanical Engineering
  • Industrial and Manufacturing Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering


Dive into the research topics of 'First-person Video Analysis for Evaluating Skill Level in the Humanitude Tender-Care Technique'. Together they form a unique fingerprint.

Cite this