Emotional Trigger System Results in Humanoid Robot REN-XIN

emotional trigger

The Emotional Trigger System is designed to give an automatic emotion expression ability for humanoid robot REN-XIN based on pre-trained emotion classification model.

The "Original" video:

  • Baseline video in which the movements of robot REN-XIN are all encoded manually step by step by Zhong Huang and Fuji Ren;
  • Voice for the robot REN-XIN are all synthesized in advance and fine-tuning for the action timelines.
  • The "(a),(b)" and "(c),(d)" videos:

  • Emotional Trigger System gives robot an action label which can be searched in Movement DB;
  • In videos (a) and (c), emotional trigger are generated by Word Mover's Distance based model;
  • In videos (b) and (d), emotional trigger are generated by CNN+LSTM based model;
  • The voices in (a) and (b) are sysnthesized in advance, while in (c) and (d) are real-time synthesis;
  • All of the voice are running in the original way, without any tuning in time-lines.
  • Original

    (a).Word Mover's Distance Based Emotional Trigger System+local voice

    (b).CNN+LSTM Based Emotional Trigger System+local voice

    (c).Word Mover's Distance Based Emotional Trigger System+online voice

    (d).CNN+LSTM Based Emotional Trigger System+online voice