Yuko Sasa - Intelligence from Socio-Affects of Robot: Language Primitives for a Scalable Interaction with a Smart Home Robot

Organized by: 
Yuko Sasa
Yuko Sasa
Detailed information: 


  • Mme Martine Adda-Decker, professeur, Université Paris III, LPP/CNRS, président
  • Mr. Mohamed Chetouani, professeur, Université Paris IV, ISIR, rapporteur
  • Mr. Daniel Luzzati, professeur émérite, Université du Maine, LIUM, rapporteur
  • Mme Véronique Aubergé, chargée de recherche, CNRS, Université Grenoble Alpes, LIG, directeur de thèse
  • Mr. Gang Feng, professeur, Université Grenoble Alpes, Gipsa-lab, co-directeur de thèse
  • Mr. Yoshinori Sagisaka, professeur, Université Waseda, GITS, co-encadrant de thèse


  • Mr. Vincent Rialle
    Maître de conférences praticien hospitalier émérite, CHU Grenoble Alpes, Université Grenoble Alpes
  • Mr. Florian Nebout
    Ingénieur R&D et Services Manager, Awabot, Villeurbanne

How do humans enter into a communicational relation? Some “mouth noises” carry the essence of melodies composing primitives: they are tools of intentional socio-affects able to link people thanks to a “socio-affective glue.” This bond is like a channel, and if it does not exist it does not succeed in delivering the language tools (e.g., words, voice, gaze, facial expressions, posture, etc.). In this study, the Emox robot is used as a mean to observe, to capture and to simulate the glue to instrument this phenomenon. In the role of a Smart Home automation butler, Emox addresses to frail elderly within a relational isolation. Across the vocal commands, the interactions, which are on the one hand controlled for the robot, and on the other hand spontaneous for the persons, change progressively. The multimodal variations of communication expressions as well as the socio-affective glue progression are measured, analysed and modelled within a dialogue system based on the glue’s curve: the robot is not born as a companion, it becomes one over interactions. On end, the system is dedicated to advance in our every day within long-life, where the human communication builds this glue. However, the only way to construct its development’s ethics resides in a joint and collaborative effort.