Material Experience Design | Yasuaki Kakehi Laboratory, The University of Tokyo

Yasuaki Kakehi Laboratory


A Remote Conversation System Using a Hand Avatar Controlled with EMS

Shin Hanagata and Yasuaki Kakehi

We propose a new method of communication with a remote partner. The system, which we call “Paralogue” (parasitic + dialogue), utilizes the user’s arm and a hand as an avatar that represents the remote conversation partner. This method is realized by controlling the movement of the user’s arm with electrical muscle stimulations (EMS) and making the user’s arm behave as if the remote conversation partner were speaking to the user. Therefore, it is possible to add the physical presence of the remote conversation partner to the situation. This can also be a telepresence system using real human arms. However, unlike many telepresence systems, external actuators and large-sized devices are not required for this system and can be completed by only utilizing physical interactions.

Shin Hanagata and Yasuaki Kakehi. 2018. Paralogue: A Remote Conversation System Using a Hand Avatar which Postures are Controlled with Electrical Muscle Stimulation. In Proceedings of the 9th Augmented Human International Conference (AH ’18). ACM, New York, NY, USA, Article 35, 3 pages. DOI: