A showcase of ÉTS researchers’ publications and other contributions

Engaging with robotic swarms: commands from expressive motion


Downloads per month over past year

St-Onge, David, Côté-Allard, Ulysse, Glette, Kyrre, Gosselin, Benoit and Beltrame, Giovanni. 2019. « Engaging with robotic swarms: commands from expressive motion ». ACM Transactions on Human-Robot Interaction (THRI), vol. 8, nº 2.

[thumbnail of St-Onge D 2019 18902.pdf]
St-Onge D 2019 18902.pdf - Accepted Version
Use licence: All rights reserved to copyright holder.

Download (3MB) | Preview


In recent years, researchers have explored human body posture and motion to control robots in more natural ways. These interfaces require the ability to track the body movements of the user in three dimensions. Deploying motion capture systems for tracking tends to be costly and intrusive and requires a clear line of sight, making them ill adapted for applications that need fast deployment. In this article, we use consumer-grade armbands, capturing orientation information and muscle activity, to interact with a robotic system through a state machine controlled by a body motion classifier. To compensate for the low quality of the information of these sensors, and to allow a wider range of dynamic control, our approach relies on machine learning. We train our classifier directly on the user to recognize (within minutes) which physiological state his or her body motion expresses. We demonstrate that on top of guaranteeing faster field deployment, our algorithm performs better than all comparable algorithms, and we detail its configuration and the most significant features extracted. As the use of large groups of robots is growing, we postulate that their interaction with humans can be eased by our approach. We identified the key factors to stimulate engagement using our system on 27 participants, each creating his or her own set of expressive motions to control a swarm of desk robots. The resulting unique dataset is available online together with the classifier and the robot control scripts.

Item Type: Peer reviewed article published in a journal
St-Onge, David
Affiliation: Autres
Date Deposited: 03 Jul 2019 21:36
Last Modified: 30 Jul 2019 18:58

Actions (login required)

View Item View Item