Underwater human-robot interaction via biological motion identification

Junaed Sattar, Gregory Dudek

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Scopus citations


We present an algorithm for underwater robots to visually detect and track human motion. Our objective is to enable human-robot interaction by allowing a robot to follow behind a human moving in (up to) six degrees of freedom. In particular, we have developed a system to allow a robot to detect, track and follow a scuba diver by using frequencydomain detection of biological motion patterns. The motion of biological entities is characterized by combinations of periodic motions which are inherently distinctive. This is especially true of human swimmers. By using the frequency-space response of spatial signals over a number of video frames, we attempt to identify signatures pertaining to biological motion. This technique is applied to track scuba divers in underwater domains, typically with the robot swimming behind the diver. The algorithm is able to detect a range of motions, which includes motion directly away from or towards the camera. The motion of the diver relative to the vehicle is then tracked using an Unscented Kalman Filter (UKF), an approach for non-linear estimation. The efficiency of our approach makes it attractive for real-time applications onboard our underwater vehicle, and in future applications we intend to track scuba divers in real-time with the robot. The paper presents an algorithmic overview of our approach, together with experimental evaluation based on underwater video footage.

Original languageEnglish (US)
Title of host publicationRobotics
Subtitle of host publicationScience and Systems V
EditorsJeff Trinkle, Yoky Matsuoka, Jose A. Castellanos
PublisherMIT Press Journals
Number of pages8
ISBN (Print)9780262514637
StatePublished - 2010
EventInternational Conference on Robotics Science and Systems, RSS 2009 - Seattle, United States
Duration: Jun 28 2009Jul 1 2009

Publication series

NameRobotics: Science and Systems
ISSN (Electronic)2330-765X


OtherInternational Conference on Robotics Science and Systems, RSS 2009
CountryUnited States

Fingerprint Dive into the research topics of 'Underwater human-robot interaction via biological motion identification'. Together they form a unique fingerprint.

Cite this