Determining child orientation from overhead video: A multiple kernel learning approach

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Our goal is to automatically detect which direction a child is facing based on a single, simple overhead picture, and track that direction across time. Engaging in joint attention, which is the shared focus of two individuals on some object of interest, is a strong cue of typically developing children, and the lack thereof can be an indicator of autism spectrum disorder or other pervasive developmental disorder. Therefore, the goal of many psychology experiments with children is to determine when, for how long, and towards what the child looks after some bid for attention or reaction. While much research looks for the orientation of faces based on frontal or profile pictures, or non-morphable, larger objects like cars, fewer studies work in the setting of minimally-invasive overhead person gaze or orientation detection. To automatically detect the child's orientation during a human-robot interaction experiment, we mount a camera on the ceiling of a child development laboratory and analyze the video footage. We use multiple kernel learning on eight potential orientation directions to determine a child's orientation during the video recorded interaction. We also contribute the labelled dataset we used on this challenging problem.

Original languageEnglish (US)
Title of host publication2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3477-3482
Number of pages6
ISBN (Electronic)9781538616451
DOIs
StatePublished - Nov 27 2017
Event2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017 - Banff, Canada
Duration: Oct 5 2017Oct 8 2017

Publication series

Name2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
Volume2017-January

Other

Other2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
CountryCanada
CityBanff
Period10/5/1710/8/17

Fingerprint Dive into the research topics of 'Determining child orientation from overhead video: A multiple kernel learning approach'. Together they form a unique fingerprint.

Cite this