MConverse: Inferring conversation episodes from respiratory measurements collected in the field

Md Mahbubur Rahman, Amin Ahsan Ali, Kurt Plarre, Mustafa Al'Absi, Emre Ertin, Santosh Kumar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

28 Scopus citations

Abstract

Automated detection of social interactions in the natural environment has resulted in promising advances in organizational behavior, consumer behavior, and behavioral health. Progress, however, has been limited since the primary means of assessing social interactions today (i.e., audio recording) has several issues in field usage such as microphone occlusion, lack of speaker specificity, and high energy drain, in addition to significant privacy concerns. In this paper, we present mConverse, a new mobilebased system to infer conversation episodes from respiration measurements collected in the field from an unobtrusively wearable respiratory inductive plethysmograph (RIP) band worn around the user's chest. The measurements are wirelessly transmitted to a mobile phone, where they are used in a novel machine learning model to determine whether the wearer is speaking, listening, or quiet. Our model incorporates several innovations to address issues that naturally arise in the noisy field environment such as confounding events, poor data quality due to sensor loosening and detachment, losses in the wireless channel, etc. Our basic model obtains 83% accuracy for the three class classification. We formulate a Hidden Markov Model to further improve the accuracy to 87%. Finally, we apply our model to data collected from 22 subjects who wore the sensor for 2 full days in the field to observe conversation behavior in daily life and find that people spend 25% of their day in conversations.

Original languageEnglish (US)
Title of host publicationProceedings - Wireless Health 2011, WH'11
DOIs
StatePublished - 2011
Event2nd Wireless Health Conference, WH'11 - San Diego, CA, United States
Duration: Oct 10 2011Oct 13 2011

Publication series

NameProceedings - Wireless Health 2011, WH'11

Other

Other2nd Wireless Health Conference, WH'11
CountryUnited States
CitySan Diego, CA
Period10/10/1110/13/11

Keywords

  • Design
  • Experimentation
  • Human factors
  • Measurement

Fingerprint Dive into the research topics of 'MConverse: Inferring conversation episodes from respiratory measurements collected in the field'. Together they form a unique fingerprint.

Cite this