Online MEM Based Binary Classification Algorithm for China Mobile Imbalanced Dataset

Shuqing Lin, Feng Yin, Zhidi Lin, Yanbin Lin, Shuguang Robert Cui, Teng Li, Fengli Yu, Wei Yu, Xuemin Hong, Jianghong Shi, Zhi Quan Tom Luo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Driven by a plethora of real machine learning applications, there have been many attempts at improving the performance of a classifier applied to imbalanced dataset. In this paper we propose a maximum entropy machine (MEM) based hybrid algorithm to handle binary classification problems with high imbalance ratios and large numbers of features in the datasets. At the training stage, we combine an efficient MEM algorithm with the SMOTE algorithm to build a classifier in a batch manner. At the application stage, the different-cost strategy is incorporated into the MEM algorithm to handle the imbalance learning problem in an online manner. Experiments are conducted based on various real datasets (including one China Mobile dataset and several other standard test datasets) with different imbalance ratios and different numbers of features. The results show that the proposed algorithm outperforms the state-of-The-Art algorithms significantly in terms of robustness and overall classification performance.

Original languageEnglish (US)
Title of host publication2018 IEEE/CIC International Conference on Communications in China, ICCC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages68-73
Number of pages6
ISBN (Electronic)9781538670057
DOIs
StatePublished - Feb 12 2019
Event2018 IEEE/CIC International Conference on Communications in China, ICCC 2018 - Beijing, China
Duration: Aug 16 2018Aug 18 2018

Publication series

Name2018 IEEE/CIC International Conference on Communications in China, ICCC 2018

Conference

Conference2018 IEEE/CIC International Conference on Communications in China, ICCC 2018
Country/TerritoryChina
CityBeijing
Period8/16/188/18/18

Bibliographical note

Funding Information:
This work was supported by Shenzhen Fundamental Research Fund under Grant No. KQTD2015033114415450. The author Feng Yin was supported by Shenzhen Science and Technology Innovation Committee (KCW) project with Grant No. JCYJ20170307155957688 and NSFC with Grant No. 61701426. Feng Yin was funded by the Shenzhen Science and Technology Innovation Council with the grant number JCYJ20170307155957688 and JCYJ20170411102101881 and partly by the Shenzhen Fundamental Research Fund under Grant No. KQTD2015033114415450.

Publisher Copyright:
© 2018 IEEE.

Keywords

  • Binary Classification
  • China Mobile
  • Imbalanced Dataset
  • MEM Algorithm
  • Online Algorithm

Fingerprint

Dive into the research topics of 'Online MEM Based Binary Classification Algorithm for China Mobile Imbalanced Dataset'. Together they form a unique fingerprint.

Cite this