Ensembles as a sequence of classifiers

Lars Asker, Richard F Maclin

Research output: Contribution to journalConference articlepeer-review

17 Scopus citations

Abstract

An ensemble is a classifier created by combining the predictions of multiple component classifiers. We present a new method for combining classifiers into an ensemble based on a simple estimation of each classifier's competence. The classifiers are grouped into an ordered list where each classifier has a corresponding threshold. To classify an example, the first classifier on the list is consulted and if that classifier's confidence for predicting the example is above the classifier's threshold, then that classifier's prediction is used. Otherwise, the next classifier and its threshold is consulted and so on. If none of the classifiers predicts the example above its confidence threshold then the class of the example is predicted by averaging all of the component classifier predictions. The key to this method is the selection of the confidence threshold for each classifier. We have implemented this method in a system called SEQUEL which has been applied to the task of recognizing volcanos in SAR images of Venus. In this domain, SEQUEL outperforms each individual classifier as well as the simple approach of using an ensemble constructed from the average prediction of all the classifiers.

Original languageEnglish (US)
Pages (from-to)860-865
Number of pages6
JournalIJCAI International Joint Conference on Artificial Intelligence
Volume2
StatePublished - Dec 1 1997
Externally publishedYes
Event15th International Joint Conference on Artificial Intelligence, IJCAI 1997 - Nagoya, Aichi, Japan
Duration: Aug 23 1997Aug 29 1997

Fingerprint Dive into the research topics of 'Ensembles as a sequence of classifiers'. Together they form a unique fingerprint.

Cite this