Online Bayes Point Machines

We present a new and simple algorithm for learning large margin classifiers that works in a truly online manner. The algorithm generates a linear classifier by averaging the weights associated with several perceptron-like algorithms run in parallel in order to approximate the Bayes point. A random subsample of the incoming data stream is used to ensure diversity in the perceptron solutions. We experimentally study the algorithm's performance on online and batch learning settings. The online experiments showed that our algorithm produces a low prediction error on the training sequence and tracks the presence of concept drift. On the batch problems its performance is comparable to the maximum margin algorithm which explicitly maximises the margin.

OBPM.ps
PostScript file

In  Proceedings of the Seventh Pacific-Asia Conference on Knowledge Discovery and Data Mining

Publisher  Springer-Verlag
All copyrights reserved by Springer 2003.

Details

TypeInproceedings
Pages241–252
> Publications > Online Bayes Point Machines