Abstract for scott_tr323


Cambridge University Engineering Department Technical Report CUED/F-INFENG/TR323

PARCEL: FEATURE SUBSET SELECTION IN VARIABLE COST DOMAINS.

M.J.J. Scott, M. Niranjan, R.W. Prager.

May 1998

The vast majority of classification systems are designed with a single set of features, and optimised to a single specified cost. However, in examples such as medical and financial risk modelling, costs are known to vary subsequent to system design. In this paper, we present a design method for feature selection in the presence of varying costs.

Starting from the Wilcoxon nonparametric statistic for the performance of a classification system, we introduce a concept called the maximum realisable receiver operating characteristic (MRROC), and prove a related theorem. A novel criterion for feature selection, based on the area under the MRROC curve, is then introduced. This leads to a framework which we call Parcel. This has the flexibility to use different combinations of features at different operating points on the resulting MRROC curve. Empirical support for each stage in our approach is provided by experiments on real world problems, with Parcel achieving superior results.


scott_tr323.ps.gz