BREAST-CANCER ------------- results of the model selection (cf. [RaeOnoMue01,MikRaeWesSchMue99]) --------------------------------------------------- RBF-Network : 5 rbf-centers; 4 steps of rbf-opt. AdaBoost with RBF-Network : 200 boost.iter.; 5 centers; 4 steps of rbf-opt. LP_Reg-AdaBoost (-"-) : C=1.000e-05; 200 boost.iter.; 5 centers; 4 steps of rbf-opt. QP_Reg-AdaBoost (-"-) : C=1.000e-04; 200 boost.iter.; 5 centers; 4 steps of rbf-opt. AdaBoost_Reg (-"-) : C=1.000e+06; 200 boost.iter.; 5 centers; 4 steps of rbf-opt. SVM with RBF-Kernel : C=1.519e+01; sigma=5.000e+01 KFD with RBF-Kernel : C=10; sigma=45; mu=0.01 averaged classification error on the test set in % (cf. [RaeOnoMue01,MikRaeWesSchMue99]) ----------------------------------------------------------------------- RBF-Network : 27.64 +/- 4.71 AdaBoost with RBF-Network : 30.36 +/- 4.73 LP_Reg-AdaBoost (-"-) : 26.79 +/- 6.08 QP_Reg-AdaBoost (-"-) : 25.91 +/- 4.61 AdaBoost_Reg (-"-) : 26.51 +/- 4.47 SVM with RBF-Kernel : 26.04 +/- 4.74 Kernel Fisher Discriminant: 24.77 +/- 4.63 cf. with the list in http://ida.first.gmd.de/~raetsch/data/breast-cancer/breast-cancer.errors, which contains the classification error rates of the classifiers for each realization of the data. references: ----------- @article{RaeOnoMue01, author = {G.~R{\"a}tsch and T.~Onoda and K.--R.~M{\"u}ller}, title = "Soft Margins for {A}da{B}oost", year = 2001, journal = "Machine Learning", note = "also NeuroCOLT Technical Report NC-TR-1998-021", publisher = "Kluwer Academic Publishers", month = mar, volume = 42, number = 3, pages = "287--320", annote = {http://www.boosting.org/papers/RaeOnoMue00a.pdf} } @inproceedings{MikRaeWesSchMue99, author = {S.~Mika and G.~R{\"a}tsch and J.~Weston and B.~Sch{\"o}lkopf and K.--R.~M{\"u}ller}, title = {Fisher Discriminant Analysis with Kernels}, booktitle = {Neural Networks for Signal Processing IX}, year = {1999}, editor = {Y.-H.~Hu and J.~Larsen and E.~Wilson and S.~Douglas}, publisher = {IEEE}, pages = {41--48}, annote = {http://ida.first.gmd.de/~mika/PS/MikRaeWesSchMue99.pdf} } see also: @PhdThesis{Rae01, author = {G.~R{\"a}tsch}, title = {Robust Boosting via Convex Optimization}, school = {University of Potsdam}, year = 2001, month = {October}, address = {Neues Palais 10, 14469 Potsdam, Germany}, annote = {http://www.boosting.org/papers/thesis.pdf} }