BANANA ------ results of the model selection (cf. [RaeOnoMue01,MikRaeWesSchMue99]) --------------------------------------------------- RBF-Network : 18 rbf-centers; 3 steps of rbf-opt. AdaBoost with RBF-Network : 200 boost.iter.; 18 centers; 3 steps of rbf-opt. LP_Reg-AdaBoost (-"-) : C=1.000e-04; 200 boost.iter.; 18 centers; 3 steps of rbf-opt. QP_Reg-AdaBoost (-"-) : C=1.000e-04; 200 boost.iter.; 18 centers; 3 steps of rbf-opt. AdaBoost_Reg (-"-) : C=3.162e+03; 200 boost.iter.; 18 centers; 3 steps of rbf-opt. SVM with RBF-Kernel : C=3.162e+02; sigma=1.000e+00 KFD with RBF-Kernel : C=1; sigma=1; mu=0.0001 averaged classification error on the test set in % (cf. [RaeOnoMue01,MikRaeWesSchMue99]) ----------------------------------------------------------------------- RBF-Network : 10.76 +/- 0.42 AdaBoost with RBF-Network : 12.26 +/- 0.67 LP_Reg-AdaBoost (-"-) : 10.73 +/- 0.43 QP_Reg-AdaBoost (-"-) : 10.90 +/- 0.46 AdaBoost_Reg (-"-) : 10.85 +/- 0.42 SVM with RBF-Kernel : 11.53 +/- 0.66 Kernel Fisher Discriminant: 10.75 +/- 0.45 cf. with the list in http://ida.first.gmd.de/~raetsch/data/banana/banana.errors, which contains the classification error rates of the classifiers for each realization of the data. references: ----------- @article{RaeOnoMue01, author = {G.~R{\"a}tsch and T.~Onoda and K.--R.~M{\"u}ller}, title = "Soft Margins for {A}da{B}oost", year = 2001, journal = "Machine Learning", note = "also NeuroCOLT Technical Report NC-TR-1998-021", publisher = "Kluwer Academic Publishers", month = mar, volume = 42, number = 3, pages = "287--320", annote = {http://www.boosting.org/papers/RaeOnoMue00a.pdf} } @inproceedings{MikRaeWesSchMue99, author = {S.~Mika and G.~R{\"a}tsch and J.~Weston and B.~Sch{\"o}lkopf and K.--R.~M{\"u}ller}, title = {Fisher Discriminant Analysis with Kernels}, booktitle = {Neural Networks for Signal Processing IX}, year = {1999}, editor = {Y.-H.~Hu and J.~Larsen and E.~Wilson and S.~Douglas}, publisher = {IEEE}, pages = {41--48}, annote = {http://ida.first.gmd.de/~mika/PS/MikRaeWesSchMue99.pdf} } see also: @PhdThesis{Rae01, author = {G.~R{\"a}tsch}, title = {Robust Boosting via Convex Optimization}, school = {University of Potsdam}, year = 2001, month = {October}, address = {Neues Palais 10, 14469 Potsdam, Germany}, annote = {http://www.boosting.org/papers/thesis.pdf} }