IMAGE ----- results of the model selection (cf. [RaeOnoMue01,MikRaeWesSchMue99]) --------------------------------------------------- RBF-Network : 110 rbf-centers; 10 steps of rbf-opt. AdaBoost with RBF-Network : 200 boost.iter.; 110 centers; 10 steps of rbf-opt. LP_Reg-AdaBoost (-"-) : C=1.000e+01; 200 boost.iter.; 110 centers; 10 steps of rbf-opt. QP_Reg-AdaBoost (-"-) : C=1.000e-06; 200 boost.iter.; 110 centers; 10 steps of rbf-opt. AdaBoost_Reg (-"-) : C=5.000e+00; 200 boost.iter.; 110 centers; 10 steps of rbf-opt. SVM with RBF-Kernel : C=5.000e+02; sigma=3.000e+01 KFD with RBF-Kernel : C=1; sigma=10; mu=0.1 averaged classification error on the test set in % (cf. [RaeOnoMue01,MikRaeWesSchMue99]) ----------------------------------------------------------------------- RBF-Network : 3.32 +/- 0.65 AdaBoost with RBF-Network : 2.73 +/- 0.66 LP_Reg-AdaBoost (-"-) : 2.76 +/- 0.61 QP_Reg-AdaBoost (-"-) : 2.67 +/- 0.63 AdaBoost_Reg (-"-) : 2.67 +/- 0.61 SVM with RBF-Kernel : 2.96 +/- 0.60 Kernel Fisher Discriminant: 4.76 +/- 0.58 cf. with the list in http://ida.first.gmd.de/~raetsch/data/image/image.errors, which contains the classification error rates of the classifiers for each realization of the data. references: ----------- @article{RaeOnoMue01, author = {G.~R{\"a}tsch and T.~Onoda and K.--R.~M{\"u}ller}, title = "Soft Margins for {A}da{B}oost", year = 2001, journal = "Machine Learning", note = "also NeuroCOLT Technical Report NC-TR-1998-021", publisher = "Kluwer Academic Publishers", month = mar, volume = 42, number = 3, pages = "287--320", annote = {http://www.boosting.org/papers/RaeOnoMue00a.pdf} } @inproceedings{MikRaeWesSchMue99, author = {S.~Mika and G.~R{\"a}tsch and J.~Weston and B.~Sch{\"o}lkopf and K.--R.~M{\"u}ller}, title = {Fisher Discriminant Analysis with Kernels}, booktitle = {Neural Networks for Signal Processing IX}, year = {1999}, editor = {Y.-H.~Hu and J.~Larsen and E.~Wilson and S.~Douglas}, publisher = {IEEE}, pages = {41--48}, annote = {http://ida.first.gmd.de/~mika/PS/MikRaeWesSchMue99.pdf} } see also: @PhdThesis{Rae01, author = {G.~R{\"a}tsch}, title = {Robust Boosting via Convex Optimization}, school = {University of Potsdam}, year = 2001, month = {October}, address = {Neues Palais 10, 14469 Potsdam, Germany}, annote = {http://www.boosting.org/papers/thesis.pdf} }