HEART ----- results of the model selection (cf. [RaeOnoMue01,MikRaeWesSchMue99]) --------------------------------------------------- RBF-Network : 4 rbf-centers; 3 steps of rbf-opt. AdaBoost with RBF-Network : 200 boost.iter.; 4 centers; 3 steps of rbf-opt. LP_Reg-AdaBoost (-"-) : C=7.000e-05; 200 boost.iter.; 4 centers; 3 steps of rbf-opt. QP_Reg-AdaBoost (-"-) : C=7.000e-05; 200 boost.iter.; 4 centers; 3 steps of rbf-opt. AdaBoost_Reg (-"-) : C=3.000e+04; 200 boost.iter.; 4 centers; 3 steps of rbf-opt. SVM with RBF-Kernel : C=3.162e+00; sigma=1.200e+02 KFD with RBF-Kernel : C=50; sigma=18; mu=10 averaged classification error on the test set in % (cf. [RaeOnoMue01,MikRaeWesSchMue99]) ----------------------------------------------------------------------- RBF-Network : 17.55 +/- 3.25 AdaBoost with RBF-Network : 20.29 +/- 3.44 LP_Reg-AdaBoost (-"-) : 17.49 +/- 3.53 QP_Reg-AdaBoost (-"-) : 17.17 +/- 3.44 AdaBoost_Reg (-"-) : 16.47 +/- 3.51 SVM with RBF-Kernel : 15.95 +/- 3.26 Kernel Fisher Discriminant: 16.14 +/- 3.39 cf. with the list in http://ida.first.gmd.de/~raetsch/data/heart/heart.errors, which contains the classification error rates of the classifiers for each realization of the data. references: ----------- @article{RaeOnoMue01, author = {G.~R{\"a}tsch and T.~Onoda and K.--R.~M{\"u}ller}, title = "Soft Margins for {A}da{B}oost", year = 2001, journal = "Machine Learning", note = "also NeuroCOLT Technical Report NC-TR-1998-021", publisher = "Kluwer Academic Publishers", month = mar, volume = 42, number = 3, pages = "287--320", annote = {http://www.boosting.org/papers/RaeOnoMue00a.pdf} } @inproceedings{MikRaeWesSchMue99, author = {S.~Mika and G.~R{\"a}tsch and J.~Weston and B.~Sch{\"o}lkopf and K.--R.~M{\"u}ller}, title = {Fisher Discriminant Analysis with Kernels}, booktitle = {Neural Networks for Signal Processing IX}, year = {1999}, editor = {Y.-H.~Hu and J.~Larsen and E.~Wilson and S.~Douglas}, publisher = {IEEE}, pages = {41--48}, annote = {http://ida.first.gmd.de/~mika/PS/MikRaeWesSchMue99.pdf} } see also: @PhdThesis{Rae01, author = {G.~R{\"a}tsch}, title = {Robust Boosting via Convex Optimization}, school = {University of Potsdam}, year = 2001, month = {October}, address = {Neues Palais 10, 14469 Potsdam, Germany}, annote = {http://www.boosting.org/papers/thesis.pdf} }