Roadmap

图1 Roadmap

Kernel Ridge Regression

图2 Kernel Ridge Regression1
图3 Kernel Ridge Regression2
图4 Kernel Ridge Regression3
图5 Kernel Ridge Regression4

Support Vector Regression Primal

图6 Support Vector Regression Primal1
图7 Support Vector Regression Primal2
图8 Support Vector Regression Primal3
图9 Support Vector Regression Primal4
图10 Support Vector Regression Primal5
图11 Support Vector Regression Primal6
图12 Support Vector Regression Primal7

Support Vector Regression Dual

图13 Support Vector Regression Dual1
图14 Support Vector Regression Dual2
图15 Support Vector Regression Dual3

Summary of Kernel Models

Map of Linear Models

图16 Map of Linear Models

Map of Kernel Models

possible kernels:
polynomial, Gaussian,..., your design (with Mercer’s condition),
coupled with

图17 Map of Kernel Models

powerful extension of linear models
with great power comes great responsibility

Map of Linear/Kernel Models

图18 Map of Linear/Kernel Models

second row: popular in LIBLINEAR
fourth row: popular in LIBSVM
first row: less used due to worse performance
third row: less used due to dense beta

Summary

图19 Summary