Machine Learning: Classifiers, SVM & Generalization

Supervised classifiers differ by how they draw a decision boundary and how they generalize — SVM maximizes the margin using only support vectors, kernels lift data to higher dimensions, while tree ensembles do implicit feature selection and distance methods die under many irrelevant features.