The concept of Support Vector Machines is briefly reviewed and their potential use in high energy physics scenarios is discussed. They have the potential to be less susceptible to over-fitting than artificial neural networks and boosted decisions trees - whose use is common across high energy particle physics. Cross validation is discussed in the context of improving generalisation of machine learning algorithms and preliminary work on bringing more rigor to understanding generalisation in HEP analysis is presented.