- Journal of New Theory
- Issue: 34
- The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines
The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines
Authors : Aslı Yaman, Mehmet Ali Cengiz
Pages : 64-71
View : 11 | Download : 8
Publication Date : 2021-03-30
Article Type : Research
Abstract :Support Vector Machine (SVM) is a supervised machine learning method used for classification and regression. It is based on the Vapnik-Chervonenkis (VC) theory and Structural Risk Minimization (SRM) principle. Thanks to its strong theoretical background, SVM exhibits a high performance compared to many other machine learning methods. The selection of hyperparameters and the kernel functions is an important task in the presence of SVM problems. In this study, the effect of tuning hyperparameters and sample size for the kernel functions on SVM classification accuracy was investigated. For this, UCI datasets of different sizes and with different correlations were simulated. Grid search and 10-fold Cross-Validation methods were used to tune the hyperparameters. Then, SVM classification process was performed using three kernel functions, and classification accuracy values were examined.Keywords : Support vector machines, kernel function, tune parameter