The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines


YAMAN A., CENGİZ M. A.

Journal of New Theory, vol.2021, no.34, pp.64-71, 2021 (Peer-Reviewed Journal) identifier

  • Publication Type: Article / Article
  • Volume: 2021 Issue: 34
  • Publication Date: 2021
  • Journal Name: Journal of New Theory
  • Journal Indexes: TR DİZİN (ULAKBİM)
  • Page Numbers: pp.64-71
  • Ondokuz Mayıs University Affiliated: Yes

Abstract

Support Vector Machine (SVM) is a supervised machine learning method used for classification and regression. It is based on the Vapnik-Chervonenkis (VC) theory and Structural Risk Minimization (SRM) principle. Thanks to its strong theoretical background, SVM exhibits a high performance compared to many other machine learning methods. The selection of hyperparameters and the kernel functions is an important task in the presence of SVM problems. In this study, the effect of tuning hyperparameters and sample size for the kernel functions on SVM classification accuracy was investigated. For this, UCI datasets of different sizes and with different correlations were simulated. Grid search and 10-fold Cross-Validation methods were used to tune the hyperparameters. Then, SVM classification process was performed using three kernel functions, and classification accuracy values were examined.