|Title||Robust Multicategory Support Vector Machines using Difference Convex Algorithm.|
|Publication Type||Journal Article|
|Year of Publication||2018|
|Authors||Zhang, Chong, Minh Pham, Sheng Fu, and Yufeng Liu|
|Date Published||2018 May|
The Support Vector Machine (SVM) is one of the most popular classification methods in the machine learning literature. Binary SVM methods have been extensively studied, and have achieved many successes in various disciplines. However, generalization to Multicategory SVM (MSVM) methods can be very challenging. Many existing methods estimate functions for classes with an explicit sum-to-zero constraint. It was shown recently that such a formulation can be suboptimal. Moreover, many existing MSVMs are not Fisher consistent, or do not take into account the effect of outliers. In this paper, we focus on classification in the angle-based framework, which is free of the explicit sum-to-zero constraint, hence more efficient, and propose two robust MSVM methods using truncated hinge loss functions. We show that our new classifiers can enjoy Fisher consistency, and simultaneously alleviate the impact of outliers to achieve more stable classification performance. To implement our proposed classifiers, we employ the difference convex algorithm (DCA) for efficient computation. Theoretical and numerical results obtained indicate that for problems with potential outliers, our robust angle-based MSVMs can be very competitive among existing methods.
|Alternate Journal||Math Program|
|Original Publication||Robust multicategory support vector machines using difference convex algorithm.|
|PubMed Central ID||PMC5935468|
|Grant List||P01 CA142538 / CA / NCI NIH HHS / United States |
R01 GM126550 / GM / NIGMS NIH HHS / United States
Robust Multicategory Support Vector Machines using Difference Convex Algorithm.