Deep Learning for Monotonic Support Vector Machines

Ming Chin Lo, Bing Han Tsai, Sheng Tun Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.

Original languageEnglish
Title of host publicationProceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages530-535
Number of pages6
ISBN (Electronic)9781538674475
DOIs
Publication statusPublished - 2018 Jul 2
Event7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018 - Yonago, Japan
Duration: 2018 Jul 82018 Jul 13

Publication series

NameProceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018

Conference

Conference7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018
Country/TerritoryJapan
CityYonago
Period18-07-0818-07-13

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Communication
  • Information Systems
  • Information Systems and Management
  • Education

Fingerprint

Dive into the research topics of 'Deep Learning for Monotonic Support Vector Machines'. Together they form a unique fingerprint.

Cite this