Deep Learning for Monotonic Support Vector Machines

Ming Chin Lo, Bing Han Tsai, Sheng-Tun Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.

Original languageEnglish
Title of host publicationProceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages530-535
Number of pages6
ISBN (Electronic)9781538674475
DOIs
Publication statusPublished - 2019 Apr 16
Event7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018 - Yonago, Japan
Duration: 2018 Jul 82018 Jul 13

Publication series

NameProceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018

Conference

Conference7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018
CountryJapan
CityYonago
Period18-07-0818-07-13

Fingerprint

Support vector machines
neural network
learning
ability
knowledge
Feature extraction
diagnostic
cancer
Classifiers
Deep learning
Monotonicity
Support vector machine
Neural networks
experiment
performance
Experiments
Deep neural networks
Prior knowledge

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Communication
  • Information Systems
  • Information Systems and Management
  • Education

Cite this

Lo, M. C., Tsai, B. H., & Li, S-T. (2019). Deep Learning for Monotonic Support Vector Machines. In Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018 (pp. 530-535). [8693415] (Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IIAI-AAI.2018.00114
Lo, Ming Chin ; Tsai, Bing Han ; Li, Sheng-Tun. / Deep Learning for Monotonic Support Vector Machines. Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 530-535 (Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018).
@inproceedings{2590bd785f4142e09e10f0bff40bcc7c,
title = "Deep Learning for Monotonic Support Vector Machines",
abstract = "Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.",
author = "Lo, {Ming Chin} and Tsai, {Bing Han} and Sheng-Tun Li",
year = "2019",
month = "4",
day = "16",
doi = "10.1109/IIAI-AAI.2018.00114",
language = "English",
series = "Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "530--535",
booktitle = "Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018",
address = "United States",

}

Lo, MC, Tsai, BH & Li, S-T 2019, Deep Learning for Monotonic Support Vector Machines. in Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018., 8693415, Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018, Institute of Electrical and Electronics Engineers Inc., pp. 530-535, 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018, Yonago, Japan, 18-07-08. https://doi.org/10.1109/IIAI-AAI.2018.00114

Deep Learning for Monotonic Support Vector Machines. / Lo, Ming Chin; Tsai, Bing Han; Li, Sheng-Tun.

Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018. Institute of Electrical and Electronics Engineers Inc., 2019. p. 530-535 8693415 (Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Deep Learning for Monotonic Support Vector Machines

AU - Lo, Ming Chin

AU - Tsai, Bing Han

AU - Li, Sheng-Tun

PY - 2019/4/16

Y1 - 2019/4/16

N2 - Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.

AB - Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.

UR - http://www.scopus.com/inward/record.url?scp=85065200189&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065200189&partnerID=8YFLogxK

U2 - 10.1109/IIAI-AAI.2018.00114

DO - 10.1109/IIAI-AAI.2018.00114

M3 - Conference contribution

T3 - Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018

SP - 530

EP - 535

BT - Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Lo MC, Tsai BH, Li S-T. Deep Learning for Monotonic Support Vector Machines. In Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018. Institute of Electrical and Electronics Engineers Inc. 2019. p. 530-535. 8693415. (Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018). https://doi.org/10.1109/IIAI-AAI.2018.00114