Deep Learning for Monotonic Support Vector Machines

Ming Chin Lo, Bing Han Tsai, Sheng-Tun Li

研究成果: Conference contribution

摘要

Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.

原文English
主出版物標題Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018
發行者Institute of Electrical and Electronics Engineers Inc.
頁面530-535
頁數6
ISBN(電子)9781538674475
DOIs
出版狀態Published - 2019 四月 16
事件7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018 - Yonago, Japan
持續時間: 2018 七月 82018 七月 13

出版系列

名字Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018

Conference

Conference7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018
國家Japan
城市Yonago
期間18-07-0818-07-13

指紋

Support vector machines
neural network
learning
ability
knowledge
Feature extraction
diagnostic
cancer
Classifiers
Deep learning
Monotonicity
Support vector machine
Neural networks
experiment
performance
Experiments
Deep neural networks
Prior knowledge

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Communication
  • Information Systems
  • Information Systems and Management
  • Education

引用此文

Lo, M. C., Tsai, B. H., & Li, S-T. (2019). Deep Learning for Monotonic Support Vector Machines. 於 Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018 (頁 530-535). [8693415] (Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IIAI-AAI.2018.00114
Lo, Ming Chin ; Tsai, Bing Han ; Li, Sheng-Tun. / Deep Learning for Monotonic Support Vector Machines. Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018. Institute of Electrical and Electronics Engineers Inc., 2019. 頁 530-535 (Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018).
@inproceedings{2590bd785f4142e09e10f0bff40bcc7c,
title = "Deep Learning for Monotonic Support Vector Machines",
abstract = "Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.",
author = "Lo, {Ming Chin} and Tsai, {Bing Han} and Sheng-Tun Li",
year = "2019",
month = "4",
day = "16",
doi = "10.1109/IIAI-AAI.2018.00114",
language = "English",
series = "Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "530--535",
booktitle = "Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018",
address = "United States",

}

Lo, MC, Tsai, BH & Li, S-T 2019, Deep Learning for Monotonic Support Vector Machines. 於 Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018., 8693415, Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018, Institute of Electrical and Electronics Engineers Inc., 頁 530-535, 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018, Yonago, Japan, 18-07-08. https://doi.org/10.1109/IIAI-AAI.2018.00114

Deep Learning for Monotonic Support Vector Machines. / Lo, Ming Chin; Tsai, Bing Han; Li, Sheng-Tun.

Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018. Institute of Electrical and Electronics Engineers Inc., 2019. p. 530-535 8693415 (Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018).

研究成果: Conference contribution

TY - GEN

T1 - Deep Learning for Monotonic Support Vector Machines

AU - Lo, Ming Chin

AU - Tsai, Bing Han

AU - Li, Sheng-Tun

PY - 2019/4/16

Y1 - 2019/4/16

N2 - Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.

AB - Deep learning, which has the ability to extract significant patterns from dataset, becomes increasingly important with regard to the information age that has the characteristics of diversity and large volume of data. Compared with deep neural networks (DNN), support vector machine (SVM) is one of the most representative models of shallow neural networks (SNN), and has been widely used in various fields since it has the ability to process high-dimensional dataset effectively. Furthermore, by considering the prior knowledge of monotonicity, SVM can enhance its generalization capability against noise data. Monotonicity-constrained SVM (MC-SVM) is a model that take prior knowledge of monotonicity into account and this model is proven to outperform conventional SVM. To benefit from the advantage of deep neural network on feature extraction and performance of MC-SVM, we propose a deep learning model called deep MC-SVM (DMC-SVM) that takes MC-SVM as feature extractor to improve the generalization property of the classifier, especially when solving complicated classification problem. We took two real-world datasets, Wisconsin Breast Cancer Diagnostic (WBCD) and PD600 as our training datasets, and the experiment results demonstrated that DMC-SVM could extract more abstract features that make this model more generalized, and for this reason, DMC-SVM has the better ability while dealing with classification problems.

UR - http://www.scopus.com/inward/record.url?scp=85065200189&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065200189&partnerID=8YFLogxK

U2 - 10.1109/IIAI-AAI.2018.00114

DO - 10.1109/IIAI-AAI.2018.00114

M3 - Conference contribution

AN - SCOPUS:85065200189

T3 - Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018

SP - 530

EP - 535

BT - Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Lo MC, Tsai BH, Li S-T. Deep Learning for Monotonic Support Vector Machines. 於 Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018. Institute of Electrical and Electronics Engineers Inc. 2019. p. 530-535. 8693415. (Proceedings - 2018 7th International Congress on Advanced Applied Informatics, IIAI-AAI 2018). https://doi.org/10.1109/IIAI-AAI.2018.00114