Apache submarine: A unified machine learning platform made simple

Kai Hsun Chen, Huan Ping Su, Wei Chiu Chuang, Hung Chang Hsiao, Wangda Tan, Zhankun Tang, Xun Liu, Yanbo Liang, Wen Chih Lo, Wanqiang Ji, Byron Hsu, Keqiu Hu, Huiyang Jian, Quan Zhou, Chien Min Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As machine learning is applied more widely, it is necessary to have a machine-learning platform for both infrastructure administrators and users including expert data scientists and citizen data scientists [24] to improve their productivity. However, existing machine-learning platforms are ill-equipped to address the "Machine Learning tech debts"[36] such as glue code, reproducibility, and portability. Furthermore, existing platforms only take expert data scientists into consideration, and thus they are inflexible for infrastructure administrators and non-user-friendly for citizen data scientists. We propose Submarine, a unified machine-learning platform, and takes all infrastructure administrators, expert data scientists, and citizen data scientists into consideration. Submarine has been widely used in many technology companies, including Ke.com and LinkedIn. We present two use cases in Section 5.

Original languageEnglish
Title of host publicationEuroMLSys 2022 - Proceedings of the 2nd European Workshop on Machine Learning and Systems
PublisherAssociation for Computing Machinery, Inc
Pages101-108
Number of pages8
ISBN (Electronic)9781450392549
DOIs
Publication statusPublished - 2022 Apr 5
Event2nd European Workshop on Machine Learning and Systems, EuroMLSys 2022, in conjunction with ACM EuroSys 2022 - Virtual, Online, France
Duration: 2022 Apr 52022 Apr 8

Publication series

NameEuroMLSys 2022 - Proceedings of the 2nd European Workshop on Machine Learning and Systems

Conference

Conference2nd European Workshop on Machine Learning and Systems, EuroMLSys 2022, in conjunction with ACM EuroSys 2022
Country/TerritoryFrance
CityVirtual, Online
Period22-04-0522-04-08

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Human-Computer Interaction
  • Information Systems
  • Software
  • Control and Systems Engineering

Fingerprint

Dive into the research topics of 'Apache submarine: A unified machine learning platform made simple'. Together they form a unique fingerprint.

Cite this