Reduction Scheme for Sensor-Data Transmission on a Big Data Streaming Platform

Yi Wei Huang, Sheng Tzong Cheng

研究成果: Conference contribution

摘要

Recent advances in sensor technology has led to varieties of sensors. Problems facing now is how to exploit and compute these data efficiently. Map Reduce is a programming model to solve these problem. However, it may cause I/O bottleneck. In-memory computing (IMC) comes up to solve the problems. However, network bandwidth remains a bottleneck. It restricts the speed of receiving the information from the source and dispersing information to each node. To our observation, some data from sensor devices might be similar due to temporal or spatial dependency. Therefore, compression technology could be an effective solution. It replaces data with smaller sizes of streams for improving data utilization. This study presents an effective reduce transmission scheme on a distributed real-time IMC platform-Spark Streaming. We design and implement a system to provide a high compression ratio in a small batch data from the source. It is expected to reduce data transmission with little delay time in the soft real-time fashion.

原文English
主出版物標題ICUFN 2018 - 10th International Conference on Ubiquitous and Future Networks
發行者IEEE Computer Society
頁面244-249
頁數6
ISBN(列印)9781538646465
DOIs
出版狀態Published - 2018 八月 14
事件10th International Conference on Ubiquitous and Future Networks, ICUFN 2018 - Prague, Czech Republic
持續時間: 2018 七月 32018 七月 6

出版系列

名字International Conference on Ubiquitous and Future Networks, ICUFN
2018-July
ISSN(列印)2165-8528
ISSN(電子)2165-8536

Other

Other10th International Conference on Ubiquitous and Future Networks, ICUFN 2018
國家/地區Czech Republic
城市Prague
期間18-07-0318-07-06

All Science Journal Classification (ASJC) codes

  • 電腦網路與通信
  • 電腦科學應用
  • 硬體和架構

指紋

深入研究「Reduction Scheme for Sensor-Data Transmission on a Big Data Streaming Platform」主題。共同形成了獨特的指紋。

引用此