Exploiting application semantics in monitoring real-time data streams

Hongya Wang, Lih-Chyun Shu, Zhidong Qin, Xiaoqiang Liu, Jing Cong, Hui Song

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Real-time stream processing applications must be prepared to operate under overloaded conditions. Existing load shedding techniques are not suitable for processing real-time data streams because their tuple dropping policies may violate application deadlines in an uncontrolled way. We'd argue that a more precise load shedding model, e.g., the (m, k) deadline model adopted in this paper, is much appropriate than the commonly used random dropping policy. Based on the (m, k) load shedding model and a novel load shedding approach, we propose a concrete (m, k) scheduling algorithm called SOSA-DBP by exploiting application semantics. Experimental results show that SOSA-DBP has significant performance gain over the existing (m, k) scheduling algorithm.

Original languageEnglish
Title of host publicationProceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008
Pages141-148
Number of pages8
DOIs
Publication statusPublished - 2008 Sep 22
Event9th International Conference on Web-Age Information Management, WAIM 2008 - Zhangjiajie, China
Duration: 2008 Jul 202008 Jul 22

Publication series

NameProceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008

Other

Other9th International Conference on Web-Age Information Management, WAIM 2008
CountryChina
CityZhangjiajie
Period08-07-2008-07-22

Fingerprint

Semantics
Scheduling algorithms
Monitoring
Processing
Concretes
Data streams
Deadline

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Information Systems and Management

Cite this

Wang, H., Shu, L-C., Qin, Z., Liu, X., Cong, J., & Song, H. (2008). Exploiting application semantics in monitoring real-time data streams. In Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008 (pp. 141-148). [4597007] (Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008). https://doi.org/10.1109/WAIM.2008.26
Wang, Hongya ; Shu, Lih-Chyun ; Qin, Zhidong ; Liu, Xiaoqiang ; Cong, Jing ; Song, Hui. / Exploiting application semantics in monitoring real-time data streams. Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008. 2008. pp. 141-148 (Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008).
@inproceedings{0fa69e6a7e184e06b2c538c153b30bf3,
title = "Exploiting application semantics in monitoring real-time data streams",
abstract = "Real-time stream processing applications must be prepared to operate under overloaded conditions. Existing load shedding techniques are not suitable for processing real-time data streams because their tuple dropping policies may violate application deadlines in an uncontrolled way. We'd argue that a more precise load shedding model, e.g., the (m, k) deadline model adopted in this paper, is much appropriate than the commonly used random dropping policy. Based on the (m, k) load shedding model and a novel load shedding approach, we propose a concrete (m, k) scheduling algorithm called SOSA-DBP by exploiting application semantics. Experimental results show that SOSA-DBP has significant performance gain over the existing (m, k) scheduling algorithm.",
author = "Hongya Wang and Lih-Chyun Shu and Zhidong Qin and Xiaoqiang Liu and Jing Cong and Hui Song",
year = "2008",
month = "9",
day = "22",
doi = "10.1109/WAIM.2008.26",
language = "English",
isbn = "9780769531854",
series = "Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008",
pages = "141--148",
booktitle = "Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008",

}

Wang, H, Shu, L-C, Qin, Z, Liu, X, Cong, J & Song, H 2008, Exploiting application semantics in monitoring real-time data streams. in Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008., 4597007, Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008, pp. 141-148, 9th International Conference on Web-Age Information Management, WAIM 2008, Zhangjiajie, China, 08-07-20. https://doi.org/10.1109/WAIM.2008.26

Exploiting application semantics in monitoring real-time data streams. / Wang, Hongya; Shu, Lih-Chyun; Qin, Zhidong; Liu, Xiaoqiang; Cong, Jing; Song, Hui.

Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008. 2008. p. 141-148 4597007 (Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Exploiting application semantics in monitoring real-time data streams

AU - Wang, Hongya

AU - Shu, Lih-Chyun

AU - Qin, Zhidong

AU - Liu, Xiaoqiang

AU - Cong, Jing

AU - Song, Hui

PY - 2008/9/22

Y1 - 2008/9/22

N2 - Real-time stream processing applications must be prepared to operate under overloaded conditions. Existing load shedding techniques are not suitable for processing real-time data streams because their tuple dropping policies may violate application deadlines in an uncontrolled way. We'd argue that a more precise load shedding model, e.g., the (m, k) deadline model adopted in this paper, is much appropriate than the commonly used random dropping policy. Based on the (m, k) load shedding model and a novel load shedding approach, we propose a concrete (m, k) scheduling algorithm called SOSA-DBP by exploiting application semantics. Experimental results show that SOSA-DBP has significant performance gain over the existing (m, k) scheduling algorithm.

AB - Real-time stream processing applications must be prepared to operate under overloaded conditions. Existing load shedding techniques are not suitable for processing real-time data streams because their tuple dropping policies may violate application deadlines in an uncontrolled way. We'd argue that a more precise load shedding model, e.g., the (m, k) deadline model adopted in this paper, is much appropriate than the commonly used random dropping policy. Based on the (m, k) load shedding model and a novel load shedding approach, we propose a concrete (m, k) scheduling algorithm called SOSA-DBP by exploiting application semantics. Experimental results show that SOSA-DBP has significant performance gain over the existing (m, k) scheduling algorithm.

UR - http://www.scopus.com/inward/record.url?scp=51849137474&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=51849137474&partnerID=8YFLogxK

U2 - 10.1109/WAIM.2008.26

DO - 10.1109/WAIM.2008.26

M3 - Conference contribution

SN - 9780769531854

T3 - Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008

SP - 141

EP - 148

BT - Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008

ER -

Wang H, Shu L-C, Qin Z, Liu X, Cong J, Song H. Exploiting application semantics in monitoring real-time data streams. In Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008. 2008. p. 141-148. 4597007. (Proceedings - The 9th International Conference on Web-Age Information Management, WAIM 2008). https://doi.org/10.1109/WAIM.2008.26