A regression-based Temporal Pattern mining scheme for Data Streams

Wei Guang Teng, Ming Syan Chen, Philip S. Yu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

96 Citations (Scopus)

Abstract

We devise in this paper a regression-based algorithm, called algorithm FTP-DS (Frequent Temporal Patterns of Data Streams), to mine frequent temporal patterns for data streams. While providing a general framework of pattern frequency counting, algorithm FTP-DS has two major features, namely one data scan for online statistics collection and regressionbased compact pattern representation. To attain the feature of one data scan, the data segmentation and the pattern growth scenarios are explored for the frequency counting purpose. Algorithm FTP-DS scans online transaction flows and generates candidate frequent patterns in real time. The second important feature of algorithm FTP-DS is on the regression-based compact pattern representation. Specifically, to meet the space constraint, we devise for pattern representation a compact ATF (standing for Accumulated Time and Frequency) form to aggregately comprise all the information required for regression analysis. In addition, we develop the techniques of the segmentation tuning and segment relaxation to enhance the functions of FTP-DS. With these features, algorithm FTP-DS is able to not only conduct mining with variable time intervals but also perform trend detection effectively. Synthetic data and a real dataset which contains network alarm logs from a major telecommunication company are utilized to verify the feasibility of algorithm FTP-DS.

Original languageEnglish
Title of host publicationProceedings - 29th International Conference on Very Large Data Bases, VLDB 2003
EditorsPatricia G. Selinger, Michael J. Carey, Johann Christoph Freytag, Serge Abiteboul, Peter C. Lockemann, Andreas Heuer
PublisherMorgan Kaufmann
Pages93-104
Number of pages12
ISBN (Electronic)0127224424, 9780127224428
Publication statusPublished - 2003 Jan 1
Event29th International Conference on Very Large Data Bases, VLDB 2003 - Berlin, Germany
Duration: 2003 Sep 92003 Sep 12

Publication series

NameProceedings - 29th International Conference on Very Large Data Bases, VLDB 2003

Other

Other29th International Conference on Very Large Data Bases, VLDB 2003
CountryGermany
CityBerlin
Period03-09-0903-09-12

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems
  • Hardware and Architecture
  • Information Systems and Management
  • Computer Science Applications
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'A regression-based Temporal Pattern mining scheme for Data Streams'. Together they form a unique fingerprint.

  • Cite this

    Teng, W. G., Chen, M. S., & Yu, P. S. (2003). A regression-based Temporal Pattern mining scheme for Data Streams. In P. G. Selinger, M. J. Carey, J. C. Freytag, S. Abiteboul, P. C. Lockemann, & A. Heuer (Eds.), Proceedings - 29th International Conference on Very Large Data Bases, VLDB 2003 (pp. 93-104). (Proceedings - 29th International Conference on Very Large Data Bases, VLDB 2003). Morgan Kaufmann.