Mining frequent patterns in a varying-size sliding window of online transactional data streams

Hui Chen, Lihchyun Shu, Jiali Xia, Qingshan Deng

研究成果: Article同行評審

44 引文 斯高帕斯(Scopus)

摘要

In some data stream applications, the information embedded in the data arriving in the most recent time period is of particular interest. This paper proposes a method for efficiently mining the frequent patterns in a varying-size sliding window of online data streams. To highlight recent frequent patterns in the data stream, a time decay model is used to differentiate the patterns of recently generated transactions from historical transactions. The derived concrete bounds of the decay factor can achieve either 100% recall or 100% precision. A summary data structure, named SWP-tree, is proposed for capturing the content of the transactions in the sliding window by scanning the stream only once. In order to speed up online processing of new transactions, the information of frequent patterns recorded in the SWP-tree is updated in an incrementally way. To make the mining operation efficient, the SWP-tree is periodically pruned by identifying insignificant patterns, which include two kinds of obsolete pattern and two kinds of infrequent pattern. Since the sliding window can change its size, the effect of window size is examined. The performance of the proposed technique is evaluated via simulation experiments. The results show that the proposed method is both efficient and scalable, and that it outperforms comparable algorithms.

原文English
頁(從 - 到)15-36
頁數22
期刊Information sciences
215
DOIs
出版狀態Published - 2012 十二月 15

All Science Journal Classification (ASJC) codes

  • 軟體
  • 控制與系統工程
  • 理論電腦科學
  • 電腦科學應用
  • 資訊系統與管理
  • 人工智慧

指紋

深入研究「Mining frequent patterns in a varying-size sliding window of online transactional data streams」主題。共同形成了獨特的指紋。

引用此