A cloud-based efficient on-line analytical processing system with inverted data model

Sheng Wei Huang, Ce-Kuen Shieh, Che Ching Liao, Chui Ming Chiu, Ming Fong Tsai, Lien Wu Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

On-line analytical processing (OLAP) provides analysis of multi-dimensional data stored in a database and achieves great success in many applications such as sales, marketing, financial data analysis. OLAP operation is a dominant part of data analysis especially when addressing a large amount of data. With the emergence of the MapReduce paradigm and cloud technology, OLAP operation can be processed on big data that resides in scalable, distributed storage. However, current MapReduce implementations of OLAP operation processing have a major performance drawback caused by improper processing procedure. This is crucial when dimension or dependent attributes are large, which is a common case for most data warehouses hold nowadays. To solve this issue, this paper proposes a methodology to accelerate the performance of OLAP operation processing on big data. We have conducted the experiments on the basic algebra of OLAP operation with different data sizes to demonstrate the effectiveness of our system.

Original languageEnglish
Title of host publicationProceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages341-345
Number of pages5
ISBN (Electronic)9781631900631
DOIs
Publication statusPublished - 2015 Nov 19
Event11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015 - Taipei, Taiwan
Duration: 2015 Aug 192015 Aug 20

Publication series

NameProceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015

Other

Other11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015
CountryTaiwan
CityTaipei
Period15-08-1915-08-20

Fingerprint

Data structures
Processing
Data warehouses
Algebra
Marketing
Sales

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Cite this

Huang, S. W., Shieh, C-K., Liao, C. C., Chiu, C. M., Tsai, M. F., & Chen, L. W. (2015). A cloud-based efficient on-line analytical processing system with inverted data model. In Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015 (pp. 341-345). [7332592] (Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.4108/eai.19-8-2015.2261409
Huang, Sheng Wei ; Shieh, Ce-Kuen ; Liao, Che Ching ; Chiu, Chui Ming ; Tsai, Ming Fong ; Chen, Lien Wu. / A cloud-based efficient on-line analytical processing system with inverted data model. Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 341-345 (Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015).
@inproceedings{8e17d8c0b6ba46d0804852e7f2e60b20,
title = "A cloud-based efficient on-line analytical processing system with inverted data model",
abstract = "On-line analytical processing (OLAP) provides analysis of multi-dimensional data stored in a database and achieves great success in many applications such as sales, marketing, financial data analysis. OLAP operation is a dominant part of data analysis especially when addressing a large amount of data. With the emergence of the MapReduce paradigm and cloud technology, OLAP operation can be processed on big data that resides in scalable, distributed storage. However, current MapReduce implementations of OLAP operation processing have a major performance drawback caused by improper processing procedure. This is crucial when dimension or dependent attributes are large, which is a common case for most data warehouses hold nowadays. To solve this issue, this paper proposes a methodology to accelerate the performance of OLAP operation processing on big data. We have conducted the experiments on the basic algebra of OLAP operation with different data sizes to demonstrate the effectiveness of our system.",
author = "Huang, {Sheng Wei} and Ce-Kuen Shieh and Liao, {Che Ching} and Chiu, {Chui Ming} and Tsai, {Ming Fong} and Chen, {Lien Wu}",
year = "2015",
month = "11",
day = "19",
doi = "10.4108/eai.19-8-2015.2261409",
language = "English",
series = "Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "341--345",
booktitle = "Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015",
address = "United States",

}

Huang, SW, Shieh, C-K, Liao, CC, Chiu, CM, Tsai, MF & Chen, LW 2015, A cloud-based efficient on-line analytical processing system with inverted data model. in Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015., 7332592, Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015, Institute of Electrical and Electronics Engineers Inc., pp. 341-345, 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015, Taipei, Taiwan, 15-08-19. https://doi.org/10.4108/eai.19-8-2015.2261409

A cloud-based efficient on-line analytical processing system with inverted data model. / Huang, Sheng Wei; Shieh, Ce-Kuen; Liao, Che Ching; Chiu, Chui Ming; Tsai, Ming Fong; Chen, Lien Wu.

Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 341-345 7332592 (Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A cloud-based efficient on-line analytical processing system with inverted data model

AU - Huang, Sheng Wei

AU - Shieh, Ce-Kuen

AU - Liao, Che Ching

AU - Chiu, Chui Ming

AU - Tsai, Ming Fong

AU - Chen, Lien Wu

PY - 2015/11/19

Y1 - 2015/11/19

N2 - On-line analytical processing (OLAP) provides analysis of multi-dimensional data stored in a database and achieves great success in many applications such as sales, marketing, financial data analysis. OLAP operation is a dominant part of data analysis especially when addressing a large amount of data. With the emergence of the MapReduce paradigm and cloud technology, OLAP operation can be processed on big data that resides in scalable, distributed storage. However, current MapReduce implementations of OLAP operation processing have a major performance drawback caused by improper processing procedure. This is crucial when dimension or dependent attributes are large, which is a common case for most data warehouses hold nowadays. To solve this issue, this paper proposes a methodology to accelerate the performance of OLAP operation processing on big data. We have conducted the experiments on the basic algebra of OLAP operation with different data sizes to demonstrate the effectiveness of our system.

AB - On-line analytical processing (OLAP) provides analysis of multi-dimensional data stored in a database and achieves great success in many applications such as sales, marketing, financial data analysis. OLAP operation is a dominant part of data analysis especially when addressing a large amount of data. With the emergence of the MapReduce paradigm and cloud technology, OLAP operation can be processed on big data that resides in scalable, distributed storage. However, current MapReduce implementations of OLAP operation processing have a major performance drawback caused by improper processing procedure. This is crucial when dimension or dependent attributes are large, which is a common case for most data warehouses hold nowadays. To solve this issue, this paper proposes a methodology to accelerate the performance of OLAP operation processing on big data. We have conducted the experiments on the basic algebra of OLAP operation with different data sizes to demonstrate the effectiveness of our system.

UR - http://www.scopus.com/inward/record.url?scp=84962367354&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962367354&partnerID=8YFLogxK

U2 - 10.4108/eai.19-8-2015.2261409

DO - 10.4108/eai.19-8-2015.2261409

M3 - Conference contribution

T3 - Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015

SP - 341

EP - 345

BT - Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Huang SW, Shieh C-K, Liao CC, Chiu CM, Tsai MF, Chen LW. A cloud-based efficient on-line analytical processing system with inverted data model. In Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 341-345. 7332592. (Proceedings of the 11th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, QSHINE 2015). https://doi.org/10.4108/eai.19-8-2015.2261409