A hierarchical scheduling strategy for the composition services architecture based on cloud computing

Kuan Rong Lee, Meng Hsuan Fu, Yau-Hwang Kuo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper addresses the problem of composition service scheduling and resource allocation in cloud. In the development of cloud computing with data-intensive and compute-intensive features, many applications are based on Map/Reduce model to enhance the performance. A hierarchical scheduling scheme strategy, i.e., PPA2-level scheduler, is proposed in this paper for the composition services architecture to achieve planning of composition service scheduling with Map/Reduce model. While executing PPA2-level scheduler, it decomposes the total progress into three steps, i.e., preprocessing, pooling and allocating. It decides the job priority according to both service-level and task-level in the resource side. And the resources are allocated by taking the data locality and total job completion rate into account on the basis of cloud framework. In the numerical evaluation, it uses a Markov model to generate various scenarios of client requested composition services. Then it evaluates the strategy by applying the scheduling strategy mentioned above to compare with the default first-in-first-out scheduling (FIFO) of Hadoop. In different distribution of composition services, the proposed strategy also performs well, especially in I/O-Bound services. It achieves better performance (about 45 %) and efficiently decreases the probability of disk spill.

Original languageEnglish
Title of host publicationProceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011
Pages163-169
Number of pages7
Publication statusPublished - 2011 Sep 1
Event2nd International Conference on Next Generation Information Technology, ICNIT 2011 - Gyeongju, Korea, Republic of
Duration: 2011 Jun 212011 Jun 23

Publication series

NameProceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011

Other

Other2nd International Conference on Next Generation Information Technology, ICNIT 2011
CountryKorea, Republic of
CityGyeongju
Period11-06-2111-06-23

Fingerprint

Cloud computing
Scheduling
Chemical analysis
Hazardous materials spills
Resource allocation
Planning

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Information Systems

Cite this

Lee, K. R., Fu, M. H., & Kuo, Y-H. (2011). A hierarchical scheduling strategy for the composition services architecture based on cloud computing. In Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011 (pp. 163-169). [5967493] (Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011).
Lee, Kuan Rong ; Fu, Meng Hsuan ; Kuo, Yau-Hwang. / A hierarchical scheduling strategy for the composition services architecture based on cloud computing. Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011. 2011. pp. 163-169 (Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011).
@inproceedings{8941415fe50b472ca2e02eb74163a818,
title = "A hierarchical scheduling strategy for the composition services architecture based on cloud computing",
abstract = "This paper addresses the problem of composition service scheduling and resource allocation in cloud. In the development of cloud computing with data-intensive and compute-intensive features, many applications are based on Map/Reduce model to enhance the performance. A hierarchical scheduling scheme strategy, i.e., PPA2-level scheduler, is proposed in this paper for the composition services architecture to achieve planning of composition service scheduling with Map/Reduce model. While executing PPA2-level scheduler, it decomposes the total progress into three steps, i.e., preprocessing, pooling and allocating. It decides the job priority according to both service-level and task-level in the resource side. And the resources are allocated by taking the data locality and total job completion rate into account on the basis of cloud framework. In the numerical evaluation, it uses a Markov model to generate various scenarios of client requested composition services. Then it evaluates the strategy by applying the scheduling strategy mentioned above to compare with the default first-in-first-out scheduling (FIFO) of Hadoop. In different distribution of composition services, the proposed strategy also performs well, especially in I/O-Bound services. It achieves better performance (about 45 {\%}) and efficiently decreases the probability of disk spill.",
author = "Lee, {Kuan Rong} and Fu, {Meng Hsuan} and Yau-Hwang Kuo",
year = "2011",
month = "9",
day = "1",
language = "English",
isbn = "9788988678381",
series = "Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011",
pages = "163--169",
booktitle = "Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011",

}

Lee, KR, Fu, MH & Kuo, Y-H 2011, A hierarchical scheduling strategy for the composition services architecture based on cloud computing. in Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011., 5967493, Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011, pp. 163-169, 2nd International Conference on Next Generation Information Technology, ICNIT 2011, Gyeongju, Korea, Republic of, 11-06-21.

A hierarchical scheduling strategy for the composition services architecture based on cloud computing. / Lee, Kuan Rong; Fu, Meng Hsuan; Kuo, Yau-Hwang.

Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011. 2011. p. 163-169 5967493 (Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A hierarchical scheduling strategy for the composition services architecture based on cloud computing

AU - Lee, Kuan Rong

AU - Fu, Meng Hsuan

AU - Kuo, Yau-Hwang

PY - 2011/9/1

Y1 - 2011/9/1

N2 - This paper addresses the problem of composition service scheduling and resource allocation in cloud. In the development of cloud computing with data-intensive and compute-intensive features, many applications are based on Map/Reduce model to enhance the performance. A hierarchical scheduling scheme strategy, i.e., PPA2-level scheduler, is proposed in this paper for the composition services architecture to achieve planning of composition service scheduling with Map/Reduce model. While executing PPA2-level scheduler, it decomposes the total progress into three steps, i.e., preprocessing, pooling and allocating. It decides the job priority according to both service-level and task-level in the resource side. And the resources are allocated by taking the data locality and total job completion rate into account on the basis of cloud framework. In the numerical evaluation, it uses a Markov model to generate various scenarios of client requested composition services. Then it evaluates the strategy by applying the scheduling strategy mentioned above to compare with the default first-in-first-out scheduling (FIFO) of Hadoop. In different distribution of composition services, the proposed strategy also performs well, especially in I/O-Bound services. It achieves better performance (about 45 %) and efficiently decreases the probability of disk spill.

AB - This paper addresses the problem of composition service scheduling and resource allocation in cloud. In the development of cloud computing with data-intensive and compute-intensive features, many applications are based on Map/Reduce model to enhance the performance. A hierarchical scheduling scheme strategy, i.e., PPA2-level scheduler, is proposed in this paper for the composition services architecture to achieve planning of composition service scheduling with Map/Reduce model. While executing PPA2-level scheduler, it decomposes the total progress into three steps, i.e., preprocessing, pooling and allocating. It decides the job priority according to both service-level and task-level in the resource side. And the resources are allocated by taking the data locality and total job completion rate into account on the basis of cloud framework. In the numerical evaluation, it uses a Markov model to generate various scenarios of client requested composition services. Then it evaluates the strategy by applying the scheduling strategy mentioned above to compare with the default first-in-first-out scheduling (FIFO) of Hadoop. In different distribution of composition services, the proposed strategy also performs well, especially in I/O-Bound services. It achieves better performance (about 45 %) and efficiently decreases the probability of disk spill.

UR - http://www.scopus.com/inward/record.url?scp=80052119153&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052119153&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9788988678381

T3 - Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011

SP - 163

EP - 169

BT - Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011

ER -

Lee KR, Fu MH, Kuo Y-H. A hierarchical scheduling strategy for the composition services architecture based on cloud computing. In Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011. 2011. p. 163-169. 5967493. (Proceedings - 2nd International Conference on Next Generation Information Technology, ICNIT 2011).