Impact of MapReduce Policies on Job Completion Reliability and Job Energy Consumption
顯示簡易詮釋資料 統計資料| 欄位 | 內容 | 語言 |
|---|---|---|
dc.citation.epage |
1378 | en_US |
dc.citation.spage |
1364 | en_US |
dc.citation.volume |
26 | en_US |
dc.citation.woscount |
0 | en_US |
dc.contributor.author |
Lin, Jia-Chun | en_US |
dc.contributor.author |
Leu, Fang-Yie | en_US |
dc.contributor.author |
Chen, Ying-ping | en_US |
dc.contributor.department |
資訊工程學系 | zh_TW |
dc.contributor.department |
Department of Computer Science | en_US |
dc.date.accessioned |
2015-07-21T08:29:32Z | |
dc.date.available |
2015-07-21T08:29:32Z | |
dc.date.issued |
2015-05-01 | en_US |
dc.description.abstract |
Recently, MapReduce has been widely employed by many companies/organizations to tackle data-intensive problems over a large-scale MapReduce cluster. To solve machine/node failure which is inevitable in a MapReduce cluster, MapReduce employs several policies, such as input-data replication and intermediate-data replication policies. To speed up job execution, MapReduce allows reduce tasks to early fetch their required intermediate data. However, the impact of these policy combinations on the job completion reliability (JCR for short) and job energy consumption (JEC for short) of a MapReduce cluster was not clear, where JCR is the reliability with which a MapReduce job can be completed by the cluster, whereas JEC is the energy consumed by the cluster to complete the job. Therefore, in this study, we analyze the JCR and JEC of a MapReduce cluster on four policy combinations (POCs for short) derived from two typical intermediate-data replication policies and two typical reduce-task assignment policies. The four POCs are further compared in extensive scenarios, which not only consider jobs at different scales with various parameters, but also give a MapReduce cluster two extreme parallel execution capabilities and diverse bandwidths. The analytical results enable MapReduce managers to comprehend how these POCs impact the JCR and JEC of a cluster and then select an appropriate POC based on the characteristics of their own MapReduce jobs and clusters. | en_US |
dc.identifier.doi |
10.1109/TPDS.2014.2374600 | en_US |
dc.identifier.issn |
1045-9219 | en_US |
dc.identifier.journal |
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS | en_US |
dc.identifier.uri |
http://dx.doi.org/10.1109/TPDS.2014.2374600 | en_US |
dc.identifier.uri |
https://ir.lib.nycu.edu.tw/handle/11536/124662 | |
dc.identifier.wosnumber |
WOS:000352728200014 | en_US |
dc.language.iso |
en_US | en_US |
dc.subject |
Intermediate-data replication | en_US |
dc.subject |
job completion reliability | en_US |
dc.subject |
job energy consumption | en_US |
dc.subject |
MapReduce | en_US |
dc.title |
Impact of MapReduce Policies on Job Completion Reliability and Job Energy Consumption | en_US |
dc.type |
Article | en_US |
檔案
本條目沒有附加檔案。
所屬典藏: 期刊論文
引用此條目
Lin, J.-C., Leu, F.-Y., & Chen, Y.-P. (2015). Impact of MapReduce Policies on Job Completion Reliability and Job Energy Consumption. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 26, 1364–1378. https://doi.org/10.1109/TPDS.2014.2374600
引用文字依 APA 第 7 版格式自動產生,使用前請再核對。
分享
永久網址:https://ir.lib.nycu.edu.tw/handle/11536/124662