KMS Chongqing Institute of Green and Intelligent Technology, CAS
Combined load balancing and energy efficiency in Hadoop | |
Tian, Wenhong1,2; Li, Guozhong1; Chen, Yu1; Huang, Chaojie1; Yang, Wutong1 | |
2016 | |
摘要 | Hadoop clusters are widely used in enterprises and research institutions but there are few tools in Hadoop to dynamically load balance and improve the energy efficiency. A dynamic load balancing method with negative feedback was developed for a dynamic management system for Hadoop systems and tested using classic Hadoop benchmark examples. This method reduces the total idle time of the Hadoop nodes by 25% and reduces energy consumption by 14% on average compared with other algorithms by improving the load balancing through reducing the load variations by 10%. © 2016, Tsinghua University Press. All right reserved. |
DOI | 10.16511/j.cnki.qhdxxb.2016.26.016 |
发表期刊 | Qinghua Daxue Xuebao/Journal of Tsinghua University |
ISSN | 10000054 |
卷号 | 56期号:11页码:1226-1231 |
收录类别 | EI |
语种 | 中文 |