JISE


  [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17]


Journal of Information Science and Engineering, Vol. 31 No. 5, pp. 1775-1793


PAReS: A Proactive and Adaptive Redundant System for MapReduce


JIA-CHUN LIN1, FANG-YIE LEU2 AND YING-PING CHEN3 
1Department of Informatics 
University of Oslo 
Oslo, 0104 Norway 
2Department of Computer Science 
TungHai University 
Taichung, 407 Taiwan 
3Department of Computer Science 
National Chiao Tung University 
Hsinchu, 300 Taiwan 
E-mail: kellylin1219@gmail.com; leufy@thu.edu.tw; ypchen@cs.nctu.edu.tw


    Recently, MapReduce has been a key and popular technology for tackling data-intensive applications. But its two master servers in current MapReduce implementations have a single-failure problem, which may interrupt MapReduce operations and filesystem services. In this paper, we propose a hybrid takeover scheme, called the Proactive and Adaptive Redundant System (PAReS for short), which employs three service-quality improvement mechanisms, including a proactive synchronization and replication method, a mutual monitoring algorithm, and an adaptive warm-up mechanism, to mitigate the above problems. The extensive experiments show that PAReS enhances service quality at acceptable energy consumption level and synchronization cost as compared with four state-of- the-art schemes.


Keywords: MapReduce, redundant system, service downtime, takeover, proactive synchronization and replication, mutual monitoring, adaptive warm-up mechanism

  Retrieve PDF document (JISE_201505_15.pdf)