PERFORMANCE COMPARISON OF HADOOP MAPREDUCE AND APACHE PIG

Chandra Kala Kuruba

Abstract


In the recent era data has been growing at an exponential rate. This data can be either Structured or Semi-Structured or Unstructured and needs to be processed and analyzed carefully to get new insights. There are various tools or frameworks available for this purpose; few of them are Apache Hadoop MapReduce, Apache Pig,Apache Hive, Apache Spark,Tez etc. These tools are widely adopted for managing and processing BigData. Hadoop MapReduce provides low level of abstraction whereas Pig provides high level of abstraction. In this paper, we discuss the major architectural component differences between MapReduce and Pig and conduct detailed experiments to compare their performances with different inputs.

Keywords


Pig, Hadoop, MapReduce,HDFS, Big Data Analytics

Full Text:

PDF


DOI: https://doi.org/10.26483/ijarcs.v8i9.5177

Refbacks

  • There are currently no refbacks.




Copyright (c) 2017 International Journal of Advanced Research in Computer Science