Using Pig on Hadoop for Data Analysis in Bioinformatics
Main Article Content
Abstract
Data storage, processing and analysis is a major component of bioinformatics. Apache Hadoop provides a distributed computing framework for processing large voluminous data. Pig is an Apache open source project that works on the Hadoop platform and let the programmer write the queries or scripts in its procedural dataflow language known as Pig Latin rather than writing core MapReduce programs in Java directly. Pig provides a lot of statements similar to SQL clauses and some other advanced features. The Pig platform compiles the statements and scripts and generates the equivalent map and reduce tasks and sends to Hadoop for execution. It helps to process the biological data available in large sizes, which can be analyzed in an effective way within a small time. Also in contrast to traditional (R)DBMS, unconstrained data may be used and the database schema also need not to be constrained or consistent or pre-defined.
Â
Keywords: Bioinformatics, Hadoop, Pig, Pig Latin.
Downloads
Article Details
COPYRIGHT
Submission of a manuscript implies: that the work described has not been published before, that it is not under consideration for publication elsewhere; that if and when the manuscript is accepted for publication, the authors agree to automatic transfer of the copyright to the publisher.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work
- The journal allows the author(s) to retain publishing rights without restrictions.
- The journal allows the author(s) to hold the copyright without restrictions.