Deploying and Improving Hadoop on PseudoDistributed Mode

Authors

  • Bhatia RK University Institute of Engineering & Technology Panjab University, Chandigarh India
  • Bansal A University Institute of Engineering & Technology Panjab University, Chandigarh India

Keywords:

Hadoop, MapReduce, Schedulers

Abstract

Hadoop is an open source framework which comprises of Map Reduce and HDFS (Hadoop Distributed File System) which allows storage of data and computing capabilities on large scale. Hadoop is expanding every day and many cloud computing enterprises have been adapting it. Hadoop provides a platform to provide cloud computing services to customers. Hadoop can be run of any the three modes: Standalone, Pseudo-Distributed and Fully-Distributed. In this paper we have improved execution time by configuring different schedulers. We implemented our method over Hadoop 2.2.0 on Pseudo-Distributed mode which improves the overall job execution time.

References

. Hadoop, The Apache Software Foundation, May 2012, 1.0.3.

. Thusoo, Ashish, et al. "Hive: a warehousing solution over a map-reduce framework." Proceedings of the VLDB Endowment 2.2 (2009): 1626-1629.

. Shvachko, Konstantin, et al. "The hadoop distributed file system." Mass Storage Systems and Technologies (MSST), 2010 IEEE 26th Symposium on. IEEE, 2010.

. Nicolae, Bogdan, et al. "BlobSeer: Bringing high throughput under heavy concurrency to Hadoop MapReduce applications." Parallel & Distributed Processing (IPDPS), 2010 IEEE International Symposium on. IEEE, 2010.

. Xu, Guanghui, Feng Xu, and Hongxu Ma. "Deploying and researching Hadoop in virtual machines."Automation and Logistics (ICAL), 2012 IEEE International Conference on. IEEE, 2012.

. Kurazumi, Shiori, et al. "Dynamic Processing Slots Scheduling for I/O Intensive Jobs of Hadoop MapReduce." ICNC. 2012.

Downloads

Published

2024-02-26

How to Cite

Bhatia, R. K., & Bansal, A. (2024). Deploying and Improving Hadoop on PseudoDistributed Mode. COMPUSOFT: An International Journal of Advanced Computer Technology, 3(10), 1136–1139. Retrieved from https://ijact.in/index.php/j/article/view/200

Issue

Vol. 3 No. 10 (2014): October

Section

Original Research Article

License

Copyright (c) 2014 COMPUSOFT: An International Journal of Advanced Computer Technology

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

©2023. COMPUSOFT: AN INTERNATIONAL OF ADVANCED COMPUTER TECHNOLOGY by COMPUSOFT PUBLICATION is licensed under a Creative Commons Attribution 4.0 International License. Based on a work at COMPUSOFT: AN INTERNATIONAL OF ADVANCED COMPUTER TECHNOLOGY. Permissions beyond the scope of this license may be available at Creative Commons Attribution 4.0 International Public License.