Saturday, October 21, 2017

Hadoop Ecosystem

Hadoop Ecosystem = HDFS + MapReduce + Tools(Hive,Pig,HBase,Zookeeper,Flume,Sqoop,Oozie,Mahout)

Three modes
Local standalone mode - single JVM
pseudo distributed mode - separate JVM
fully distributed mode - multiple JVM

Hadoop Components
Namenode
Datanode
Secondary Namenode
JobTracker
TaskTracker

Configuration files
core-site.xml => location of namenode
hdfs-site.xml => replication factor
mapred-site.xml => location of jobtracker

hadoop dfs -ls
dfs -copyFromLocal
dfs put
dfs -cat
dfs -get

-

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Web Development

Design Phase:- Below all these represent different stages of the UX/UI design flow:- Wireframes represent a very basic & visual repr...

  • static vs volatile
    Static variable is a class variable but not instance variable which is declared and initialized once in its life and shared by any number o...
  • CI/CD Pipeline | modern DevOps process
    CI/CD:- It bridges the gap between development and operations teams by automating the building, testing, and deployment of applications. ...
  • MVC Framework
    In the beginning there was darkness (and simplicity). The only things that existed were static html pages. They would have html and text, a...