Tag: hadoop

  • Zookeeper Setup

    —

    in ,

    Zookeeper Setup Required Software Zookeeper runs in Java release 1.6 or greater (JDK 6 or greater) hence please download and install JDK first. Zookeeper runs as an ensemble of Zookeeper servers, which should be of odd numbers,  as zookeeper requires a majority. For example, with four machines ZooKeeper can only handle the failure of a single machine;…

  • Securing Hadoop Cluster part-2 KERBEROS SETUP

    —

    in , , , , , ,

    Securing Hadoop Cluster part-2 KERBEROS SETUP Contents Kerberos: 1 Kerberos Installation and setup: 2 Kerberos KDC server setup. 2 Kerberos Client Setup: 8 Create service principal and keytabs  for Hadoop Services. 8 Update the configuration files for each Hadoop service. 10   Kerberos:   –a secured netowrk authentication system developed by MIT in mid 1990.…

  • VM setup for Hadoop Cluster (centos)

    —

    in , , , ,

    VM setup for Hadoop Cluster (centos) Before you get hands on Hadoop ecosystem, be it for Hadoop Admin or Development exposure you will need your own small cluster setup which will help you understand how hadoop internally works. In order to have a distributed Hadoop cluster setup we need multiple hosts/servers and for obvious reason…

  • Hadoop2 Cluster Setup

    —

    in , , , ,

    Hadoop2  Cluster  Setup This document guideline the steps to Hadoop2 Cluster Setup. Table of Contents Pre-requisites: 1 Create user and group (hadoop) on all hosts: 1 setup SSH for hadoop user. 1 Download and install Java. 2 Download hadoop: 2 Update bashrc file for hadoop user to set required path variables. 2 Update Hadoop Configuration…