Hadoop Admin Online Training

INTRODUCTION

• Big Data
• 3Vs
• Role of Hadoop in Big data
• Hadoop and its ecosystem
• Overview of other Big Data Systems
• Requirements in Hadoop
• Use Cases of Hadoop

Installing the Hadoop Distributed File System (HDFS)

• Defining key design assumptions and architecture
• Configuring and setting up the file system
• Issuing commands from the console
• Reading and writing files

Setting the stage for MapReduce

• Introducing the computing daemons
• Dissecting a MapReduce job

Defining Hadoop Cluster Requirements

• Selecting appropriate hardware
• Designing a scalable cluster

Building the cluster

• Installing Hadoop daemons
• Optimizing the network architecture

Basicadnd Advanced file and directory permissions

• Configuring a Cluster – Pseudo node and multi – node
• Setting basic configuration parameters
• Configuring block allocation, redundancy and replication

Deploying MapReduce

• Installing and setting up the MapReduce environment
• Delivering redundant load balancing via Rack Awareness

Configuring a Cluster

• Setting basic configuration parameters
• Configuring block allocation, redundancy and replication

Maintaining HDFS

• Starting and stopping Hadoop daemons
• Monitoring HDFS status
• Adding and removing data nodes

Administering MapReduce

• Managing MapReduce jobs
• Tracking progress with monitoring tools
• Commissioning and decommissioning compute nodes

Performing Hadoop status checks

Planning for Backup, Recovery and Security

etc.

Extending Hadoop

• Enabling SQL-like querying with Hive
• Installing Pig to create MapReduce jobs
• Working with Zookeeper and Ooziew workflow