Deprecated: mysql_connect(): The mysql extension is deprecated and will be removed in the future: use mysqli or PDO instead in /home/content/77/8880177/html/ipartner/db.php on line 2
Hadoop Admin, Advance Admin Training -iPartner
loading...

Hadoop Admin, Advance Admin Training

  1. Hadoop Admin, Advance Admin Training
31 hr / 391*
(* including all taxes.)


Key Features
SMALL
BATCHES
MENTORING
BY EXPERTS
FLEXIBLE
SCHEDULE
LEARN
BY DOING
GOAL
ORIENTED



Course Agenda


  • The amount of data processing in today’s life
  • What Hadoop is why it is important?
  • Hadoop comparison with traditional systems
  • Hadoop history
  • Hadoop main components and architecture
  • HDFS overview and design
  • HDFS architecture
  • HDFS file storage
  • Component failures and recoveries
  • Block placement
  • Balancing the Hadoop cluster
  • Planning a Hadoop cluster and its capacity
  • Hadoop software and hardware configuration
  • HDFS Block replication and rack awareness
  • Network topology for Hadoop cluster
  • Ways of accessing data in HDFS
  • Common HDFS operations and commands
  • Different HDFS commands
  • Internals of a file read in HDFS
  • Data copying with ‘distcp’
  • What MapReduce is and why it is popular
  • The Big Picture of the MapReduce
  • MapReduce process and terminology
  • MapReduce components failures and recoveries
  • Working with MapReduce
  • Namenode/Datanode directory structures and files
  • File system image and Edit log
  • The Checkpoint Procedure
  • Namenode failure and recovery procedure
  • Safe Mode
  • Metadata and Data backup
  • Potential problems and solutions / what to look for
  • Adding and removing nodes

  • How to schedule Hadoop Jobs on the same cluster
  • Default Hadoop FIFO Schedule
  • Fair Scheduler and its configuration
  • Hadoop Multi Node Cluster Setup using Amazon ec2 – Creating 4 node cluster setup
  • Running Map Reduce Jobs on Cluster

Hadoop Adnvance Admin

  • Architecture
  • Resource Manager
  • Node Manager
  • Application Master
  • Resource Manager Component
  • Remote procedure call
  • Component connecting RM to the Nodes
  • Component interacting with per-application AMS
  • The scheduler and related components
  • Token secret managers
  • Node Manager
  • Node status updater
  • Container Manager
  • Container Monitor
  • Log handler
  • Container executer
  • Security
  • Web server
  • Web Application proxy server
  • History server
  • Hadoop Security
  • Communication and threats
  • Security threats in Hadoop
  • Solutions to threats
  • HDFS Security
  • Kerberos and Hadoop
  • Three step Kerberos Ticketing protocol
  • Example
  • KDC
  • Multiple utilities
  • Delegation Tokens
  • Multiple Realms
  • Setting up a secured Hadoop cluster
  • Setting up the Kerberos
  • Installing the key distribution centre
  • Setting up the KERBEROS clients on all the Hadoop nodes.
  • Setting up the Hadoop service principals
  • Creating a key tab file for the Hadoop services
  • Distributing the key tab file for all the salves.
  • Setting up Hadoop configuration files.
  • Hadoop HDFS over HTTP
  • How does HTTPFS Works
  • How HTTPFS and Hadoop HDFS Proxy differ?
  • Cloudera Sentry
  • Key feature of sentry
  • Apache Knox
  • Knox gateway server
  • Apache Flume
  • Big data ecosystem
  • Physically distributed Data sources
  • Changing structure of Data
  • Closer look
  • Anatomy of Flume
  • Core concepts
  • Event
  • Clients
  • Agents
  • Source
  • Channels
  • Sinks
  • Interceptors
  • Channel selector
  • Sink processor
  • Data ingest
  • Agent pipeline
  • Transactional data exchange
  • Routing and replicating
  • Why channels?
  • Use case- Log aggregation
  • Adding flume agent
  • Handling a server farm
  • Data volume per agent
  • Example describing a single node flume deployment
  • HUE introduction
  • HUE ecosystem
  • What is HUE?
  • HUE real world view
  • Advantages of HUE
  • How to upload data in File Browser?
  • View the content
  • Integrating users
  • Integrating HDFS
  • Fundamentals of HUE FRONTEND

  • IMPALA Overview: Goals
  • User view of Impala: Overview
  • User view of Impala: SQL
  • User view of Impala: Apache HBase
  • Impala architecture
  • Impala state store
  • Impala catalogue service
  • Query execution phases
  • Comparing Impala to Hive
  • ZOOKEEPER Introduction
  • ZOOKEEPER use cases
  • ZOOKEEPER Services
  • ZOOKEEPER data Model
  • Znodes and its types
  • Znodes operations
  • Znodes watches
  • Znodes reads and writes
  • Consistency Guarantees
  • Cluster management
  • Leader Election
  • Distributed Exclusive Lock
  • Important points
  • Why Oozie?
  • Installing Oozie
  • Running an example
  • Oozie- workflow engine
  • Example M/R action
  • Word count example
  • Workflow application
  • Workflow submission
  • Workflow state transitions
  • Oozie job processing
  • Oozie- HADOOP security
  • Why Oozie security?
  • Job submission to hadoop
  • Multi tenancy and scalability
  • Time line of Oozie job
  • Coordinator
  • Bundle
  • Layers of abstraction
  • Architecture
  • Use Case 1: time triggers
  • Use Case 2: data and time triggers
  • Use Case 3: rolling window
  • Hadoop maintenance
  • Name node directory structure
  • Secondary name node
  • Secondary name node directory structure
  • Data node directory structure
  • Safe mode
  • Safe mode properties
  • Entering and leaving safe mode
  • Audit logging
  • DFS Admin
  • File system check
  • Data node block scanner
  • Balancer
  • HDFS federation
  • HDFS high availability
  • Failover
  • Fencing
  • DISTCP
  • File formats in hadoop
  • Mentee can select project from predefined set of iPartner projects or they can come up with their own ideas for their projects.

Learn & Get

  • Working with Map Reduce, Hive, Sqoop
  • Hadoop Multi-Node Cluster Setup using Amazon ec2 – Creating 4 node cluster setup
  • Running MapReduce Jobs on Cluster
     
  • Create Applications using Hadodp Technology
  • Developing data storage, Creating Content Provider, Google Maps API V2, Multimedia and Animation, App Exporting
  • 70% of extensive learning through Hands-on exercises , Project Work , Assignments and Quizzes

Payment Method

PAYMENT METHODS
You need to pay through PayPal. We accept both Debit and Credit Card for transaction.
SCHOLARSHIPS
We subsidize our fees by 10% for military personnel, and college students with exceptional records. To apply for a scholarship, email info@ipartner.ca
FREQUENTLY ASKED QUESTIONS
In our iPartner self-paced training program, you will receive the training assessments, recorded sessions, course materials, Quizzes, related softwares and assignments. The courses are designed in such a way that you will the get real world exposure; the solid understanding of every concept that allows you to get the most from the online training experience and you will be able to apply the information and skills in the workplace. After the successful completion of your training program, you can take quizzes which enable you to check your level of knowledge and also enables you to clear your relevant certification at higher marks/grade where you will be able to work on the technologies independently.
In Self-paced courses, the learners are able to conduct hands-on exercises and produce learning deliverables entirely on their own at any convenient time without a facilitator whereas in the Online training courses, a facilitator will be available for answering queries at a specific time to be dedicated for learning. During your self-paced learning, you can learn more effectively when you interact with the content that is presented and a great way to facilitate this is through review questions and quizzes that strengthen key concepts. In case if you face any unexpected challenges while learning, we will arrange a live class with our trainer.
All Courses from iPartner are highly interactive to provide good exposure to learners and gives them a real time experience. You can learn only at a time where there are no distractions, which leads to effective learning. The costs of self-paced training are 75% cheaper than the online training. You will offer lifetime access hence you can refer it anytime during your project work or job.
Yes, at the top of the page of course details you can see sample videos.
As soon as you enroll to the course, your LMS (The Learning Management System) Access will be Functional. You will immediately get access to our course content in the form of a complete set of previous class recordings, PPTs, PDFs, assignments and access to our 24*7 support team. You can start learning right away.
24/7 access to video tutorials and Email Support along with online interactive session support with trainer for issue resolving.
Yes, You can pay difference amount between Online training and Self-paced course and you can be enrolled in next online training batch.
Please send an email. You can join our Live chat for instant solution.
We will provide you the links of the software to download which are open source and for proprietary tools, we will provide you the trail version if available.
You will have to work on a training project towards the end of the course. This will help you understand how the different components of courses are related to each other.
Classes are conducted via LIVE Video Streaming, where you get a chance to meet the instructor by speaking, chatting and sharing your screen. You will always have the access to videos and PPT. This would give you a clear insight about how the classes are conducted, quality of instructors and the level of Interaction in the class.
Yes, we do keep launching multiple offers that best suits your needs. Please email us at: info@ipartner.ca and we will get back to you with exciting offers.
We will help you with the issue and doubts regarding the course. You can attempt the quiz again.
Sure! Your feedbacks are greatly appreciated. Please connect with us on the email support - info@ipartner.ca.