Hadoop Essential Training for Administrators and Developers
Big data is here! In this Hadoop Essential Training for Administrators and Developers class, students will learn the fundamentals of setting up a Hadoop cluster as well as the "soup" of related technologies like Hive, Pig, and Oozie. Come prepared to learn how to access the Hadoop file system, write MapReduce jobs using java, Pig, and Hive, as well as how to use Pig, Hive, and Oozie. Every participant will work with their own installation of a Hadoop 2, single node cluster.
Public Classes: Delivered live online via WebEx and guaranteed to run . Join from anywhere!
Private Classes: Delivered at your offices , or any other location of your choice.
- Gain an understanding of the Hadoop File System (HDFS).
- Learn what MapReduce is and why you should care.
- Learn how to write a MapReduce job with java, Pig, and Hive.
- Learn how the different Hadoop technologies interoperate to provide a cohesive big data solution.
- Learn basic management of a Hadoop cluster.
- Learn how to perform basic unit testing of your MapReduce jobs.
- Learn the different modes that Hadoop can be run in to support massive amounts of data as well as your MapReduce jobs during development.
- Hadoop Overview
- What is Big Data?
- How did we get to this point?
- How does Hadoop compare to a relational database system?
- Big Data Introduction
- Comparison to Relational Databases
- Hadoop Ecosystem
- Filesystem Shell
- Accessing HDFS with Java
- Reading/Writing/Browsing file system
- Data Model
- Installation and Shell
- Access via Java API
- Administration access via Java
- Scan API
- Storage Model
- Table Design
- Map Reduce on YARN
- Processing Model
- Command line tools
- MapReduce framework
- Submitting MapReduce Jobs
- Writing MapReduce jobs in Java
- MapReduce Theory
- Distributive Cache
- Speculative Executin
- YARN Components
- Details of MapReduce Job Execution
- Hadoop Streaming
- Implementing a streaming job
- Counters in streaming jobs
- Contrast with Java Jobs
- MapReduce Workflows
- Problem decomposition into MapReduce Jobs
- Coding workflows
- Using the JobControl Class
- Oozie Installation
- Writing Oozie workflows
- Deploying and running Oozie jobs
- Pig Latin
- Writing Pig Scripts
- User Defined functions
- Data set joins
- Table creation and deletion
- Loading data into Hive
Each student in our Live Online and our Onsite classes receives a comprehensive set of materials, including course notes and all the class examples.
Experience in the following is required for this Hadoop class:
Experience in the following would be useful for this Hadoop class: