MOC 20776 - Performing Big Data Engineering on Microsoft Cloud Services

See Course Outline

Training for your Team

5
Days
  • Private Class for your Team
  • Online or On-location
  • Customizable
  • Expert Instructors
Overview

This five-day Performing Big Data Engineering on Microsoft Cloud Services training class describes how to process Big Data using Azure tools and services including Azure Stream Analytics, Azure Data Lake, Azure SQL Data Warehouse and Azure Data Factory. The course also explains how to include custom functions, and integrate Python and R.
The primary audience for this course is data engineers (IT professionals, developers, and information workers) who plan to implement big data engineering workflows on Azure.

Goals
  1. Learn to describe common architectures for processing big data using Azure tools and services.
  2. Learn to describe how to use Azure Stream Analytics to design and implement stream processing over large-scale data.
  3. Learn to describe how to include custom functions and incorporate machine learning activities into an Azure Stream Analytics job.
  4. Learn to describe how to use Azure Data Lake Store as a large-scale repository of data files.
  5. Learn to describe how to use Azure Data Lake Analytics to examine and process data held in Azure Data Lake Store.
  6. Learn to describe how to create and deploy custom functions and operations, integrate with Python and R, and protect and optimize jobs.
  7. Learn to describe how to use Azure SQL Data Warehouse to create a repository that can support large-scale analytical processing over data at rest.
  8. Learn to describe how to use Azure SQL Data Warehouse to perform analytical processing, how to maintain performance, and how to protect the data.
  9. Learn to describe how to use Azure Data Factory to import, transform, and transfer data between repositories and services.
Outline
  1. Architectures for Big Data Engineering with Azure
    1. Understanding Big Data
    2. Architectures for Processing Big Data
    3. Considerations for designing Big Data solutions
    4. Lab: Designing a Big Data Architecture
      1. Design a big data architecture
  2. Processing Event Streams using Azure Stream Analytics
    1. Introduction to Azure Stream Analytics
    2. Configuring Azure Stream Analytics jobs
    3. Lab: Processing Event Streams with Azure Stream Analytics
      1. Create an Azure Stream Analytics job
      2. Create another Azure Stream job
      3. Add an Input
      4. Edit the ASA job
      5. Determine the nearest Patrol Car
  3. Performing custom processing in Azure Stream Analytics
    1. Implementing Custom Functions
    2. Incorporating Machine Learning into an Azure Stream Analytics Job
    3. Lab: Performing Custom Processing with Azure Stream Analytics
      1. Add logic to the analytics
      2. Detect consistent anomalies
      3. Determine consistencies using machine learning and ASA
  4. Managing Big Data in Azure Data Lake Store
    1. Using Azure Data Lake Store
    2. Monitoring and protecting data in Azure Data Lake Store
    3. Lab: Managing Big Data in Azure Data Lake Store
      1. Update the ASA Job
      2. Upload details to ADLS
  5. Processing Big Data using Azure Data Lake Analytics
    1. Introduction to Azure Data Lake Analytics
    2. Analyzing Data with U-SQL
    3. Sorting, grouping, and joining data
    4. Lab: Processing Big Data using Azure Data Lake Analytics
      1. Add functionality
      2. Query against Database
      3. Calculate average speed
  6. Implementing custom operations and monitoring performance in Azure Data Lake Analytics
    1. Incorporating custom functionality into Analytics jobs
    2. Managing and Optimizing jobs
    3. Lab: Implementing custom operations and monitoring performance in Azure Data Lake Analytics
      1. Custom extractor
      2. Custom processor
      3. Integration with R/Python
      4. Monitor and optimize a job
  7. Implementing Azure SQL Data Warehouse
    1. Introduction to Azure SQL Data Warehouse
    2. Designing tables for efficient queries
    3. Importing Data into Azure SQL Data Warehouse
    4. Lab: Implementing Azure SQL Data Warehouse
      1. Create a new data warehouse
      2. Design and create tables and indexes
      3. Import data into the warehouse.
  8. Performing Analytics with Azure SQL Data Warehouse
    1. Querying Data in Azure SQL Data Warehouse
    2. Maintaining Performance
    3. Protecting Data in Azure SQL Data Warehouse
    4. Lab: Performing Analytics with Azure SQL Data Warehouse
      1. Performing queries and tuning performance
      2. Integrating with Power BI and Azure Machine Learning
      3. Configuring security and analysing threats
  9. Automating the Data Flow with Azure Data Factory
    1. Introduction to Azure Data Factory
    2. Transferring Data
    3. Transforming Data
    4. Monitoring Performance and Protecting Data
    5. Lab: Automating the Data Flow with Azure Data Factory
      1. Automate the Data Flow with Azure Data Factory
Class Materials

Each student in our Live Online and our Onsite classes receives a comprehensive set of materials, including course notes and all the class examples.

Class Prerequisites

Experience in the following is required for this SQL Server class:

  • A good understanding of Azure data services.
  • A basic knowledge of the Microsoft Windows operating system and its core functionality.
  • A good knowledge of relational databases. .
Preparing for Class
Certifications

No cancelation for low enrollment

Certified Microsoft Partner

Registered Education Provider (R.E.P.)

GSA schedule pricing

91,059

Students who have taken Live Online Training

16,075

Organizations who trust Webucator for their training needs

100%

Satisfaction guarantee and retake option

9.44

Students rated our trainers 9.44 out of 10 based on 5097 reviews

Great experience. I am ready to program with VBA!

Shane Mofford, Coloradod Department of Health Care Policy and Financing
Denver CO

Two Words to describe this class: 'Loved It.' The trainer was absolutely patient, understanding, and helpful. I am looking forward to my next class.

Evan Davis, Metafore
Calgary AB

I would highly recommend Webucator online classes for individuals who currently work in IT as this is the most expedient method to get up to speed on a particular technology.

Jon Feldman, PNC Financial Services Group
Bradenton FL

I was satisfied with the Microsoft Project training. The instructor is extremely knowledgeable about the program and his experience in project management is apparent in the way he instructs and leads the class.

Ashton Esling, Starcom

Contact Us or call 1-877-932-8228