Subcribe and Access : 5200+ FREE Videos and 21+ Subjects Like CRT, SoftSkills, JAVA, Hadoop, Microsoft .NET, Testing Tools etc..

Batch Date: Apr 8th @8:00PM

Faculty: Mr. U. Seshadri (20+ Yrs of Exp,..)

Duration : 3 Months

Venue :
DURGA SOFTWARE SOLUTIONS,
Flat No : 202, 2nd Floor,
HUDA Maitrivanam,
Ameerpet, Hyderabad - 500038

Ph. No: +91 - 8885252627, 9246212143, 80 96 96 96 96

Syllabus:

Full Stack Data Engineering with Azure
(MySQL + Python + PySpark + ADE + Fabric)

SQL

• Introduction to SQL
• Popular Databases – MySQL
• SQL Basics
  • Database, Tables
    DDL, DML, DCL, TCL
• SQL Constraints
  • Not Null
  • Primary Key
  • Foreign Key
  • Default
  • Check
  • Unique
• SQL Data Types
• SQL DQL
  • Select
  • Group By
  • Having
  • Order By
• SQL Joins
  • Inner Join
  • Left Join
  • Right Join
  • Full Join
  • Self-Join
  • Cross Join
• SQL Advanced Queries
• SQL Windows Functions
• SQL CTE/Hierarchical Queries
• SQL Views
• SQL Indexes
• PLSQL
  • SQL vs PLSQL
  • Procedures
  • Functions
  • Triggers
• SQL Project
• SQL Data Engineering Use Case

PYTHON

• Python Introduction:
  • History & features of Python
  • Python Vs Other Programming Languages
  • First Python Program
  • Python basic syntax
  • Python Development Tools & Packages
  • Installing Python
  • Verify & Setup Python environment
  • Variables
• Python Data Types:
  • Data Types
  • Strings
  • Type Casting
• Python Operators:
  • Arithmetic Operators
  • Relational Operators
  • Logical Operators
  • Bitwise Operators
  • Assignment Operator
• Python Flow Control and Loops:
  • if, if else, if else if
  • while, do while loops
  • for loops
• Python Functional Programming
  • Function Declarations
  • Calling Functions
  • Functions Call-by-Name
  • Functions with Named Arguments
  • Functions with Variable Arguments
  • Functions with Default Parameter Values
  • Lambda Functions
• Python Collections:
  • Lists
  • Tuples
  • Sets
  • Dictionaries
• Python File I/O
  • Reading input from console
  • Reading data from Files
  • Writing data to Files
• Python Object Oriented Programming
  • Simple class
  • Class objects
  • Inheritance
• Python Exception Handling:
  • Throwing Exceptions
  • try, catch, finally
  • Catching Exceptions
  • The Finally Clause Python Miscellaneous
  • Modules
  • Dates
  • RegEx

Dataware House

• Dataware House
  • What is Data Warehouse?
  • Why do you need Data Warehouse?
  • Ideal Data Warehouse Solution
• Database Schemas:
  • Star Schema
  • Snowflake Schema
• Data Modeling:
  • Fact Tables
  • Dimension Table
  • Fact less Tables
• ETL:
  • Introduction to ETL
  • Compare ETL to ELT
  • ETL Design

BigData and Pyspark

• Introduction to Bigdata
• Growth of Bigdata
• Traditional Database problems
• Traditional Database Processing problems
• Hadoop Architecture
• HDFS and MapReduce
• Hadoop 1.X and Hadoop 2.X
• HIVE, PIG, MapReduce
• Introduction of Spark
• Spark Architecture
• PySpark

Cloud Computing

• Problems in Traditional Storage Systems
• Problems in Traditional Processing Services
• Cloud Computing as Solution
  • IAAS
  • PAAS
  • SAAS
• Cloud Services
• Comparison of AZURE, AWS and GCP

AZURE

• Overview of AZURE
• AZURE Free Account
• Azure Portal
• Azure Services and Applications
• Azure Services
• Azure Storage:
  • Azure Blob Storage
  • Azure Data Lake Store Gen I & Gen II
  • Azure Disk Storage
• Azure SQL Database:
  • Introduction to Azure SQL Database
  • Azure Single Database
• Azure Data Factory:
  • What is Data Factory?
  • Data Factory Components
  • Data Factory - Pipelines
  • Data Factory - Activities
  • Data Factory - Linked Services
  • Data Factory - Datasets
  • Data Factory - Triggers
  • Data Factory - Dataflow
  • Data Factory - Parameters
  • Data Factory – Monitoring
• Azure Synapse Analytics:
  • What is Synapse Analytics Service?
  • Create Dedicated SQL Pool Explore Synapse Studio V2
  • Analyse Data using Apache Spark Notebook
  • Analyse Data using Dedicated SQL Pool
  • Monitor Synapse Studio
• Azure Stream Analytics:
  • Introduction to Azure Streaming Analytics Service
  • Spark Analytics - Time Windowing
  • Spark Analytics - Monitoring
  • Spark Analytics - Optimization
  • Spark Analytics - Types of Window Functions
• Introduction to Data Bricks
• Why Databricks in Cloud?
• Azure - Databricks Clusters
• Azure - Databricks Components
• Azure - Monitoring
• Explore, Analyse, Clean, Transform and Load Data in Databricks
• Azure CosmosDB:
  • Introduction to Cosmos DB
  • Cosmos DB Features
  • Storage vs. Cosmos DB
  • Provision Cosmos DB Account
  • Cosmos - Database, Containers and item

Project:

• On-Premise ETL Demo Example
• Cloud ETL Demo Example
• On-Premise Databases Migration
• End to End Project – Health Care