Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Databricks | Spark ETL & Delta Lake Data Engineering Mastery
Introduction & Setup
Course Overview & Learning Path (2:45)
Exam Guide Breakdown (3:39)
What is Databricks & Why Data Engineering (3:54)
Creating Your Free Databricks Environment (3:48)
Navigating the Databricks User Interface (11:06)
Databricks Building Blocks
How Databricks Fits Together Lesson 1 (4:48)
How Databricks Fits Together Lesson 2 (8:52)
File and Notebook Management in Databricks (6:27)
Databricks Compute Options Lesson 1 (7:00)
Databricks Compute Options Lesson 2 (10:09)
Databricks Cluster Settings: Theoretical Guide and Certification Preparation (7:17)
Databricks – Your Digital Notebook and Laboratory Lesson 1 (4:05)
Databricks – Your Digital Notebook and Laboratory Lesson 2 (7:39)
Databricks – Your Digital Notebook and Laboratory Lesson 3 (5:57)
Essential Notebook Commands in Databricks (11:16)
Smart Shortcuts in Databricks (8:43)
Lakehouse Architecture Fundamentals
What is Lakehouse? – The Unified Data Platform (7:02)
Understanding the Medallion Layers (Bronze, Silver, Gold) (9:42)
ACID Transactions & Transaction Logs (7:50)
Data Governance & Unity Catalog
From DBFS to Unity Catalog: The Evolution of Data Governance (10:07)
Understanding Unity Catalog Layers (8:28)
Managed vs External Tables in Unity Catalog (13:26)
Creating a Unity Catalog (11:30)
Creating Managed Tables – Lesson 1 (12:59)
Creating Managed Tables – Lesson 2 (6:38)
Creating Volumes – Lesson 1 (11:46)
Creating Volumes – Lesson 2 (6:10)
Getting Started with ETL Apache Spark
Getting Started with ETL and Apache Spark (7:32)
Understanding the Data Model (8:19)
Data Engineering with Apache Spark – Bronze Layer
Your First ETL Steps (Extract) with Apache Spark – Lesson 2 (9:25)
Your First ETL Steps (Extract) with Apache Spark – Lesson 1 (18:39)
Your First ETL Steps (Extract) with Apache Spark – Lesson 3 (6:02)
Exploring All Bronze DataFrames with PySpark (10:46)
External Tables: Using External Data Without Bringing It into Databricks (9:11)
Detecting Duplicate Keys in the Bronze Layer (8:36)
Missing Value Profiling in the Bronze Layer (25:06)
Final Checks Before Moving to Silver Layer – Lesson 1 (8:24)
Final Checks Before Moving to Silver Layer – Lesson 2 (5:53)
Data Engineering with Apache Spark – Silver Layer
Cleaning and Normalizing Customers Table – Lesson 1 (5:42)
Cleaning and Normalizing Customers Table – Lesson 2 (17:33)
Olist Sellers- Transforming Bronze to Silver – Lesson 1 (11:51)
Olist Sellers- Transforming Bronze to Silver – Lesson 2 (14:17)
Cleaning and Enriching the Products Table — Lesson 1 (8:46)
Cleaning and Enriching the Products Table — Lesson 2 (6:49)
Cleaning and Enriching the Products Table — Lesson 3 (10:43)
Cleaning and Enriching the Products Table — Lesson 4 (13:07)
Cleaning and Enriching the Products Table — Lesson 5 (11:00)
Time, Quality, and Missing Data Management in Orders Table — Lesson 1 (10:05)
Time, Quality, and Missing Data Management in Orders Table — Lesson 2 (9:12)
Time, Quality, and Missing Data Management in Orders Table — Lesson 3 (10:48)
Time, Quality, and Missing Data Management in Orders Table — Lesson 4 (9:35)
Time, Quality, and Missing Data Management in Orders Table — Lesson 5 (14:18)
Order_Items Data Transformation and Quality Checks – Lesson 1 (14:38)
Order_Items Data Transformation and Quality Checks – Lesson 2 (13:05)
Order_Items Data Transformation and Quality Checks – Lesson 3 (8:37)
Payments Data Validation and Transformation Lesson 1 (7:36)
Payments Data Validation and Transformation Lesson 2 (7:48)
Payments Data Validation and Transformation Lesson 3 (8:56)
Payments Data Validation and Transformation Lesson 4 (3:59)
Building the Silver Version of order_reviews Data — Lesson 1 (8:48)
Building the Silver Version of order_reviews Data — Lesson 2 (10:37)
Building the Silver Version of order_reviews Data — Lesson 3 (14:09)
Geolocation Data Cleaning and Deduplication Lesson 1 (8:41)
Geolocation Data Cleaning and Deduplication Lesson 2 (9:18)
Geolocation Data Cleaning and Deduplication Lesson 3 (11:40)
Geolocation Data Cleaning and Deduplication Lesson 4 (8:54)
Clean Reference Tables in the Silver Layer (5:44)
Data Engineering with Apache Spark – Gold Layer
Customer Distribution Analysis – Gold Layer Lesson 2 (20:26)
Customer Distribution Analysis – Gold Layer Lesson 1 (12:14)
Seller Metrics and Pareto Visualization in Databricks – Lesson 1 (6:29)
Seller Metrics and Pareto Visualization in Databricks – Lesson 2 (18:20)
Analyzing Product Categories by Weight, Volume and Density Lesson 1 (9:31)
Analyzing Product Categories by Weight, Volume and Density Lesson 2 (8:51)
Analyzing Product Categories by Weight, Volume and Density Lesson 3 (10:12)
Gold Layer – Each Table Tells Its Own Story (13:25)
Unified Order Gold Analytics – Lesson 1 (8:23)
Unified Order Gold Analytics – Lesson 2 (6:30)
Unified Order Gold Analytics – Lesson 3 (11:58)
Unified Order Gold Analytics – Lesson 4 (14:37)
Unified Order Gold Analytics – Lesson 5 (8:39)
Designing Analytical Joins in the Gold Layer (7:59)
Creating Your Free Databricks Environment
Lesson content locked
If you're already enrolled,
you'll need to login
.
Enroll in Course to Unlock