Autoplay
Autocomplete
Previous Lesson
Complete and Continue
GCP: Complete Google Data Engineer and Cloud Architect Guide
You, This Course and Us
You, This Course and Us (2:02)
Course Materials
Introduction
Theory, Practice and Tests (10:28)
Lab: Setting Up A GCP Account (6:59)
Why Cloud? (9:45)
Hadoop and Distributed Computing (9:03)
On-premise, Colocation or Cloud? (10:07)
Introducing the Google Cloud Platform (13:22)
Lab: Using The Cloud Shell (6:01)
Important! Delete unused GCP projects/instances
quiz 1 GCP Introduction
Compute
About this section
Compute Options (9:18)
Google Compute Engine (GCE) (7:40)
Lab: Creating a VM Instance (5:59)
More GCE (8:14)
Lab: Editing a VM Instance (4:45)
Lab: Creating a VM Instance Using The Command Line (4:43)
Lab: Creating And Attaching A Persistent Disk (4:00)
Google Container Engine - Kubernetes (GKE) (10:35)
More GKE (9:56)
Lab: Creating A Kubernetes Cluster And Deploying A Wordpress Container (6:55)
App Engine (6:50)
Contrasting App Engine, Compute Engine and Container Engine (6:05)
Lab: Deploy And Run An App Engine App (7:29)
Quiz 2 Compute
Storage
About this section
Storage Options (9:50)
Quick Take (13:43)
Cloud Storage (10:39)
Lab: Working With Cloud Storage Buckets (5:25)
Lab: Bucket And Object Permissions (3:52)
Lab: Life cycle Management On Buckets (5:06)
Lab: Running A Program On a VM Instance And Storing Results on Cloud Storage (7:09)
Transfer Service (5:09)
Lab: Migrating Data Using The Transfer Service (5:32)
Lab: Cloud Storage ACLs and API access with Service Account (7:49)
Lab: Cloud Storage Customer-Supplied Encryption Keys and Life-Cycle Management (9:27)
Lab: Cloud Storage Versioning, Directory Sync (8:41)
Cloud SQL, Cloud Spanner ~ OLTP ~ RDBMS
About this section
Cloud SQL (7:42)
Lab: Creating A Cloud SQL Instance (7:54)
Lab: Running Commands On Cloud SQL Instance (6:31)
Lab: Bulk Loading Data Into Cloud SQL Tables (9:09)
Cloud Spanner (7:27)
More Cloud Spanner (9:20)
Lab: Working With Cloud Spanner (6:49)
Important! Delete unused GCP projects/instances
Hadoop Pre-reqs and Context
Hadoop Pre-reqs and Context
BigTable ~ HBase = Columnar Store
About this section
BigTable Intro (7:59)
Columnar Store (8:14)
Denormalised (9:04)
Column Families (8:12)
BigTable Performance (13:21)
Lab: BigTable demo (7:39)
Important! Delete unused GCP projects/instances
Datastore ~ Document Database
About this section
Datastore (14:12)
Lab: Datastore demo (6:42)
Quiz 3 Datastore
BigQuery ~ Hive ~ OLAP
About this section
BigQuery Intro (11:03)
BigQuery Advanced (9:59)
Lab: Loading CSV Data Into Big Query (9:03)
Lab: Running Queries On Big Query (5:26)
Lab: Loading JSON Data With Nested Tables (7:28)
Lab: Public Datasets In Big Query (8:16)
Lab: Using Big Query Via The Command Line (7:45)
Lab: Aggregations And Conditionals In Aggregations (9:51)
Lab: Subqueries And Joins (5:44)
Lab: Regular Expressions In Legacy SQL (5:36)
Lab: Using The With Statement For SubQueries (10:45)
Dataflow ~ Apache Beam
About this section
Data Flow Intro (11:06)
Apache Beam (3:42)
Lab: Running A Python Data flow Program (12:56)
Lab: Running A Java Data flow Program (13:42)
Lab: Implementing Word Count In Dataflow Java (11:17)
Lab: Executing The Word Count Dataflow (4:37)
Lab: Executing MapReduce In Dataflow In Python (9:50)
Lab: Executing MapReduce In Dataflow In Java (6:08)
Lab: Dataflow With Big Query As Source And Side Inputs (15:50)
Lab: Dataflow With Big Query As Source And Side Inputs 2 (6:28)
Dataproc ~ Managed Hadoop
About this section
Data Proc (8:30)
Lab: Creating And Managing A Dataproc Cluster (8:11)
Lab: Creating A Firewall Rule To Access Dataproc (8:25)
Lab: Running A PySpark Job On Dataproc (7:39)
Lab: Running The PySpark REPL Shell And Pig Scripts On Dataproc (8:44)
Lab: Submitting A Spark Jar To Dataproc (2:10)
Lab: Working With Dataproc Using The Gcloud CLI (8:19)
Pub/Sub for Streaming
About this section
Pub Sub (8:25)
Lab: Working With Pubsub On The Command Line (5:35)
Lab: Working With PubSub Using The Web Console (4:39)
Lab: Setting Up A Pubsub Publisher Using The Python Library (5:52)
Lab: Setting Up A Pubsub Subscriber Using The Python Library (4:08)
Lab: Publishing Streaming Data Into Pubsub (8:18)
Lab: Reading Streaming Data From PubSub And Writing To BigQuery (10:14)
Lab: Executing A Pipeline To Read Streaming Data And Write To BigQuery (5:54)
Lab: Pubsub Source BigQuery Sink (10:20)
Datalab ~ Jupyter
About this section
Data Lab (3:01)
Lab: Creating And Working On A Datalab Instance (4:01)
Lab: Importing And Exporting Data Using Datalab (12:14)
Lab: Using The Charting API In Datalab (6:43)
TensorFlow and Machine Learning
About this section
Introducing Machine Learning (8:06)
Representation Learning (10:29)
NN Introduced (7:37)
Introducing TF (7:18)
Lab: Simple Math Operations (8:46)
Computation Graph (10:19)
Tensors (9:04)
Lab: Tensors (5:03)
Linear Regression Intro (9:59)
Placeholders and Variables (8:46)
Lab: Placeholders (6:36)
Lab: Variables (7:49)
Lab: Linear Regression with Made-up Data (4:52)
Image Processing (8:07)
Images As Tensors (8:18)
Lab: Reading and Working with Images (8:05)
Lab: Image Transformations (6:37)
Introducing MNIST (4:15)
K-Nearest Neigbors as Unsupervised Learning (7:44)
One-hot Notation and L1 Distance (7:31)
Steps in the K-Nearest-Neighbors Implementation (9:34)
Lab: K-Nearest-Neighbors (14:14)
Learning Algorithm (11:00)
Individual Neuron (9:54)
Learning Regression (7:53)
Learning XOR (10:29)
XOR Trained (11:13)
Regression in TensorFlow
About this section
Lab: Access Data from Yahoo Finance (2:49)
Non TensorFlow Regression (8:07)
Lab: Linear Regression - Setting Up a Baseline (11:18)
Gradient Descent (9:58)
Lab: Linear Regression (14:42)
Lab: Multiple Regression in TensorFlow (9:15)
Logistic Regression Introduced (10:18)
Linear Classification (5:27)
Lab: Logistic Regression - Setting Up a Baseline (7:33)
Logit (8:35)
Softmax (11:57)
Argmax (12:15)
Lab: Logistic Regression (16:56)
Estimators (4:12)
Lab: Linear Regression using Estimators (7:49)
Lab: Logistic Regression using Estimators (4:54)
Vision, Translate, NLP and Speech: Trained ML APIs
About this section
Lab: Taxicab Prediction - Setting up the dataset (14:38)
Lab: Taxicab Prediction - Training and Running the model (11:22)
Lab: The Vision, Translate, NLP and Speech API (10:53)
Lab: The Vision API for Label and Landmark Detection (7:00)
Virtual Machines and Images
About this section
Live Migration (10:16)
Machine Types and Billing (9:20)
Sustained Use and Committed Use Discounts (7:03)
Rightsizing Recommendations (2:22)
RAM Disk (2:07)
Images (7:45)
Startup Scripts And Baked Images (7:31)
VPCs and Interconnecting Networks
About this section
VPCs And Subnets (11:14)
Global VPCs, Regional Subnets (11:19)
IP Addresses (11:39)
Lab: Working with Static IP Addresses (5:46)
Routes (7:36)
Firewall Rules (15:33)
Lab: Working with Firewalls (7:05)
Lab: Working with Auto Mode and Custom Mode Networks (19:32)
Lab: Bastion Host (7:10)
Cloud VPN (7:26)
Lab: Working with Cloud VPN (11:11)
Cloud Router (10:31)
Lab: Using Cloud Routers for Dynamic Routing (14:07)
Dedicated Interconnect Direct and Carrier Peering (8:10)
Shared VPCs (10:11)
Lab: Shared VPCs (6:17)
VPC Network Peering (10:10)
Lab: VPC Peering (7:16)
Cloud DNS And Legacy Networks (5:18)
Quiz 4 Networking
Managed Instance Groups and Load Balancing
About this section
Managed and Unmanaged Instance Groups (10:53)
Types of Load Balancing (5:46)
Overview of HTTP(S) Load Balancing (9:20)
Forwarding Rules Target Proxy and Url Maps (8:31)
Backend Service and Backends (9:28)
Load Distribution and Firewall Rules (4:28)
Lab: HTTP(S) Load Balancing (11:21)
Lab: Content Based Load Balancing (7:06)
SSL Proxy and TCP Proxy Load Balancing (5:05)
Lab: SSL Proxy Load Balancing (7:49)
Network Load Balancing (5:07)
Internal Load Balancing (7:16)
Autoscalers (11:51)
Lab: Autoscaling with Managed Instance Groups (12:22)
Ops and Security
About this section
StackDriver (12:10)
StackDriver Logging (7:41)
Lab: Stackdriver Resource Monitoring (8:12)
Lab: Stackdriver Error Reporting and Debugging (5:51)
Cloud Deployment Manager (6:07)
Lab: Using Deployment Manager (5:10)
Lab: Deployment Manager and Stackdriver (8:26)
Cloud Endpoints (3:49)
Cloud IAM: User accounts, Service accounts, API Credentials (9:03)
Cloud IAM: Roles, Identity-Aware Proxy, Best Practices (9:31)
Data Protection (12:04)
Lab: Cloud IAM (11:57)
Quiz 5: Operations and Security
Appendix: Hadoop Ecosystem
Introducing the Hadoop Ecosystem (1:35)
Hadoop (9:45)
HDFS (10:55)
MapReduce (10:34)
Yarn (5:29)
Hive (7:19)
Hive v RDBMS (7:10)
HQL vs. SQL (7:38)
OLAP in Hive (7:36)
Windowing Hive (8:22)
Pig (8:04)
More Pig (6:38)
Spark (8:56)
More Spark (11:45)
Streams Intro (7:44)
Microbatches (5:42)
Window Types (5:48)
Quiz 6: Hadoop Ecosystem
Lab: Taxicab Prediction - Setting up the dataset
Lesson content locked
If you're already enrolled,
you'll need to login
.
Enroll in Course to Unlock