Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Apache Spark with Scala - Hands On with Big Data
Getting Started
Introduction, and Getting Set Up
Create a Histogram of Real Movie Ratings with Spark!
Scala Crash Course
Scala Basics, Part 1
Scala Basics, Part 2
Flow Control in Scala
Functions in Scala
Data Structures in Scala
Spark Basics and Simple Examples
Introduction to Spark
The Resilient Distributed Dataset
Ratings Histogram Walkthrough
Spark Internals
Key / Value RDD's, and the Average Friends by Age example
Running the Average Friends by Age Example
Filtering RDD's, and the Minimum Temperature by Location Example
Running the Minimum Temperature Example, and Modifying it for Maximum
Counting Word Occurrences using Flatmap()
Improving the Word Count Script with Regular Expressions
Sorting the Word Count Results
Find the Total Amount Spent by Customer
Check your Results, and Sort Them by Total Amount Spent
Check Your Results and Implementation Against Mine
Advanced Examples of Spark Programs
Find the Most Popular Movie
Use Broadcast Variables to Display Movie Names
Find the Most Popular Superhero in a Social Graph
Superhero Degrees of Separation: Introducing Breadth-First Search
Superhero Degrees of Separation: Accumulators, and Implementing BFS in Spark
Superhero Degrees of Separation: Review the code, and run it!
Item-Based Collaborative Filtering in Spark, cache(), and persist()
Running the Similar Movies Script using Spark's Cluster Manager
Improve the Quality of Similar Movies
Running Spark on a Cluster
Using spark-submit to run Spark driver scripts
Packaging driver scripts with SBT
Introducing Amazon Elastic MapReduce
Creating Similar Movies from One Million Ratings on EMR
Partitioning
Best Practices for Running on a Cluster
Troubleshooting, and Managing Dependencies
SparkSQL, DataFrames, and DataSets
Introduction to SparkSQL
Using SparkSQL
Using DataFrames and DataSets
Using DataSets instead of RDD's
Machine Learning with MLLib
Introducing MLLib
If you have trouble running the following activity...
Using MLLib to Produce Movie Recommendations
Linear Regression with MLLib
Using DataFrames with MLLib
Intro to Spark Streaming
Spark Streaming Overview
Set up a Twitter Developer Account, and Stream Tweets
Structured Streaming
Intro to GraphX
GraphX, Pregel, and Breadth-First-Search with Pregel.
Superhero Degrees of Separation using GraphX
You Made It! Where to Go from Here.
Learning More, and Career Tips
Introduction, and Getting Set Up
Download
winutils.exe
spark-install.pdf
Complete and Continue