Two new interfaces

Introduction to Spark with sparklyr in R

Richie Cotton

Data Evangelist at DataCamp

The MLlib machine learning interface

  • Feature Transformation functions named ft_
  • Machine Learning functions named ml_
Introduction to Spark with sparklyr in R

Feature transformations

$$

$$

A diagram describing cutting a numeric variable into categories.

Introduction to Spark with sparklyr in R

The Spark DataFrame interface

  • Spark DataFrame functions named sdf_
Introduction to Spark with sparklyr in R

Let's practice!

Introduction to Spark with sparklyr in R

Preparing Video For Download...