Overview

Welcome to the H2O Sparkling Water documentation site! This document describes how to install and run Sparkling Water.

Depending on your area of interest, select a learning path from the sidebar, or look at the full content outline below. To view Sparkling Water examples, please visit the Sparkling Water GitHub repository at https://github.com/h2oai/sparkling-water/tree/master/examples.

Have questions about Sparkling Water? Post them on Stack Overflow using the sparkling-water tag, or join the chat on Gitter.

Contents

• About Sparkling Water
• Typical Use Case
• Sparkling Water Requirements
• Installing and Starting
  • Download and Run Locally
  • Run on Hadoop
  • Run on a Standalone Cluster
  • Kluster Mode
  • Use from Maven
  • Sparkling Water as a Spark Package
• Design
  • Supported Platforms
  • Supported Data Sources
  • Supported Data Formats
  • Provided Primitives
  • Spark - H2O Frame Mapping
  • Data Sharing
• Configuration
  • Sparkling Water Configuration Properties
  • Memory Allocation
  • Sparkling Water Tuning
  • Enforce System-Level Command Line Arguments in External Backend on YARN
• Deployment
  • Sparkling Water Backends
  • Importing H2O MOJOs
  • Deploying PySparkling Pipeline Models
  • Using the MOJO Scoring Pipeline with Spark/Sparkling Water
  • Use Sparkling Water with Amazon EMR
  • Use Sparkling Water with Amazon EMR from the Edge Node
  • Start Sparkling Water on Amazon EMR using our Terraform Template
  • Running Sparkling Water in Kubernetes
  • Running Sparkling Water on Databricks Azure Cluster
  • Running RSparkling on Databricks Azure Cluster
  • Running PySparkling on Databricks Azure Cluster
  • Download H2O Logs from Databricks Cloud
  • Running Sparkling Water on Google Cloud Dataproc
  • Using Sparkling Water with Microsoft Azure HDInsight - Beta
  • Use Sparkling Water in Windows Environments
  • Use RSparkling in Windows Environments
  • Sparkling Water and Zeppelin
• How to…
  • Calling H2O Algorithms
  • Running Sparkling Water
  • Changing the Default Port
  • Hive Support in Sparkling Water
  • Enabling SSL
  • Enabling LDAP
  • Enabling Kerberos Authentication
  • Running Sparkling Water on Kerberized Hadoop Cluster
  • Using SSL to secure H2O Flow
  • Spark Frame <–> H2O Frame Conversions
  • H2O Frame as Spark’s Data Source
  • Creating H2OFrame from an Existing Key
  • Import & Export H2O Frames from/to S3
  • Train XGBoost Model in Sparkling Water
  • Train AutoML Model in Sparkling Water
  • Train KMeans Model in Sparkling Water
  • Target Encoding in Sparkling Water
  • Train DRF Model in Sparkling Water
  • Obtain SHAP values from MOJO model
  • Using Grid Search GBM in Spark Pipelines
  • Change Sparkling Shell Logging Level
  • Change Sparkling Shell Logs Location
  • Obtain Sparkling Water Logs
  • Use Sparkling Water via Spark Packages
• Development
  • Build Sparkling Water
  • Changing Scala Version
  • Building Against Custom H2O
  • Integration Tests
  • Running Sparkling Water Examples
  • Running Unit Tests
  • Sparkling Water REST API
• PySparkling
  • What is H2O?
  • What is Spark?
  • What is Sparkling Water?
  • What is PySparkling?
  • PySparkling and Spark Version
  • Dependencies
  • The Sparkling Water Python Module
• RSparkling
  • Installation of SparklyR & Spark
  • Install H2O
  • Install RSparkling
  • Enable RSparkling
  • Starting Spark
  • Using RSparkling
  • Machine Learning with RSparkling & H2O
  • Additional Resources
• Migration Guide
  • From 3.30 to 3.32
  • From 3.28.1 to 3.30
  • From 3.28.0 to 3.28.1
  • From 3.26 To 3.28.0
  • From any previous version to 3.26.11
• Frequently Asked Questions
• Change Log
  • v3.28.1.2-1 (2020-03-19)
  • v3.28.1.1-1 (2020-03-06)
  • v3.28.0.4-1 (2020-02-25)
  • v3.28.0.3-1 (2020-02-06)
  • v3.28.0.2-1 (2020-01-23)
  • v3.28.0.1-1 (2019-12-19)
  • v3.26.11 (2019-12-06)
  • v3.26.10 (2019-11-07)
  • v3.26.9 (2019-10-31)
  • v3.26.8 (2019-10-18)
  • v3.26.7 (2019-10-11)
  • v3.26.6 (2019-10-02)
  • v3.26.5 (2019-09-16)
  • v3.26.3 (2019-08-28)
  • v3.26.2 (2019-07-30)
  • v2.1.56, v2.2.42, v2.3.31, v2.4.13 (2019-06-24)
  • v2.1.55, v2.2.41, v2.3.30, v2.4.12 (2019-06-03)
  • v2.1.54, v2.2.40, v2.3.29, v2.4.11 (2019-05-17)
  • v2.1.53, v2.2.39, v2.3.28, v2.4.10 (2019-04-26)
  • v2.1.52, v2.2.38, v2.3.27, v2.4.9 (2019-04-03)
  • v2.1.51, v2.2.37, v2.3.26, v2.4.8 (2019-03-15)
  • v2.1.50, v2.2.36, v2.3.25, v2.4.7 (2019-03-07)
  • v2.1.49, v2.2.35, v2.3.24, v2.4.6 (2019-02-18)
  • v2.1.48, v2.2.34, v2.3.23, v2.4.5 (2019-01-29)
  • v2.1.47, v2.2.33, v2.3.22, v2.4.4 (2019-01-21)
  • v2.1.46, v2.2.32, v2.3.21, v2.4.3 (2019-01-17)
  • v2.1.45, v2.2.31, v2.3.20, v2.4.2 (2019-01-08)
  • v2.1.44, v2.2.30, v2.3.19, v2.4.1 (2018-12-27)
  • v2.1.43, v2.2.29, v2.3.18 (2018-11-27)
  • v2.1.42, v2.2.28, v2.3.17 (2018-10-27)
  • v2.1.41, v2.2.27, v2.3.16 (2018-10-17)
  • v2.1.40, v2.2.26, v2.3.15 (2018-10-02)
  • v2.1.39, v2.2.25, v2.3.14 (2018-09-24)
  • v2.1.38, v2.2.24, v2.3.13 (2018-09-14)
  • v2.1.37, v2.2.23, v2.3.12 (2018-08-28)
  • v2.1.36, v2.2.22, v2.3.11 (2018-08-09)
  • v2.1.35, v2.2.21, v2.3.10 (2018-08-01)
  • v2.1.34, v2.2.20, v2.3.9 (2018-07-16)
  • v2.1.33, v2.2.19, v2.3.8 (2018-06-18)
  • v2.1.32, v2.2.18, v2.3.7 (2018-06-18)
  • v2.1.31, v2.2.17, v2.3.6 (2018-06-13)
  • v2.1.30, v2.2.16, v2.3.5 (2018-05-23)
  • v2.1.29, v2.2.15, v2.3.4 (2018-05-18)
  • v2.1.28, v2.2.14, v2.3.3 (2018-05-15)
  • v2.1.27, v2.2.13, v2.3.2 (2018-05-02)
  • v2.1.26, v2.2.12, v2.3.1 (2018-04-19)
  • v2.1.25, v2.2.11, v2.3.0 (2018-03-29)
  • v2.1.24, v2.2.10 (2018-03-08)
  • v2.1.23, v2.2.9 (2018-02-26)
  • v2.1.22, v2.2.8 (2018-02-14)
  • v2.1.21, v2.2.7 (2018-01-18)
  • v2.1.20, v2.2.6 (2018-01-03)
  • v2.1.19, v2.2.5 (2017-12-11)
  • v2.1.18, v2.2.4 (2017-12-01)
  • v2.1.17, v2.2.3 (2017-11-25)
  • v2.1.16, v2.2.2 (2017-10-23)
  • v2.1.15, v2.2.1 (2017-10-10)
  • v2.1.14, v2.2.0 (2017-08-23)
  • v2.1.13 (2017-08-02)
  • v2.1.12 (2017-07-17)
  • v2.1.11 (2017-07-12)
  • v2.1.10 (2017-06-29)
  • v2.1.9 (2017-06-15)
  • v2.1.8 (2017-05-25)
  • v2.1.7 (2017-05-10)
  • v2.1.6 (2017-05-09)
  • v2.1.5 (2017-04-27)
  • v2.1.4 (2017-04-20)
  • v2.1.3 (2017-04-7)
  • v2.1.2 (2017-03-20)
  • v2.1.1 (2017-03-18)
  • v2.1.0 (2017-03-02)