Change Log¶

v2.3.8 (2018-06-18)¶

Bug
- SW-842 - Enforce system level properties in SW
Improvement
- SW-845 - Upgrade H2O to 3.18.0.10
- SW-847 - Remove GA from Sparkling Water

Bug
- SW-836 - Add support for converting empty dataframe/RDD in Python and Scala to H2OFrame
- SW-841 - Remove withCustomCommitsState in pipelines as it's now duplicating Github
- SW-843 - Fix data obtaining for mojo pipeline
- SW-844 - Upgrade Mojo pipeline to 0.9.9

Bug
- SW-817 - Enable running MOJO spark pipeline without H2O init
- SW-825 - Local creation of Sparkling Water does not work anymore.
- SW-831 - Check shape of H2O frame after the conversion from Spark frame
- SW-834 - External Backend stored sparse vector values incorrectly
Improvement
- SW-829 - Type checking in PySparkling pipelines
- SW-832 - Small refactoring in identifiers
- SW-833 - Explicitly set source and target java versions
- SW-837 - Upgrade H2O to 3.18.0.9
- SW-838 - Upgrade Mojo pipeline dependency to 0.9.8
- SW-840 - Add test checking column names and types between spark and mojo2

Bug
- SW-574 - Process steam handle and use it for connection to external h2o cluster
- SW-822 - Require correct colorama version
- SW-823 - Fix Windows starting scripts
- SW-824 - Fix NPE in mojo pipeline predictions
New Feature
- SW-827 - Change color highlight in scala cell as it is too dark
Improvement
- SW-815 - Upgrade H2O to 3.18.0.8
- SW-816 - Update Mojo2 dependency to one which is compatible with Java7
- SW-818 - Spark Pipeline imports do not work in PySparkling
- SW-819 - Add ability to convert specific columns to categoricals in Sparkling Water pipelines
- SW-820 - Sparkling Water pipelines add duplicate response column to the list of features

Bug
- SW-696 - Intermittent script test issue on external backend
- SW-726 - Mark Spark dependencies as provided on artefacts published to maven
- SW-740 - Increase timeout for conversion in pyunit test for external cluster
- SW-760 - Fix doc artefact publication
- SW-763 - Remove support for downloading H2O logs from Spark UI
- SW-766 - Fix coding style issue
- SW-769 - Fix import
- SW-770 - Fix link to Spark 2.3 in travis tests
- SW-776 - sparkling water from maven does not know the stacktrace_collector_interval option
- SW-778 - Handle nulls properly in H2OMojoModel
- SW-779 - As from Spark 2.3, use H2O ip address to show instead of spark's one
- SW-783 - Make H2OAutoML pipeline tests deterministic by setting the seed
New Feature
- SW-722 - [PySparkling] Check for correct data type as part of as_h2o_frame
Improvement
- SW-733 - Parametrize pipeline scripts to be able to specify different algorithms
- SW-746 - Log chunk layout after the conversion of data to external H2O cluster
- SW-750 - Support for Spark 2.3.0
- SW-755 - Document GBM Grid Search Pipeline Step
- SW-765 - Remove test artefacts from the sparkling-water assembly
- SW-768 - Add missing import
- SW-771 - Travis edits - no longer need the workaround for JDK7
- SW-773 - Don't use default value for output dir in external backend, it's not required
- SW-780 - Upgrade H2O to 3.18.0.5
Docs
- SW-775 - Fix link for documentation on DEVEL.md