Check Spark and H2O environment, update it if necessary and and warn about possible problems.
Check Spark and H2O environment, update it if necessary and and warn about possible problems.
This method checks the environments for generic configuration which does not depend on particular backend used In order to check the configuration for specific backend, method checkAndUpdateConf on particular backend has to be called.
This method has to be called at the start of each method which override this one
H2O Configuration to check
checked and updated configuration
Get H2O arguments which are passed to every node - regular node, client node
Get H2O arguments which are passed to every node - regular node, client node
H2O Configuration
sequence of arguments
Return hostname of this node based on SparkEnv
Return hostname of this node based on SparkEnv
SparkEnv instance
hostname of the node
This method should be used whenever the Frame needs to be updated.
This method should be used whenever the Frame needs to be updated. This method ensures to use proper locking mechanism.
H2O Frame Type
frame to update
function to run on the frame
returns the updated frame
All helper methods which are used when H2O client is running on Spark driver This class should be removed after we remove H2O client from Scala as well