object H2OClientUtils extends SharedBackendUtils
All helper methods which are used when H2O client is running on Spark driver This class should be removed after we remove H2O client from Scala as well
- Alphabetic
- By Inheritance
- H2OClientUtils
- SharedBackendUtils
- Logging
- Serializable
- Serializable
- Logging
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
- val PROP_REST_API_BASED_CLIENT: (String, Boolean)
-
def
checkAndUpdateConf(conf: H2OConf): H2OConf
Check Spark and H2O environment, update it if necessary and and warn about possible problems.
Check Spark and H2O environment, update it if necessary and and warn about possible problems.
This method checks the environments for generic configuration which does not depend on particular backend used In order to check the configuration for specific backend, method checkAndUpdateConf on particular backend has to be called.
This method has to be called at the start of each method which override this one
- conf
H2O Configuration to check
- returns
checked and updated configuration
- Definition Classes
- SharedBackendUtils
-
def
createTempDir(): File
- Definition Classes
- SharedBackendUtils
-
def
distributeFiles(conf: H2OConf, sc: SparkContext): Unit
- Definition Classes
- SharedBackendUtils
- def getExtraExternalBackendArgsWhenClientBased(conf: H2OConf): Seq[String]
-
def
getExtraHttpHeaderArgs(conf: H2OConf): Seq[String]
- Definition Classes
- SharedBackendUtils
-
def
getH2OCommonArgs(conf: H2OConf): Seq[String]
Get H2O arguments which are passed to every node - regular node, client node
Get H2O arguments which are passed to every node - regular node, client node
- conf
H2O Configuration
- returns
sequence of arguments
- Definition Classes
- SharedBackendUtils
- def getH2OCommonArgsWhenClientBased(conf: H2OConf): Seq[String]
-
def
getH2OSecurityArgs(conf: H2OConf): Seq[String]
- Definition Classes
- SharedBackendUtils
-
def
getH2OWorkerAsClientArgs(conf: H2OConf): Seq[String]
- Definition Classes
- SharedBackendUtils
-
def
getHostname(env: SparkEnv): String
Return hostname of this node based on SparkEnv
Return hostname of this node based on SparkEnv
- env
SparkEnv instance
- returns
hostname of the node
- Definition Classes
- SharedBackendUtils
- def isH2OClientBased(conf: H2OConf): Boolean
-
def
parseStringToHttpHeaderArgs(headers: String): Seq[String]
- Definition Classes
- SharedBackendUtils
-
def
saveFlatFileAsFile(content: String): File
- Definition Classes
- SharedBackendUtils
- def startH2OClient(hc: H2OContext, conf: H2OConf, nodes: Array[NodeDesc]): NodeDesc
-
def
toH2OArgs(h2oArgs: Seq[String], executors: Array[NodeDesc] = Array()): Array[String]
- Definition Classes
- SharedBackendUtils
-
def
withLockAndUpdate[T <: Frame](fr: T)(f: (T) ⇒ Any): T
This method should be used whenever the Frame needs to be updated.
This method should be used whenever the Frame needs to be updated. This method ensures to use proper locking mechanism.
- T
H2O Frame Type
- fr
frame to update
- f
function to run on the frame
- returns
returns the updated frame