object ExternalH2OBackend extends SharedBackendUtils
- Alphabetic
- By Inheritance
- ExternalH2OBackend
- SharedBackendUtils
- Logging
- Serializable
- Serializable
- Logging
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
- val ENV_H2O_DRIVER_JAR: String
- val H2O_JOB_NAME: String
- val TAG_EXTERNAL_H2O: String
- val TAG_SPARK_APP: String
-
def
checkAndUpdateConf(conf: H2OConf): H2OConf
Check Spark and H2O environment, update it if necessary and and warn about possible problems.
Check Spark and H2O environment, update it if necessary and and warn about possible problems.
This method checks the environments for generic configuration which does not depend on particular backend used In order to check the configuration for specific backend, method checkAndUpdateConf on particular backend has to be called.
This method has to be called at the start of each method which override this one
- conf
H2O Configuration to check
- returns
checked and updated configuration
- Definition Classes
- ExternalH2OBackend → SharedBackendUtils
-
def
createTempDir(): File
- Definition Classes
- SharedBackendUtils
-
def
distributeFiles(conf: H2OConf, sc: SparkContext): Unit
- Definition Classes
- SharedBackendUtils
-
def
getExtraHttpHeaderArgs(conf: H2OConf): Seq[String]
- Definition Classes
- SharedBackendUtils
-
def
getH2OCommonArgs(conf: H2OConf): Seq[String]
Get H2O arguments which are passed to every node - regular node, client node
Get H2O arguments which are passed to every node - regular node, client node
- conf
H2O Configuration
- returns
sequence of arguments
- Definition Classes
- SharedBackendUtils
-
def
getH2OSecurityArgs(conf: H2OConf): Seq[String]
- Definition Classes
- SharedBackendUtils
-
def
getH2OWorkerAsClientArgs(conf: H2OConf): Seq[String]
- Definition Classes
- SharedBackendUtils
-
def
getHostname(env: SparkEnv): String
Return hostname of this node based on SparkEnv
Return hostname of this node based on SparkEnv
- env
SparkEnv instance
- returns
hostname of the node
- Definition Classes
- SharedBackendUtils
-
def
parseStringToHttpHeaderArgs(headers: String): Seq[String]
- Definition Classes
- SharedBackendUtils
-
def
saveFlatFileAsFile(content: String): File
- Definition Classes
- SharedBackendUtils
-
def
toH2OArgs(h2oArgs: Seq[String], executors: Array[NodeDesc] = Array()): Array[String]
- Definition Classes
- SharedBackendUtils