Packages

object ExternalH2OBackend extends SharedBackendUtils

Linear Supertypes
SharedBackendUtils, Logging, Serializable, Serializable, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExternalH2OBackend
  2. SharedBackendUtils
  3. Logging
  4. Serializable
  5. Serializable
  6. Logging
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. val ENV_H2O_DRIVER_JAR: String
  2. val H2O_JOB_NAME: String
  3. val TAG_EXTERNAL_H2O: String
  4. val TAG_SPARK_APP: String
  5. def checkAndUpdateConf(conf: H2OConf): H2OConf

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    This method checks the environments for generic configuration which does not depend on particular backend used In order to check the configuration for specific backend, method checkAndUpdateConf on particular backend has to be called.

    This method has to be called at the start of each method which override this one

    conf

    H2O Configuration to check

    returns

    checked and updated configuration

    Definition Classes
    ExternalH2OBackendSharedBackendUtils
  6. def createTempDir(): File
    Definition Classes
    SharedBackendUtils
  7. def distributeFiles(conf: H2OConf, sc: SparkContext): Unit
    Definition Classes
    SharedBackendUtils
  8. def getExtraHttpHeaderArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  9. def getH2OCommonArgs(conf: H2OConf): Seq[String]

    Get H2O arguments which are passed to every node - regular node, client node

    Get H2O arguments which are passed to every node - regular node, client node

    conf

    H2O Configuration

    returns

    sequence of arguments

    Definition Classes
    SharedBackendUtils
  10. def getH2OSecurityArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  11. def getH2OWorkerAsClientArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  12. def getHostname(env: SparkEnv): String

    Return hostname of this node based on SparkEnv

    Return hostname of this node based on SparkEnv

    env

    SparkEnv instance

    returns

    hostname of the node

    Definition Classes
    SharedBackendUtils
  13. def parseStringToHttpHeaderArgs(headers: String): Seq[String]
    Definition Classes
    SharedBackendUtils
  14. def saveFlatFileAsFile(content: String): File
    Definition Classes
    SharedBackendUtils
  15. def toH2OArgs(h2oArgs: Seq[String], executors: Array[NodeDesc] = Array()): Array[String]
    Definition Classes
    SharedBackendUtils