Packages

object InternalH2OBackend extends InternalBackendUtils

Linear Supertypes
InternalBackendUtils, SharedBackendUtils, Logging, Serializable, Serializable, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. InternalH2OBackend
  2. InternalBackendUtils
  3. SharedBackendUtils
  4. Logging
  5. Serializable
  6. Serializable
  7. Logging
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. val UNSUPPORTED_SPARK_OPTIONS: Seq[(String, String)]
  2. def checkAndUpdateConf(conf: H2OConf): H2OConf

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    This method checks the environments for generic configuration which does not depend on particular backend used In order to check the configuration for specific backend, method checkAndUpdateConf on particular backend has to be called.

    This method has to be called at the start of each method which override this one

    conf

    H2O Configuration to check

    returns

    checked and updated configuration

    Definition Classes
    InternalH2OBackend → SharedBackendUtils
  3. def checkUnsupportedSparkOptions(unsupportedSparkOptions: Seq[(String, String)], conf: H2OConf): Unit
    Definition Classes
    InternalBackendUtils
  4. def createTempDir(): File
    Definition Classes
    SharedBackendUtils
  5. def distributeFiles(conf: H2OConf, sc: SparkContext): Unit
    Definition Classes
    SharedBackendUtils
  6. def getExtraHttpHeaderArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  7. def getH2OCommonArgs(conf: H2OConf): Seq[String]

    Get H2O arguments which are passed to every node - regular node, client node

    Get H2O arguments which are passed to every node - regular node, client node

    conf

    H2O Configuration

    returns

    sequence of arguments

    Definition Classes
    SharedBackendUtils
  8. def getH2OSecurityArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  9. def getH2OWorkerArgs(conf: H2OConf): Seq[String]

    Produce arguments for H2O node based on provided configuration and environment

    Produce arguments for H2O node based on provided configuration and environment

    It is expected to run on the executor machine

    returns

    array of H2O launcher command line arguments

    Definition Classes
    InternalBackendUtils
  10. def getH2OWorkerAsClientArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  11. def getHostname(env: SparkEnv): String

    Return hostname of this node based on SparkEnv

    Return hostname of this node based on SparkEnv

    env

    SparkEnv instance

    returns

    hostname of the node

    Definition Classes
    SharedBackendUtils
  12. def parseStringToHttpHeaderArgs(headers: String): Seq[String]
    Definition Classes
    SharedBackendUtils
  13. def saveFlatFileAsFile(content: String): File
    Definition Classes
    SharedBackendUtils
  14. def setSelfAddressToH2ONode(h2oArgs: Seq[String]): Unit
    Definition Classes
    InternalBackendUtils
  15. def startH2OWorker(conf: H2OConf): NodeDesc
  16. def toH2OArgs(h2oArgs: Seq[String], executors: Array[NodeDesc] = Array()): Array[String]
    Definition Classes
    SharedBackendUtils