Packages

t

ai.h2o.sparkling.backend.utils

SharedBackendUtils

trait SharedBackendUtils extends Logging with Serializable

Shared functions which can be used by both backends

Linear Supertypes
Logging, Serializable, Serializable, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SharedBackendUtils
  2. Logging
  3. Serializable
  4. Serializable
  5. Logging
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. def checkAndUpdateConf(conf: H2OConf): H2OConf

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    This method checks the environments for generic configuration which does not depend on particular backend used In order to check the configuration for specific backend, method checkAndUpdateConf on particular backend has to be called.

    This method has to be called at the start of each method which override this one

    conf

    H2O Configuration to check

    returns

    checked and updated configuration

  2. def createTempDir(): File
  3. def distributeFiles(conf: H2OConf, sc: SparkContext): Unit
  4. def getExtraHttpHeaderArgs(conf: H2OConf): Seq[String]
  5. def getH2OCommonArgs(conf: H2OConf): Seq[String]

    Get H2O arguments which are passed to every node - regular node, client node

    Get H2O arguments which are passed to every node - regular node, client node

    conf

    H2O Configuration

    returns

    sequence of arguments

  6. def getH2OSecurityArgs(conf: H2OConf): Seq[String]
  7. def getH2OWorkerAsClientArgs(conf: H2OConf): Seq[String]
  8. def getHostname(env: SparkEnv): String

    Return hostname of this node based on SparkEnv

    Return hostname of this node based on SparkEnv

    env

    SparkEnv instance

    returns

    hostname of the node

  9. def parseStringToHttpHeaderArgs(headers: String): Seq[String]
  10. def saveFlatFileAsFile(content: String): File
  11. def toH2OArgs(h2oArgs: Seq[String], executors: Array[NodeDesc] = Array()): Array[String]