Packages

o

ai.h2o.sparkling.backend.utils

H2OClientUtils

object H2OClientUtils extends SharedBackendUtils

All helper methods which are used when H2O client is running on Spark driver This class should be removed after we remove H2O client from Scala as well

Linear Supertypes
SharedBackendUtils, Logging, Serializable, Serializable, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. H2OClientUtils
  2. SharedBackendUtils
  3. Logging
  4. Serializable
  5. Serializable
  6. Logging
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. val PROP_REST_API_BASED_CLIENT: (String, Boolean)
  2. def checkAndUpdateConf(conf: H2OConf): H2OConf

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    This method checks the environments for generic configuration which does not depend on particular backend used In order to check the configuration for specific backend, method checkAndUpdateConf on particular backend has to be called.

    This method has to be called at the start of each method which override this one

    conf

    H2O Configuration to check

    returns

    checked and updated configuration

    Definition Classes
    SharedBackendUtils
  3. def createTempDir(): File
    Definition Classes
    SharedBackendUtils
  4. def distributeFiles(conf: H2OConf, sc: SparkContext): Unit
    Definition Classes
    SharedBackendUtils
  5. def getExtraExternalBackendArgsWhenClientBased(conf: H2OConf): Seq[String]
  6. def getExtraHttpHeaderArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  7. def getH2OCommonArgs(conf: H2OConf): Seq[String]

    Get H2O arguments which are passed to every node - regular node, client node

    Get H2O arguments which are passed to every node - regular node, client node

    conf

    H2O Configuration

    returns

    sequence of arguments

    Definition Classes
    SharedBackendUtils
  8. def getH2OCommonArgsWhenClientBased(conf: H2OConf): Seq[String]
  9. def getH2OSecurityArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  10. def getH2OWorkerAsClientArgs(conf: H2OConf): Seq[String]
    Definition Classes
    SharedBackendUtils
  11. def getHostname(env: SparkEnv): String

    Return hostname of this node based on SparkEnv

    Return hostname of this node based on SparkEnv

    env

    SparkEnv instance

    returns

    hostname of the node

    Definition Classes
    SharedBackendUtils
  12. def isH2OClientBased(conf: H2OConf): Boolean
  13. def parseStringToHttpHeaderArgs(headers: String): Seq[String]
    Definition Classes
    SharedBackendUtils
  14. def saveFlatFileAsFile(content: String): File
    Definition Classes
    SharedBackendUtils
  15. def startH2OClient(hc: H2OContext, conf: H2OConf, nodes: Array[NodeDesc]): NodeDesc
  16. def toH2OArgs(h2oArgs: Seq[String], executors: Array[NodeDesc] = Array()): Array[String]
    Definition Classes
    SharedBackendUtils
  17. def withLockAndUpdate[T <: Frame](fr: T)(f: (T) ⇒ Any): T

    This method should be used whenever the Frame needs to be updated.

    This method should be used whenever the Frame needs to be updated. This method ensures to use proper locking mechanism.

    T

    H2O Frame Type

    fr

    frame to update

    f

    function to run on the frame

    returns

    returns the updated frame