Class/Object

org.apache.spark.h2o.backends.internal

InternalH2OBackend

Related Docs: object InternalH2OBackend | package internal

Permalink

class InternalH2OBackend extends SparklingBackend with InternalBackendUtils with Logging

Linear Supertypes
InternalBackendUtils, SharedBackendUtils, Serializable, Serializable, Logging, SparklingBackend, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. InternalH2OBackend
  2. InternalBackendUtils
  3. SharedBackendUtils
  4. Serializable
  5. Serializable
  6. Logging
  7. SparklingBackend
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new InternalH2OBackend(hc: H2OContext)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. val TEMP_DIR_ATTEMPTS: Int

    Permalink
    Definition Classes
    SharedBackendUtils
  5. def addIfNotNull(arg: String, value: String): Seq[String]

    Permalink
    Definition Classes
    SharedBackendUtils
  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  7. def backendUIInfo: Seq[(String, String)]

    Permalink
    Definition Classes
    InternalH2OBackendSparklingBackend
  8. def checkAndUpdateConf(conf: H2OConf): H2OConf

    Permalink

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    Check Spark and H2O environment, update it if necessary and and warn about possible problems.

    This method checks the environments for generic configuration which does not depend on particular backend used In order to check the configuration for specific backend, method checkAndUpdateConf on particular backend has to be called.

    This method has to be called at the start of each method which override this one

    conf

    H2O Configuration to check

    returns

    checked and updated configuration

    Definition Classes
    InternalH2OBackend → SharedBackendUtils → SparklingBackend
  9. def checkUnsupportedSparkOptions(unsupportedSparkOptions: Seq[(String, String)], conf: H2OConf): Unit

    Permalink
    Definition Classes
    InternalBackendUtils
  10. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. def defaultLogDir(appId: String): String

    Permalink
    Definition Classes
    SharedBackendUtils
  12. def epilog: String

    Permalink
    Definition Classes
    InternalH2OBackendSparklingBackend
  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  17. def getH2OClientArgs(conf: H2OConf): Array[String]

    Permalink

    Get common arguments for H2O client.

    Get common arguments for H2O client.

    returns

    array of H2O client arguments.

    Definition Classes
    SharedBackendUtils
  18. def getH2OCommonArgs(conf: H2OConf): Seq[String]

    Permalink

    Get H2O arguments which are passed to every node - regular node, client node

    Get H2O arguments which are passed to every node - regular node, client node

    conf

    H2O Configuration

    returns

    sequence of arguments

    Definition Classes
    SharedBackendUtils
  19. def getH2ONodeArgs(conf: H2OConf): Array[String]

    Permalink

    Produce arguments for H2O node based on provided configuration

    Produce arguments for H2O node based on provided configuration

    returns

    array of H2O launcher command line arguments

    Definition Classes
    InternalBackendUtils
  20. def getHostname(env: SparkEnv): String

    Permalink

    Return hostname of this node based on SparkEnv

    Return hostname of this node based on SparkEnv

    env

    SparkEnv instance

    returns

    hostname of the node

    Definition Classes
    SharedBackendUtils
  21. def getLoginArgs(conf: H2OConf): Seq[String]

    Permalink
    Definition Classes
    SharedBackendUtils
  22. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  23. val hc: H2OContext

    Permalink
  24. def init(): Array[NodeDesc]

    Permalink

    Initialize Sparkling H2O and start H2O cloud.

    Initialize Sparkling H2O and start H2O cloud.

    Definition Classes
    InternalH2OBackendSparklingBackend
  25. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  26. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  27. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  28. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  29. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  30. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  31. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  32. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  33. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  34. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  35. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  36. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  37. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  38. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  39. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  40. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  41. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  42. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  43. def saveAsFile(content: String): File

    Permalink
    Definition Classes
    SharedBackendUtils
  44. def startH2O(sc: SparkContext, spreadRDD: RDD[NodeDesc], numOfExecutors: Int, h2oArgs: Array[String], conf: H2OConf): Array[NodeDesc]

    Permalink

    Start H2O nodes on given executors.

    Start H2O nodes on given executors.

    sc

    Spark context

    spreadRDD

    helper RDD spread over all executors

    numOfExecutors

    number of executors in Spark cluster

    h2oArgs

    arguments passed to H2O instances

    conf

    H2O Conf

    returns

    flatfile string if flatfile mode is enabled, else None

    Definition Classes
    InternalBackendUtils
  45. def stop(stopSparkContext: Boolean): Unit

    Permalink
    Definition Classes
    InternalH2OBackendSparklingBackend
  46. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  47. def toFlatFileString(conf: H2OConf, executors: Array[NodeDesc]): String

    Permalink
    Definition Classes
    InternalBackendUtils
  48. def toH2OArgs(h2oArgs: Array[String], conf: H2OConf, executors: Array[NodeDesc]): Array[String]

    Permalink
    Definition Classes
    InternalBackendUtils
  49. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  50. def translateHostnameToIp(hostname: String): String

    Permalink
    Definition Classes
    InternalBackendUtils
  51. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  52. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  53. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from InternalBackendUtils

Inherited from SharedBackendUtils

Inherited from Serializable

Inherited from Serializable

Inherited from Logging

Inherited from SparklingBackend

Inherited from AnyRef

Inherited from Any

Ungrouped