Class/Object

org.apache.spark.h2o

H2OConf

Related Docs: object H2OConf | package h2o

Permalink

class H2OConf extends Logging with InternalBackendConf with ExternalBackendConf

Configuration holder which is representing properties passed from user to Sparkling Water.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. H2OConf
  2. ExternalBackendConf
  3. InternalBackendConf
  4. SharedBackendConf
  5. Logging
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new H2OConf(sparkSession: SparkSession)

    Permalink
  2. new H2OConf(sc: SparkContext)

    Permalink
  3. new H2OConf(jsc: JavaSparkContext)

    Permalink

    Support for creating H2OConf in Java environments

  4. new H2OConf(sparkConf: SparkConf)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def HDFSOutputDir: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  5. def YARNQueue: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  7. def backendClusterMode: String

    Permalink

    Generic parameters

    Generic parameters

    Definition Classes
    SharedBackendConf
  8. def clientBasePort: Int

    Permalink
    Definition Classes
    SharedBackendConf
  9. def clientCheckRetryTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  10. def clientConnectionTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  11. def clientIcedDir: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  12. def clientIp: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  13. def clientNetworkMask: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  14. def clientVerboseOutput: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  15. def clientWebPort: Int

    Permalink
    Definition Classes
    SharedBackendConf
  16. def clone(): H2OConf

    Permalink

    Copy this object

    Copy this object

    Definition Classes
    H2OConf → AnyRef
  17. def cloudName: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  18. def cloudTimeout: Int

    Permalink
    Definition Classes
    SharedBackendConf
  19. def clusterInfoFile: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  20. def clusterStartMode: String

    Permalink
    Definition Classes
    ExternalBackendConf
  21. def clusterStartTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  22. def contains(key: String): Boolean

    Permalink
  23. def defaultCloudSize: Int

    Permalink
    Definition Classes
    InternalBackendConf
  24. def disableGA: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  25. def drddMulFactor: Int

    Permalink
    Definition Classes
    InternalBackendConf
  26. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  27. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  28. def externalConfString: String

    Permalink
    Definition Classes
    ExternalBackendConf
  29. def externalReadConfirmationTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  30. def externalWriteConfirmationTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  31. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  32. def flowDir: Option[String]

    Permalink

    H2O Client parameters

    H2O Client parameters

    Definition Classes
    SharedBackendConf
  33. def get(key: String, defaultValue: String): String

    Permalink

    Get a parameter, falling back to a default if not set

  34. def get(key: String): String

    Permalink

    Get a parameter; throws a NoSuchElementException if it's not set

  35. def getAll: Array[(String, String)]

    Permalink

    Get all parameters as a list of pairs

  36. def getBoolean(key: String, defaultValue: Boolean): Boolean

    Permalink

    Get a parameter as a boolean, falling back to a default if not set

  37. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  38. def getDouble(key: String, defaultValue: Double): Double

    Permalink

    Get a parameter as a double, falling back to a default if not set

  39. def getInt(key: String, defaultValue: Int): Int

    Permalink

    Get a parameter as an integer, falling back to a default if not set

  40. def getLong(key: String, defaultValue: Long): Long

    Permalink

    Get a parameter as a long, falling back to a default if not set

  41. def getOption(key: String): Option[String]

    Permalink

    Get a parameter as an Option

  42. def h2oClientLogDir: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  43. def h2oClientLogLevel: String

    Permalink
    Definition Classes
    SharedBackendConf
  44. def h2oCluster: Option[String]

    Permalink

    Getters

    Getters

    Definition Classes
    ExternalBackendConf
  45. def h2oClusterHost: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  46. def h2oClusterPort: Option[Int]

    Permalink
    Definition Classes
    ExternalBackendConf
  47. def h2oDriverPath: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  48. def h2oNodeLogDir: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  49. def h2oNodeLogLevel: String

    Permalink
    Definition Classes
    SharedBackendConf
  50. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  51. def hashLogin: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  52. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  53. def internalConfString: String

    Permalink
    Definition Classes
    InternalBackendConf
  54. def isAutoClusterStartUsed: Boolean

    Permalink
    Definition Classes
    ExternalBackendConf
  55. def isClusterTopologyListenerEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  56. def isFailOnUnsupportedSparkParamEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  57. def isH2OReplEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  58. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  59. def isManualClusterStartUsed: Boolean

    Permalink
    Definition Classes
    ExternalBackendConf
  60. def isSparkVersionCheckEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  61. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  62. def jks: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  63. def jksPass: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  64. def kerberosLogin: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  65. def ldapLogin: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  66. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  67. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  68. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  69. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  70. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  71. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  72. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  73. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  74. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  75. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  76. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  77. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  78. def loginConf: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  79. def mapperXmx: String

    Permalink
    Definition Classes
    ExternalBackendConf
  80. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  81. def nodeBasePort: Int

    Permalink
    Definition Classes
    InternalBackendConf
  82. def nodeIcedDir: Option[String]

    Permalink
    Definition Classes
    InternalBackendConf
  83. def nodeNetworkMask: Option[String]

    Permalink
    Definition Classes
    InternalBackendConf
  84. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  85. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  86. def nthreads: Int

    Permalink
    Definition Classes
    SharedBackendConf
  87. def numH2OWorkers: Option[Int]

    Permalink
    Definition Classes
    InternalBackendConf
  88. def numOfExternalH2ONodes: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  89. def numRddRetries: Int

    Permalink
    Definition Classes
    InternalBackendConf
  90. def remove(key: String): H2OConf

    Permalink

    Remove a parameter from the configuration

  91. def runsInExternalClusterMode: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  92. def runsInInternalClusterMode: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  93. def scalaIntDefaultNum: Int

    Permalink
    Definition Classes
    SharedBackendConf
  94. def set(key: String, value: String): H2OConf

    Permalink

    Set a configuration variable.

  95. def setAll(settings: Traversable[(String, String)]): H2OConf

    Permalink

    Set multiple parameters together

  96. def setClientCheckRetryTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  97. def setClientConnectionTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  98. def setClientIcedDir(icedDir: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  99. def setClientIp(ip: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  100. def setClientNetworkMask(mask: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  101. def setClientPortBase(basePort: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  102. def setClientVerboseDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  103. def setClientVerboseEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  104. def setCloudName(cloudName: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  105. def setCloudTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  106. def setClusterConfigFile(path: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  107. def setClusterStartTimeout(clusterStartTimeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  108. def setClusterTopologyListenerDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  109. def setClusterTopologyListenerEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  110. def setDefaultCloudSize(defaultClusterSize: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  111. def setDefaultNumReplSessions(numSessions: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  112. def setDrddMulFactor(factor: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  113. def setExternalClusterMode(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  114. def setExternalReadConfirmationTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  115. def setExternalWriteConfirmationTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  116. def setFailOnUnsupportedSparkParamDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  117. def setFailOnUnsupportedSparkParamEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  118. def setFlatFileDisabled(): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  119. def setFlatFileEnabled(): H2OConf

    Permalink

    Setters

    Setters

    Definition Classes
    InternalBackendConf
  120. def setFlowDir(dir: String): H2OConf

    Permalink

    H2O Client parameters

    H2O Client parameters

    Definition Classes
    SharedBackendConf
  121. def setGADisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  122. def setGAEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  123. def setH2OClientLogDir(dir: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  124. def setH2OClientLogLevel(level: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  125. def setH2OCluster(hostPort: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  126. def setH2OCluster(host: String, port: Int): H2OConf

    Permalink

    Sets node and port representing H2O Cluster to which should H2O connect when started in external mode.

    Sets node and port representing H2O Cluster to which should H2O connect when started in external mode. This method automatically sets external cluster mode

    host

    host representing the cluster

    port

    port representing the cluster

    returns

    H2O Configuration

    Definition Classes
    ExternalBackendConf
  127. def setH2ODriverPath(path: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  128. def setH2ONodeLogDir(dir: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  129. def setH2ONodeLogLevel(level: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  130. def setHDFSOutputDir(dir: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  131. def setHashLoginDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  132. def setHashLoginEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  133. def setInternalClusterMode(): H2OConf

    Permalink

    Generic parameters

    Generic parameters

    Definition Classes
    SharedBackendConf
  134. def setJks(path: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  135. def setJksPass(password: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  136. def setKerberosLoginDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  137. def setKerberosLoginEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  138. def setLdapLoginDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  139. def setLdapLoginEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  140. def setLoginConf(file: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  141. def setMapperXmx(mem: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  142. def setNodeBasePort(port: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  143. def setNodeIcedDir(dir: String): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  144. def setNodeNetworkMask(mask: String): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  145. def setNthreads(numThreads: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  146. def setNumH2OWorkers(numWorkers: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  147. def setNumOfExternalH2ONodes(numOfExternalH2ONodes: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  148. def setNumRddRetries(retries: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  149. def setReplDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  150. def setReplEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  151. def setSparkVersionCheckDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  152. def setSparkVersionCheckEnable(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  153. def setSslConf(path: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  154. def setSubseqTries(subseqTriesNum: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  155. def setUiUpdateInterval(interval: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  156. def setUserName(username: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  157. def setYARNQueue(queueName: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  158. val sparkConf: SparkConf

    Permalink
  159. def sslConf: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  160. def subseqTries: Int

    Permalink
    Definition Classes
    InternalBackendConf
  161. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  162. def toString(): String

    Permalink
    Definition Classes
    H2OConf → AnyRef → Any
  163. def uiUpdateInterval: Int

    Permalink
    Definition Classes
    SharedBackendConf
  164. def useAutoClusterStart(): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  165. def useFlatFile: Boolean

    Permalink

    Getters

    Getters

    Definition Classes
    InternalBackendConf
  166. def useManualClusterStart(): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  167. def userName: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  168. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  169. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  170. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from ExternalBackendConf

Inherited from InternalBackendConf

Inherited from SharedBackendConf

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped