Class/Object

org.apache.spark.h2o

H2OConf

Related Docs: object H2OConf | package h2o

Permalink

class H2OConf extends Logging with InternalBackendConf with ExternalBackendConf

Configuration holder which is representing properties passed from user to Sparkling Water.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. H2OConf
  2. ExternalBackendConf
  3. InternalBackendConf
  4. SharedBackendConf
  5. Logging
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new H2OConf(sparkSession: SparkSession)

    Permalink
  2. new H2OConf(sc: SparkContext)

    Permalink
  3. new H2OConf(jsc: JavaSparkContext)

    Permalink

    Support for creating H2OConf in Java environments

  4. new H2OConf(sparkConf: SparkConf)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def HDFSOutputDir: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  5. def YARNQueue: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  7. def backendClusterMode: String

    Permalink

    Generic parameters

    Generic parameters

    Definition Classes
    SharedBackendConf
  8. def clientBasePort: Int

    Permalink
    Definition Classes
    SharedBackendConf
  9. def clientCheckRetryTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  10. def clientConnectionTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  11. def clientIcedDir: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  12. def clientIp: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  13. def clientNetworkMask: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  14. def clientVerboseOutput: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  15. def clientWebPort: Int

    Permalink
    Definition Classes
    SharedBackendConf
  16. def clone(): H2OConf

    Permalink

    Copy this object

    Copy this object

    Definition Classes
    H2OConf → AnyRef
  17. def cloudName: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  18. def cloudTimeout: Int

    Permalink
    Definition Classes
    SharedBackendConf
  19. def clusterInfoFile: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  20. def clusterStartMode: String

    Permalink
    Definition Classes
    ExternalBackendConf
  21. def clusterStartTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  22. def contains(key: String): Boolean

    Permalink
  23. def contextPath: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  24. def defaultCloudSize: Int

    Permalink
    Definition Classes
    InternalBackendConf
  25. def drddMulFactor: Int

    Permalink
    Definition Classes
    InternalBackendConf
  26. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  27. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  28. def externalConfString: String

    Permalink
    Definition Classes
    ExternalBackendConf
  29. def externalReadConfirmationTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  30. def externalWriteConfirmationTimeout: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  31. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  32. def flowDir: Option[String]

    Permalink

    H2O Client parameters

    H2O Client parameters

    Definition Classes
    SharedBackendConf
  33. def get(key: String, defaultValue: String): String

    Permalink

    Get a parameter, falling back to a default if not set

  34. def get(key: String): String

    Permalink

    Get a parameter; throws a NoSuchElementException if it's not set

  35. def getAll: Array[(String, String)]

    Permalink

    Get all parameters as a list of pairs

  36. def getBoolean(key: String, defaultValue: Boolean): Boolean

    Permalink

    Get a parameter as a boolean, falling back to a default if not set

  37. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  38. def getDouble(key: String, defaultValue: Double): Double

    Permalink

    Get a parameter as a double, falling back to a default if not set

  39. def getInt(key: String, defaultValue: Int): Int

    Permalink

    Get a parameter as an integer, falling back to a default if not set

  40. def getLong(key: String, defaultValue: Long): Long

    Permalink

    Get a parameter as a long, falling back to a default if not set

  41. def getOption(key: String): Option[String]

    Permalink

    Get a parameter as an Option

  42. def h2oClientLogDir: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  43. def h2oClientLogLevel: String

    Permalink
    Definition Classes
    SharedBackendConf
  44. def h2oCluster: Option[String]

    Permalink

    Getters

    Getters

    Definition Classes
    ExternalBackendConf
  45. def h2oClusterHost: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  46. def h2oClusterPort: Option[Int]

    Permalink
    Definition Classes
    ExternalBackendConf
  47. def h2oDriverIf: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  48. def h2oDriverPath: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  49. def h2oNodeLogDir: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  50. def h2oNodeLogLevel: String

    Permalink
    Definition Classes
    SharedBackendConf
  51. def h2oNodeWebEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  52. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  53. def hashLogin: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  54. def healthCheckInterval: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  55. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  56. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  57. def internalConfString: String

    Permalink
    Definition Classes
    InternalBackendConf
  58. def isAutoClusterStartUsed: Boolean

    Permalink
    Definition Classes
    ExternalBackendConf
  59. def isClusterTopologyListenerEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  60. def isFailOnUnsupportedSparkParamEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  61. def isH2OReplEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  62. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  63. def isInternalSecureConnectionsEnabled: Boolean

    Permalink
    Definition Classes
    InternalBackendConf
  64. def isKillOnUnhealthyClusterEnabled: Boolean

    Permalink
    Definition Classes
    ExternalBackendConf
  65. def isManualClusterStartUsed: Boolean

    Permalink
    Definition Classes
    ExternalBackendConf
  66. def isSparkVersionCheckEnabled: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  67. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  68. def jks: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  69. def jksPass: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  70. def kerberosLogin: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  71. def killOnUnhealthyClusterInterval: Int

    Permalink
    Definition Classes
    ExternalBackendConf
  72. def ldapLogin: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  73. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  74. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  75. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  76. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  77. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  78. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  79. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  80. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  81. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  82. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  83. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  84. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  85. def loginConf: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  86. def mapperXmx: String

    Permalink
    Definition Classes
    ExternalBackendConf
  87. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  88. def nodeBasePort: Int

    Permalink
    Definition Classes
    InternalBackendConf
  89. def nodeIcedDir: Option[String]

    Permalink
    Definition Classes
    InternalBackendConf
  90. def nodeNetworkMask: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  91. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  92. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  93. def nthreads: Int

    Permalink
    Definition Classes
    SharedBackendConf
  94. def numH2OWorkers: Option[Int]

    Permalink
    Definition Classes
    InternalBackendConf
  95. def numOfExternalH2ONodes: Option[String]

    Permalink
    Definition Classes
    ExternalBackendConf
  96. def numRddRetries: Int

    Permalink
    Definition Classes
    InternalBackendConf
  97. def remove(key: String): H2OConf

    Permalink

    Remove a parameter from the configuration

  98. def runsInExternalClusterMode: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  99. def runsInInternalClusterMode: Boolean

    Permalink
    Definition Classes
    SharedBackendConf
  100. def scalaIntDefaultNum: Int

    Permalink
    Definition Classes
    SharedBackendConf
  101. def set(key: String, value: Boolean): H2OConf

    Permalink
  102. def set(key: String, value: String): H2OConf

    Permalink

    Set a configuration variable.

  103. def setAll(settings: Traversable[(String, String)]): H2OConf

    Permalink

    Set multiple parameters together

  104. def setClientCheckRetryTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  105. def setClientConnectionTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  106. def setClientIcedDir(icedDir: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  107. def setClientIp(ip: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  108. def setClientNetworkMask(mask: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  109. def setClientPortBase(basePort: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  110. def setClientVerboseDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  111. def setClientVerboseEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  112. def setCloudName(cloudName: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  113. def setCloudTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  114. def setClusterConfigFile(path: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  115. def setClusterStartTimeout(clusterStartTimeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  116. def setClusterTopologyListenerDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  117. def setClusterTopologyListenerEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  118. def setContextPath(contextPath: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  119. def setDefaultCloudSize(defaultClusterSize: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  120. def setDefaultNumReplSessions(numSessions: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  121. def setDrddMulFactor(factor: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  122. def setExternalClusterMode(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  123. def setExternalReadConfirmationTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  124. def setExternalWriteConfirmationTimeout(timeout: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  125. def setFailOnUnsupportedSparkParamDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  126. def setFailOnUnsupportedSparkParamEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  127. def setFlatFileDisabled(): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  128. def setFlatFileEnabled(): H2OConf

    Permalink

    Setters

    Setters

    Definition Classes
    InternalBackendConf
  129. def setFlowDir(dir: String): H2OConf

    Permalink

    H2O Client parameters

    H2O Client parameters

    Definition Classes
    SharedBackendConf
  130. def setH2OClientLogDir(dir: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  131. def setH2OClientLogLevel(level: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  132. def setH2OCluster(hostPort: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  133. def setH2OCluster(host: String, port: Int): H2OConf

    Permalink

    Sets node and port representing H2O Cluster to which should H2O connect when started in external mode.

    Sets node and port representing H2O Cluster to which should H2O connect when started in external mode. This method automatically sets external cluster mode

    host

    host representing the cluster

    port

    port representing the cluster

    returns

    H2O Configuration

    Definition Classes
    ExternalBackendConf
  134. def setH2ODriverIf(ip: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  135. def setH2ODriverPath(path: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  136. def setH2ONodeLogDir(dir: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  137. def setH2ONodeLogLevel(level: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  138. def setH2ONodeWebDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  139. def setH2ONodeWebEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  140. def setHDFSOutputDir(dir: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  141. def setHashLoginDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  142. def setHashLoginEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  143. def setHealthCheckInterval(interval: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  144. def setInternalClusterMode(): H2OConf

    Permalink

    Generic parameters

    Generic parameters

    Definition Classes
    SharedBackendConf
  145. def setInternalSecureConnectionsDisabled(): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  146. def setInternalSecureConnectionsEnabled(): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  147. def setJks(path: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  148. def setJksPass(password: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  149. def setKerberosLoginDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  150. def setKerberosLoginEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  151. def setKillOnUnhealthyClusterDisabled(): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  152. def setKillOnUnhealthyClusterEnabled(): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  153. def setKillOnUnhealthyClusterInterval(interval: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  154. def setLdapLoginDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  155. def setLdapLoginEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  156. def setLoginConf(file: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  157. def setMapperXmx(mem: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  158. def setNodeBasePort(port: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  159. def setNodeIcedDir(dir: String): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  160. def setNodeNetworkMask(mask: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  161. def setNthreads(numThreads: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  162. def setNumH2OWorkers(numWorkers: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  163. def setNumOfExternalH2ONodes(numOfExternalH2ONodes: Int): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  164. def setNumRddRetries(retries: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  165. def setReplDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  166. def setReplEnabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  167. def setSparkVersionCheckDisabled(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  168. def setSparkVersionCheckEnable(): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  169. def setSslConf(path: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  170. def setStacktraceCollectorInterval(interval: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  171. def setSubseqTries(subseqTriesNum: Int): H2OConf

    Permalink
    Definition Classes
    InternalBackendConf
  172. def setUiUpdateInterval(interval: Int): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  173. def setUserName(username: String): H2OConf

    Permalink
    Definition Classes
    SharedBackendConf
  174. def setYARNQueue(queueName: String): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  175. val sparkConf: SparkConf

    Permalink
  176. def sslConf: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  177. def stacktraceCollectorInterval: Int

    Permalink
    Definition Classes
    SharedBackendConf
  178. def subseqTries: Int

    Permalink
    Definition Classes
    InternalBackendConf
  179. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  180. def toString(): String

    Permalink
    Definition Classes
    H2OConf → AnyRef → Any
  181. def uiUpdateInterval: Int

    Permalink
    Definition Classes
    SharedBackendConf
  182. def useAutoClusterStart(): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  183. def useFlatFile: Boolean

    Permalink

    Getters

    Getters

    Definition Classes
    InternalBackendConf
  184. def useManualClusterStart(): H2OConf

    Permalink
    Definition Classes
    ExternalBackendConf
  185. def userName: Option[String]

    Permalink
    Definition Classes
    SharedBackendConf
  186. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  187. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  188. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from ExternalBackendConf

Inherited from InternalBackendConf

Inherited from SharedBackendConf

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped