Packages

class H2OContext extends H2OContextExtensions

Create new H2OContext based on provided H2O configuration

Self Type
H2OContext
Linear Supertypes
H2OContextExtensions, K8sExternalBackendClient, K8sH2OStatefulSet, K8sHeadlessService, K8sUtils, ShellUtils, RestApiUtils, RestCommunication, RestEncodingUtils, Logging, Serializable, Serializable, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. H2OContext
  2. H2OContextExtensions
  3. K8sExternalBackendClient
  4. K8sH2OStatefulSet
  5. K8sHeadlessService
  6. K8sUtils
  7. ShellUtils
  8. RestApiUtils
  9. RestCommunication
  10. RestEncodingUtils
  11. Logging
  12. Serializable
  13. Serializable
  14. Logging
  15. AnyRef
  16. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def asH2OFrame(s: String): H2OFrame

    Create a new H2OFrame based on existing Frame referenced by its id.

  5. def asH2OFrame(ds: SupportedDataset, frameName: Option[String]): H2OFrame
  6. def asH2OFrame(ds: SupportedDataset, frameName: String): H2OFrame
  7. def asH2OFrame(ds: SupportedDataset): H2OFrame

    Transforms Dataset[Supported type] to H2OFrame

  8. def asH2OFrame(df: DataFrame, frameName: Option[String]): H2OFrame
  9. def asH2OFrame(df: DataFrame, frameName: String): H2OFrame
  10. def asH2OFrame(df: DataFrame): H2OFrame

    Transform DataFrame to H2OFrame

  11. def asH2OFrame(rdd: SupportedRDD, frameName: Option[String]): H2OFrame
  12. def asH2OFrame(rdd: SupportedRDD, frameName: String): H2OFrame
  13. def asH2OFrame(rdd: SupportedRDD): H2OFrame

    Transforms RDD[Supported type] to H2OFrame

  14. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  15. def asRDD[A <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A], arg1: ClassTag[A]): AnyRef { def apply(fr: ai.h2o.sparkling.H2OFrame): org.apache.spark.rdd.RDD[A] }

    A generic convert of Frame into Product RDD type

    A generic convert of Frame into Product RDD type

    Consider using asH2OFrame since asRDD has several limitations such as that asRDD can't be used in Spark REPL in case we are RDD[T] where T is class defined in REPL. This is because class T is created as inner class and we are not able to create instance of class T without outer scope - which is impossible to get.

    This code: hc.asRDD[PUBDEV458Type](rdd) will need to be call as hc.asRDD[PUBDEV458Type].apply(rdd)

  16. def asRDD[A <: Product](fr: H2OFrame)(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A], arg1: ClassTag[A]): RDD[A]

    Convert given H2O frame into a Product RDD type

    Convert given H2O frame into a Product RDD type

    Consider using asH2OFrame since asRDD has several limitations such as that asRDD can't be used in Spark REPL in case we are RDD[T] where T is class defined in REPL. This is because class T is created as inner class and we are not able to create instance of class T without outer scope - which is impossible to get.

  17. def asSparkFrame(s: String): DataFrame
  18. def asSparkFrame(s: String, copyMetadata: Boolean): DataFrame
  19. def asSparkFrame(fr: H2OFrame, copyMetadata: Boolean = true): DataFrame
  20. val backend: SparklingBackend

    Used backend

    Used backend

    Attributes
    protected
  21. def checkResponseCode(connection: HttpURLConnection, confirmationLoggingLevel: LoggingLevel = Info): Unit
    Definition Classes
    RestCommunication
  22. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  23. def collectPropertiesDoc(): Map[String, String]
    Attributes
    protected
    Definition Classes
    H2OContextExtensions
  24. def convertLabel(label: String): String
    Attributes
    protected
    Definition Classes
    K8sUtils
  25. def delete(endpoint: URI, suffix: String, conf: H2OConf): Unit

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    Attributes
    protected
    Definition Classes
    RestCommunication
  26. def delete[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false)(implicit arg0: ClassTag[ResultType]): ResultType

    ResultType

    A type that the result will be deserialized to

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    skippedFields

    The list of field specifications that are skipped during deserialization. The specification consists of the class containing the field and the field name.

    returns

    A deserialized object

    Definition Classes
    RestCommunication
  27. def deleteH2OHeadlessService(client: KubernetesClient, conf: H2OConf): Unit
    Attributes
    protected
    Definition Classes
    K8sHeadlessService
  28. def deleteH2OStatefulSet(client: KubernetesClient, conf: H2OConf): Unit
    Attributes
    protected
    Definition Classes
    K8sH2OStatefulSet
  29. def downloadBinaryURLContent(endpoint: URI, suffix: String, conf: H2OConf, file: File): Unit
    Attributes
    protected
    Definition Classes
    RestCommunication
  30. def downloadH2OLogs(destinationDir: String, logContainer: String): String
    Definition Classes
    H2OContextExtensions
  31. def downloadStringURLContent(endpoint: URI, suffix: String, conf: H2OConf, file: File): Unit
    Attributes
    protected
    Definition Classes
    RestCommunication
  32. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  33. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  34. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  35. def flowURL(): String
  36. def getAndVerifyWorkerNodes(conf: H2OConf): Array[NodeDesc]
    Attributes
    protected
    Definition Classes
    H2OContextExtensions
  37. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  38. def getClusterEndpoint(conf: H2OConf): URI
    Definition Classes
    RestApiUtils
  39. def getClusterInfo(conf: H2OConf): CloudV3
    Definition Classes
    RestApiUtils
  40. def getConf: H2OConf

    Return a copy of this H2OContext's configuration.

    Return a copy of this H2OContext's configuration. The configuration cannot be changed at runtime.

  41. def getH2OHeadlessServiceURL(conf: H2OConf): String
    Attributes
    protected
    Definition Classes
    K8sHeadlessService
  42. def getH2OLogLevel(): String
  43. def getH2ONodes(): Array[NodeDesc]
  44. def getLogLevel(conf: H2OConf): String
    Definition Classes
    RestApiUtils
  45. def getNodes(cloudV3: CloudV3): Array[NodeDesc]
    Definition Classes
    RestApiUtils
  46. def getNodes(conf: H2OConf): Array[NodeDesc]
    Definition Classes
    RestApiUtils
  47. def getPingInfo(conf: H2OConf): PingV3
    Definition Classes
    RestApiUtils
  48. def getTimeZone(conf: H2OConf): String
    Definition Classes
    RestApiUtils
  49. def h2oLocalClient: String

    Returns location of REST API of H2O client

  50. def h2oLocalClientIp: String

    Returns IP of H2O client

  51. def h2oLocalClientPort: Int

    Returns port where H2O REST API is exposed

  52. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  53. def importHiveTable(database: String = HiveTableImporter.DEFAULT_DATABASE, table: String, partitions: Array[Array[String]] = null, allowMultiFormat: Boolean = false): H2OFrame
    Definition Classes
    H2OContextExtensions
  54. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  55. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  56. def insert(endpoint: URI, suffix: String, conf: H2OConf, streamWrapper: (OutputStream) ⇒ OutputStream = identity, params: Map[String, Any] = Map.empty): OutputStream

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    returns

    HttpUrlConnection facilitating the insertion and holding the outputStream

    Attributes
    protected
    Definition Classes
    RestCommunication
  57. def insertToNode(node: NodeDesc, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty): OutputStream

    node

    H2O node descriptor

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    returns

    HttpUrlConnection facilitating the insertion and holding the outputStream

    Definition Classes
    RestCommunication
  58. def installH2OHeadlessService(client: KubernetesClient, conf: H2OConf): Unit
    Attributes
    protected
    Definition Classes
    K8sHeadlessService
  59. def installH2OStatefulSet(client: KubernetesClient, conf: H2OConf, headlessServiceURL: String): String
    Attributes
    protected
    Definition Classes
    K8sH2OStatefulSet
  60. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  61. def isPrimitiveType(value: Any): Boolean
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  62. def isStopped(): Boolean
  63. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  64. def launchShellCommand(cmdToLaunch: Seq[String]): Int
    Attributes
    protected
    Definition Classes
    ShellUtils
  65. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  66. def logDebug(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  67. def logDebug(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  68. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  69. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  70. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  71. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  72. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  73. def logTrace(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  74. def logTrace(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  75. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  76. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  77. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  78. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  79. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  80. def openFlow(): Unit

    Open H2O Flow running in this client.

  81. def openURI(uri: String): Unit

    Open browser for given address.

    Open browser for given address.

    uri

    address to open in browser, e.g., http://example.com

    Attributes
    protected
    Definition Classes
    H2OContextExtensions
  82. def query[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, confirmationLoggingLevel: LoggingLevel = Info)(implicit arg0: ClassTag[ResultType]): ResultType

    ResultType

    A type that the result will be deserialized to

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    skippedFields

    The list of field specifications that are skipped during deserialization. The specification consists of the class containing the field and the field name.

    returns

    A deserialized object

    Definition Classes
    RestCommunication
  83. def readURLContent(endpoint: URI, requestType: String, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, encodeParamsAsJson: Boolean = false, file: Option[String], confirmationLoggingLevel: LoggingLevel = Info): InputStream
    Attributes
    protected
    Definition Classes
    RestCommunication
  84. def request[ResultType](endpoint: URI, requestType: String, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false, confirmationLoggingLevel: LoggingLevel = Info)(implicit arg0: ClassTag[ResultType]): ResultType
    Definition Classes
    RestCommunication
  85. def resolveNodeEndpoint(node: NodeDesc, conf: H2OConf): URI
    Definition Classes
    RestApiUtils
  86. def setH2OLogLevel(level: String): Unit
  87. def setLogLevel(conf: H2OConf, logLevel: String): Unit
    Definition Classes
    RestApiUtils
  88. def setTimeZone(conf: H2OConf, timezone: String): Unit
    Definition Classes
    RestApiUtils
  89. def shutdownCluster(conf: H2OConf): Unit
    Definition Classes
    RestApiUtils
  90. val sparkContext: SparkContext
  91. def startExternalH2OOnKubernetes(conf: H2OConf): Unit
    Definition Classes
    K8sExternalBackendClient
  92. def stop(stopSparkContext: Boolean = false): Unit

    Stops H2O context.

    Stops H2O context.

    stopSparkContext

    stop also spark context

  93. def stopExternalH2OOnKubernetes(conf: H2OConf): Unit
    Definition Classes
    K8sExternalBackendClient
  94. def stringify(value: Any): String
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  95. def stringifyArray(arr: Array[_]): String
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  96. def stringifyMap(map: Map[_, _]): String
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  97. def stringifyPair(pair: Tuple2[_, _]): String
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  98. def stringifyParams(params: Map[String, Any] = Map.empty, encodeParamsAsJson: Boolean = false): String
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  99. def stringifyPrimitiveParam(value: Any): String
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  100. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  101. def toString(): String
    Definition Classes
    H2OContext → AnyRef → Any
  102. def update[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false)(implicit arg0: ClassTag[ResultType]): ResultType

    ResultType

    A type that the result will be deserialized to

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    skippedFields

    The list of field specifications that are skipped during deserialization. The specification consists of the class containing the field and the field name.

    returns

    A deserialized object

    Definition Classes
    RestCommunication
  103. def visibleFlowURL(): String
  104. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  105. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  106. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  107. def withConversionDebugPrints(sc: SparkContext, conversionName: String, block: ⇒ H2OFrame): H2OFrame
    Attributes
    protected
    Definition Classes
    H2OContextExtensions
  108. object implicits extends H2OContextImplicits with Serializable

    Define implicits available via h2oContext.implicits._

  109. object LoggingLevel extends Enumeration
    Definition Classes
    RestCommunication

Inherited from H2OContextExtensions

Inherited from K8sExternalBackendClient

Inherited from K8sH2OStatefulSet

Inherited from K8sHeadlessService

Inherited from K8sUtils

Inherited from ShellUtils

Inherited from RestApiUtils

Inherited from RestCommunication

Inherited from RestEncodingUtils

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped