H2OContext

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. def asDataFrame(s: String): DataFrame

   

   Annotations

   @DeprecatedMethod( "asSparkFrame" , "3.32" )

5. def asDataFrame(s: String, copyMetadata: Boolean): DataFrame

   

   Annotations

   @DeprecatedMethod( "asSparkFrame" , "3.32" )

6. def asDataFrame[T <: Frame](fr: T, copyMetadata: Boolean = true): DataFrame

   

   Annotations

   @DeprecatedMethod( "asSparkFrame" , "3.32" )

7. def asH2OFrame(fr: Frame): H2OFrame

   

   Create a new H2OFrame based on existing Frame

8. def asH2OFrame(s: String): H2OFrame

   

   Create a new H2OFrame based on existing Frame referenced by its key.

9. def asH2OFrame(ds: SupportedDataset, frameName: String): H2OFrame

   

10. def asH2OFrame(ds: SupportedDataset, frameName: Option[String]): H2OFrame

    

11. def asH2OFrame(ds: SupportedDataset): H2OFrame

    

    Transforms Dataset[Supported type] to H2OFrame

12. def asH2OFrame(df: DataFrame, frameName: String): H2OFrame

    

13. def asH2OFrame(df: DataFrame, frameName: Option[String]): H2OFrame

    

14. def asH2OFrame(df: DataFrame): H2OFrame

    

    Transform DataFrame to H2OFrame

15. def asH2OFrame(rdd: SupportedRDD, frameName: String): H2OFrame

    

16. def asH2OFrame(rdd: SupportedRDD, frameName: Option[String]): H2OFrame

    

17. def asH2OFrame(rdd: SupportedRDD): H2OFrame

    

    Transforms RDD[Supported type] to H2OFrame

18. def asH2OFrameKeyString(df: DataFrame, frameName: Option[String]): String

    

19. def asH2OFrameKeyString(df: DataFrame, frameName: String): String

    

20. def asH2OFrameKeyString(df: DataFrame): String

    

    The method transforms Spark DataFrame to H2OFrame and returns String representation of its key.

    The method transforms Spark DataFrame to H2OFrame and returns String representation of its key.

    df

    Input data frame

    returns

    String representation of H2O Frame Key

21. def asH2OFrameKeyString(rdd: SupportedRDD, frameName: Option[String]): String

    

22. def asH2OFrameKeyString(rdd: SupportedRDD, frameName: String): String

    

23. def asH2OFrameKeyString(rdd: SupportedRDD): String

    

    The method transforms RDD to H2OFrame and returns String representation of its key.

    The method transforms RDD to H2OFrame and returns String representation of its key.

    rdd

    Input RDD

    returns

    String representation of H2O Frame Key

24. final def asInstanceOf[T0]: T0

    

    Definition Classes

    Any

25. def asRDD[A <: Product](fr: ai.h2o.sparkling.H2OFrame)(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A], arg1: ClassTag[A]): rdd.RDD[A]

    

26. def asRDD[A <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A], arg1: ClassTag[A]): AnyRef { def apply[T <: org.apache.spark.h2o.Frame](fr: T): org.apache.spark.h2o.RDD[A] }

    

    A generic convert of Frame into Product RDD type

    A generic convert of Frame into Product RDD type

    Consider using asH2OFrame since asRDD has several limitations such as that asRDD can't be used in Spark REPL in case we are RDD[T] where T is class defined in REPL. This is because class T is created as inner class and we are not able to create instance of class T without outer scope - which is impossible to get.

    This code: hc.asRDD[PUBDEV458Type](rdd) will need to be call as hc.asRDD[PUBDEV458Type].apply(rdd)

27. def asRDD[A <: Product](fr: H2OFrame)(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A], arg1: ClassTag[A]): RDD[A]

    

    Convert given H2O frame into a Product RDD type

    Convert given H2O frame into a Product RDD type

    Consider using asH2OFrame since asRDD has several limitations such as that asRDD can't be used in Spark REPL in case we are RDD[T] where T is class defined in REPL. This is because class T is created as inner class and we are not able to create instance of class T without outer scope - which is impossible to get.

28. def asSparkFrame(s: String): DataFrame

    

29. def asSparkFrame(s: String, copyMetadata: Boolean): DataFrame

    

30. def asSparkFrame[T <: Frame](fr: T, copyMetadata: Boolean = true): DataFrame

    

31. val backend: SparklingBackend

    

    Used backend

    Used backend

    Attributes

    protected

32. def checkResponseCode(connection: HttpURLConnection): Unit

    

    Definition Classes

    RestCommunication

33. def clone(): AnyRef

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

34. def delete[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false)(implicit arg0: ClassTag[ResultType]): ResultType

    
    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    Definition Classes

    RestCommunication

35. def downloadBinaryURLContent(endpoint: URI, suffix: String, conf: H2OConf, file: File): Unit

    

    Attributes

    protected

    Definition Classes

    RestCommunication

36. def downloadH2OLogs(destinationDir: String, logContainer: String): String

    

    Definition Classes

    H2OContextExtensions

37. def downloadStringURLContent(endpoint: URI, suffix: String, conf: H2OConf, file: File): Unit

    

    Attributes

    protected

    Definition Classes

    RestCommunication

38. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

39. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

40. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

41. def flowURL(): String

    

42. def getAndVerifyWorkerNodes(conf: H2OConf): Array[NodeDesc]

    

    Attributes

    protected

    Definition Classes

    H2OContextExtensions

43. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

44. def getClusterEndpoint(conf: H2OConf): URI

    

    Definition Classes

    RestApiUtils

45. def getClusterInfo(conf: H2OConf): CloudV3

    

    Definition Classes

    RestApiUtils

46. def getConf: H2OConf

    

    Return a copy of this H2OContext's configuration.

    Return a copy of this H2OContext's configuration. The configuration cannot be changed at runtime.

47. def getH2OLogLevel(): String

    

48. def getH2ONodes(): Array[NodeDesc]

    

49. def getLogLevel(conf: H2OConf): String

    

    Definition Classes

    RestApiUtils

50. def getNodes(cloudV3: CloudV3): Array[NodeDesc]

    

    Definition Classes

    RestApiUtils

51. def getNodes(conf: H2OConf): Array[NodeDesc]

    

    Definition Classes

    RestApiUtils

52. def getPingInfo(conf: H2OConf): PingV3

    

    Definition Classes

    RestApiUtils

53. def getTimeZone(conf: H2OConf): String

    

    Definition Classes

    RestApiUtils

54. def h2oLocalClient: String

    

    Returns location of REST API of H2O client

55. def h2oLocalClientIp: String

    

    Returns IP of H2O client

56. def h2oLocalClientPort: Int

    

    Returns port where H2O REST API is exposed

57. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

58. object implicits extends H2OContextImplicits with Serializable

    

    Define implicits available via h2oContext.implicits._

59. def importHiveTable(database: String = HiveTableImporter.DEFAULT_DATABASE, table: String, partitions: Array[Array[String]] = null, allowMultiFormat: Boolean = false): water.fvec.Frame

    

    Definition Classes

    H2OContextExtensions

60. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

61. def insert(endpoint: URI, suffix: String, conf: H2OConf, streamWrapper: (OutputStream) ⇒ OutputStream = identity, params: Map[String, Any] = Map.empty): OutputStream

    
    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    returns

    HttpUrlConnection facilitating the insertion and holding the outputStream

    Attributes

    protected

    Definition Classes

    RestCommunication

62. def insertToNode(node: NodeDesc, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty): OutputStream

    
    node

    H2O node descriptor

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    returns

    HttpUrlConnection facilitating the insertion and holding the outputStream

    Definition Classes

    RestCommunication

63. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

64. def isPrimitiveType(value: Any): Boolean

    

    Attributes

    protected

    Definition Classes

    RestEncodingUtils

65. def isStopped(): Boolean

    

66. def isTraceEnabled(): Boolean

    

    Attributes

    protected

    Definition Classes

    Logging

67. def launchShellCommand(cmdToLaunch: Seq[String]): Int

    

    Attributes

    protected

    Definition Classes

    ShellUtils

68. def log: Logger

    

    Attributes

    protected

    Definition Classes

    Logging

69. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

70. def logDebug(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

71. def logError(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

72. def logError(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

73. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

74. def logInfo(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

75. def logName: String

    

    Attributes

    protected

    Definition Classes

    Logging

76. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

77. def logTrace(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

78. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

79. def logWarning(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

80. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

81. final def notify(): Unit

    

    Definition Classes

    AnyRef

82. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

83. def openFlow(): Unit

    

    Open H2O Flow running in this client.

84. def openURI(uri: String): Unit

    

    Open browser for given address.

    Open browser for given address.

    uri

    address to open in browser, e.g., http://example.com

    Attributes

    protected

    Definition Classes

    H2OContextExtensions

85. def query[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty)(implicit arg0: ClassTag[ResultType]): ResultType

    
    ResultType

    A type that the result will be deserialized to

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    skippedFields

    The list of field specifications that are skipped during deserialization. The specification consists of the class containing the field and the field name.

    returns

    A deserialized object

    Definition Classes

    RestCommunication

86. def readURLContent(endpoint: URI, requestType: String, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, encodeParamsAsJson: Boolean = false): InputStream

    

    Attributes

    protected

    Definition Classes

    RestCommunication

87. def request[ResultType](endpoint: URI, requestType: String, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false)(implicit arg0: ClassTag[ResultType]): ResultType

    

    Definition Classes

    RestCommunication

88. def resolveNodeEndpoint(node: NodeDesc, conf: H2OConf): URI

    

    Definition Classes

    RestApiUtils

89. def setH2OClientLogLevel(level: String): Unit

    

    Annotations

    @DeprecatedMethod( "setH2OLogLevel" , "3.32" )

90. def setH2OLogLevel(level: String): Unit

    

91. def setH2ONodeLogLevel(level: String): Unit

    

    Annotations

    @DeprecatedMethod( "setH2OLogLevel" , "3.32" )

92. def setLogLevel(conf: H2OConf, logLevel: String): Unit

    

    Definition Classes

    RestApiUtils

93. def setTimeZone(conf: H2OConf, timezone: String): Unit

    

    Definition Classes

    RestApiUtils

94. def shutdownCluster(conf: H2OConf): Unit

    

    Definition Classes

    RestApiUtils

95. val sparkContext: SparkContext

    

96. val sparkSession: SparkSession

    

97. def stop(stopSparkContext: Boolean = false): Unit

    

    Stops H2O context.

    Stops H2O context.

    stopSparkContext

    stop also spark context

98. def stringify(value: Any): String

    

    Attributes

    protected

    Definition Classes

    RestEncodingUtils

99. def stringifyArray(arr: Array[_]): String

    

    Attributes

    protected

    Definition Classes

    RestEncodingUtils

100. def stringifyMap(map: Map[_, _]): String

     

     Attributes

     protected

     Definition Classes

     RestEncodingUtils

101. def stringifyParams(params: Map[String, Any] = Map.empty, encodeParamsAsJson: Boolean = false): String

     

     Attributes

     protected

     Definition Classes

     RestEncodingUtils

102. def stringifyPrimitiveParam(value: Any): String

     

     Attributes

     protected

     Definition Classes

     RestEncodingUtils

103. final def synchronized[T0](arg0: ⇒ T0): T0

     

     Definition Classes

     AnyRef

104. def toH2OFrameKey(ds: SupportedDataset, frameName: String): Key[Frame]

     

105. def toH2OFrameKey(ds: SupportedDataset, frameName: Option[String]): Key[Frame]

     

106. def toH2OFrameKey(ds: SupportedDataset): Key[Frame]

     

     Transforms Dataset[Supported type] to H2OFrame key

107. def toH2OFrameKey(df: DataFrame, frameName: String): Key[Frame]

     

108. def toH2OFrameKey(df: DataFrame, frameName: Option[String]): Key[Frame]

     

109. def toH2OFrameKey(df: DataFrame): Key[Frame]

     

     Transform DataFrame to H2OFrame key

110. def toH2OFrameKey(rdd: SupportedRDD, frameName: String): Key[_]

     

111. def toH2OFrameKey(rdd: SupportedRDD, frameName: Option[String]): Key[_]

     

112. def toH2OFrameKey(rdd: SupportedRDD): Key[_]

     

     Transforms RDD[Supported type] to H2OFrame key

113. def toString(): String

     

     Definition Classes

     H2OContext → AnyRef → Any

114. def update[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false)(implicit arg0: ClassTag[ResultType]): ResultType

     
     ResultType

     A type that the result will be deserialized to

     endpoint

     An address of H2O node with exposed REST endpoint

     suffix

     REST relative path representing a specific call

     conf

     H2O conf object

     params

     Query parameters

     skippedFields

     The list of field specifications that are skipped during deserialization. The specification consists of the class containing the field and the field name.

     returns

     A deserialized object

     Definition Classes

     RestCommunication

115. final def wait(): Unit

     

     Definition Classes

     AnyRef

     Annotations

     @throws( ... )

116. final def wait(arg0: Long, arg1: Int): Unit

     

     Definition Classes

     AnyRef

     Annotations

     @throws( ... )

117. final def wait(arg0: Long): Unit

     

     Definition Classes

     AnyRef

     Annotations

     @throws( ... )

118. def withConversionDebugPrints[R <: water.fvec.Frame](sc: SparkContext, conversionName: String, block: ⇒ R): R

     

     Attributes

     protected

     Definition Classes

     H2OContextExtensions