Packages

c

org.apache.spark.h2o

JavaH2OContext

class JavaH2OContext extends AnyRef

A Java-friendly version of org.apache.spark.h2o.H2OContext

Sparkling Water can run in two modes. External cluster mode and internal cluster mode. When using external cluster mode, it tries to connect to existing H2O cluster using the provided spark configuration properties. In the case of internal cluster mode,it creates H2O cluster living in Spark - that means that each Spark executor will have one h2o instance running in it. This mode is not recommended for big clusters and clusters where Spark executors are not stable.

Cluster mode can be set using the spark configuration property spark.ext.h2o.mode which can be set in script starting sparkling-water or can be set in H2O configuration class H2OConf

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JavaH2OContext
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def asDataFrame(key: String, copyMetadata: Boolean): Dataset[Row]
  5. def asDataFrame(key: String): Dataset[Row]
  6. def asDataFrame(fr: Frame, copyMetadata: Boolean): Dataset[Row]
  7. def asDataFrame(fr: Frame): Dataset[Row]
  8. def asH2OFrame(fr: Frame): water.fvec.H2OFrame

    Create a new H2OFrame based on existing Frame

    Create a new H2OFrame based on existing Frame

    fr

    the frame to be used

    returns

    Java H2O Context

  9. def asH2OFrame(s: String): water.fvec.H2OFrame

    Create a new H2OFrame based on existing Frame referenced by its key.

    Create a new H2OFrame based on existing Frame referenced by its key.

    s

    the key

    returns

    a new H2O frame

  10. def asH2OFrame(df: Dataset[Row], frameName: String): water.fvec.H2OFrame

    Pass-through to H2OContext.asH2OFrame.

    Pass-through to H2OContext.asH2OFrame. For API support only.

    df

    data frame to pass for building an H2OFrame

    frameName

    name of the new frame

    returns

    a new H2O frame

  11. def asH2OFrame(df: Dataset[Row]): water.fvec.H2OFrame

    Pass-through to H2OContext.asH2OFrame.

    Pass-through to H2OContext.asH2OFrame. For API support only.

    df

    data frame to pass for building an H2OFrame

    returns

    a new H2O frame

  12. def asH2OFrameFromRDDBool(rdd: JavaRDD[Boolean], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[Boolean] to H2O's DataFrame

    Conversion from RDD[Boolean] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  13. def asH2OFrameFromRDDBoolKey(rdd: JavaRDD[Boolean], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[Boolean]

    Returns key of the H2O's DataFrame conversed from RDD[Boolean]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  14. def asH2OFrameFromRDDBoolKeyString(rdd: JavaRDD[Boolean], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[Boolean]

    Returns key string of the H2O's DataFrame conversed from RDD[Boolean]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  15. def asH2OFrameFromRDDByte(rdd: JavaRDD[Byte], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[Byte] to H2O's DataFrame

    Conversion from RDD[Byte] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  16. def asH2OFrameFromRDDByteKey(rdd: JavaRDD[Byte], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[Byte]

    Returns key of the H2O's DataFrame conversed from RDD[Byte]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  17. def asH2OFrameFromRDDByteKeyString(rdd: JavaRDD[Byte], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[Byte]

    Returns key string of the H2O's DataFrame conversed from RDD[Byte]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  18. def asH2OFrameFromRDDDouble(rdd: JavaRDD[Double], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[Double] to H2O's DataFrame

    Conversion from RDD[Double] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  19. def asH2OFrameFromRDDDoubleKey(rdd: JavaRDD[Double], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[Double]

    Returns key of the H2O's DataFrame conversed from RDD[Double]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  20. def asH2OFrameFromRDDDoubleKeyString(rdd: JavaRDD[Double], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[Double]

    Returns key string of the H2O's DataFrame conversed from RDD[Double]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  21. def asH2OFrameFromRDDFloat(rdd: JavaRDD[Float], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[Float] to H2O's DataFrame

    Conversion from RDD[Float] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  22. def asH2OFrameFromRDDFloatKey(rdd: JavaRDD[Float], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[Float]

    Returns key of the H2O's DataFrame conversed from RDD[Float]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  23. def asH2OFrameFromRDDFloatKeyString(rdd: JavaRDD[Float], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[Float]

    Returns key string of the H2O's DataFrame conversed from RDD[Float]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  24. def asH2OFrameFromRDDInt(rdd: JavaRDD[Integer], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[Integer] to H2O's DataFrame

    Conversion from RDD[Integer] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  25. def asH2OFrameFromRDDIntKey(rdd: JavaRDD[Integer], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[Integer]

    Returns key of the H2O's DataFrame conversed from RDD[Integer]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  26. def asH2OFrameFromRDDIntKeyString(rdd: JavaRDD[Integer], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[Integer]

    Returns key string of the H2O's DataFrame conversed from RDD[Integer]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  27. def asH2OFrameFromRDDLabeledPoint(rdd: JavaRDD[LabeledPoint], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[LabeledPoint] to H2O's DataFrame

    Conversion from RDD[LabeledPoint] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  28. def asH2OFrameFromRDDLabeledPointKey(rdd: JavaRDD[LabeledPoint], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[LabeledPoint]

    Returns key of the H2O's DataFrame conversed from RDD[LabeledPoint]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  29. def asH2OFrameFromRDDLabeledPointKeyString(rdd: JavaRDD[LabeledPoint], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[LabeledPoint]

    Returns key string of the H2O's DataFrame conversed from RDD[LabeledPoint]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  30. def asH2OFrameFromRDDLong(rdd: JavaRDD[Long], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[Long] to H2O's DataFrame

    Conversion from RDD[Long] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  31. def asH2OFrameFromRDDLongKey(rdd: JavaRDD[Long], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[Long]

    Returns key of the H2O's DataFrame conversed from RDD[Long]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  32. def asH2OFrameFromRDDLongKeyString(rdd: JavaRDD[Long], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[Long]

    Returns key string of the H2O's DataFrame conversed from RDD[Long]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  33. def asH2OFrameFromRDDShort(rdd: JavaRDD[Short], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[Short] to H2O's DataFrame

    Conversion from RDD[Short] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  34. def asH2OFrameFromRDDShortKey(rdd: JavaRDD[Short], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[Short]

    Returns key of the H2O's DataFrame conversed from RDD[Short]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  35. def asH2OFrameFromRDDShortKeyString(rdd: JavaRDD[Short], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[Short]

    Returns key string of the H2O's DataFrame conversed from RDD[Short]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  36. def asH2OFrameFromRDDString(rdd: JavaRDD[String], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[String] to H2O's DataFrame

    Conversion from RDD[String] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  37. def asH2OFrameFromRDDStringKey(rdd: JavaRDD[String], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[String]

    Returns key of the H2O's DataFrame conversed from RDD[String]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  38. def asH2OFrameFromRDDStringKeyString(rdd: JavaRDD[String], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[String]

    Returns key string of the H2O's DataFrame conversed from RDD[String]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  39. def asH2OFrameFromRDDTimeStamp(rdd: JavaRDD[Timestamp], frameName: String): water.fvec.H2OFrame

    Conversion from RDD[java.sql.TimeStamp] to H2O's DataFrame

    Conversion from RDD[java.sql.TimeStamp] to H2O's DataFrame

    rdd

    rdd to convert

    frameName

    frame name

    returns

    new H2O Frame

  40. def asH2OFrameFromRDDTimeStampKey(rdd: JavaRDD[Timestamp], frameName: String): Key[Frame]

    Returns key of the H2O's DataFrame conversed from RDD[java.sql.TimeStamp]

    Returns key of the H2O's DataFrame conversed from RDD[java.sql.TimeStamp]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key of the created H2O Frame

  41. def asH2OFrameFromRDDTimeStampKeyString(rdd: JavaRDD[Timestamp], frameName: String): String

    Returns key string of the H2O's DataFrame conversed from RDD[java.sql.TimeStamp]

    Returns key string of the H2O's DataFrame conversed from RDD[java.sql.TimeStamp]

    rdd

    rdd to convert

    frameName

    frame name

    returns

    Key string of the created H2O Frame

  42. def asH2OFrameKeyString(df: Dataset[Row], frameName: String): String

    Pass-through to H2OContext.toH2OFrameKey.

    Pass-through to H2OContext.toH2OFrameKey. For API support only

    df

    dataset to convert

    frameName

    name of the frame

    returns

    String representation of H2OFrame key

  43. def asH2OFrameKeyString(df: Dataset[Row]): String

    Pass-through to H2OContext.toH2OFrameKey.

    Pass-through to H2OContext.toH2OFrameKey. For API support only

    df

    dataset to convert

    returns

    String representation of H2OFrame key

  44. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  45. def asRDD(fr: water.fvec.H2OFrame): JavaRDD[Row]

    Convert given H2O frame into a RDD

    Convert given H2O frame into a RDD

    fr

    the frame to be used

    returns

    a new RDD

  46. def asSparkFrame(key: String, copyMetadata: Boolean): Dataset[Row]

    Convert given H2O frame into DataFrame type

    Convert given H2O frame into DataFrame type

    key

    key of H2O frame to convert

    copyMetadata

    true if metadata should be copied

    returns

    Spark dataset

  47. def asSparkFrame(key: String): Dataset[Row]

    Convert given H2O frame into DataFrame type

    Convert given H2O frame into DataFrame type

    key

    key of H2O frame to convert

    returns

    Spark dataset

  48. def asSparkFrame(fr: Frame, copyMetadata: Boolean): Dataset[Row]

    Convert given H2O frame into DataFrame type

    Convert given H2O frame into DataFrame type

    fr

    H2O frame to convert

    copyMetadata

    true if metadata should be copied

    returns

    Spark dataset

  49. def asSparkFrame(fr: Frame): Dataset[Row]

    Convert given H2O frame into DataFrame type

    Convert given H2O frame into DataFrame type

    fr

    the frame to be used

    returns

    a new data frame

  50. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  51. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  52. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  53. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  54. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  55. def getConf(): H2OConf

    Return a copy of this JavaH2OContext's configuration.

    Return a copy of this JavaH2OContext's configuration. The configuration cannot be changed at runtime.

    returns

    Sparkling Water configuration

  56. def h2oContext(): H2OContext
  57. def h2oLocalClient(): String
  58. def h2oLocalClientIp(): String
  59. def h2oLocalClientPort(): Int
  60. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  61. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  62. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  63. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  64. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  65. def openFlow(): Unit
  66. def sparkContext(): SparkContext
  67. def stop(stopSparkContext: Boolean): Unit
  68. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  69. def toH2OFrameKey(df: Dataset[Row], frameName: String): Key[Frame]

    Pass-through to H2OContext.toH2OFrameKey.

    Pass-through to H2OContext.toH2OFrameKey. For API support only

    df

    dataset to convert

    frameName

    name of the frame

    returns

    key of H2O frame

  70. def toH2OFrameKey(df: Dataset[Row], frameName: Option[String]): Key[Frame]

    Pass-through to H2OContext.toH2OFrameKey.

    Pass-through to H2OContext.toH2OFrameKey. For API support only

    df

    dataset to convert

    frameName

    option containing name of the frame

    returns

    key of H2O frame

  71. def toH2OFrameKey(df: Dataset[Row]): Key[Frame]

    Pass-through to H2OContext.toH2OFrameKey.

    Pass-through to H2OContext.toH2OFrameKey. For API support only

    df

    dataset to convert

    returns

    key of H2O frame

  72. def toString(): String
    Definition Classes
    JavaH2OContext → AnyRef → Any
  73. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  74. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  75. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped