Class

org.apache.spark.h2o.backends.external

ExternalReadConverterCtx

Related Doc: package external

Permalink

class ExternalReadConverterCtx extends ReadConverterCtx

Linear Supertypes
ReadConverterCtx, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExternalReadConverterCtx
  2. ReadConverterCtx
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ExternalReadConverterCtx(keyName: String, chunkIdx: Int, nodeDesc: NodeDesc, expectedTypes: Array[Byte], selectedColumnIndices: Array[Int], readTimeout: Int)

    Permalink

    keyName

    key name of frame to query data from

    chunkIdx

    chunk index

    nodeDesc

    the h2o node which has data for chunk with the chunkIdx

Type Members

  1. type DataSource = ExternalFrameReaderClient

    Permalink

    Type from which we query the data

    Type from which we query the data

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  2. type OptionReader = (Int) ⇒ Option[Any]

    Permalink
    Definition Classes
    ReadConverterCtx
  3. type Reader = (Int) ⇒ Any

    Permalink
    Definition Classes
    ReadConverterCtx

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. lazy val ExtractorsTable: Map[SimpleType[_], Function1[DataSource, _]]

    Permalink

    This map registers for each type corresponding extractor

    This map registers for each type corresponding extractor

    Given a a column number, returns an Option[T] with the value parsed according to the type. You can override it.

    A map from type name to option reader

    Attributes
    protected
    Definition Classes
    ReadConverterCtx
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def booleanAt(source: ExternalFrameReaderClient): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  7. def byteAt(source: ExternalFrameReaderClient): Byte

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  8. val chunkIdx: Int

    Permalink

    chunk index

    chunk index

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  9. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. def columnValueProviders(columnIndexesWithTypes: Array[(Int, SimpleType[_])]): Array[() ⇒ Option[Any]]

    Permalink

    For a given array of source column indexes and required data types, produces an array of value providers.

    For a given array of source column indexes and required data types, produces an array of value providers.

    columnIndexesWithTypes

    lists which columns we need, and what are the required types

    returns

    an array of value providers. Each provider gives the current column value

    Definition Classes
    ReadConverterCtx
  11. def doubleAt(source: DataSource): Double

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  12. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  13. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  14. val externalFrameReader: ExternalFrameReaderClient

    Permalink
  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. def floatAt(source: ExternalFrameReaderClient): Float

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  17. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  18. def hasNext: Boolean

    Permalink

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
    Exceptions thrown

    ExternalFrameConfirmationException in case of confirmation failure. This has also effect of Spark stopping the current job and rescheduling it

  19. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  20. def increaseRowIdx(): Unit

    Permalink
    Definition Classes
    ReadConverterCtx
  21. def intAt(source: ExternalFrameReaderClient): Int

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  22. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  23. val keyName: String

    Permalink

    key name of frame to query data from

    key name of frame to query data from

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  24. def longAt(source: DataSource): Long

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  25. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  26. val nodeDesc: NodeDesc

    Permalink

    the h2o node which has data for chunk with the chunkIdx

  27. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  28. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  29. def numRows: Int

    Permalink
  30. val readTimeout: Int

    Permalink
  31. lazy val readerMapByName: Map[NameOfType, Reader]

    Permalink
    Definition Classes
    ReadConverterCtx
  32. def returnOption[T](read: (DataSource) ⇒ T)(columnNum: Int): Option[T]

    Permalink

    Returns Option with data was successfully obtained or none otherwise

    Returns Option with data was successfully obtained or none otherwise

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  33. def returnSimple[T](ifMissing: (String) ⇒ T, read: (DataSource) ⇒ T)(columnNum: Int): T

    Permalink

    Returns the data if it was obtained successfully or the default value

    Returns the data if it was obtained successfully or the default value

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  34. var rowIdx: Int

    Permalink

    Current row index

    Current row index

    Definition Classes
    ReadConverterCtx
  35. def shortAt(source: ExternalFrameReaderClient): Short

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  36. def string(source: DataSource): String

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  37. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  38. def timestamp(source: DataSource): Long

    Permalink
    Attributes
    protected
    Definition Classes
    ReadConverterCtx
  39. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  40. def utfString(source: DataSource): UTF8String

    Permalink
    Attributes
    protected
    Definition Classes
    ReadConverterCtx
  41. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  42. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  43. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from ReadConverterCtx

Inherited from AnyRef

Inherited from Any

Ungrouped