Class

org.apache.spark.h2o.backends.external

ExternalReadConverterCtx

Related Doc: package external

Permalink

class ExternalReadConverterCtx extends ReadConverterCtx

Linear Supertypes
ReadConverterCtx, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExternalReadConverterCtx
  2. ReadConverterCtx
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ExternalReadConverterCtx(keyName: String, chunkIdx: Int, nodeDesc: NodeDesc, expectedTypes: Array[Byte], selectedColumnIndices: Array[Int], readTimeout: Int, driverTimeStamp: Short)

    Permalink

    keyName

    key name of frame to query data from

    chunkIdx

    chunk index

    nodeDesc

    the h2o node which has data for chunk with the chunkIdx

Type Members

  1. type DataSource = ExternalFrameReaderClient

    Permalink

    Type from which we query the data

    Type from which we query the data

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  2. type OptionReader = (Int) ⇒ Option[Any]

    Permalink
    Definition Classes
    ReadConverterCtx
  3. type Reader = (Int) ⇒ Any

    Permalink
    Definition Classes
    ReadConverterCtx

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. lazy val ExtractorsTable: Map[SimpleType[_], Function1[DataSource, _]]

    Permalink

    This map registers for each type corresponding extractor

    This map registers for each type corresponding extractor

    Given a a column number, returns an Option[T] with the value parsed according to the type. You can override it.

    A map from type name to option reader

    Attributes
    protected
    Definition Classes
    ReadConverterCtx
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def booleanAt(source: ExternalFrameReaderClient): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  7. def byteAt(source: ExternalFrameReaderClient): Byte

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  8. val chunkIdx: Int

    Permalink

    chunk index

    chunk index

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  9. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. def columnValueProviders(columnIndexesWithTypes: Array[(Int, SimpleType[_])]): Array[() ⇒ Option[Any]]

    Permalink

    For a given array of source column indexes and required data types, produces an array of value providers.

    For a given array of source column indexes and required data types, produces an array of value providers.

    columnIndexesWithTypes

    lists which columns we need, and what are the required types

    returns

    an array of value providers. Each provider gives the current column value

    Definition Classes
    ReadConverterCtx
  11. def doubleAt(source: DataSource): Double

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  12. val driverTimeStamp: Short

    Permalink
  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  15. val externalFrameReader: ExternalFrameReaderClient

    Permalink
  16. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  17. def floatAt(source: ExternalFrameReaderClient): Float

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  18. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  19. def hasNext: Boolean

    Permalink

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
    Exceptions thrown

    ExternalFrameConfirmationException in case of confirmation failure. This has also effect of Spark stopping the current job and rescheduling it

  20. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  21. def increaseRowIdx(): Unit

    Permalink
    Definition Classes
    ReadConverterCtx
  22. def intAt(source: ExternalFrameReaderClient): Int

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  23. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  24. val keyName: String

    Permalink

    key name of frame to query data from

    key name of frame to query data from

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  25. def longAt(source: DataSource): Long

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  26. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  27. val nodeDesc: NodeDesc

    Permalink

    the h2o node which has data for chunk with the chunkIdx

  28. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  29. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  30. def numRows: Int

    Permalink
  31. val readTimeout: Int

    Permalink
  32. lazy val readerMapByName: Map[NameOfType, Reader]

    Permalink
    Definition Classes
    ReadConverterCtx
  33. def returnOption[T](read: (DataSource) ⇒ T)(columnNum: Int): Option[T]

    Permalink

    Returns Option with data was successfully obtained or none otherwise

    Returns Option with data was successfully obtained or none otherwise

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  34. def returnSimple[T](ifMissing: (String) ⇒ T, read: (DataSource) ⇒ T)(columnNum: Int): T

    Permalink

    Returns the data if it was obtained successfully or the default value

    Returns the data if it was obtained successfully or the default value

    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  35. var rowIdx: Int

    Permalink

    Current row index

    Current row index

    Definition Classes
    ReadConverterCtx
  36. def shortAt(source: ExternalFrameReaderClient): Short

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  37. def string(source: DataSource): String

    Permalink
    Attributes
    protected
    Definition Classes
    ExternalReadConverterCtxReadConverterCtx
  38. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  39. def timestamp(source: DataSource): Long

    Permalink
    Attributes
    protected
    Definition Classes
    ReadConverterCtx
  40. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  41. def utfString(source: DataSource): UTF8String

    Permalink
    Attributes
    protected
    Definition Classes
    ReadConverterCtx
  42. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  43. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  44. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from ReadConverterCtx

Inherited from AnyRef

Inherited from Any

Ungrouped