Trait

org.apache.spark.h2o.converters

ReadConverterCtx

Related Doc: package converters

Permalink

trait ReadConverterCtx extends AnyRef

Methods which each ReadConverterCtx has to implement.

Read Converter Context is a class which holds the state of connection/chunks and allows us to read/download data from those chunks via unified API

Linear Supertypes
AnyRef, Any
Known Subclasses
ExternalReadConverterCtx, InternalReadConverterCtx
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ReadConverterCtx
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. abstract type DataSource

    Permalink

    Type from which we query the data

  2. type OptionReader = (Int) ⇒ Option[Any]

    Permalink

  3. type Reader = (Int) ⇒ Any

    Permalink

Abstract Value Members

  1. abstract def booleanAt(source: DataSource): Boolean

    Permalink
    Attributes
    protected

  2. abstract def byteAt(source: DataSource): Byte

    Permalink
    Attributes
    protected

  3. abstract val chunkIdx: Int

    Permalink

    Chunk Idx/Partition index

  4. abstract def doubleAt(source: DataSource): Double

    Permalink
    Attributes
    protected

  5. abstract def floatAt(source: DataSource): Float

    Permalink
    Attributes
    protected

  6. abstract def intAt(source: DataSource): Int

    Permalink
    Attributes
    protected

  7. abstract val keyName: String

    Permalink

    Key pointing to H2OFrame containing the data

  8. abstract def longAt(source: DataSource): Long

    Permalink
    Attributes
    protected

  9. abstract def numRows: Int

    Permalink

  10. abstract def returnOption[T](read: (DataSource) ⇒ T)(columnNum: Int): Option[T]

    Permalink

    Returns Option with data was successfully obtained or none otherwise

    Returns Option with data was successfully obtained or none otherwise

    Attributes
    protected

  11. abstract def returnSimple[T](ifMissing: (String) ⇒ T, read: (DataSource) ⇒ T)(columnNum: Int): T

    Permalink

    Returns the data if it was obtained successfully or the default value

    Returns the data if it was obtained successfully or the default value

    Attributes
    protected

  12. abstract def shortAt(source: DataSource): Short

    Permalink
    Attributes
    protected

  13. abstract def string(source: DataSource): String

    Permalink
    Attributes
    protected

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. lazy val ExtractorsTable: Map[SimpleType[_], Function1[DataSource, _]]

    Permalink

    This map registers for each type corresponding extractor

    This map registers for each type corresponding extractor

    Given a a column number, returns an Option[T] with the value parsed according to the type. You can override it.

    A map from type name to option reader

    Attributes
    protected

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. def columnValueProviders(columnIndexesWithTypes: Array[(Int, SimpleType[_])]): Array[() ⇒ Option[Any]]

    Permalink

    For a given array of source column indexes and required data types, produces an array of value providers.

    For a given array of source column indexes and required data types, produces an array of value providers.

    columnIndexesWithTypes

    lists which columns we need, and what are the required types

    returns

    an array of value providers. Each provider gives the current column value

  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  12. def hasNext: Boolean

    Permalink

  13. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  14. def increaseRowIdx(): Unit

    Permalink

  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  16. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  17. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  18. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  19. lazy val readerMapByName: Map[NameOfType, Reader]

    Permalink

  20. var rowIdx: Int

    Permalink

    Current row index

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  22. def timestamp(source: DataSource): Long

    Permalink
    Attributes
    protected

  23. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  24. def utfString(source: DataSource): UTF8String

    Permalink
    Attributes
    protected

  25. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped