Trait

org.apache.spark.h2o.converters

ReadConverterCtx

Related Doc: package converters

Permalink

trait ReadConverterCtx extends AnyRef

Methods which each ReadConverterCtx has to implement.

Read Converter Context is a class which holds the state of connection/chunks and allows us to read/download data from those chunks via unified API

Linear Supertypes
AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ReadConverterCtx
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. abstract type DataSource

    Permalink

    Type from which we query the data

  2. type OptionReader = (Int) ⇒ Option[Any]

    Permalink
  3. type Reader = (Int) ⇒ Any

    Permalink

Abstract Value Members

  1. abstract def booleanAt(source: DataSource): Boolean

    Permalink
    Attributes
    protected
  2. abstract def byteAt(source: DataSource): Byte

    Permalink
    Attributes
    protected
  3. abstract val chunkIdx: Int

    Permalink

    Chunk Idx/Partition index

  4. abstract def doubleAt(source: DataSource): Double

    Permalink
    Attributes
    protected
  5. abstract def floatAt(source: DataSource): Float

    Permalink
    Attributes
    protected
  6. abstract def intAt(source: DataSource): Int

    Permalink
    Attributes
    protected
  7. abstract val keyName: String

    Permalink

    Key pointing to H2OFrame containing the data

  8. abstract def longAt(source: DataSource): Long

    Permalink
    Attributes
    protected
  9. abstract def numRows: Int

    Permalink
  10. abstract def returnOption[T](read: (DataSource) ⇒ T)(columnNum: Int): Option[T]

    Permalink

    Returns Option with data was successfully obtained or none otherwise

    Returns Option with data was successfully obtained or none otherwise

    Attributes
    protected
  11. abstract def returnSimple[T](ifMissing: (String) ⇒ T, read: (DataSource) ⇒ T)(columnNum: Int): T

    Permalink

    Returns the data if it was obtained successfully or the default value

    Returns the data if it was obtained successfully or the default value

    Attributes
    protected
  12. abstract def shortAt(source: DataSource): Short

    Permalink
    Attributes
    protected
  13. abstract def string(source: DataSource): String

    Permalink
    Attributes
    protected

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. lazy val ExtractorsTable: Map[SimpleType[_], Function1[DataSource, _]]

    Permalink

    This map registers for each type corresponding extractor

    This map registers for each type corresponding extractor

    Given a a column number, returns an Option[T] with the value parsed according to the type. You can override it.

    A map from type name to option reader

    Attributes
    protected
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def columnValueProviders(columnIndexesWithTypes: Array[(Int, SimpleType[_])]): Array[() ⇒ Option[Any]]

    Permalink

    For a given array of source column indexes and required data types, produces an array of value providers.

    For a given array of source column indexes and required data types, produces an array of value providers.

    columnIndexesWithTypes

    lists which columns we need, and what are the required types

    returns

    an array of value providers. Each provider gives the current column value

  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def hasNext: Boolean

    Permalink
  13. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  14. def increaseRowIdx(): Unit

    Permalink
  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  17. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  19. lazy val readerMapByName: Map[NameOfType, Reader]

    Permalink
  20. var rowIdx: Int

    Permalink

    Current row index

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  22. def timestamp(source: DataSource): Long

    Permalink
    Attributes
    protected
  23. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  24. def utfString(source: DataSource): UTF8String

    Permalink
    Attributes
    protected
  25. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped