water.fvec

Class AppendableVec

java.lang.Object

water.Iced

water.fvec.Vec

water.fvec.AppendableVec

All Implemented Interfaces:

java.lang.Cloneable, Freezable

public class AppendableVec
extends Vec

A NEW single distributed vector column. The NEW vector has no data, and takes no space. It supports distributed parallel writes to it, via calls to append2. Such writes happen in parallel and all writes are ordered. Writes *will* be local to the node doing them, specifically to allow control over locality. By default, writes will go local-homed chunks with no compression; there is a final 'close' to the NEW vector which may do compression; the final 'close' will return some other Vec type. NEW Vectors do NOT support reads!

Nested Class Summary

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.CollectDomain, Vec.VecIdenticalTask, Vec.VectorGroup, Vec.Writer

Field Summary

Fields

Modifier and Type	Field and Description
static byte	ENUM
static byte	NA
static byte	NUMBER
static byte	TIME
static byte	UUID

Fields inherited from class water.fvec.Vec

_domain, _key, _time, CHUNK_SZ, KEY_PREFIX_LEN, LOG_CHK, MAX_ENUM_SIZE

Constructor Summary

Constructors

Constructor and Description
AppendableVec(Key key)

Method Summary

Methods

Modifier and Type	Method and Description
long	byteSize() Size of compressed vector data.
long	chunk2StartElem(int cidx) Convert a chunk-index into a starting row #.
Chunk	chunkForChunkIdx(int cidx) The Chunk for a chunk#.
Value	chunkIdx(int cidx) Get a Chunk's Value by index.
Vec	close(Futures fs)
long	length() Number of elements in the vector.
int	nChunks() Number of chunks.
boolean	readable() Default read/write behavior for Vecs.
void	reduce(AppendableVec nv)
java.lang.String	toString() Pretty print the Vec: [#elems, min/mean/max]{chunks,...}
boolean	writable() Default read/write behavior for Vecs.

Methods inherited from class water.fvec.Vec

align, at, at16h, at16l, at8, cardinality, changeDomain, checkMissing, checksum, chunkForRow, chunkKey, chunkKey, chunkLen, domain, domain, equals, getVecKey, group, groupKey, hashCode, isBad, isByteVec, isConst, isEnum, isFloat, isInt, isNA, isTime, isUUID, make1Elem, make1Elem, makeCon, makeCon, makeCon, makeCons, makeConSeq, makeNewCons, makeSeq, makeTransf, makeZero, makeZero, makeZeros, makeZeros, masterVec, max, mean, min, naCnt, newKey, open, postWrite, remove, rollupStats, rollupStats, set, set, set, setNA, sigma, timeMode, timeParse, toEnum

Methods inherited from class water.Iced

clone, frozenType, init, newInstance, read, toDocField, write, writeJSON, writeJSONFields

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

NA

public static final byte NA

See Also:

Constant Field Values

ENUM

public static final byte ENUM

See Also:

Constant Field Values

NUMBER

public static final byte NUMBER

See Also:

Constant Field Values

TIME

public static final byte TIME

See Also:

Constant Field Values

UUID

public static final byte UUID

See Also:

Constant Field Values

Constructor Detail

AppendableVec

public AppendableVec(Key key)

Method Detail

reduce

public void reduce(AppendableVec nv)

close

public Vec close(Futures fs)

readable

public boolean readable()

Description copied from class: Vec

Default read/write behavior for Vecs. File-backed Vecs are read-only.

Overrides:

readable in class Vec

writable

public boolean writable()

Description copied from class: Vec

Default read/write behavior for Vecs. AppendableVecs are write-only.

Overrides:

writable in class Vec

chunkForChunkIdx

public Chunk chunkForChunkIdx(int cidx)

Description copied from class: Vec

The Chunk for a chunk#. Warning: this loads the data locally!

Overrides:

chunkForChunkIdx in class Vec

chunkIdx

public Value chunkIdx(int cidx)

Description copied from class: Vec

Get a Chunk's Value by index. Basically the index-to-key map, plus the DKV.get(). Warning: this pulls the data locally; using this call on every Chunk index on the same node will probably trigger an OOM!

Overrides:

chunkIdx in class Vec

length

public long length()

Description copied from class: Vec

Number of elements in the vector. Overridden by subclasses that compute length in an alternative way, such as file-backed Vecs.

Overrides:

length in class Vec

nChunks

public int nChunks()

Description copied from class: Vec

Number of chunks. Overridden by subclasses that compute chunks in an alternative way, such as file-backed Vecs.

Overrides:

nChunks in class Vec

chunk2StartElem

public long chunk2StartElem(int cidx)

Description copied from class: Vec

Convert a chunk-index into a starting row #. For constant-sized chunks this is a little shift-and-add math. For variable-sized chunks this is a table lookup.

Overrides:

chunk2StartElem in class Vec

byteSize

public long byteSize()

Description copied from class: Vec

Size of compressed vector data.

Overrides:

byteSize in class Vec

toString

public java.lang.String toString()

Description copied from class: Vec

Pretty print the Vec: [#elems, min/mean/max]{chunks,...}

Overrides:

toString in class Vec