water.fvec

Class TransformWrappedVec

java.lang.Object

water.Iced<T>

water.Keyed<Vec>

water.fvec.Vec

water.fvec.TransformWrappedVec

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Vec>

public class TransformWrappedVec
extends Vec

This wrapper pushes a transform down into each chunk so that transformations will happen on-the-fly. When wrapped and there are Op instances to be applied, the atd call will supersede the usual chunk-at retrieval with a "special" atd call. Overhead added per element fetch per chunk is another virtual call per Op per element (per Chunk). As has been noted (see e.g. RollupStats), virtual calls are expensive, but the memory savings are substantial. AutoML can freely transform columns without ramification. Each wrapped Vec will track its own transformations, which makes it easy when generating a POJO. A TransformWrappedVec is actually a function of one or more Vec instances. This class exists here so that Chunk and NewChunk don't need to become fully public (since java has no friends). Other packages (not just core H2O) depend on this class!

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TransformWrappedVec.TransformWrappedChunk

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.ESPC, Vec.Reader, Vec.VectorGroup, Vec.Writer

Field Summary

Fields inherited from class water.fvec.Vec

_rowLayout, DO_HISTOGRAMS, KEY_PREFIX_LEN, PERCENTILES, T_BAD, T_CAT, T_NUM, T_STR, T_TIME, T_UUID, TYPE_STR

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Constructor and Description
TransformWrappedVec(Key key, int rowLayout, AstRoot fun, Key<Vec>... masterVecKeys)
TransformWrappedVec(Vec v, AstRoot fun)

Method Summary

Methods

Modifier and Type	Method and Description
Chunk	chunkForChunkIdx(int cidx) The Chunk for a chunk#.
Vec	doCopy()
Vec	makeVec()
Vec	masterVec()

Methods inherited from class water.fvec.Vec

adaptTo, align, at, at16h, at16l, at8, atStr, base, bins, byteSize, cardinality, checksum_impl, chunkForRow, chunkIdx, chunkKey, chunkKey, copyMeta, domain, elem2ChunkIdx, equals, espc, factor, get_type_str, get_type, getVecKey, group, hashCode, isBad, isBinary, isCategorical, isConst, isInt, isNA, isNumeric, isString, isTime, isUUID, lazy_bins, length, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCons, makeCons, makeCopy, makeCopy, makeCopy, makeDoubles, makeRand, makeRepSeq, makeSeq, makeSeq, makeSeq, makeVec, makeVec, makeVec, makeZero, makeZero, makeZero, makeZero, makeZeros, makeZeros, max, maxs, mean, min, mins, mode, naCnt, nChunks, newKey, ninfs, nzCnt, open, pctiles, pinfs, postWrite, preWriting, readAll_impl, remove_impl, rollupStatsKey, set, set, set, set, setBad, setDomain, sigma, sparseRatio, startRollupStats, startRollupStats, stride, toCategoricalVec, toNumericVec, toString, toStringVec, writeAll_impl

Methods inherited from class water.Keyed

checksum, makeSchema, readAll, remove, remove, remove, remove, writeAll

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

TransformWrappedVec

public TransformWrappedVec(Key key,
                   int rowLayout,
                   AstRoot fun,
                   Key<Vec>... masterVecKeys)

TransformWrappedVec

public TransformWrappedVec(Vec v,
                   AstRoot fun)

Method Detail

makeVec

public Vec makeVec()

chunkForChunkIdx

public Chunk chunkForChunkIdx(int cidx)

Description copied from class: Vec

The Chunk for a chunk#. Warning: this pulls the data locally; using this call on every Chunk index on the same node will probably trigger an OOM!

Returns:

Chunk for a chunk#

doCopy

public Vec doCopy()

Overrides:

doCopy in class Vec

masterVec

public Vec masterVec()