water.fvec

Class CategoricalWrappedVec

java.lang.Object

water.Iced<T>

water.Keyed<Vec>

water.fvec.Vec

water.fvec.CategoricalWrappedVec

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Vec>

public class CategoricalWrappedVec
extends Vec

A vector transforming values of given vector according to given domain mapping - currently only used to transform categorical columns but in theory would work for any dense-packed Int column. Expected usage is to map from a new dataset to the domain-mapping expected by a model (which will match the dataset it was trained on).

The Vector's domain is the union of the Test and Train domains.

The mapping is defined by int[] array, size is input Test.domain.length. Contents refer to values in the Train.domain. Extra values in the Test domain are sorted after the Train.domain - so mapped values have to be range-checked (note that returning some flag for NA, say -1, would also need to be checked for).

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CategoricalWrappedVec.CategoricalWrappedChunk

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.ESPC, Vec.Reader, Vec.VectorGroup, Vec.Writer

Field Summary

Fields inherited from class water.fvec.Vec

_rowLayout, DO_HISTOGRAMS, KEY_PREFIX_LEN, PERCENTILES, T_BAD, T_CAT, T_NUM, T_STR, T_TIME, T_UUID, TYPE_STR

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Constructor and Description
CategoricalWrappedVec(Key key, int rowLayout, java.lang.String[] toDomain, Key masterVecKey) Main constructor: convert from one categorical to another

Method Summary

Methods

Modifier and Type	Method and Description
Chunk	chunkForChunkIdx(int cidx) The Chunk for a chunk#.
static int[]	computeMap(java.lang.String[] from, java.lang.String[] to)
Vec	doCopy()
Vec	masterVec()

Methods inherited from class water.fvec.Vec

adaptTo, align, at, at16h, at16l, at8, atStr, base, bins, byteSize, cardinality, checksum_impl, chunkForRow, chunkIdx, chunkKey, chunkKey, copyMeta, domain, elem2ChunkIdx, equals, espc, factor, get_type_str, get_type, getVecKey, group, hashCode, isBad, isBinary, isCategorical, isConst, isInt, isNA, isNumeric, isString, isTime, isUUID, lazy_bins, length, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCons, makeCons, makeCopy, makeCopy, makeCopy, makeDoubles, makeRand, makeRepSeq, makeSeq, makeSeq, makeSeq, makeVec, makeVec, makeVec, makeZero, makeZero, makeZero, makeZero, makeZeros, makeZeros, max, maxs, mean, min, mins, mode, naCnt, nChunks, newKey, ninfs, nzCnt, open, pctiles, pinfs, postWrite, preWriting, readAll_impl, remove_impl, rollupStatsKey, set, set, set, set, setBad, setDomain, sigma, sparseRatio, startRollupStats, startRollupStats, stride, toCategoricalVec, toNumericVec, toString, toStringVec, writeAll_impl

Methods inherited from class water.Keyed

checksum, makeSchema, readAll, remove, remove, remove, remove, writeAll

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

CategoricalWrappedVec

public CategoricalWrappedVec(Key key,
                     int rowLayout,
                     java.lang.String[] toDomain,
                     Key masterVecKey)

Main constructor: convert from one categorical to another

Method Detail

computeMap

public static int[] computeMap(java.lang.String[] from,
               java.lang.String[] to)

chunkForChunkIdx

public Chunk chunkForChunkIdx(int cidx)

Description copied from class: Vec

The Chunk for a chunk#. Warning: this pulls the data locally; using this call on every Chunk index on the same node will probably trigger an OOM!

Returns:

Chunk for a chunk#

doCopy

public Vec doCopy()

Overrides:

doCopy in class Vec

masterVec

public Vec masterVec()