water.fvec

Class CategoricalWrappedVec

java.lang.Object

water.Iced<T>

water.Keyed<Vec>

water.fvec.Vec

water.fvec.CategoricalWrappedVec

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Vec>

public class CategoricalWrappedVec
extends Vec

A vector transforming values of given vector according to given domain mapping - currently only used to transform categorical columns but in theory would work for any dense-packed Int column. Expected usage is to map from a new dataset to the domain-mapping expected by a model (which will match the dataset it was trained on).

The Vector's domain is the union of the Test and Train domains.

The mapping is defined by int[] array, size is input Test.domain.length. Contents refer to values in the Train.domain. Extra values in the Test domain are sorted after the Train.domain - so mapped values have to be range-checked (note that returning some flag for NA, say -1, would also need to be checked for).

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CategoricalWrappedVec.CategoricalWrappedChunk

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.ESPC, Vec.Reader, Vec.VectorGroup, Vec.Writer

Nested classes/interfaces inherited from class water.Keyed

Keyed.BinarySerializer<X extends Keyed>

Field Summary

Fields inherited from class water.fvec.Vec

_rowLayout, DO_HISTOGRAMS, KEY_PREFIX_LEN, PERCENTILES, T_BAD, T_CAT, T_NUM, T_STR, T_TIME, T_UUID, TYPE_STR

Fields inherited from class water.Keyed

_key, EMPTY_KEY_LIST

Constructor Summary

Constructors

Constructor and Description
CategoricalWrappedVec(Key key, int rowLayout, java.lang.String[] toDomain, Key masterVecKey) Main constructor: convert from one categorical to another

Method Summary

Methods

Modifier and Type	Method and Description
Chunk	chunkForChunkIdx(int cidx) The Chunk for a chunk#.
static int[]	computeMap(java.lang.String[] from, java.lang.String[] to)
Vec	doCopy()
Vec	masterVec()

Methods inherited from class water.fvec.Vec

adaptTo, align, at, at16h, at16l, at8, atStr, base, bins, byteSize, cardinality, checksum_impl, chunkForRow, chunkIdx, chunkKey, chunkKey, copyMeta, domain, equals, espc, factor, get_type_str, get_type, getVecKey, group, hashCode, isBad, isBinary, isCategorical, isConst, isInt, isNA, isNumeric, isString, isTime, isUUID, lazy_bins, length, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCons, makeCons, makeCopy, makeCopy, makeCopy, makeRand, makeRepSeq, makeSeq, makeSeq, makeSeq, makeVec, makeVec, makeZero, makeZero, makeZero, makeZero, makeZeros, makeZeros, max, maxs, mean, min, mins, mode, naCnt, nChunks, newKey, ninfs, nzCnt, open, pctiles, pinfs, postWrite, preWriting, remove_impl, set, set, set, set, setBad, setDomain, sigma, sparseRatio, startRollupStats, startRollupStats, stride, toCategoricalVec, toNumericVec, toString, toStringVec

Methods inherited from class water.Keyed

checksum, getBinarySerializer, getPublishedKeys, remove, remove, remove, remove

Methods inherited from class water.Iced

clone, frozenType, read_impl, read, readExternal, readJSON_impl, readJSON, toJsonString, write_impl, write, writeExternal, writeJSON_impl, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

CategoricalWrappedVec

public CategoricalWrappedVec(Key key,
                     int rowLayout,
                     java.lang.String[] toDomain,
                     Key masterVecKey)

Main constructor: convert from one categorical to another

Method Detail

computeMap

public static int[] computeMap(java.lang.String[] from,
               java.lang.String[] to)

chunkForChunkIdx

public Chunk chunkForChunkIdx(int cidx)

Description copied from class: Vec

The Chunk for a chunk#. Warning: this pulls the data locally; using this call on every Chunk index on the same node will probably trigger an OOM!

Returns:

Chunk for a chunk#

doCopy

public Vec doCopy()

Overrides:

doCopy in class Vec

masterVec

public Vec masterVec()