water.util

Class VecUtils.DomainDedupe

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<T>

water.DTask<T>

water.MRTask<VecUtils.DomainDedupe>

water.util.VecUtils.DomainDedupe

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, ForkJoinPool.ManagedBlocker, Freezable<VecUtils.DomainDedupe>

Enclosing class:

VecUtils

public static class VecUtils.DomainDedupe
extends MRTask<VecUtils.DomainDedupe>

Create a new categorical Vec with deduplicated domains from a categorical Vec. Categoricals may have the same values after munging, and should have the same domain index in the numerical chunk representation. Unify categoricals that are the same by remapping their domain indices. Could be more efficient with a vec copy and replace domain indices as needed. PUBDEV-2587

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class water.DTask

DTask.DKeyTask<T extends DTask.DKeyTask,V extends Keyed>, DTask.RemoveCall

Field Summary

Fields inherited from class water.MRTask

_appendables, _fr, _fs, _hi, _keys, _left, _lo, _nhi, _nleft, _nlo, _nrite, _rite, _run_local, _topLocal

Fields inherited from class water.DTask

_ex

Constructor Summary

Constructors

Constructor and Description
DomainDedupe(java.util.HashMap<java.lang.Integer,java.lang.Integer> oldToNewDomainIndex)

Method Summary

Modifier and Type	Method and Description
static Vec	domainDeduper(Vec vec, java.util.HashMap<java.lang.String,java.util.ArrayList<java.lang.Integer>> substringToOldDomainIndices)
void	map(Chunk c, NewChunk nc)

Methods inherited from class water.MRTask

appendables, asyncExecOnAllNodes, block, closeLocal, compute2, dfork, dfork, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, modifiesVolatileVecs, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, postGlobal, profile, profString, reduce, self, setupLocal

Methods inherited from class water.DTask

copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException

Methods inherited from class water.H2O.H2OCountedCompleter

asBytes, clone, compute, compute1, currThrPriority, frozenType, icer, priority, read, readJSON, reloadFromBytes, write, writeJSON

Methods inherited from class jsr166y.CountedCompleter

__tryComplete, addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DomainDedupe

public DomainDedupe(java.util.HashMap<java.lang.Integer,java.lang.Integer> oldToNewDomainIndex)

Method Detail

map

public void map(Chunk c,
                NewChunk nc)

Overrides:

map in class MRTask<VecUtils.DomainDedupe>

domainDeduper

public static Vec domainDeduper(Vec vec,
                                java.util.HashMap<java.lang.String,java.util.ArrayList<java.lang.Integer>> substringToOldDomainIndices)