hex.gram

Class Gram.GramTask

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<T>

water.DTask<T>

water.MRTask<T>

hex.FrameTask<Gram.GramTask>

hex.gram.Gram.GramTask

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, jsr166y.ForkJoinPool.ManagedBlocker, water.Freezable

Enclosing class:

Gram

public static class Gram.GramTask
extends FrameTask<Gram.GramTask>

Task to compute gram matrix normalized by the number of observations (not counting rows with NAs). in R's notation g = t(X)%*%X/nobs, nobs = number of rows of X with no NA.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class hex.FrameTask

FrameTask.ExtractDenseRow

Nested classes/interfaces inherited from class water.DTask

water.DTask.DKeyTask<T extends water.DTask.DKeyTask,V extends water.Keyed>, water.DTask.RemoveCall

Field Summary

Fields

Modifier and Type	Field and Description
Gram	_gram
long	_nobs

Fields inherited from class hex.FrameTask

_dinfo, _jobKey, _shuffle, _useFraction

Fields inherited from class water.MRTask

_appendables, _fr, _fs, _hi, _keys, _left, _lo, _nhi, _nleft, _nlo, _nrite, _rite, _run_local, _topLocal

Fields inherited from class water.DTask

_ex, _modifiesInputs

Constructor Summary

Constructors

Constructor and Description
Gram.GramTask(water.Key jobKey, DataInfo dinfo)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	chunkDone(long n) Override this to do post-chunk processing work.
protected boolean	chunkInit() Override this to initialize at the beginning of chunk processing.
protected void	processRow(long gid, DataInfo.Row r) Method to process one row of the data.
void	reduce(Gram.GramTask gt)

Methods inherited from class hex.FrameTask

applyMiniBatchUpdate, closeLocal, dinfo, getMiniBatchSize, map, processRow, setupLocal

Methods inherited from class water.MRTask

appendables, asyncExec, asyncExec, asyncExec, asyncExec, asyncExecOnAllNodes, block, compute2, dfork, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, map, map, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, postGlobal, postLocal, priority, profString, self, setProfile

Methods inherited from class water.DTask

copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException

Methods inherited from class water.H2O.H2OCountedCompleter

clone, compute, frozenType, icer, nextThrPriority, read_impl, read, readJSON_impl, readJSON, write_impl, write, writeJSON_impl, writeJSON

Methods inherited from class jsr166y.CountedCompleter

addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_gram

public Gram _gram

_nobs

public long _nobs

Constructor Detail

Gram.GramTask

public Gram.GramTask(water.Key jobKey,
             DataInfo dinfo)

Method Detail

chunkInit

protected boolean chunkInit()

Description copied from class: FrameTask

Override this to initialize at the beginning of chunk processing.

Overrides:

chunkInit in class FrameTask<Gram.GramTask>

Returns:

whether or not to process this chunk

processRow

protected void processRow(long gid,
              DataInfo.Row r)

Description copied from class: FrameTask

Method to process one row of the data. See for separate mini-batch logic below. Numeric and categorical values are passed separately, as is response. Categoricals are passed as absolute indexes into the expanded beta vector, 0-levels are skipped (so the number of passed categoricals will not be the same for every row). Categorical expansion/indexing: Categoricals are placed in the beginning of the beta vector. Each cat variable with n levels is expanded into n-1 independent binary variables. Indexes in cats[] will point to the appropriate coefficient in the beta vector, so e.g. assume we have 2 categorical columns both with values A,B,C, then the following rows will have following indexes: A,A - ncats = 0, we do not pass any categorical here A,B - ncats = 1, indexes = [2] B,B - ncats = 2, indexes = [0,2] and so on

Overrides:

processRow in class FrameTask<Gram.GramTask>

Parameters:

gid - - global id of this row, in [0,_adaptedFrame.numRows())

chunkDone

protected void chunkDone(long n)

Description copied from class: FrameTask

Override this to do post-chunk processing work.

Overrides:

chunkDone in class FrameTask<Gram.GramTask>

Parameters:

n - Number of processed rows

reduce

public void reduce(Gram.GramTask gt)

Overrides:

reduce in class water.MRTask<Gram.GramTask>