hex

Class FrameTask<T extends FrameTask<T>>

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter

water.DTask

water.MRTask2<T>

hex.FrameTask<T>

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, jsr166y.ForkJoinPool.ManagedBlocker, Freezable

Direct Known Subclasses:

DeepLearningTask, GLMTask, GLMTask.LMIterationTask, Gram.GramTask, PCAScore.PCAScoreTask

public abstract class FrameTask<T extends FrameTask<T>>
extends MRTask2<T>

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FrameTask.DataInfo

Field Summary

Fields

Modifier and Type	Field and Description
protected FrameTask.DataInfo	_dinfo
protected boolean	_shuffle
protected float	_useFraction

Fields inherited from class water.MRTask2

_appendables, _fr, _fs, _hi, _left, _lo, _nhi, _nleft, _nrite, _nxx, _rite, _t0, _topLocal

Fields inherited from class water.DTask

_cls, _eFromNode, _exception, _fname, _lineNum, _msg, _mth

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	FrameTask(FrameTask ft)
	FrameTask(Job job, FrameTask.DataInfo dinfo)
	FrameTask(Job job, FrameTask.DataInfo dinfo, H2O.H2OCountedCompleter cmp)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	chunkDone() Override this to do post-chunk processing work.
protected void	chunkInit() Override this to initialize at the beginning of chunk processing.
T	dfork(Frame fr)
void	map(Chunk[] chunks, NewChunk[] outputs) Extracts the values, applies regularization to numerics, adds appropriate offsets to categoricals, and adapts response according to the CaseMode/CaseValue if set.
double[]	normMul()
double[]	normRespMul()
double[]	normRespSub()
double[]	normSub()
protected void	processRow(long gid, double[] nums, int ncats, int[] cats, double[] response) Method to process one row of the data for GLM functions.
protected void	processRow(long gid, double[] nums, int ncats, int[] cats, double[] response, NewChunk[] outputs)

Methods inherited from class water.MRTask2

asyncExec, asyncExec, asyncExec, block, clone, closeLocal, compute2, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, exec, exec, exec, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, map, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, postGlobal, priority, profString, reduce, reduce4, setupLocal, vecs

Methods inherited from class water.DTask

copyOver, frozenType, getDException, hasException, logVerbose, newInstance, onAck, onAckAck, read, setException, toDocField, write, writeJSONFields

Methods inherited from class water.H2O.H2OCountedCompleter

compute

Methods inherited from class jsr166y.CountedCompleter

addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_dinfo

protected final FrameTask.DataInfo _dinfo

_useFraction

protected float _useFraction

_shuffle

protected boolean _shuffle

Constructor Detail

FrameTask

public FrameTask(Job job,
         FrameTask.DataInfo dinfo)

FrameTask

public FrameTask(Job job,
         FrameTask.DataInfo dinfo,
         H2O.H2OCountedCompleter cmp)

FrameTask

protected FrameTask(FrameTask ft)

Method Detail

normMul

public final double[] normMul()

normSub

public final double[] normSub()

normRespMul

public final double[] normRespMul()

normRespSub

public final double[] normRespSub()

processRow

protected void processRow(long gid,
              double[] nums,
              int ncats,
              int[] cats,
              double[] response)

Method to process one row of the data for GLM functions. Numeric and categorical values are passed separately, as is response. Categoricals are passed as absolute indexes into the expanded beta vector, 0-levels are skipped (so the number of passed categoricals will not be the same for every row). Categorical expansion/indexing: Categoricals are placed in the beginning of the beta vector. Each cat variable with n levels is expanded into n-1 independent binary variables. Indexes in cats[] will point to the appropriate coefficient in the beta vector, so e.g. assume we have 2 categorical columns both with values A,B,C, then the following rows will have following indexes: A,A - ncats = 0, we do not pass any categorical here A,B - ncats = 1, indexes = [2] B,B - ncats = 2, indexes = [0,2] and so on

Parameters:

gid - - global id of this row, in [0,_adaptedFrame.numRows())

nums - - numeric values of this row

ncats - - number of passed (non-zero) categoricals

cats - - indexes of categoricals into the expanded beta-vector.

response - - numeric value for the response

processRow

protected void processRow(long gid,
              double[] nums,
              int ncats,
              int[] cats,
              double[] response,
              NewChunk[] outputs)

dfork

public T dfork(Frame fr)

Overrides:

dfork in class MRTask2<T extends FrameTask<T>>

chunkInit

protected void chunkInit()

Override this to initialize at the beginning of chunk processing.

chunkDone

protected void chunkDone()

Override this to do post-chunk processing work.

map

public final void map(Chunk[] chunks,
       NewChunk[] outputs)

Extracts the values, applies regularization to numerics, adds appropriate offsets to categoricals, and adapts response according to the CaseMode/CaseValue if set.

Overrides:

map in class MRTask2<T extends FrameTask<T>>