public abstract class FrameTask<T extends FrameTask<T>>
extends water.MRTask<T>
Modifier and Type | Field and Description |
---|---|
protected DataInfo |
_dinfo |
protected water.Key |
_jobKey |
protected boolean |
_shuffle |
protected float |
_useFraction |
Modifier | Constructor and Description |
---|---|
protected |
FrameTask(FrameTask ft) |
|
FrameTask(water.Key jobKey,
DataInfo dinfo) |
|
FrameTask(water.Key jobKey,
DataInfo dinfo,
water.H2O.H2OCountedCompleter cmp) |
|
FrameTask(water.Key jobKey,
water.Key dinfoKey,
int[] activeCols) |
|
FrameTask(water.Key jobKey,
water.Key dinfoKey,
int[] activeCols,
water.H2O.H2OCountedCompleter cmp) |
Modifier and Type | Method and Description |
---|---|
protected void |
chunkDone(long n)
Override this to do post-chunk processing work.
|
protected void |
chunkInit()
Override this to initialize at the beginning of chunk processing.
|
protected void |
closeLocal() |
T |
dfork(water.fvec.Frame fr) |
DataInfo |
dinfo() |
void |
map(water.fvec.Chunk[] chunks,
water.fvec.NewChunk[] outputs)
Extracts the values, applies regularization to numerics, adds appropriate offsets to categoricals,
and adapts response according to the CaseMode/CaseValue if set.
|
protected void |
processRow(long gid,
DataInfo.Row r)
Method to process one row of the data for GLM functions.
|
protected void |
processRow(long gid,
DataInfo.Row r,
water.fvec.NewChunk[] outputs) |
protected void |
setupLocal() |
appendables, asyncExec, asyncExec, asyncExec, block, compute2, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, map, map, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, outputFrame, postGlobal, priority, profString, reduce, setProfile
copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException
clone, compute, frozenType, icer, nextThrPriority, read_impl, read, readJSON_impl, readJSON, write_impl, write, writeHTML_impl, writeHTML, writeJSON_impl, writeJSON
addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete
adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork
protected transient DataInfo _dinfo
protected final water.Key _jobKey
protected float _useFraction
protected boolean _shuffle
public FrameTask(water.Key jobKey, DataInfo dinfo)
public FrameTask(water.Key jobKey, DataInfo dinfo, water.H2O.H2OCountedCompleter cmp)
public FrameTask(water.Key jobKey, water.Key dinfoKey, int[] activeCols)
public FrameTask(water.Key jobKey, water.Key dinfoKey, int[] activeCols, water.H2O.H2OCountedCompleter cmp)
protected FrameTask(FrameTask ft)
public DataInfo dinfo()
protected void setupLocal()
protected void closeLocal()
protected void processRow(long gid, DataInfo.Row r)
gid
- - global id of this row, in [0,_adaptedFrame.numRows())protected void processRow(long gid, DataInfo.Row r, water.fvec.NewChunk[] outputs)
public T dfork(water.fvec.Frame fr)
protected void chunkInit()
protected void chunkDone(long n)
n
- Number of processed rowspublic final void map(water.fvec.Chunk[] chunks, water.fvec.NewChunk[] outputs)