public static class ParseSetup.GuessSetupTsk extends MRTask<ParseSetup.GuessSetupTsk>
DTask.DKeyTask<T extends DTask.DKeyTask,V extends Keyed>, DTask.RemoveCall
Modifier and Type | Field and Description |
---|---|
ParseSetup |
_gblSetup |
long |
_maxLineLength |
long |
_totalParseSize |
Constructor and Description |
---|
GuessSetupTsk(ParseSetup userSetup) |
Modifier and Type | Method and Description |
---|---|
void |
map(Key key)
Runs once on each file to guess that file's ParseSetup
For ByteVecs, UploadFileVecs, compressed files and small files,
the ParseSetup is guessed from a single DFLT_CHUNK_SIZE chunk from
the start of the file.
|
void |
postGlobal() |
void |
reduce(ParseSetup.GuessSetupTsk other)
Merges ParseSetup results, conflicts, and errors from several files
|
appendables, asyncExecOnAllNodes, block, closeLocal, compute2, dfork, dfork, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, modifiesVolatileVecs, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, profile, profString, self, setupLocal
copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException
asBytes, clone, compute, compute1, currThrPriority, frozenType, icer, priority, read, readJSON, reloadFromBytes, write, writeJSON
__tryComplete, addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete
adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork
public ParseSetup _gblSetup
public long _totalParseSize
public long _maxLineLength
public GuessSetupTsk(ParseSetup userSetup)
userSetup
- ParseSetup to guide examination of filespublic void map(Key key)
map
in class MRTask<ParseSetup.GuessSetupTsk>
public void reduce(ParseSetup.GuessSetupTsk other)
reduce
in class MRTask<ParseSetup.GuessSetupTsk>
public void postGlobal()
postGlobal
in class MRTask<ParseSetup.GuessSetupTsk>