hex

Class FrameExtractor

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter

hex.FrameExtractor

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>

Direct Known Subclasses:

NFoldFrameExtractor

public abstract class FrameExtractor
extends H2O.H2OCountedCompleter

Support class for extracting things from frame.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
FrameExtractor(Frame dataset, Key[] destKeys, Key jobKey)

Method Summary

Methods

Modifier and Type	Method and Description
void	compute2()
protected abstract long[][]	computeEspcPerSplit(long[] espc, long nrows) Compute espc for output vectors for each split.
protected abstract MRTask2	createNewWorker(H2O.H2OCountedCompleter completer, Vec[] inputVecs, int split) Create a new worker which has to setup given completer.
protected Key[]	generateDestKeys(Key masterKey, int numberOfKeys) Generates default names for destination keys.
Frame[]	getResult() Blocking call to obtain a result of computation.
protected Vec[][]	makeTemplates() Create a templates for vector composing output frame
protected abstract int	numOfOutputs() Return a number of resulting frame which this task produces.
void	onCompletion(jsr166y.CountedCompleter caller) Performs an action when method CountedCompleter.tryComplete() is invoked and there are no pending counts, or when the unconditional method CountedCompleter.complete(java.lang.Void) is invoked.

Methods inherited from class water.H2O.H2OCountedCompleter

clone, compute, onExceptionalCompletion, priority

Methods inherited from class jsr166y.CountedCompleter

addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FrameExtractor

public FrameExtractor(Frame dataset,
              Key[] destKeys,
              Key jobKey)

Method Detail

compute2

public void compute2()

Specified by:

compute2 in class H2O.H2OCountedCompleter

getResult

public Frame[] getResult()

Blocking call to obtain a result of computation.

onCompletion

public void onCompletion(jsr166y.CountedCompleter caller)

Description copied from class: jsr166y.CountedCompleter

Performs an action when method CountedCompleter.tryComplete() is invoked and there are no pending counts, or when the unconditional method CountedCompleter.complete(java.lang.Void) is invoked. By default, this method does nothing.

Overrides:

onCompletion in class jsr166y.CountedCompleter

Parameters:

caller - the task invoking this method (which may be this task itself).

createNewWorker

protected abstract MRTask2 createNewWorker(H2O.H2OCountedCompleter completer,
                      Vec[] inputVecs,
                      int split)

Create a new worker which has to setup given completer.

makeTemplates

protected Vec[][] makeTemplates()

Create a templates for vector composing output frame

computeEspcPerSplit

protected abstract long[][] computeEspcPerSplit(long[] espc,
                           long nrows)

Compute espc for output vectors for each split.

Parameters:

espc - input vector espc

nrows - total number of rows in input vector

Returns:

espc for each partition

generateDestKeys

protected Key[] generateDestKeys(Key masterKey,
                     int numberOfKeys)

Generates default names for destination keys.

Parameters:

masterKey - key for input dataset

numberOfKeys - number of keys to generate

Returns:

return an array of keys.

numOfOutputs

protected abstract int numOfOutputs()

Return a number of resulting frame which this task produces.