hex.tree

Class ScoreBuildHistogram

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<T>

water.DTask<T>

water.MRTask<ScoreBuildHistogram>

hex.tree.ScoreBuildHistogram

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, jsr166y.ForkJoinPool.ManagedBlocker, water.Freezable

public class ScoreBuildHistogram
extends water.MRTask<ScoreBuildHistogram>

Score and Build Histogram

Fuse 2 conceptual passes into one:

Pass 1:

Score a prior partially-built tree model, and make new Node assignments to every row. This involves pulling out the current assigned DecidedNode, "scoring" the row against that Node's decision criteria, and assigning the row to a new child UndecidedNode (and giving it an improved prediction).

Pass 2:

Build new summary DHistograms on the new child UndecidedNodes every row got assigned into. Collect counts, mean, variance, min, max per bin, per column.

The result is a set of DHistogram arrays; one DHistogram array for each unique 'leaf' in the tree being histogramed in parallel. These have node ID's (nids) from 'leaf' to 'tree._len'. Each DHistogram array is for all the columns in that 'leaf'.

The other result is a prediction "score" for the whole dataset, based on the previous passes' DHistograms.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class water.DTask

water.DTask.DKeyTask<T extends water.DTask.DKeyTask,V extends water.Keyed>, water.DTask.RemoveCall

Field Summary

Fields

Modifier and Type	Field and Description
static int	DECIDED_ROW Marker for already decided row.
static int	OUT_OF_BAG Marker for sampled out rows

Fields inherited from class water.MRTask

_appendables, _fr, _fs, _hi, _keys, _left, _lo, _nhi, _nleft, _nlo, _nrite, _rite, _run_local, _topLocal

Fields inherited from class water.DTask

_ex, _modifiesInputs

Constructor Summary

Constructors

Constructor and Description
ScoreBuildHistogram(water.H2O.H2OCountedCompleter cc, int k, int ncols, int nbins, int nbins_cats, DTree tree, int leaf, DHistogram[][] hcs, boolean subset)

Method Summary

Methods

Modifier and Type	Method and Description
static boolean	isDecidedRow(int nid)
static boolean	isOOBRow(int nid)
void	map(water.fvec.Chunk[] chks)
static int	nid2Oob(int nid)
static int	oob2Nid(int oobNid)
void	reduce(ScoreBuildHistogram sbh)
void	setupLocal()

Methods inherited from class water.MRTask

appendables, asyncExec, asyncExec, asyncExec, block, closeLocal, compute2, dfork, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, map, map, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, postGlobal, postLocal, priority, profString, self, setProfile

Methods inherited from class water.DTask

copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException

Methods inherited from class water.H2O.H2OCountedCompleter

clone, compute, frozenType, icer, nextThrPriority, read_impl, read, readJSON_impl, readJSON, write_impl, write, writeHTML_impl, writeHTML, writeJSON_impl, writeJSON

Methods inherited from class jsr166y.CountedCompleter

addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DECIDED_ROW

public static final int DECIDED_ROW

Marker for already decided row.

See Also:

Constant Field Values

OUT_OF_BAG

public static final int OUT_OF_BAG

Marker for sampled out rows

See Also:

Constant Field Values

Constructor Detail

ScoreBuildHistogram

public ScoreBuildHistogram(water.H2O.H2OCountedCompleter cc,
                   int k,
                   int ncols,
                   int nbins,
                   int nbins_cats,
                   DTree tree,
                   int leaf,
                   DHistogram[][] hcs,
                   boolean subset)

Method Detail

isOOBRow

public static boolean isOOBRow(int nid)

isDecidedRow

public static boolean isDecidedRow(int nid)

oob2Nid

public static int oob2Nid(int oobNid)

nid2Oob

public static int nid2Oob(int nid)

setupLocal

public void setupLocal()

Overrides:

setupLocal in class water.MRTask<ScoreBuildHistogram>

map

public void map(water.fvec.Chunk[] chks)

Overrides:

map in class water.MRTask<ScoreBuildHistogram>

reduce

public void reduce(ScoreBuildHistogram sbh)

Overrides:

reduce in class water.MRTask<ScoreBuildHistogram>