water.util

Class FrameUtils.CalculateWeightMeanSTD

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<T>

water.DTask<T>

water.MRTask<FrameUtils.CalculateWeightMeanSTD>

water.util.FrameUtils.CalculateWeightMeanSTD

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, ForkJoinPool.ManagedBlocker, Freezable<FrameUtils.CalculateWeightMeanSTD>

Enclosing class:

FrameUtils

public static class FrameUtils.CalculateWeightMeanSTD
extends MRTask<FrameUtils.CalculateWeightMeanSTD>

This class will calculate the weighted mean and standard deviatioin of a target column of a data frame with the weights specified in another column. For the weighted mean, it is calculated as (sum from i=1 to N wi*xi)/(sum from i=1 to N wi) For the weigthed std, it is calculated as (sum from i=1 to N wi*(xi-weightedMean)*(xi-weightedMean))/(C *sum from i=1 to N wi) where C = (M-1)/M and M is the number of nonzero weights.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class water.DTask

DTask.DKeyTask<T extends DTask.DKeyTask,V extends Keyed>, DTask.RemoveCall

Field Summary

Fields

Modifier and Type	Field and Description
long	_nonZeroWeightsNum
double	_weightedCount
double	_weightedEleSqSum
double	_weightedEleSum
double	_weightedMean
double	_weightedSigma

Fields inherited from class water.MRTask

_appendables, _fr, _fs, _hi, _keys, _left, _lo, _nhi, _nleft, _nlo, _nrite, _rite, _run_local, _topLocal

Fields inherited from class water.DTask

_ex

Constructor Summary

Constructors

Constructor and Description
CalculateWeightMeanSTD()

Method Summary

Modifier and Type	Method and Description
double	getWeightedMean()
double	getWeightedSigma()
void	map(Chunk pcs, Chunk wcs) Override with your map implementation.
void	postGlobal()
void	reduce(FrameUtils.CalculateWeightMeanSTD other) Override to combine results from 'mrt' into 'this' MRTask.

Methods inherited from class water.MRTask

appendables, asyncExecOnAllNodes, block, closeLocal, compute2, dfork, dfork, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, modifiesVolatileVecs, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, profile, profString, self, setupLocal

Methods inherited from class water.DTask

copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException

Methods inherited from class water.H2O.H2OCountedCompleter

asBytes, clone, compute, compute1, currThrPriority, frozenType, icer, priority, read, readJSON, reloadFromBytes, write, writeJSON

Methods inherited from class jsr166y.CountedCompleter

__tryComplete, addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_weightedEleSum

public double _weightedEleSum

_weightedEleSqSum

public double _weightedEleSqSum

_weightedCount

public double _weightedCount

_weightedMean

public double _weightedMean

_weightedSigma

public double _weightedSigma

_nonZeroWeightsNum

public long _nonZeroWeightsNum

Constructor Detail

CalculateWeightMeanSTD

public CalculateWeightMeanSTD()

Method Detail

map

public void map(Chunk pcs,
                Chunk wcs)

Description copied from class: MRTask

Override with your map implementation. This overload is given two local Chunks. All map variants are called, but only one is expected to be overridden.

Overrides:

map in class MRTask<FrameUtils.CalculateWeightMeanSTD>

reduce

public void reduce(FrameUtils.CalculateWeightMeanSTD other)

Description copied from class: MRTask

Override to combine results from 'mrt' into 'this' MRTask. Both 'this' and 'mrt' are guaranteed to either have map() run on them, or be the results of a prior reduce(). Reduce is optional if, e.g., the result is some output vector.

Overrides:

reduce in class MRTask<FrameUtils.CalculateWeightMeanSTD>

postGlobal

public void postGlobal()

Overrides:

postGlobal in class MRTask<FrameUtils.CalculateWeightMeanSTD>

getWeightedMean

public double getWeightedMean()

getWeightedSigma

public double getWeightedSigma()