hex

Class ModelMetrics

java.lang.Object

water.Iced<T>

water.Keyed<ModelMetrics>

hex.ModelMetrics

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<ModelMetrics>

Direct Known Subclasses:

ModelMetricsSupervised, ModelMetricsUnsupervised

public class ModelMetrics
extends Keyed<ModelMetrics>

Container to hold the metric for a model as scored on a specific frame. The MetricBuilder class is used in a hot inner-loop of a Big Data pass, and when given a class-distribution, can be used to compute CM's, and AUC's "on the fly" during ModelBuilding - or after-the-fact with a Model and a new Frame to be scored.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ModelMetrics.MetricBuilder<T extends ModelMetrics.MetricBuilder<T>> Class used to compute AUCs, CMs & HRs "on the fly" during other passes over Big Data.

Nested classes/interfaces inherited from class water.Keyed

Keyed.BinarySerializer<X extends Keyed>

Field Summary

Fields

Modifier and Type	Field and Description
java.lang.String	_description
double	_MSE
long	_scoring_time

Fields inherited from class water.Keyed

_key, EMPTY_KEY_LIST

Constructor Summary

Constructors

Constructor and Description
ModelMetrics(Model model, Frame frame, double MSE, java.lang.String desc)

Method Summary

Methods

Modifier and Type	Method and Description
AUC2	auc()
static Key<ModelMetrics>	buildKey(Model model, Frame frame)
static TwoDimTable	calcVarImp(double[] rel_imp, java.lang.String[] coef_names)
static TwoDimTable	calcVarImp(double[] rel_imp, java.lang.String[] coef_names, java.lang.String table_header, java.lang.String[] col_headers)
static TwoDimTable	calcVarImp(float[] rel_imp, java.lang.String[] coef_names)
static TwoDimTable	calcVarImp(VarImp vi)
protected long	checksum_impl() High-quality 64-bit checksum of the content of the object.
ConfusionMatrix	cm()
Frame	frame()
static ModelMetrics	getFromDKV(Model model, Frame frame)
float[]	hr()
boolean	isForFrame(Frame f)
boolean	isForModel(Model m)
Model	model()
double	mse()

Methods inherited from class water.Keyed

checksum, getBinarySerializer, getPublishedKeys, remove_impl, remove, remove, remove, remove

Methods inherited from class water.Iced

clone, frozenType, read_impl, read, readExternal, readJSON_impl, readJSON, toJsonString, write_impl, write, writeExternal, writeHTML_impl, writeHTML, writeJSON_impl, writeJSON

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_description

public java.lang.String _description

_scoring_time

public final long _scoring_time

_MSE

public final double _MSE

Constructor Detail

ModelMetrics

public ModelMetrics(Model model,
            Frame frame,
            double MSE,
            java.lang.String desc)

Method Detail

model

public Model model()

frame

public Frame frame()

mse

public double mse()

cm

public ConfusionMatrix cm()

hr

public float[] hr()

auc

public AUC2 auc()

calcVarImp

public static TwoDimTable calcVarImp(VarImp vi)

calcVarImp

public static TwoDimTable calcVarImp(float[] rel_imp,
                     java.lang.String[] coef_names)

calcVarImp

public static TwoDimTable calcVarImp(double[] rel_imp,
                     java.lang.String[] coef_names)

calcVarImp

public static TwoDimTable calcVarImp(double[] rel_imp,
                     java.lang.String[] coef_names,
                     java.lang.String table_header,
                     java.lang.String[] col_headers)

buildKey

public static Key<ModelMetrics> buildKey(Model model,
                         Frame frame)

isForModel

public boolean isForModel(Model m)

isForFrame

public boolean isForFrame(Frame f)

getFromDKV

public static ModelMetrics getFromDKV(Model model,
                      Frame frame)

checksum_impl

protected long checksum_impl()

Description copied from class: Keyed

High-quality 64-bit checksum of the content of the object. Similar to hashcode(), but a long to reduce the chance of hash clashes. For composite objects this should be defined using the subcomponents' checksums (or hashcodes if not available). If two Keyed objects have the same checksum() there should be a 1 - 1/2^64 chance that they are the same object by value.

Specified by:

checksum_impl in class Keyed<ModelMetrics>