water.fvec

Class ByteVec

java.lang.Object

water.Iced<T>

water.Keyed<Vec>

water.fvec.Vec

water.fvec.ByteVec

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Vec>

Direct Known Subclasses:

FileVec

public class ByteVec
extends Vec

A vector of plain Bytes.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.ESPC, Vec.Reader, Vec.VectorGroup, Vec.Writer

Field Summary

Fields inherited from class water.fvec.Vec

_rowLayout, DO_HISTOGRAMS, KEY_PREFIX_LEN, PERCENTILES, T_BAD, T_CAT, T_NUM, T_STR, T_TIME, T_UUID, TYPE_STR

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Constructor and Description
ByteVec(Key key, int rowLayout)

Method Summary

Methods

Modifier and Type	Method and Description
water.fvec.C1NChunk	chunkForChunkIdx(int cidx) The Chunk for a chunk#.
byte[]	getFirstBytes() Get an unspecified amount of initial bytes; typically a whole C1NChunk of length Vec.DFLT_CHUNK_SIZE but no guarantees.
byte[]	getPreviewChunkBytes(int chkIdx) Get all the bytes of a given chunk.
boolean	isInt() Is all integers? Yes, it's all bytes
long	naCnt() Return column missing-element-count - ByteVecs do not allow any "missing elements"
java.io.InputStream	openStream(Key job_key) Open a stream view over the underlying data

Methods inherited from class water.fvec.Vec

adaptTo, align, at, at16h, at16l, at8, atStr, base, bins, byteSize, cardinality, checksum_impl, chunkForRow, chunkIdx, chunkKey, chunkKey, copyMeta, doCopy, domain, elem2ChunkIdx, equals, espc, factor, get_type_str, get_type, getVecKey, group, hashCode, isBad, isBinary, isCategorical, isConst, isNA, isNumeric, isString, isTime, isUUID, lazy_bins, length, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCons, makeCons, makeCopy, makeCopy, makeCopy, makeDoubles, makeRand, makeRepSeq, makeSeq, makeSeq, makeSeq, makeVec, makeVec, makeVec, makeZero, makeZero, makeZero, makeZero, makeZeros, makeZeros, max, maxs, mean, min, mins, mode, nChunks, newKey, ninfs, nzCnt, open, pctiles, pinfs, postWrite, preWriting, readAll_impl, remove_impl, rollupStatsKey, set, set, set, set, setBad, setDomain, sigma, sparseRatio, startRollupStats, startRollupStats, stride, toCategoricalVec, toNumericVec, toString, toStringVec, writeAll_impl

Methods inherited from class water.Keyed

checksum, makeSchema, readAll, remove, remove, remove, remove, writeAll

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ByteVec

public ByteVec(Key key,
       int rowLayout)

Method Detail

chunkForChunkIdx

public water.fvec.C1NChunk chunkForChunkIdx(int cidx)

Description copied from class: Vec

The Chunk for a chunk#. Warning: this pulls the data locally; using this call on every Chunk index on the same node will probably trigger an OOM!

Overrides:

chunkForChunkIdx in class Vec

Returns:

Chunk for a chunk#

naCnt

public long naCnt()

Return column missing-element-count - ByteVecs do not allow any "missing elements"

Overrides:

naCnt in class Vec

Returns:

Count of missing elements

isInt

public boolean isInt()

Is all integers? Yes, it's all bytes

Overrides:

isInt in class Vec

Returns:

true if the Vec is all integers

getFirstBytes

public byte[] getFirstBytes()

Get an unspecified amount of initial bytes; typically a whole C1NChunk of length Vec.DFLT_CHUNK_SIZE but no guarantees. Useful for previewing the start of large files.

Returns:

array of initial bytes

getPreviewChunkBytes

public byte[] getPreviewChunkBytes(int chkIdx)

Get all the bytes of a given chunk. Useful for previewing sections of files.

Parameters:

chkIdx - index of desired chunk

Returns:

array of initial bytes

openStream

public java.io.InputStream openStream(Key job_key)

Open a stream view over the underlying data