water.parser

Class Parser

java.lang.Object

water.Iced

water.parser.Parser

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable

public abstract class Parser
extends Iced

A collection of utility classes for parsing. Interfaces: DataIn - Manage bulk streaming input data to the parser. Sometimes the data comes from parallel raw byte file reads, with speculative line starts. Sometimes the data comes from an InputStream - probably a GZIP stream. DataOut- Interface for writing results of parsing, accumulating numbers and strings or handling invalid lines & parse errors. static classes: StreamData - Class implementing DataIn from a Stream (probably a GZIP stream) InspectDataOut - Class implementing DataOut, on behalf of the GUI, for parsing & previewing the first few lines & columns of a file.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected Key<Job>	_jobKey
protected ParseSetup	_setup
protected byte	CHAR_DECIMAL_SEP
protected byte	CHAR_SEPARATOR
protected static byte	COND_QUOTE
protected static byte	COND_QUOTED_NUMBER_END
protected static byte	COND_QUOTED_TOKEN
protected static byte	EOL
protected static byte	EXPECT_COND_LF
protected static long	LARGEST_DIGIT_NUMBER
protected static byte	NUMBER
protected static byte	NUMBER_END
protected static byte	NUMBER_EXP
protected static byte	NUMBER_EXP_START
protected static byte	NUMBER_FRACTION
protected static byte	NUMBER_SKIP
protected static byte	NUMBER_SKIP_NO_DOT
protected static byte	POSSIBLE_CURRENCY
protected static byte	POSSIBLE_EMPTY_LINE
protected static byte	SEPARATOR_OR_EOL
protected static byte	SKIP_LINE
protected static byte	STRING
protected static byte	STRING_END
protected static byte	TOKEN
protected static byte	WHITESPACE_BEFORE_TOKEN

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	Parser(ParseSetup setup, Key<Job> jobKey)

Method Summary

Methods

Modifier and Type	Method and Description
protected int	fileHasHeader(byte[] bits, ParseSetup ps)
protected static boolean	isEOL(byte c)
protected abstract ParseWriter	parseChunk(int cidx, ParseReader din, ParseWriter dout)
protected ParseWriter	streamParse(java.io.InputStream is, StreamParseWriter dout)
protected ParseWriter	streamParseZip(java.io.InputStream is, StreamParseWriter dout, java.io.InputStream bvs)

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SKIP_LINE

protected static final byte SKIP_LINE

See Also:

Constant Field Values

EXPECT_COND_LF

protected static final byte EXPECT_COND_LF

See Also:

Constant Field Values

EOL

protected static final byte EOL

See Also:

Constant Field Values

TOKEN

protected static final byte TOKEN

See Also:

Constant Field Values

COND_QUOTED_TOKEN

protected static final byte COND_QUOTED_TOKEN

See Also:

Constant Field Values

NUMBER

protected static final byte NUMBER

See Also:

Constant Field Values

NUMBER_SKIP

protected static final byte NUMBER_SKIP

See Also:

Constant Field Values

NUMBER_SKIP_NO_DOT

protected static final byte NUMBER_SKIP_NO_DOT

See Also:

Constant Field Values

NUMBER_FRACTION

protected static final byte NUMBER_FRACTION

See Also:

Constant Field Values

NUMBER_EXP

protected static final byte NUMBER_EXP

See Also:

Constant Field Values

NUMBER_EXP_START

protected static final byte NUMBER_EXP_START

See Also:

Constant Field Values

NUMBER_END

protected static final byte NUMBER_END

See Also:

Constant Field Values

STRING

protected static final byte STRING

See Also:

Constant Field Values

COND_QUOTE

protected static final byte COND_QUOTE

See Also:

Constant Field Values

SEPARATOR_OR_EOL

protected static final byte SEPARATOR_OR_EOL

See Also:

Constant Field Values

WHITESPACE_BEFORE_TOKEN

protected static final byte WHITESPACE_BEFORE_TOKEN

See Also:

Constant Field Values

STRING_END

protected static final byte STRING_END

See Also:

Constant Field Values

COND_QUOTED_NUMBER_END

protected static final byte COND_QUOTED_NUMBER_END

See Also:

Constant Field Values

POSSIBLE_EMPTY_LINE

protected static final byte POSSIBLE_EMPTY_LINE

See Also:

Constant Field Values

POSSIBLE_CURRENCY

protected static final byte POSSIBLE_CURRENCY

See Also:

Constant Field Values

CHAR_DECIMAL_SEP

protected final byte CHAR_DECIMAL_SEP

See Also:

Constant Field Values

CHAR_SEPARATOR

protected final byte CHAR_SEPARATOR

LARGEST_DIGIT_NUMBER

protected static final long LARGEST_DIGIT_NUMBER

See Also:

Constant Field Values

_setup

protected final ParseSetup _setup

_jobKey

protected final Key<Job> _jobKey

Constructor Detail

Parser

protected Parser(ParseSetup setup,
      Key<Job> jobKey)

Method Detail

isEOL

protected static boolean isEOL(byte c)

fileHasHeader

protected int fileHasHeader(byte[] bits,
                ParseSetup ps)

parseChunk

protected abstract ParseWriter parseChunk(int cidx,
                     ParseReader din,
                     ParseWriter dout)

streamParse

protected ParseWriter streamParse(java.io.InputStream is,
                      StreamParseWriter dout)
                           throws java.io.IOException

Throws:

java.io.IOException

streamParseZip

protected ParseWriter streamParseZip(java.io.InputStream is,
                         StreamParseWriter dout,
                         java.io.InputStream bvs)
                              throws java.io.IOException

Throws:

java.io.IOException