water.parser

Class ParserProvider

java.lang.Object

water.parser.ParserProvider

Direct Known Subclasses:

DefaultParserProviders.ArffParserProvider, DefaultParserProviders.CsvParserProvider, DefaultParserProviders.GuessParserProvider, DefaultParserProviders.SVMLightParserProvider, DefaultParserProviders.XlsParserProvider

public abstract class ParserProvider
extends java.lang.Object

Generic Parser provider.

Constructor Summary

Constructors

Constructor and Description
ParserProvider()

Method Summary

Methods

Modifier and Type	Method and Description
abstract Parser	createParser(ParseSetup setup, Key<Job> jobKey) Create a new parser
abstract ParseSetup	createParserSetup(Key[] inputs, ParseSetup requiredSetup) Create a parser specific setup.
abstract ParseSetup	guessSetup(ByteVec v, byte[] bits, byte sep, int ncols, boolean singleQuotes, int checkHeader, java.lang.String[] columnNames, byte[] columnTypes, java.lang.String[][] domains, java.lang.String[][] naStrings) Returns parser setup of throws exception if input is not recognized
abstract ParserInfo	info() Technical information for this parser
ParseSetup	setupLocal(Vec v, ParseSetup setup) Executed exactly once per-file-per-node during parse.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParserProvider

public ParserProvider()

Method Detail

info

public abstract ParserInfo info()

Technical information for this parser

createParser

public abstract Parser createParser(ParseSetup setup,
                  Key<Job> jobKey)

Create a new parser

guessSetup

public abstract ParseSetup guessSetup(ByteVec v,
                    byte[] bits,
                    byte sep,
                    int ncols,
                    boolean singleQuotes,
                    int checkHeader,
                    java.lang.String[] columnNames,
                    byte[] columnTypes,
                    java.lang.String[][] domains,
                    java.lang.String[][] naStrings)

Returns parser setup of throws exception if input is not recognized

createParserSetup

public abstract ParseSetup createParserSetup(Key[] inputs,
                           ParseSetup requiredSetup)

Create a parser specific setup. Useful if parser need a single

Parameters:

inputs - input keys

requiredSetup - user given parser setup

Returns:

parser specific setup

setupLocal

public ParseSetup setupLocal(Vec v,
                    ParseSetup setup)

Executed exactly once per-file-per-node during parse. Do any file-related non-distributed setup here. E.g. ORC reader creates node-shared instance of a (non-serializable) Reader.

Parameters:

v -

setup -