alluxio.job.plan.transform.format.tables

Class TablesWriter

java.lang.Object

alluxio.job.plan.transform.format.tables.TablesWriter

All Implemented Interfaces:

TableWriter, Closeable, AutoCloseable

public class TablesWriter
extends Object
implements TableWriter

Writes a stream of rows to a list of tables, when Committer determines that the current table should be committed/completed, the table file is completed and a new table file is created.

Method Summary

Modifier and Type	Method and Description
void	close() Closes a writer, which means the table is complete now.
static TablesWriter	create(TableSchema schema, Committer committer, AlluxioURI outputDir)
long	getBytes() Note that the bytes written should take compression and encoding into consideration.
int	getRows()
void	write(TableRow row) Writes a row.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface alluxio.job.plan.transform.format.TableWriter

create, create

Method Detail

create

public static TablesWriter create(TableSchema schema,
                                  Committer committer,
                                  AlluxioURI outputDir)
                           throws IOException

Parameters:

schema - the table schema

committer - the committer

outputDir - the output directory

Returns:

a new writer

Throws:

IOException - when failed to create an internal table writer

write

public void write(TableRow row)
           throws IOException

Description copied from interface: TableWriter

Writes a row.

Specified by:

write in interface TableWriter

Parameters:

row - a row

Throws:

IOException - when write fails

close

public void close()
           throws IOException

Description copied from interface: TableWriter

Closes a writer, which means the table is complete now.

Specified by:

close in interface TableWriter

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException - when failing to close the underlying output stream

getRows

public int getRows()

Specified by:

getRows in interface TableWriter

Returns:

the number of rows that have been written

getBytes

public long getBytes()

Description copied from interface: TableWriter

Note that the bytes written should take compression and encoding into consideration. If the writer writes to a file, the bytes written should be an estimate of the actual bytes written to the file.

Specified by:

getBytes in interface TableWriter

Returns:

the number of bytes that have been written