public class LineSupplier extends Object implements Supplier<LineBatch>
batches
for
multiple threads to consume. The line numbers associated with the batches will start at 1. The definition of a line
follows the BufferedReader.readLine()
definition. The lines in the resulting batches will not have any
line-termination characters in them.Modifier and Type | Class and Description |
---|---|
static interface |
LineSupplier.InputStreamSupplier |
Constructor and Description |
---|
LineSupplier(InputStream theInput,
FileFormat.Compression theCompression) |
LineSupplier(LineSupplier.InputStreamSupplier theInput,
FileFormat.Compression theCompression) |
LineSupplier(Path theFile,
FileFormat.Compression theCompression) |
Modifier and Type | Method and Description |
---|---|
long |
bytesRead()
The number of bytes that have been read so far.
|
LineBatch |
get()
Retrieve the next batch available.
|
void |
setBatchSize(int theBatchSize)
Sets the number of lines that should be in every batch.
|
void |
setQueueSize(int theQueueSize)
Sets the maximum number of batches that should be buffered internally.
|
void |
start()
Starts the reading process.
|
void |
stop()
Stops reading the lines as soon as possible.
|
public LineSupplier(Path theFile, FileFormat.Compression theCompression)
public LineSupplier(InputStream theInput, FileFormat.Compression theCompression)
public LineSupplier(LineSupplier.InputStreamSupplier theInput, FileFormat.Compression theCompression)
public void setBatchSize(int theBatchSize)
starts.
public void setQueueSize(int theQueueSize)
starts.
public void start() throws IOException
shared executor
until the stream is consumed or this supplier is stopped
.
If this function is called multiple times subsequent calls will have no effect.IOException
public void stop()
public long bytesRead()
public LineBatch get()
an empty batch
will be returned for all
subsequent calls.Copyright © 2010-2016 Stardog Union. All Rights Reserved.