gr.cite.geoanalytics.functions.output.file

Class HdfsFileWriter

java.lang.Object

gr.cite.geoanalytics.functions.output.file.HdfsFileWriter

All Implemented Interfaces:

FileWriterI

public class HdfsFileWriter
extends Object
implements FileWriterI

Constructor Summary

Constructors

Constructor and Description
HdfsFileWriter(String hdfsHost)
HdfsFileWriter(String hdfsHost, String asUser)

Method Summary

Modifier and Type	Method and Description
void	close()
OutputStream	getStreamOutputForPath(String fullDestFilePath) Note that it overwrites the destination file, if present
void	writeBytesAtPath(String fullDestFilePath, byte[] data)
void	writeBytesAtPathIfNotExist(String fullDestFilePath, byte[] data)
void	writeFile(File fileToWrite, String fullDestFilePath) Note that it overwrites the destination file, if present

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HdfsFileWriter

public HdfsFileWriter(String hdfsHost)
               throws IOException,
                      URISyntaxException

Parameters:

hdfsHost - is the namenode host of the hdfs. e.g: hdfs://node1.madgik.di.uoa.gr:50050

Throws:

IOException

URISyntaxException

HdfsFileWriter

public HdfsFileWriter(String hdfsHost,
                      String asUser)
               throws IOException,
                      URISyntaxException

Parameters:

hdfsHost - is the namenode host of the hdfs. e.g: hdfs://node1.madgik.di.uoa.gr:50050

asUser - is the username for the hadoop. e.g: sys-hcv

Throws:

IOException

URISyntaxException

Method Detail

writeFile

public void writeFile(File fileToWrite,
                      String fullDestFilePath)
               throws IOException

Note that it overwrites the destination file, if present

Specified by:

writeFile in interface FileWriterI

Parameters:

fullDestFilePath - the full file path to write on hdfs. It should start with a / , as in unix. i.e. /Myfolder/file1.png

Throws:

IOException

getStreamOutputForPath

public OutputStream getStreamOutputForPath(String fullDestFilePath)
                                    throws IOException

Note that it overwrites the destination file, if present

Specified by:

getStreamOutputForPath in interface FileWriterI

Parameters:

fullDestFilePath - gets an output stream for writing on the specified fullDestFilePath

Returns:

Throws:

IOException

writeBytesAtPath

public void writeBytesAtPath(String fullDestFilePath,
                             byte[] data)
                      throws IOException

Specified by:

writeBytesAtPath in interface FileWriterI

Throws:

IOException

writeBytesAtPathIfNotExist

public void writeBytesAtPathIfNotExist(String fullDestFilePath,
                                       byte[] data)
                                throws IOException

Specified by:

writeBytesAtPathIfNotExist in interface FileWriterI

Throws:

IOException

close

public void close()

Specified by:

close in interface FileWriterI