org.gcube.dataanalysis.executor.job.management

Class DistributedProcessingAgent

java.lang.Object

org.gcube.dataanalysis.executor.job.management.DistributedProcessingAgent

public class DistributedProcessingAgent
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
protected Serializable	configurationFile
protected String	containerFolder
protected static String	defaultJobOutput
protected static String	defaultScriptFile
protected boolean	deletefiles
protected List<String>	endpoints
protected boolean	forceUpload
protected String	gscope
protected QueueJobManager	jobManager
protected int	leftSetNumberOfElements
protected org.apache.log4j.Logger	logger
protected String	mainclass
int	maxElementsAllowedPerJob
protected String	modelName
protected String	pathToLib
protected int	rightSetNumberOfElements
protected boolean	stop
protected int	subdivisiondiv
protected String	userName

Constructor Summary

Constructors

Constructor and Description
DistributedProcessingAgent(Serializable configurationFile, String gCubeScope, String computationOwner, String mainClass, String pathToLibFolder, String modelName, String containerFolder, int maxElementsPerJob, boolean forceReUploadofLibs, int leftSetNumberOfElements, int rightSetNumberOfElements) A distributed processing agent.

Method Summary

Methods

Modifier and Type	Method and Description
void	buildScriptFile(String jobName, String jobOutput, String jarsPath, String fullMainClass)
void	compute()
org.gcube.dataanalysis.ecoengine.configuration.INFRASTRUCTURE	getInfrastructure()
String	getLoad()
String	getResourceLoad()
String	getResources()
float	getStatus()
org.gcube.dataanalysis.ecoengine.configuration.ALG_PROPS[]	getSupportedAlgorithms()
boolean	hasResentMessages()
void	setEndPoints(List<String> endpoints)
void	setLogger(org.apache.log4j.Logger logger)
void	shutdown()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

jobManager

protected QueueJobManager jobManager

deletefiles

protected boolean deletefiles

mainclass

protected String mainclass

maxElementsAllowedPerJob

public int maxElementsAllowedPerJob

forceUpload

protected boolean forceUpload

stop

protected boolean stop

gscope

protected String gscope

userName

protected String userName

pathToLib

protected String pathToLib

modelName

protected String modelName

containerFolder

protected String containerFolder

configurationFile

protected Serializable configurationFile

rightSetNumberOfElements

protected int rightSetNumberOfElements

leftSetNumberOfElements

protected int leftSetNumberOfElements

endpoints

protected List<String> endpoints

subdivisiondiv

protected int subdivisiondiv

defaultJobOutput

protected static String defaultJobOutput

defaultScriptFile

protected static String defaultScriptFile

logger

protected org.apache.log4j.Logger logger

Constructor Detail

DistributedProcessingAgent

public DistributedProcessingAgent(Serializable configurationFile,
                          String gCubeScope,
                          String computationOwner,
                          String mainClass,
                          String pathToLibFolder,
                          String modelName,
                          String containerFolder,
                          int maxElementsPerJob,
                          boolean forceReUploadofLibs,
                          int leftSetNumberOfElements,
                          int rightSetNumberOfElements)

A distributed processing agent. Performs a distributed computation doing the MAP of the product of two sets: A and B Splits over B : A x B1 , A x B2, ... , A x Bn Prepares a script to be executed on remote nodes The computation is then sent to remote processors.

Method Detail

setLogger

public void setLogger(org.apache.log4j.Logger logger)

setEndPoints

public void setEndPoints(List<String> endpoints)

hasResentMessages

public boolean hasResentMessages()

compute

public void compute()
             throws Exception

Throws:

Exception

buildScriptFile

public void buildScriptFile(String jobName,
                   String jobOutput,
                   String jarsPath,
                   String fullMainClass)
                     throws Exception

Throws:

Exception

getResources

public String getResources()

getStatus

public float getStatus()

getSupportedAlgorithms

public org.gcube.dataanalysis.ecoengine.configuration.ALG_PROPS[] getSupportedAlgorithms()

getInfrastructure

public org.gcube.dataanalysis.ecoengine.configuration.INFRASTRUCTURE getInfrastructure()

shutdown

public void shutdown()

getLoad

public String getLoad()

getResourceLoad

public String getResourceLoad()