Package eu.dnetlib.dhp.solr

Class RecordImporter

java.lang.Object

eu.dnetlib.dhp.solr.RecordImporter

All Implemented Interfaces:

Serializable

public class RecordImporter
extends Object
implements Serializable

See Also:

• Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
static final int	BATCH_SIZE
static final int	RETRY_DELAY_MILLIS	Base delay before the first retry; doubles on each subsequent attempt.

Constructor Summary

Constructors

Constructor	Description
RecordImporter()

Method Summary

Modifier and Type	Method	Description
static void	importRecords(org.apache.spark.SparkConf conf, CloudClientParams params, String path, int batchSize, boolean shouldCommit, boolean shouldFilterXmlPayload)
static void	importRecords(org.apache.spark.SparkConf conf, String zkHost, String collection, String path, int batchSize, boolean shouldCommit, boolean shouldFilterXmlPayload)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

BATCH_SIZE

public static final int BATCH_SIZE

See Also:

• Constant Field Values

RETRY_DELAY_MILLIS

public static final int RETRY_DELAY_MILLIS

Base delay before the first retry; doubles on each subsequent attempt.

See Also:

• Constant Field Values

Constructor Details

RecordImporter

public RecordImporter()

Method Details

importRecords

public static void importRecords(org.apache.spark.SparkConf conf,
 String zkHost,
 String collection,
 String path,
 int batchSize,
 boolean shouldCommit,
 boolean shouldFilterXmlPayload)

importRecords

public static void importRecords(org.apache.spark.SparkConf conf,
 CloudClientParams params,
 String path,
 int batchSize,
 boolean shouldCommit,
 boolean shouldFilterXmlPayload)