eu.dnetlib.dhp.oa.dedup

Class Deduper

java.lang.Object

eu.dnetlib.dhp.oa.dedup.Deduper

All Implemented Interfaces:

Serializable

public class Deduper
extends Object
implements scala.Serializable

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
Deduper()

Method Summary

Modifier and Type	Method and Description
static org.apache.spark.api.java.JavaPairRDD<String,String>	computeRelations(org.apache.spark.api.java.JavaSparkContext context, org.apache.spark.api.java.JavaPairRDD<String,Block> blocks, eu.dnetlib.pace.config.DedupConfig config)
static org.apache.spark.api.java.JavaPairRDD<String,Block>	createSortedBlocks(org.apache.spark.api.java.JavaPairRDD<String,eu.dnetlib.pace.model.MapDocument> mapDocs, eu.dnetlib.pace.config.DedupConfig config)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Deduper

public Deduper()

Method Detail

computeRelations

public static org.apache.spark.api.java.JavaPairRDD<String,String> computeRelations(org.apache.spark.api.java.JavaSparkContext context,
                                                                                    org.apache.spark.api.java.JavaPairRDD<String,Block> blocks,
                                                                                    eu.dnetlib.pace.config.DedupConfig config)

createSortedBlocks

public static org.apache.spark.api.java.JavaPairRDD<String,Block> createSortedBlocks(org.apache.spark.api.java.JavaPairRDD<String,eu.dnetlib.pace.model.MapDocument> mapDocs,
                                                                                     eu.dnetlib.pace.config.DedupConfig config)