org.apache.tinkerpop.gremlin.process.traversal.step.util

Class ReducingBarrierStep.DefaultMapReduce

java.lang.Object

org.apache.tinkerpop.gremlin.process.computer.util.StaticMapReduce<MapReduce.NullObject,Object,MapReduce.NullObject,Object,Object>

org.apache.tinkerpop.gremlin.process.traversal.step.util.ReducingBarrierStep.DefaultMapReduce

All Implemented Interfaces:

Cloneable, MapReduce<MapReduce.NullObject,Object,MapReduce.NullObject,Object,Object>

Enclosing class:

ReducingBarrierStep<S,E>

public static class ReducingBarrierStep.DefaultMapReduce
extends StaticMapReduce<MapReduce.NullObject,Object,MapReduce.NullObject,Object,Object>

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.tinkerpop.gremlin.process.computer.MapReduce

MapReduce.MapEmitter<K,V>, MapReduce.NullObject, MapReduce.ReduceEmitter<OK,OV>, MapReduce.Stage

Field Summary

Fields inherited from interface org.apache.tinkerpop.gremlin.process.computer.MapReduce

MAP_REDUCE

Constructor Summary

Constructors

Constructor and Description
DefaultMapReduce(Supplier seedSupplier, BiFunction biFunction)

Method Summary

Modifier and Type	Method and Description
boolean	doStage(MapReduce.Stage stage) A MapReduce job can be map-only, map-reduce-only, or map-combine-reduce.
Object	generateFinalResult(Iterator keyValues) The key/value pairs emitted by reduce() (or map() in a map-only job) can be iterated to generate a local JVM Java object.
String	getMemoryKey() The results of the MapReduce job are associated with a memory-key to ultimately be stored in Memory.
void	loadState(Graph graph, Configuration configuration) When it is necessary to load the state of a MapReduce job, this method is called.
void	map(Vertex vertex, MapReduce.MapEmitter<MapReduce.NullObject,Object> emitter) The map() method is logically executed at all vertices in the graph in parallel.
void	reduce(MapReduce.NullObject key, Iterator<Object> values, MapReduce.ReduceEmitter<MapReduce.NullObject,Object> emitter) The reduce() method is logically on the "machine" the respective key hashes to.
void	storeState(Configuration configuration) When it is necessary to store the state of a MapReduce job, this method is called.

Methods inherited from class org.apache.tinkerpop.gremlin.process.computer.util.StaticMapReduce

clone, equals, hashCode, toString

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.tinkerpop.gremlin.process.computer.MapReduce

addResultToMemory, combine, createMapReduce, getMapKeySort, getReduceKeySort, workerEnd, workerStart

Constructor Detail

DefaultMapReduce

public DefaultMapReduce(Supplier seedSupplier,
                        BiFunction biFunction)

Method Detail

storeState

public void storeState(Configuration configuration)

Description copied from interface: MapReduce

When it is necessary to store the state of a MapReduce job, this method is called. This is typically required when the MapReduce job needs to be serialized to another machine. Note that what is stored is simply the instance state, not any processed data.

Specified by:

storeState in interface MapReduce<MapReduce.NullObject,Object,MapReduce.NullObject,Object,Object>

Overrides:

storeState in class StaticMapReduce<MapReduce.NullObject,Object,MapReduce.NullObject,Object,Object>

Parameters:

configuration - the configuration to store the state of the MapReduce job in.

loadState

public void loadState(Graph graph,
                      Configuration configuration)

Description copied from interface: MapReduce

When it is necessary to load the state of a MapReduce job, this method is called. This is typically required when the MapReduce job needs to be serialized to another machine. Note that what is loaded is simply the instance state, not any processed data.

It is important that the state loaded from loadState() is identical to any state created from a constructor. For those GraphComputers that do not need to use Configurations to migrate state between JVMs, the constructor will only be used.

Parameters:

graph - the graph the MapReduce job will run against

configuration - the configuration to load the state of the MapReduce job from.

doStage

public boolean doStage(MapReduce.Stage stage)

Description copied from interface: MapReduce

A MapReduce job can be map-only, map-reduce-only, or map-combine-reduce. Before executing the particular stage, this method is called to determine if the respective stage is defined. This method should return true if the respective stage as a non-default method implementation.

Parameters:

stage - the stage to check for definition.

Returns:

whether that stage should be executed.

getMemoryKey

public String getMemoryKey()

Description copied from interface: MapReduce

The results of the MapReduce job are associated with a memory-key to ultimately be stored in Memory.

Returns:

the memory key of the generated result object.

generateFinalResult

public Object generateFinalResult(Iterator keyValues)

Description copied from interface: MapReduce

The key/value pairs emitted by reduce() (or map() in a map-only job) can be iterated to generate a local JVM Java object.

Parameters:

keyValues - the key/value pairs that were emitted from reduce() (or map() in a map-only job)

Returns:

the resultant object formed from the emitted key/values.

map

public void map(Vertex vertex,
                MapReduce.MapEmitter<MapReduce.NullObject,Object> emitter)

Description copied from interface: MapReduce

The map() method is logically executed at all vertices in the graph in parallel. The map() method emits key/value pairs given some analysis of the data in the vertices (and/or its incident edges).

Parameters:

vertex - the current vertex being map() processed.

emitter - the component that allows for key/value pairs to be emitted to the next stage.

reduce

public void reduce(MapReduce.NullObject key,
                   Iterator<Object> values,
                   MapReduce.ReduceEmitter<MapReduce.NullObject,Object> emitter)

Description copied from interface: MapReduce

The reduce() method is logically on the "machine" the respective key hashes to. The reduce() method combines all the values associated with the key and emits key/value pairs.

Parameters:

key - the key that has aggregated values

values - the aggregated values associated with the key

emitter - the component that allows for key/value pairs to be emitted as the final result.