Class SparkDistributedBackend

java.lang.Object

org.episteme.core.distributed.backends.SparkDistributedBackend

All Implemented Interfaces:

DistributedComputingProvider, AlgorithmProvider, Backend, ComputeBackend, DistributedBackend

@AutoService({Backend.class,AlgorithmProvider.class})
public class SparkDistributedBackend
extends Object
implements DistributedBackend

Apache Spark Distributed Computing Backend. Wraps Apache Spark for cluster computing.

Since:

1.2

Author:

Silvere Martin-Michiellot, Gemini AI (Google DeepMind)

Constructor Summary

Constructors

Constructor	Description
SparkDistributedBackend()

Method Summary

Modifier and Type	Method	Description
DistributedContext	createDistributedContext()	Creates a new distributed execution context.
String	getName()	Returns the display name for UI presentation.
int	getNodeCount()	Returns the number of available distributed nodes.
boolean	isAvailable()	Resolves the method conflict between invalid reference Backend#isAvailable() and AlgorithmProvider.isAvailable().
void	shutdown()	Called when the application is shutting down or the backend is being replaced.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface AlgorithmProvider

description, getMetadata, score

Methods inherited from interface Backend

getAlgorithmProviders, getStatusMessage, isExplicitlyDisabled

Methods inherited from interface ComputeBackend

createBackend, getDescription, getId, supportsComplexNumbers, supportsFloatingPoint

Methods inherited from interface DistributedBackend

createContext, getAcceleratorType, getAlgorithmType, getPriority, getType, supportsParallelOps

Constructor Details

SparkDistributedBackend

public SparkDistributedBackend()

Method Details

getName

public String getName()

Description copied from interface: Backend

Returns the display name for UI presentation.

Specified by:

getName in interface AlgorithmProvider

Specified by:

getName in interface Backend

isAvailable

public boolean isAvailable()

Description copied from interface: DistributedBackend

Resolves the method conflict between

invalid reference

Backend#isAvailable()

and AlgorithmProvider.isAvailable().

Specified by:

isAvailable in interface AlgorithmProvider

Specified by:

isAvailable in interface Backend

Specified by:

isAvailable in interface DistributedBackend

getNodeCount

public int getNodeCount()

Description copied from interface: DistributedBackend

Returns the number of available distributed nodes.

Specified by:

getNodeCount in interface DistributedBackend

Returns:

the node count

createDistributedContext

public DistributedContext createDistributedContext()

Description copied from interface: DistributedComputingProvider

Creates a new distributed execution context.

Specified by:

createDistributedContext in interface DistributedComputingProvider

Returns:

a context for submitting distributed tasks.

shutdown

public void shutdown()

Description copied from interface: Backend

Called when the application is shutting down or the backend is being replaced. Use this to release hardware resources, close file handles, or stop background threads.

Specified by:

shutdown in interface AlgorithmProvider

Specified by:

shutdown in interface Backend

Specified by:

shutdown in interface DistributedBackend