org.apache.flink.mesos.runtime.clusterframework

Class MesosFlinkResourceManager

java.lang.Object

akka.actor.UntypedActor

org.apache.flink.runtime.akka.FlinkUntypedActor

org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

org.apache.flink.mesos.runtime.clusterframework.MesosFlinkResourceManager

All Implemented Interfaces:

akka.actor.Actor

public class MesosFlinkResourceManager
extends org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

Flink Resource Manager for Apache Mesos.

Nested Class Summary

Nested classes/interfaces inherited from interface akka.actor.Actor

akka.actor.Actor.emptyBehavior$, akka.actor.Actor.ignoringBehavior$

Field Summary

Fields inherited from class org.apache.flink.runtime.clusterframework.FlinkResourceManager

config, EXIT_CODE_FATAL_ERROR, RESOURCE_MANAGER_NAME

Fields inherited from class org.apache.flink.runtime.akka.FlinkUntypedActor

LOG

Constructor Summary

Constructors

Constructor and Description

MesosFlinkResourceManager(org.apache.flink.configuration.Configuration flinkConfig, MesosConfiguration mesosConfig, MesosWorkerStore workerStore, org.apache.flink.runtime.leaderretrieval.LeaderRetrievalService leaderRetrievalService, MesosTaskManagerParameters taskManagerParameters, org.apache.flink.runtime.clusterframework.ContainerSpecification taskManagerContainerSpec, MesosArtifactResolver artifactResolver, int maxFailedTasks, int numInitialTaskManagers)

Method Summary

Modifier and Type	Method and Description
static akka.actor.Props	createActorProps(Class<? extends MesosFlinkResourceManager> actorClass, org.apache.flink.configuration.Configuration flinkConfig, MesosConfiguration mesosConfig, MesosWorkerStore workerStore, org.apache.flink.runtime.leaderretrieval.LeaderRetrievalService leaderRetrievalService, MesosTaskManagerParameters taskManagerParameters, org.apache.flink.runtime.clusterframework.ContainerSpecification taskManagerContainerSpec, MesosArtifactResolver artifactResolver, org.slf4j.Logger log) Creates the props needed to instantiate this actor.
protected akka.actor.ActorRef	createConnectionMonitor()
protected akka.actor.ActorRef	createLaunchCoordinator()
protected akka.actor.ActorRef	createReconciliationCoordinator()
protected akka.actor.ActorRef	createTaskRouter()
protected void	fatalError(String message, Throwable error)
protected int	getNumWorkerRequestsPending()
protected int	getNumWorkersPendingRegistration()
protected void	handleMessage(Object message)
protected void	initialize()
void	postStop()
protected Collection<RegisteredMesosWorkerNode>	reacceptRegisteredWorkers(Collection<org.apache.flink.runtime.clusterframework.types.ResourceID> toConsolidate) Accept the given registered workers into the internal state.
protected void	releasePendingWorker(org.apache.flink.runtime.clusterframework.types.ResourceID id) Release the given pending worker.
protected void	releaseStartedWorker(RegisteredMesosWorkerNode worker) Release the given started worker.
protected void	requestNewWorkers(int numWorkers) Plan for some additional workers to be launched.
protected void	shutdownApplication(org.apache.flink.runtime.clusterframework.ApplicationStatus finalStatus, String optionalDiagnostics) Called to shut down the cluster (not a failover situation).
protected RegisteredMesosWorkerNode	workerStarted(org.apache.flink.runtime.clusterframework.types.ResourceID resourceID) Accept the given started worker into the internal state.

Methods inherited from class org.apache.flink.runtime.clusterframework.FlinkResourceManager

allStartedWorkers, getDesignatedWorkerPoolSize, getLeaderSessionID, getNumberOfStartedTaskManagers, getResourceManagerProps, getStartedTaskManagers, isStarted, notifyWorkerFailed, preStart, sendInfoMessage, startResourceManagerActors, startResourceManagerActors, triggerCheckWorkers, triggerConnectingToJobManager

Methods inherited from class org.apache.flink.runtime.akka.FlinkUntypedActor

decorateMessage, onReceive

Methods inherited from class akka.actor.UntypedActor

akka$actor$Actor$_setter_$context_$eq, akka$actor$Actor$_setter_$self_$eq, aroundPostRestart, aroundPostStop, aroundPreRestart, aroundPreStart, aroundReceive, context, getContext, getSelf, getSender, postRestart, preRestart, receive, self, sender, supervisorStrategy, unhandled

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MesosFlinkResourceManager

public MesosFlinkResourceManager(org.apache.flink.configuration.Configuration flinkConfig,
                                 MesosConfiguration mesosConfig,
                                 MesosWorkerStore workerStore,
                                 org.apache.flink.runtime.leaderretrieval.LeaderRetrievalService leaderRetrievalService,
                                 MesosTaskManagerParameters taskManagerParameters,
                                 org.apache.flink.runtime.clusterframework.ContainerSpecification taskManagerContainerSpec,
                                 MesosArtifactResolver artifactResolver,
                                 int maxFailedTasks,
                                 int numInitialTaskManagers)

Method Detail

initialize

protected void initialize()
                   throws Exception

Specified by:

initialize in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

Throws:

Exception

createConnectionMonitor

protected akka.actor.ActorRef createConnectionMonitor()

createTaskRouter

protected akka.actor.ActorRef createTaskRouter()

createLaunchCoordinator

protected akka.actor.ActorRef createLaunchCoordinator()

createReconciliationCoordinator

protected akka.actor.ActorRef createReconciliationCoordinator()

postStop

public void postStop()

Specified by:

postStop in interface akka.actor.Actor

Overrides:

postStop in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

handleMessage

protected void handleMessage(Object message)

Overrides:

handleMessage in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

shutdownApplication

protected void shutdownApplication(org.apache.flink.runtime.clusterframework.ApplicationStatus finalStatus,
                                   String optionalDiagnostics)

Called to shut down the cluster (not a failover situation).

Specified by:

shutdownApplication in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

Parameters:

finalStatus - The application status to report.

optionalDiagnostics - An optional diagnostics message.

fatalError

protected void fatalError(String message,
                          Throwable error)

Specified by:

fatalError in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

requestNewWorkers

protected void requestNewWorkers(int numWorkers)

Plan for some additional workers to be launched.

Specified by:

requestNewWorkers in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

Parameters:

numWorkers - The number of workers to allocate.

workerStarted

protected RegisteredMesosWorkerNode workerStarted(org.apache.flink.runtime.clusterframework.types.ResourceID resourceID)

Accept the given started worker into the internal state.

Specified by:

workerStarted in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

Parameters:

resourceID - The worker resource id

Returns:

A registered worker node record.

reacceptRegisteredWorkers

protected Collection<RegisteredMesosWorkerNode> reacceptRegisteredWorkers(Collection<org.apache.flink.runtime.clusterframework.types.ResourceID> toConsolidate)

Accept the given registered workers into the internal state.

Specified by:

reacceptRegisteredWorkers in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

Parameters:

toConsolidate - The worker IDs known previously to the JobManager.

Returns:

A collection of registered worker node records.

releasePendingWorker

protected void releasePendingWorker(org.apache.flink.runtime.clusterframework.types.ResourceID id)

Release the given pending worker.

Specified by:

releasePendingWorker in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

releaseStartedWorker

protected void releaseStartedWorker(RegisteredMesosWorkerNode worker)

Release the given started worker.

Specified by:

releaseStartedWorker in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

getNumWorkerRequestsPending

protected int getNumWorkerRequestsPending()

Specified by:

getNumWorkerRequestsPending in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

getNumWorkersPendingRegistration

protected int getNumWorkersPendingRegistration()

Specified by:

getNumWorkersPendingRegistration in class org.apache.flink.runtime.clusterframework.FlinkResourceManager<RegisteredMesosWorkerNode>

createActorProps

public static akka.actor.Props createActorProps(Class<? extends MesosFlinkResourceManager> actorClass,
                                                org.apache.flink.configuration.Configuration flinkConfig,
                                                MesosConfiguration mesosConfig,
                                                MesosWorkerStore workerStore,
                                                org.apache.flink.runtime.leaderretrieval.LeaderRetrievalService leaderRetrievalService,
                                                MesosTaskManagerParameters taskManagerParameters,
                                                org.apache.flink.runtime.clusterframework.ContainerSpecification taskManagerContainerSpec,
                                                MesosArtifactResolver artifactResolver,
                                                org.slf4j.Logger log)

Creates the props needed to instantiate this actor.

Rather than extracting and validating parameters in the constructor, this factory method takes care of that. That way, errors occur synchronously, and are not swallowed simply in a failed asynchronous attempt to start the actor.

Parameters:

actorClass - The actor class, to allow overriding this actor with subclasses for testing.

flinkConfig - The Flink configuration object.

taskManagerParameters - The parameters for launching TaskManager containers.

taskManagerContainerSpec - The container specification.

artifactResolver - The artifact resolver to locate artifacts

log - The logger to log to.

Returns:

The Props object to instantiate the MesosFlinkResourceManager actor.