org.apache.flink.yarn

Class YarnClusterDescriptor

java.lang.Object

org.apache.flink.yarn.AbstractYarnClusterDescriptor

org.apache.flink.yarn.YarnClusterDescriptor

All Implemented Interfaces:

AutoCloseable, org.apache.flink.client.deployment.ClusterDescriptor<org.apache.hadoop.yarn.api.records.ApplicationId>

public class YarnClusterDescriptor
extends AbstractYarnClusterDescriptor

Implementation of AbstractYarnClusterDescriptor which is used to start the application master.

Field Summary

Fields inherited from class org.apache.flink.yarn.AbstractYarnClusterDescriptor

shipFiles

Constructor Summary

Constructors

Constructor and Description
YarnClusterDescriptor(org.apache.flink.configuration.Configuration flinkConfiguration, org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfiguration, String configurationDirectory, org.apache.hadoop.yarn.client.api.YarnClient yarnClient, boolean sharedYarnClient)

Method Summary

Modifier and Type	Method and Description
protected org.apache.flink.client.program.ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId>	createYarnClusterClient(AbstractYarnClusterDescriptor descriptor, int numberTaskManagers, int slotsPerTaskManager, org.apache.hadoop.yarn.api.records.ApplicationReport report, org.apache.flink.configuration.Configuration flinkConfiguration, boolean perJobCluster) Creates a YarnClusterClient; may be overriden in tests.
org.apache.flink.client.program.ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId>	deployJobCluster(org.apache.flink.client.deployment.ClusterSpecification clusterSpecification, org.apache.flink.runtime.jobgraph.JobGraph jobGraph, boolean detached)
protected String	getYarnJobClusterEntrypoint() The class to start the application master with.
protected String	getYarnSessionClusterEntrypoint() The class to start the application master with.

Methods inherited from class org.apache.flink.yarn.AbstractYarnClusterDescriptor

addLibFolderToShipFiles, addShipFiles, close, deployInternal, deploySessionCluster, getClusterDescription, getDynamicPropertiesEncoded, getFlinkConfiguration, getNodeLabel, getYarnClient, getZookeeperNamespace, hasUserJarFiles, isDetachedMode, killCluster, retrieve, setDetachedMode, setDynamicPropertiesEncoded, setLocalJarPath, setName, setNodeLabel, setProvidedUserJarFiles, setQueue, setupApplicationMasterContainer, setZookeeperNamespace, startAppMaster, validateClusterResources

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

YarnClusterDescriptor

public YarnClusterDescriptor(org.apache.flink.configuration.Configuration flinkConfiguration,
                             org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfiguration,
                             String configurationDirectory,
                             org.apache.hadoop.yarn.client.api.YarnClient yarnClient,
                             boolean sharedYarnClient)

Method Detail

getYarnSessionClusterEntrypoint

protected String getYarnSessionClusterEntrypoint()

Description copied from class: AbstractYarnClusterDescriptor

The class to start the application master with. This class runs the main method in case of session cluster.

Specified by:

getYarnSessionClusterEntrypoint in class AbstractYarnClusterDescriptor

getYarnJobClusterEntrypoint

protected String getYarnJobClusterEntrypoint()

Description copied from class: AbstractYarnClusterDescriptor

The class to start the application master with. This class runs the main method in case of the job cluster.

Specified by:

getYarnJobClusterEntrypoint in class AbstractYarnClusterDescriptor

deployJobCluster

public org.apache.flink.client.program.ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId> deployJobCluster(org.apache.flink.client.deployment.ClusterSpecification clusterSpecification,
                                                                                                                        org.apache.flink.runtime.jobgraph.JobGraph jobGraph,
                                                                                                                        boolean detached)
                                                                                                                 throws org.apache.flink.client.deployment.ClusterDeploymentException

Throws:

org.apache.flink.client.deployment.ClusterDeploymentException

createYarnClusterClient

protected org.apache.flink.client.program.ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId> createYarnClusterClient(AbstractYarnClusterDescriptor descriptor,
                                                                                                                                  int numberTaskManagers,
                                                                                                                                  int slotsPerTaskManager,
                                                                                                                                  org.apache.hadoop.yarn.api.records.ApplicationReport report,
                                                                                                                                  org.apache.flink.configuration.Configuration flinkConfiguration,
                                                                                                                                  boolean perJobCluster)
                                                                                                                           throws Exception

Description copied from class: AbstractYarnClusterDescriptor

Creates a YarnClusterClient; may be overriden in tests.

Specified by:

createYarnClusterClient in class AbstractYarnClusterDescriptor

Throws:

Exception