Package org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities

Class ActivitiesManager

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities.ActivitiesManager

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.service.Service

public class ActivitiesManager
extends org.apache.hadoop.service.AbstractService

A class to store node or application allocations. It mainly contains operations for allocation start, add, update and finish.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ActivitiesManager.DiagnosticsCollectorManager	Class to manage the diagnostics collector.

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

org.apache.hadoop.service.Service.STATE

Field Summary

Fields

Modifier and Type	Field	Description
static final char	DIAGNOSTICS_DETAILS_SEPARATOR
static final String	EMPTY_DIAGNOSTICS
static final org.apache.hadoop.yarn.api.records.NodeId	EMPTY_NODE_ID

Constructor Summary

Constructors

Constructor	Description
ActivitiesManager(RMContext rmContext)

Method Summary

Modifier and Type	Method	Description
ActivitiesInfo	getActivitiesInfo(String nodeId, RMWSConsts.ActivitiesGroupBy groupBy)
AppActivitiesInfo	getAppActivitiesInfo(org.apache.hadoop.yarn.api.records.ApplicationId applicationId, Set<Integer> requestPriorities, Set<Long> allocationRequestIds, RMWSConsts.ActivitiesGroupBy groupBy, int limit, boolean summarize, double maxTimeInSeconds)
int	getAppActivitiesMaxQueueLength()
static String	getDiagnostics(Optional<DiagnosticsCollector> dcOpt)
Optional<DiagnosticsCollector>	getOptionalDiagnosticsCollector()
org.apache.hadoop.yarn.api.records.NodeId	getRecordingNodeId(SchedulerNode node)	Get recording node id: 1. node id of the input node if it is not null. 2.
String	getResourceDiagnostics(org.apache.hadoop.yarn.util.resource.ResourceCalculator rc, org.apache.hadoop.yarn.api.records.Resource required, org.apache.hadoop.yarn.api.records.Resource available)
boolean	isRecordingMultiNodes()
List<ActivitiesInfo>	recordAndGetBulkActivitiesInfo(int activitiesCount, RMWSConsts.ActivitiesGroupBy groupBy)
void	recordNextNodeUpdateActivities(String nodeId)
protected void	serviceStart()
protected void	serviceStop()
void	turnOnAppActivitiesRecording(org.apache.hadoop.yarn.api.records.ApplicationId applicationId, double maxTime)

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, serviceInit, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

EMPTY_NODE_ID

public static final org.apache.hadoop.yarn.api.records.NodeId EMPTY_NODE_ID

DIAGNOSTICS_DETAILS_SEPARATOR

public static final char DIAGNOSTICS_DETAILS_SEPARATOR

See Also:

• Constant Field Values

EMPTY_DIAGNOSTICS

public static final String EMPTY_DIAGNOSTICS

See Also:

• Constant Field Values

Constructor Details

ActivitiesManager

public ActivitiesManager(RMContext rmContext)

Method Details

getAppActivitiesInfo

public AppActivitiesInfo getAppActivitiesInfo(org.apache.hadoop.yarn.api.records.ApplicationId applicationId,
 Set<Integer> requestPriorities,
 Set<Long> allocationRequestIds,
 RMWSConsts.ActivitiesGroupBy groupBy,
 int limit,
 boolean summarize,
 double maxTimeInSeconds)

getActivitiesInfo

public ActivitiesInfo getActivitiesInfo(String nodeId,
 RMWSConsts.ActivitiesGroupBy groupBy)

recordAndGetBulkActivitiesInfo

public List<ActivitiesInfo> recordAndGetBulkActivitiesInfo(int activitiesCount,
 RMWSConsts.ActivitiesGroupBy groupBy)
                                                    throws InterruptedException

Throws:

InterruptedException

recordNextNodeUpdateActivities

public void recordNextNodeUpdateActivities(String nodeId)

turnOnAppActivitiesRecording

public void turnOnAppActivitiesRecording(org.apache.hadoop.yarn.api.records.ApplicationId applicationId,
 double maxTime)

serviceStart

protected void serviceStart()
                     throws Exception

Overrides:

serviceStart in class org.apache.hadoop.service.AbstractService

Throws:

Exception

serviceStop

protected void serviceStop()
                    throws Exception

Overrides:

serviceStop in class org.apache.hadoop.service.AbstractService

Throws:

Exception

isRecordingMultiNodes

public boolean isRecordingMultiNodes()

getRecordingNodeId

public org.apache.hadoop.yarn.api.records.NodeId getRecordingNodeId(SchedulerNode node)

Get recording node id: 1. node id of the input node if it is not null. 2. EMPTY_NODE_ID if input node is null and activities manager is recording multi-nodes. 3. null otherwise.

Parameters:

node - - input node

Returns:

recording nodeId

getOptionalDiagnosticsCollector

public Optional<DiagnosticsCollector> getOptionalDiagnosticsCollector()

getResourceDiagnostics

public String getResourceDiagnostics(org.apache.hadoop.yarn.util.resource.ResourceCalculator rc,
 org.apache.hadoop.yarn.api.records.Resource required,
 org.apache.hadoop.yarn.api.records.Resource available)

getDiagnostics

public static String getDiagnostics(Optional<DiagnosticsCollector> dcOpt)

getAppActivitiesMaxQueueLength

@VisibleForTesting
public int getAppActivitiesMaxQueueLength()