Package org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources

Class CGroupsCpuResourceHandlerImpl

java.lang.Object

org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.AbstractCGroupsCpuResourceHandler

org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.CGroupsCpuResourceHandlerImpl

All Implemented Interfaces:

CpuResourceHandler, ResourceHandler

@Unstable
@Private
public class CGroupsCpuResourceHandlerImpl
extends AbstractCGroupsCpuResourceHandler

An implementation for using CGroups to restrict CPU usage on Linux. The implementation supports 3 different controls - restrict usage of all YARN containers, restrict relative usage of individual YARN containers and restrict usage of individual YARN containers. Admins can set the overall CPU to be used by all YARN containers - this is implemented by setting cpu.cfs_period_us and cpu.cfs_quota_us to the ratio desired. If strict resource usage mode is not enabled, cpu.shares is set for individual containers - this prevents containers from exceeding the overall limit for YARN containers but individual containers can use as much of the CPU as available(under the YARN limit). If strict resource usage is enabled, then container can only use the percentage of CPU allocated to them and this is again implemented using cpu.cfs_period_us and cpu.cfs_quota_us.

Field Summary

Fields inherited from class org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.AbstractCGroupsCpuResourceHandler

cGroupsHandler

Method Summary

Modifier and Type	Method	Description
static boolean	checkCgroupV1CPULimitExists(String path)
boolean	cpuLimitExists(String cgroupPath)
protected int	getCpuWeightByContainerVcores(int containerVCores)
protected int	getOpportunisticCpuWeight()
protected void	updateCgroupCpuWeight(String cgroupId, int weight)
protected void	updateCgroupMaxCpuLimit(String cgroupId, String quota, String period)

Methods inherited from class org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.AbstractCGroupsCpuResourceHandler

bootstrap, getOverallLimits, postComplete, preStart, reacquireContainer, teardown, toString, updateContainer

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Details

updateCgroupMaxCpuLimit

protected void updateCgroupMaxCpuLimit(String cgroupId,
 String quota,
 String period)
                                throws ResourceHandlerException

Specified by:

updateCgroupMaxCpuLimit in class AbstractCGroupsCpuResourceHandler

Throws:

ResourceHandlerException

getOpportunisticCpuWeight

protected int getOpportunisticCpuWeight()

Specified by:

getOpportunisticCpuWeight in class AbstractCGroupsCpuResourceHandler

getCpuWeightByContainerVcores

protected int getCpuWeightByContainerVcores(int containerVCores)

Specified by:

getCpuWeightByContainerVcores in class AbstractCGroupsCpuResourceHandler

updateCgroupCpuWeight

protected void updateCgroupCpuWeight(String cgroupId,
 int weight)
                              throws ResourceHandlerException

Specified by:

updateCgroupCpuWeight in class AbstractCGroupsCpuResourceHandler

Throws:

ResourceHandlerException

cpuLimitExists

public boolean cpuLimitExists(String cgroupPath)
                       throws ResourceHandlerException

Specified by:

cpuLimitExists in class AbstractCGroupsCpuResourceHandler

Throws:

ResourceHandlerException

checkCgroupV1CPULimitExists

@Private
public static boolean checkCgroupV1CPULimitExists(String path)
                                           throws IOException

Throws:

IOException