spark||flink||scala

Yarn-AM-资源不足异常

2019-05-23  本文已影响0人  liuzx32

Yarn-AM-资源不足异常

Application is added to the scheduler and is not yet activated. Queue's AM resource limit exceeded. Details : AM Partition = 3ssystem; AM Resource Request = <memory:4096, vCores:1>; Queue Resource Limit for AM = <memory:6144, vCores:3>; User AM Resource Limit of the queue = <memory:6144, vCores:3>; Queue AM Resource Usage = <memory:4096, vCores:1>;

That your drivers have exceeded max memory configured in Max Application Master Resources. You can either increase max memory for AM or decrease driver memory in your jobs.

  1. 解决方案1:调整yarn.scheduler.capacity.maximum-am-resource-percent
<property>
<!-- Maximum resources to allocate to application masters
If this is too high application masters can crowd out actual work -->
<name>yarn.scheduler.capacity.maximum-am-resource-percent</name>
<value>0.6</value>
</property>
  1. 解决方案2:decrease driver memory in your jobs.
上一篇下一篇

猜你喜欢

热点阅读