“Application rejected by queue p
2018-11-09 本文已影响0人
Anan9527
hive> select count(*) from kylin_sales limit 10;
Query ID = root_20181108175454_275f4f71-f877-43e0-8d51-b9b53a439a4b
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_154167062 YARN : Application rejected by queue placement policy
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:336)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
排查问题
1.上面的报错与队列相关
2.CDH yarn界面问题排查队列生成的样子异常
image.png
让我想到了集群动态资源池放置规则，我打开集群动态资源池配置的放置规则一看果然是因为无法创建资源池或者没指定队列造成的异常。进行如下配置即可。
image.png
