Hadoop问题
2017-06-10 本文已影响0人
予早
version: 2.7.3
Kill a hadoop job:
yarn application -kill $ApplicationId
You can get a list of all ApplicationId's doing:
yarn application -list
MapReduce jobs get stuck in Accepted state:
A job stuck in accepted state on YARN is usually because of free resources are not enough. You can check it at http://resourcemanager:port/cluster/scheduler:
if Memory Used + Memory Reserved >= Memory Total, memory is not enough
if VCores Used + VCores Reserved >= VCores Total, VCores is not enough
It may also be limited by parameters such as maxAMShare.
See more: http://stackoverflow.com/questions/20200636/mapreduce-jobs-get-stuck-in-accepted-state
查看scheduler发现Memory Total为0，htop发现内存已被chrome几乎用尽，关闭chrome，重启了yarn，完美运行job
