查看YARN任务日志的几种方式

Caused by: java.lang.Exception: Exception from container-launch.

Container id: container_e54_1625726431774_87633_01_000002

Exit code: 255

Stack trace: ExitCodeException exitCode=255:

at org.apache.hadoop.util.Shell.runCommand(Shell.java:601)

at org.apache.hadoop.util.Shell.run(Shell.java:504)

at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)

at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213)

at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)

at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Container exited with a non-zero exit code 255

at org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager.onWorkerTerminated(ActiveResourceManager.java:225)

at org.apache.flink.yarn.YarnResourceManagerDriveronContainersCompleted$0(YarnResourceManagerDriver.java:590)

at org.apache.flink.yarn.YarnResourceManagerDriver841/1711006368.run(Unknown Source)

at org.apache.flink.yarn.YarnResourceManagerDriverrunAsyncWithFatalHandler$2(YarnResourceManagerDriver.java:622)

at org.apache.flink.yarn.YarnResourceManagerDriver653/709899353.run(Unknown Source)

at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:442)

at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:209)

查看YARN任务日志的几种方式

application_1625726431774_1234

hdfs dfs -ls /data/tmp/logs/bigdata/logs

yarn logs -applicationId application_1625726431774_1234

https://ask.csdn.net/questions/169078

https://www.qedev.com/bigdata/192178.html

    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-yarn-client</artifactId>
        <version>${hadoop.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-yarn-client</artifactId>
        <version>${hadoop.version}</version>
    </dependency>