oozie常用命令--如何查看coordinator和workf
2018-12-03 本文已影响10人
润土1030
有的时候受限于网络环境登录不上web页面，无法从Hue查看Oozie Job的状态，接下来就是讲下如何从命令行查看oozie job的状态。
查看正在运行的coordinator
[root@dlbdn3 ~]# oozie jobs -oozie http://localhost:11000/oozie -jobtype coordinator -filter status=RUNNING
Job ID App Name Status Freq Unit Started Next Materialized
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C PG-LANDING-JOB-CoordinatorRUNNING */5 * * * *CRON 2018-09-12 16:00 GMT 2018-09-12 16:50 GMT
------------------------------------------------------------------------------------------------------------------------------------
[root@dlbdn3 ~]#
查看某一个coordinator的状态
[root@dlbdn3 ~]#oozie job --oozie http://localhost:11000/oozie -info 0000027-181203143359779-oozie-oozi-C
Job ID : 0000027-181203143359779-oozie-oozi-C
------------------------------------------------------------------------------------------------------------------------------------
Job Name : PG-LANDING-JOB-Coordinator
App Path : hdfs://dlbdn3:8020/user/hue/oozie/deployments/_ericsson_-oozie-13-1543825800.46
Status : RUNNING
Start Time : 2018-09-12 16:00 GMT
End Time : 2040-09-01 07:15 GMT
Pause Time : -
Concurrency : 1
------------------------------------------------------------------------------------------------------------------------------------
ID Status Ext ID Err Code Created Nominal Time
0000027-181203143359779-oozie-oozi-C@1 SUCCEEDED 0000028-181203143359779-oozie-oozi-W - 2018-12-03 08:30 GMT 2018-09-12 16:00 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@2 SUCCEEDED 0000029-181203143359779-oozie-oozi-W - 2018-12-03 08:30 GMT 2018-09-12 16:05 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@3 RUNNING 0000030-181203143359779-oozie-oozi-W - 2018-12-03 08:30 GMT 2018-09-12 16:10 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@4 READY - - 2018-12-03 08:30 GMT 2018-09-12 16:15 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@5 READY - - 2018-12-03 08:30 GMT 2018-09-12 16:20 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@6 READY - - 2018-12-03 08:30 GMT 2018-09-12 16:25 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@7 READY - - 2018-12-03 08:30 GMT 2018-09-12 16:30 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@8 READY - - 2018-12-03 08:30 GMT 2018-09-12 16:35 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@9 READY - - 2018-12-03 08:30 GMT 2018-09-12 16:40 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@10 READY - - 2018-12-03 08:30 GMT 2018-09-12 16:45 GMT
------------------------------------------------------------------------------------------------------------------------------------
[root@dlbdn3 ~]#
上面的命令默认只能显示一千条记录，当记录数多的时候，需要调整一下命令,倒叙显示一百条，len参数可以调整。同时发现时间有些问题，时区没有，导致差8小时
[root@dlbdn3 ~]# oozie job -info 0000027-181203143359779-oozie-oozi-C -oozie http://localhost:11000/oozie -len=100 -order=desc -timezone='Asia/Shanghai'
Job ID : 0000027-181203143359779-oozie-oozi-C
------------------------------------------------------------------------------------------------------------------------------------
Job Name : PG-LANDING-JOB-Coordinator
App Path : hdfs://dlbdn3:8020/user/hue/oozie/deployments/_ericsson_-oozie-13-1543825800.46
Status : RUNNING
Start Time : 2018-09-13 00:00 CST
End Time : 2040-09-01 15:15 CST
Pause Time : -
Concurrency : 1
------------------------------------------------------------------------------------------------------------------------------------
ID Status Ext ID Err Code Created Nominal Time
0000027-181203143359779-oozie-oozi-C@30 READY - - 2018-12-03 16:39 CST 2018-09-13 02:25 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@29 READY - - 2018-12-03 16:39 CST 2018-09-13 02:20 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@28 READY - - 2018-12-03 16:39 CST 2018-09-13 02:15 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@27 READY - - 2018-12-03 16:39 CST 2018-09-13 02:10 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@26 READY - - 2018-12-03 16:39 CST 2018-09-13 02:05 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@25 READY - - 2018-12-03 16:39 CST 2018-09-13 02:00 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@24 READY - - 2018-12-03 16:39 CST 2018-09-13 01:55 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@23 READY - - 2018-12-03 16:39 CST 2018-09-13 01:50 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@22 READY - - 2018-12-03 16:39 CST 2018-09-13 01:45 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@21 READY - - 2018-12-03 16:39 CST 2018-09-13 01:40 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@20 READY - - 2018-12-03 16:34 CST 2018-09-13 01:35 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@19 READY - - 2018-12-03 16:34 CST 2018-09-13 01:30 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@18 READY - - 2018-12-03 16:34 CST 2018-09-13 01:25 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@17 READY - - 2018-12-03 16:34 CST 2018-09-13 01:20 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@16 READY - - 2018-12-03 16:34 CST 2018-09-13 01:15 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@15 READY - - 2018-12-03 16:34 CST 2018-09-13 01:10 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@14 READY - - 2018-12-03 16:34 CST 2018-09-13 01:05 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@13 READY - - 2018-12-03 16:34 CST 2018-09-13 01:00 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@12 READY - - 2018-12-03 16:34 CST 2018-09-13 00:55 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@11 READY - - 2018-12-03 16:34 CST 2018-09-13 00:50 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@10 RUNNING 0000037-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:45 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@9 SUCCEEDED 0000036-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:40 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@8 SUCCEEDED 0000035-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:35 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@7 SUCCEEDED 0000034-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:30 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@6 SUCCEEDED 0000033-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:25 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@5 SUCCEEDED 0000032-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:20 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@4 SUCCEEDED 0000031-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:15 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@3 SUCCEEDED 0000030-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:10 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@2 SUCCEEDED 0000029-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:05 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@1 SUCCEEDED 0000028-181203143359779-oozie-oozi-W - 2018-12-03 16:30 CST 2018-09-13 00:00 CST
------------------------------------------------------------------------------------------------------------------------------------
[root@dlbdn3 ~]#
查看执行错误的workflow
[root@dlbdn3 ~]# oozie job -info 0000027-181203143359779-oozie-oozi-C -oozie http://localhost:11000/oozie -order=desc -timezone='Asia/Shanghai' -filter status=KILLED AND FAILED
Job ID : 0000027-181203143359779-oozie-oozi-C
------------------------------------------------------------------------------------------------------------------------------------
Job Name : PG-LANDING-JOB-Coordinator
App Path : hdfs://dlbdn3:8020/user/hue/oozie/deployments/_ericsson_-oozie-13-1543825800.46
Status : KILLED
Start Time : 2018-09-13 00:00 CST
End Time : 2040-09-01 15:15 CST
Pause Time : -
Concurrency : 1
------------------------------------------------------------------------------------------------------------------------------------
ID Status Ext ID Err Code Created Nominal Time
0000027-181203143359779-oozie-oozi-C@30 KILLED - - 2018-12-03 16:39 CST 2018-09-13 02:25 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@29 KILLED - - 2018-12-03 16:39 CST 2018-09-13 02:20 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@28 KILLED - - 2018-12-03 16:39 CST 2018-09-13 02:15 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@27 KILLED - - 2018-12-03 16:39 CST 2018-09-13 02:10 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@26 KILLED - - 2018-12-03 16:39 CST 2018-09-13 02:05 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@25 KILLED - - 2018-12-03 16:39 CST 2018-09-13 02:00 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@24 KILLED - - 2018-12-03 16:39 CST 2018-09-13 01:55 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@23 KILLED - - 2018-12-03 16:39 CST 2018-09-13 01:50 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@22 KILLED - - 2018-12-03 16:39 CST 2018-09-13 01:45 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@21 KILLED - - 2018-12-03 16:39 CST 2018-09-13 01:40 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@20 KILLED - - 2018-12-03 16:34 CST 2018-09-13 01:35 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@19 KILLED - - 2018-12-03 16:34 CST 2018-09-13 01:30 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@18 KILLED - - 2018-12-03 16:34 CST 2018-09-13 01:25 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@17 KILLED - - 2018-12-03 16:34 CST 2018-09-13 01:20 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@16 KILLED - - 2018-12-03 16:34 CST 2018-09-13 01:15 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@15 KILLED - - 2018-12-03 16:34 CST 2018-09-13 01:10 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@14 KILLED - - 2018-12-03 16:34 CST 2018-09-13 01:05 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@13 KILLED - - 2018-12-03 16:34 CST 2018-09-13 01:00 CST
------------------------------------------------------------------------------------------------------------------------------------
0000027-181203143359779-oozie-oozi-C@12 KILLED 0000039-181203143359779-oozie-oozi-W - 2018-12-03 16:34 CST 2018-09-13 00:55 CST
------------------------------------------------------------------------------------------------------------------------------------
[root@dlbdn3 ~]#
查看一个具体的workflow信息
[root@dlbdn3 ~]# oozie job --oozie http://localhost:11000/oozie -info 0000039-181203143359779-oozie-oozi-W -localtime
Job ID : 0000039-181203143359779-oozie-oozi-W
------------------------------------------------------------------------------------------------------------------------------------
Workflow Name : PG-LANDING-JOB
App Path : hdfs://dlbdn3:8020/user/hue/oozie/workspaces/hue-oozie-1535681485.06
Status : KILLED
Run : 0
User : ericsson
Group : -
Created : 2018-12-03 16:42 CST
Started : 2018-12-03 16:42 CST
Last Modified : 2018-12-03 16:43 CST
Ended : 2018-12-03 16:43 CST
CoordAction ID: 0000027-181203143359779-oozie-oozi-C@12
Actions
------------------------------------------------------------------------------------------------------------------------------------
ID Status Ext ID Ext Status Err Code
------------------------------------------------------------------------------------------------------------------------------------
0000039-181203143359779-oozie-oozi-W@:start: OK - OK -
------------------------------------------------------------------------------------------------------------------------------------
0000039-181203143359779-oozie-oozi-W@spark-23f2 KILLED job_1543800485319_0062 KILLED -
------------------------------------------------------------------------------------------------------------------------------------
[root@dlbdn3 ~]#
查看当前运行的workflow有哪些
[root@dlbdn3 ~]# oozie jobs -oozie http://localhost:11000/oozie -jobtype wf -filter status=RUNNING
No Jobs match your criteria!
[root@dlbdn3 ~]# oozie jobs -oozie http://localhost:11000/oozie -jobtype wf -filter status=RUNNING
Job ID App Name Status User Group Started Ended
------------------------------------------------------------------------------------------------------------------------------------
0000041-181203143359779-oozie-oozi-W PG-LANDING-JOBRUNNING ericsson - 2018-12-03 08:50 GMT -
------------------------------------------------------------------------------------------------------------------------------------
[root@dlbdn3 ~]# oozie jobs -oozie http://localhost:11000/oozie -jobtype wf -filter status=RUNNING -localtime
Job ID App Name Status User Group Started Ended
------------------------------------------------------------------------------------------------------------------------------------
0000041-181203143359779-oozie-oozi-W PG-LANDING-JOBRUNNING ericsson - 2018-12-03 16:50 CST -
------------------------------------------------------------------------------------------------------------------------------------
[root@dlbdn3 ~]#
