一个切换JDK后ZINC进程导致Apache Spark编译失败
2018-05-08 本文已影响147人
Kent_Yao
错误日志
[info] Compiling 13 Scala sources and 1 Java source to /srv/nbs/0/ne-spark/ne-spark/external/kafka-0-10-sql/target/scala-2.11/classes...
[error] javac: invalid source release: 1.8
[error] Usage: javac <options> <source files>
[error] use -help for a list of possible options
[error] Compile failed at 2018-5-8 15:01:18 [1.697s]
相关JIRA
https://issues.apache.org/jira/browse/SPARK-21075
不过这玩意都有人提issue，还好committer中有owen大哥，到处顶帖。。不过还是Dongjoon哥稳，一下就看出了啥毛病
popo_2018-05-08 15-23-02.jpg
确认JDK
hadoop@hzadg-jenkins:~/data/ne-spark/ne-spark$ jenv list java
Available java Versions
=========================
1.8.0_91
* 1.8.0_77
>* 1.8.0_71
1.8.0_60
1.8.0_51
1.8.0_45
1.8.0_40
1.8.0_31
1.8.0_25
1.8.0_20
* 1.8.0_112
1.8.0_11
1.8.0_101
1.8.0_05
1.8.0
* 1.7.0_75
1.7.0_67
1.7.0_65
1.7.0_60
1.7.0_55
1.7.0_51
1.7.0_45
1.7.0_40
1.7.0_25
1.6.0_45
当前环境使用的是 >* 1.8.0_71貌似没啥问题。
看看ZINC
hadoop@hzadg-jenkins:~/data/ne-spark/ne-spark$ ps -ef | grep zinc
hadoop 1346 1 1 May04 ? 01:05:36 /home/hadoop/.jenv/candidates/java/current/bin/java -server -Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m -Dzinc.home=/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9 -classpath /srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/compiler-interface-sources.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/incremental-compiler.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/nailgun-server.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/sbt-interface.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/scala-compiler.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/scala-library.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/scala-reflect.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/zinc.jar com.typesafe.zinc.Nailgun 3030 0
果然是早上切了个JDK 1.7.0_75后导致的问题，果断kill
