大数据平台建设

Azkaban搭建 3.44版本

2018-09-05  本文已影响0人  hbtszyt

1.创建元数据库

为Azkaban创建一个数据库:

# Example database creation command, although the db name doesn't need to be 'azkaban'

mysql> CREATE DATABASE azkaban;

 为Azkaban创建一个数据库用户:

# Example database creation command. The user name doesn't need to be 'azkaban'

mysql> CREATE USER 'username'@'%' IDENTIFIED BY 'password';

为用户赋予Azkaban数据库的增删查改的权限:

# Replace db, username with the ones created by the previous steps.

mysql> GRANT SELECT,INSERT,UPDATE,DELETE ON .* to ''@'%' WITH GRANT OPTION;

sudo /sbin/service mysqld restart

编译源码:

# Build Azkaban

./gradlew build

# Clean the build

./gradlew clean

# Build and install distributions

./gradlew installDist

# Run tests

./gradlew test

# Build without running tests

./gradlew build -x test

命令执行完成后,会在各个模块的azkaban*/build/distributions目录下生成编译好的安装包,这里生成了tar.gz和zip类型的压缩包

mv /server/azkaban-3.44.0/azkaban-web-server/build/distributions/azkaban-web-server-0.1.0-SNAPSHOT.tar.gz /server

mv /server/azkaban-3.44.0/azkaban-exec-server/build/distributions/azkaban-exec-server-0.1.0-SNAPSHOT.tar.gz /server

解压缩tar包:tar -zxvf *

将azkaban sql表结构导入mysql

mysql> use azkaban;

mysql> source /opt/azkaban-db-3.32.0-7-gcdfb2c8/create-all-sql-3.32.0-7-gcdfb2c8.sql

2.配置keystore

azkaban-web-server-3.1.0$ keytool -keystore keystore -alias jetty -genkey -keyalg RSA

输入密钥库口令: 

密钥库口令太短 - 至少必须为 6 个字符

输入密钥库口令: 

再次输入新口令:

您的名字与姓氏是什么?

[Unknown]:  firstName

您的组织单位名称是什么?

[Unknown]:  companyName

您的组织名称是什么?

[Unknown]:  groupName

您所在的城市或区域名称是什么?

[Unknown]:  beijing

您所在的省/市/自治区名称是什么?

[Unknown]:  beijing

该单位的双字母国家/地区代码是什么?

[Unknown]:  CN

CN= firstName, OU= companyName, O= groupName, L=beijing, ST=beijing, C=CN是否正确?[否]:  Y

以上配置完成之后会在当前目录生成一个keystore文件。以下配置会用到。

解压tar包:会生成几个文件夹:

drwxr-xr-x 2 tinyv tinyv 4096 Mar 7 11:05 azkaban-db-3.44.0

drwxr-xr-x 7 tinyv tinyv 4096 Mar 13 15:32 azkaban-exec-server-3.44.0

drwxr-xr-x 8 tinyv tinyv 4096 Mar  7 11:05 azkaban-solo-server-3.44.0

drwxr-xr-x 6 tinyv tinyv 4096 May  8 10:51 azkaban-web-server-3.44.0

drwxr-xr-x 2 tinyv tinyv 4096 Mar  7 11:16 package

关于azkaban-web-server-3.44.0目录修改

将keystore 考贝到 azkaban web服务器根目录中.

cd /server/azkaban-3.44.0/azkaban-web-server-3.44.0

cp keystore azkaban/webserver

vi /server/azkaban-3.44.0/azkaban-web-server-3.44.0/conf/azkaban.properties

注意配置的默认时区是:default.timezone.id=America/Los_Angeles 修改为:default.timezone.id=Asia/Shanghai

下边是完整的azkaban.properties相关配置,其中有些是默认的

azkaban.name=Test

azkaban.label=My Local Azkaban

azkaban.color=#FF3601

azkaban.default.servlet.path=/index

web.resource.dir=/server/azkaban-3.44.0/azkaban-web-server-3.44.0/web/

default.timezone.id=America/Los_Angeles

# Azkaban UserManager class

user.manager.class=azkaban.user.XmlUserManager

user.manager.xml.file=/server/azkaban-3.44.0/azkaban-web-server-3.44.0/conf/azkaban-users.xml

# Loader for projects

executor.global.properties=/server/azkaban-3.44.0/azkaban-web-server-3.44.0/conf/global.properties

azkaban.project.dir=projects

database.type=mysql

mysql.port=3306

mysql.host=10.2.26.23

mysql.database=azkaban

mysql.user=azkaban

mysql.password=azkaban

mysql.numconnections=100

# Velocity dev mode

velocity.dev.mode=false

# Azkaban Jetty server properties.

#jetty.use.ssl=false

jetty.maxThreads=25

jetty.port=8081

jetty.ssl.port=8443

jetty.keystore=keystore

jetty.password=azkaban

jetty.keypassword=azkaban

jetty.truststore=keystore

jetty.trustpassword=azkaban

jetty.excludeCipherSuites=SSL_RSA_WITH_DES_CBC_SHA,SSL_DHE_RSA_WITH_DES_CBC_SHA,SSL_DHE_DSS_WITH_DES_CBC_SHA,SSL_RSA_EXPORT_WITH_RC4_40_MD5,SSL_RSA_EXPORT_WITH_DES40_CBC_SHA,SSL_DHE_RSA_EXPORT_WITH_DES40_CBC_SHA,SSL_DHE_RSA_WITH_3DES_EDE_CBC_SHA,SSL_DHE_DSS_WITH_3DES_EDE_CBC_SHA,T

LS_DHE_RSA_WITH_AES_256_CBC_SHA256,TLS_DHE_DSS_WITH_AES_256_CBC_SHA256,TLS_DHE_RSA_WITH_AES_256_CBC_SHA,TLS_DHE_DSS_WITH_AES_256_CBC_SHA,TLS_DHE_RSA_WITH_AES_128_CBC_SHA256,TLS_DHE_DSS_WITH_AES_128_CBC_SHA256,TLS_DHE_RSA_WITH_AES_128_CBC_SHA,TLS_DHE_DSS_WITH_AES_128_CBC_SHA

# Azkaban Executor settings

executor.port=12321

# mail settings

mail.sender=hblfyla@163.com

mail.host=smtp.163.com

mail.user=hblfyla@163.com

mail.password=xiaoao0316

#job.failure.email=

#job.success.email=

lockdown.create.projects=false

cache.directory=cache

# JMX stats

jetty.connector.stats=true

executor.connector.stats=true

# Azkaban plugin settings

azkaban.jobtype.plugin.dir=/server/azkaban-3.44.0/azkaban-web-server-3.44.0/plugins/jobtypes

用户相关配置:

关于azkaban-exec-server-3.44.0目录修改

vi /server/azkaban-3.44.0/azkaban-exec-server-3.44.0/conf/azkaban.properties

default.timezone.id=America/Los_Angeles

# Azkaban JobTypes Plugins

azkaban.jobtype.plugin.dir=/server/azkaban-3.44.0/azkaban-exec-server-3.44.0/plugins/jobtypes

# Loader for projects

executor.global.properties=/server/azkaban-3.44.0/azkaban-exec-server-3.44.0/conf/global.properties

azkaban.project.dir=projects

database.type=mysql

mysql.port=3306

mysql.host=10.2.26.23

mysql.database=azkaban

mysql.user=azkaban

mysql.password=azkaban

mysql.numconnections=100

# Azkaban Executor settings

executor.maxThreads=50

executor.port=12321

executor.flow.threads=30

# JMX stats

jetty.connector.stats=true

executor.connector.stats=true

# uncomment to enable inmemory stats for azkaban

#executor.metric.reports=true

#executor.metric.milisecinterval.default=60000

3.启动相关服务

web服务器,在azkaban web服务器目录下执行启动命令,bin/azkaban-web-start.sh

注:在web服务器根目录运行

执行服务器,在执行服务器目录下执行启动命令,bin/azkaban-executor-start.sh ./

注:只能要执行服务器根目录运行

启动完成后,在浏览器(建议使用谷歌浏览器)中输入https://服务器IP地址:8443 ,即可访问azkaban服务了.在登录中输入刚才新的户用名及密码,点击 login.

上一篇下一篇

猜你喜欢

热点阅读