Flink JobHistoryServer on K8s

2021-07-13  本文已影响0人  john瀚
apiVersion: v1
kind: ConfigMap
metadata:
  name: flink-job-history-server-config
data:
  flink-conf.yaml: |
    # 指定由JobManager归档的作业信息所存放的目录,这里使用的是HDFS
    jobmanager.archive.fs.dir: hdfs:///flink/completed-jobs/
    # 指定History Server扫描哪些归档目录,多个目录使用逗号分隔
    historyserver.archive.fs.dir: hdfs:///flink/completed-jobs/
    # 指定History Server间隔多少毫秒扫描一次归档目录
    historyserver.archive.fs.refresh-interval: 10000
    # History Server所绑定的ip,0.0.0.0代表允许所有ip访问
    historyserver.web.address: 0.0.0.0
    # 指定History Server所监听的端口号
    historyserver.web.port: 8082
---
apiVersion: apps/v1
kind: Deployment
metadata:
  name: flink-job-history-server-deployment
spec:
  selector:
    matchLabels:
      app: flink-job-history-server
  replicas: 1
  template:
    metadata:
      labels:
        app: flink-job-history-server
    spec:
      dnsConfig:
        nameservers:
          - 10.52.44.1
        searches:
          - oppo.internal
      volumes:
        - configMap:
            items:
              - key: flink-conf.yaml
                path: flink-conf.yaml
            name: flink-job-history-server-config
          name: flink-config-volume
        - configMap:
            name: ad-hadoop-config
          name: hadoop-config-volume
      containers:
        - name: history-server
          image: flink:1.13.1-scala_2.11
          command: ["/opt/flink/bin/historyserver.sh","start-foreground"]
          ports:
            - containerPort: 8082
          env:
            - name: HADOOP_USER_NAME
              value: "hdfs"
            - name: HADOOP_CONF_DIR
              value: /opt/hadoop/conf
          resources:
            requests:
              memory: "100Mi"
              cpu: "100m"
          volumeMounts:
            - mountPath: /opt/hadoop/conf
              name: hadoop-config-volume
            - mountPath: /opt/flink/conf
              name: flink-config-volume
---
apiVersion: v1
kind: Service
metadata:
  name: flink-job-history-server-service
spec:
  selector:
    app: flink-job-history-server
  ports:
    - protocol: TCP
      port: 8082
      targetPort: 8082
---
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: flink-job-history-server-ingress
  annotations:
    kubernetes.io/ingress.class: "nginx"
    nginx.ingress.kubernetes.io/rewrite-target: /$2
spec:
  rules:
  - host: "long-stream-flink.com"
    http:
      paths:
      - pathType: Prefix
        path: /history(/|$)(.*)
        backend:
          service:
            name: flink-job-history-server-service
            port:
              number: 8082
上一篇下一篇

猜你喜欢

热点阅读