pavlov/fluentd

fluentd

Kubernetes集群的简单日志收集器，集成Loggly和S3功能。

概述

本镜像用于替换或增强Kubernetes集群的日志系统，其配置文件fluent.conf中的核心指令借鉴自官方fluentd镜像。若需调整插件配置（如移除Loggly或修改S3存储规则），可fork仓库进行定制。

核心功能

• 收集Kubernetes集群节点及容器日志
• 支持将日志发送至Loggly服务进行分析
• 支持将日志持久化存储到AWS S3桶

使用场景

适用于需要集中管理Kubernetes集群日志的场景，满足日志监控、分析和长期存储需求。

配置说明

镜像已发布至Docker Hub：https://hub.docker.com/r/pavlov/fluentd

AWS环境下的DaemonSet部署示例

yaml
apiVersion: v1
kind: Secret
type: Opaque
metadata:
  name: fluentd
data:
  loggly: dHJ5YWdhaW5pbnRlcm5ldHBlcnNvbg==
  aws.key: bmljZXRyeW5zYSE=
  aws.secret: bm9wZXRoaXNvbmVpc24ndHJlYWxlaXRoZXI=
  aws.s3.bucket: dHJvbG9sb2xvbG8=
  aws.s3.region: aWxpa2V0dXJ0bGVz
---
apiVersion: extensions/v1beta1
kind: DaemonSet
metadata:
  name: fluentd
spec:
  template:
    metadata:
      labels:
        app: fluentd
    spec:
      containers:
      - name: fluentd
        image: docker.xuanyuan.run/pavlov/fluentd
        imagePullPolicy: Always
        env:
        - name: FLUENTD_LOGGLY_TOKEN
          valueFrom:
            secretKeyRef:
              name: fluentd
              key: loggly
        - name: AWS_ACCESS_KEY_ID
          valueFrom:
            secretKeyRef:
              name: fluentd
              key: aws.key
        - name: AWS_SECRET_ACCESS_KEY
          valueFrom:
            secretKeyRef:
              name: fluentd
              key: aws.secret
        - name: FLUENTD_S3_BUCKET
          valueFrom:
            secretKeyRef:
              name: fluentd
              key: aws.s3.bucket
        - name: FLUENTD_S3_REGION
          valueFrom:
            secretKeyRef:
              name: fluentd
              key: aws.s3.region
        volumeMounts:
        - name: pos
          mountPath: /etc/fluent/pos
          readOnly: false
        - name: varlog
          mountPath: /var/log
          readOnly: false
        - name: mntephemeraldockercontainers
          mountPath: /mnt/ephemeral/docker/containers
          readOnly: true
        - name: docker-socket
          mountPath: /var/run/docker.sock
          readOnly: false
      volumes:
      - name: pos
        hostPath:
          path: /etc/fluent/pos
      - name: varlog
        hostPath:
          path: /var/log
      - name: mntephemeraldockercontainers
        hostPath:
          path: /mnt/ephemeral/docker/containers
      - name: docker-socket
        hostPath:
          path: /var/run/docker.sock

开发

bash
$ make build  # 构建镜像
$ make push   # 推送镜像至Docker Hub

许可证

本Docker镜像基于https://github.com/usepavlov/fluentd/blob/master/LICENSE%E5%8F%91%E5%B8%83%E3%80%82