lomik/carbon-clickhouse

carbon-clickhouse

Graphite指标接收器，使用ClickHouse作为存储后端，用于监控数据的高效采集与存储。

生产状态

最新版本稳定，可用于生产环境。

快速开始

https://github.com/lomik/graphite-clickhouse-tldr

构建（源码）

sh
# 构建二进制文件
git clone https://github.com/lomik/carbon-clickhouse.git
cd carbon-clickhouse
make

ClickHouse配置

1. 在config.xml中添加graphite_rollup section，示例见https://github.com/lomik/graphite-clickhouse-tldr/blob/master/rollup.xml%E3%80%82%E5%8F%AF%E9%80%9A%E8%BF%87https://github.com/bzed/carbon-schema-to-clickhouse%E5%B7%A5%E5%85%B7%E4%BB%8EGraphite%E7%9A%84storage-schemas.conf%E7%94%9F%E6%88%90rollup xml。
2. 创建表：

sql
CREATE TABLE graphite ( 
  Path String,  
  Value Float64,  
  Time UInt32,  
  Date Date,  
  Timestamp UInt32
) ENGINE = GraphiteMergeTree('graphite_rollup')
PARTITION BY toYYYYMM(Date)
ORDER BY (Path, Time);

-- 可选：用于快速指标搜索的索引表
CREATE TABLE graphite_index (
  Date Date,
  Level UInt32,
  Path String,
  Version UInt32
) ENGINE = ReplacingMergeTree(Version)
PARTITION BY toYYYYMM(Date)
ORDER BY (Level, Path, Date);

-- 可选：存储Graphite标签的表
CREATE TABLE graphite_tagged (
  Date Date,
  Tag1 String,
  Path String,
  Tags Array(String),
  Version UInt32
) ENGINE = ReplacingMergeTree(Version)
PARTITION BY toYYYYMM(Date)
ORDER BY (Tag1, Path, Date);

更多GraphiteMergeTree信息见官方文档，也可创建复制表（参考ClickHouse复制文档）。

配置说明

命令行参数

$ carbon-clickhouse -help
Usage of carbon-clickhouse:
  -check-config=false: 检查配置并退出
  -config="": 配置文件名
  -config-print-default=false: 打印默认配置
  -version=false: 打印版本

配置文件（toml格式）

主要配置项包括：

• common: 内部指标前缀、存储端点、采集间隔等
• logging: 日志文件路径、级别
• data: 数据缓冲目录、分片大小/间隔、压缩算法
• upload: 数据上传到ClickHouse的配置（表名、线程数、URL等）
• 协议监听: UDP/TCP/Pickle/gRPC/Prometheus等协议的监听端口与开关
• pprof: 调试接口配置

示例配置片段：

toml
[common]
metric-prefix = "carbon.agents.{host}"
metric-endpoint = "local"
metric-interval = "1m0s"
max-cpu = 1

[logging]
file = "/var/log/carbon-clickhouse/carbon-clickhouse.log"
level = "info"

[udp]
listen = ":2003"
enabled = true

[tcp]
listen = ":2003"
enabled = true

Docker部署示例

单容器运行

sh
docker run -d \
  --name carbon-clickhouse \
  -p 2003:2003/tcp \
  -p 2003:2003/udp \
  -v /path/to/config.toml:/etc/carbon-clickhouse/config.toml \
  -v /path/to/data:/data/carbon-clickhouse \
  docker.xuanyuan.run/lomik/carbon-clickhouse

参考docker-compose

详见https://github.com/lomik/graphite-clickhouse-tldr%EF%BC%8C%E5%8C%85%E5%90%ABcarbon-clickhouse%E3%80%81ClickHouse%E5%8F%8A%E7%9B%B8%E5%85%B3%E7%BB%84%E4%BB%B6%E7%9A%84%E5%AE%8C%E6%95%B4%E9%83%A8%E7%BD%B2%E9%85%8D%E7%BD%AE%E3%80%82