sentry中间件解释
2024-05-07 本文已影响0人
就叫basi
关键中间件
- Loadbalancer（负载均衡器）负责路由转发（这一服务由用户搭建），错误上报转发到 /api/\d+/store
- 项目、成员、错误管理功能由 Sentry Web 负责。这一层的承担数据入口、展示的作用
- Relay 负责消息中继转发，并把数据先汇集到 Kafka；Snuba 负责接收 SentryWeb 的请求，进行数据的聚合、搜索；Sentry Worker 则是一个队列服务，主要负责数据的存储
- Kafka 作为消息队列
- ClickHouse 负责接近实时的数据分析
- Redis（主要） 和 Memcached 负责项目配置、错误基础信息的存储和统计
- Postgres 承担基础数据持久化（主要是项目、用户权限管理等）
- Symbolicator 主要用于错误信息格式化
中间件合集
| 服务 | 解释 |
|---|---|
| sentry-self-hosted-worker-1 | 内置任务队列，以异步的方式处理上报的issues和transactions 等 |
| sentry-self-hosted-web-1 | web 服务（UI + web api） |
| sentry-self-hosted-vroom-cleanup-1 | 定时任务 每天0点 清理 90天以外/var/lib/sentry-profiles下的目录文件 |
| sentry-self-hosted-vroom-1 | 性能分析服务 |
| sentry-self-hosted-transactions-consumer-1 | ingest-consumer 订阅 ingest-transactions topic 上报的transactions事件 |
| sentry-self-hosted-symbolicator-cleanup-1 | 每天的 23 点 55 分执行清理 symcaches cache |
| sentry-self-hosted-symbolicator-1 | 符号化服务，符号化是将程序中的内存地址与源代码中的函数、变量等符号进行关联的过程 |
| sentry-self-hosted-subscription-consumer-transactions-1 | subscription-consumer-transactions 订阅 transactions-subscription-results topic |
| sentry-self-hosted-subscription-consumer-metrics-1 | subscription-consumer-metrics 订阅 metrics-subscription-results topic |
| sentry-self-hosted-subscription-consumer-generic-metrics-1 | subscription-consumer-generic-metrics 订阅 generic-metrics-subscription-results topic |
| sentry-self-hosted-subscription-consumer-events-1 | subscription-consumer-events 订阅 events-subscription-results topic |
| sentry-self-hosted-snuba-transactions-consumer-1 | transactions_group 订阅 transactions topic 上报的transactions事件 |
| sentry-self-hosted-snuba-subscription-consumer-transactions-1 | snuba-subscription-consumer-transactions 订阅snuba-transactions-commit-log topic |
| sentry-self-hosted-snuba-subscription-consumer-metrics-1 | snuba-subscription-consumer-metrics 订阅 snuba-metrics-commit-log topic |
| sentry-self-hosted-snuba-subscription-consumer-events-1 | snuba-subscription-consumer-events 订阅snuba-commit-log topic |
| sentry-self-hosted-snuba-replays-consumer-1 | snuba-replays-consumer 订阅ingest-replay-events topic |
| sentry-self-hosted-snuba-replacer-1 | snuba-replacer 订阅 event-replacements topic |
| sentry-self-hosted-snuba-profiling-profiles-consumer-1 | snuba-profiling-profiles-consumer 订阅processed-profiles topic |
| sentry-self-hosted-snuba-profiling-functions-consumer-1 | snuba-profiling-functions-consumer 订阅 profiles-call-tree |
| sentry-self-hosted-snuba-outcomes-consumer-1 | 订阅 outcomes topic |
| sentry-self-hosted-snuba-metrics-consumer-1 | 订阅 snuba-metrics topic |
| sentry-self-hosted-snuba-issue-occurrence-consumer-1 | snuba-issue-occurrence-consumer 订阅 generic-events topic |
| sentry-self-hosted-snuba-generic-metrics-sets-consumer-1 | snuba-generic-metrics-sets-consumer 订阅 snuba-generic-metrics topic |
| sentry-self-hosted-snuba-generic-metrics-distributions-consumer-1 | snuba-generic-metrics-distributions-consumer 订阅 snuba-generic-metrics topic |
| sentry-self-hosted-snuba-generic-metrics-counters-consumer-1 | snuba-generic-metrics-counters-consumer 订阅snuba-generic-metrics topic |
| sentry-self-hosted-snuba-consumer-1 | snuba-consumers 订阅events topic 上报的issues事件 |
| sentry-self-hosted-snuba-api-1 | |
| sentry-self-hosted-smtp-1 | 邮件服务 |
| sentry-self-hosted-sentry-cleanup-1 | 每天0点执行定时清理过期的数据，过期时间 SENTRY_EVENT_RETENTION_DAYS=90 |
| sentry-self-hosted-relay-1 | |
| sentry-self-hosted-post-process-forwarder-transactions-1 | post-process-forwarder 订阅 transactions topic 上报的transactions事件 |
| sentry-self-hosted-post-process-forwarder-issue-platform-1 | post-process-forwarder-issue-platform 订阅 generic-events topic |
| sentry-self-hosted-post-process-forwarder-errors-1 | post-process-forwarder 订阅 events topic 上报的issues事件 |
| sentry-self-hosted-nginx-1 | 负载均衡 |
| sentry-self-hosted-metrics-consumer-1 | metrics-consumer 订阅 ingest-metrics topic |
| sentry-self-hosted-memcached-1 | 系统相关用户权限、组织信息、项目信息 |
| sentry-self-hosted-ingest-replay-recordings-1 | ingest-replay-recordings 订阅 ingest-replay-recordings topic |
| sentry-self-hosted-ingest-profiles-1 | ingest-profiles 订阅 ingest-profiles topic |
| sentry-self-hosted-ingest-occurrences-1 | ingest-occurrences 订阅 ingest-occurrences topic |
| sentry-self-hosted-ingest-monitors-1 | ingest-monitors 订阅 ingest-monitors topic |
| sentry-self-hosted-generic-metrics-consumer-1 | generic-metrics-consumer 订阅 ingest-generic-metrics topic |
| sentry-self-hosted-events-consumer-1 | ingest-consumer 订阅 ingest-events topic 上报的issues事件 |
| sentry-self-hosted-cron-1 | 定时任务 |
| sentry-self-hosted-billing-metrics-consumer-1 | billing-metrics-consumer 订阅 snuba-generic-metrics topic |
| sentry-self-hosted-attachments-consumer-1 | ingest-consumer 订阅 ingest-attachments topic |
| redis | 业务相关的transcation，系统相关的设置，待处理的任务，事件的聚合结果、错误分组信息，限流，有的有过期时间，有的没有 |
| postgres | 配置数据、用户数据、错误信息摘要 |
| kafka | 消息上报，消息存储 |
| clickhouse | 异常数据存储/查询 |
clickhouse数据源
errors_local : 存储所有的 issue 详细数据
transactions_local ：存储所有的 trans 数据
profiles_local：存储所有分析数据
replays_local：存储所有Session Replay数据
postgres数据源
sentry_groupedmessage：存储异常数据 同一个方法抛出的同一类异常，只会保留一条数据，并只记录异常的名字、指定的msg和异常出现的次数
