Sheet 08
Kafka Event Bus & Messaging Engine
Throughput sizing, KRaft controller plane quorum, partition balancing, and topic lifecycle architecture.
Cluster Sizing3 Brokers (6 Partitions)
Producer Throughput
6.51 MB/s
1 KB avg msgInternal Replication
19.5 MB/s
3x replicationMonthly Ingress
16.1 TB
5.4 TB with zstdKRaft Quorum
3 Controllers
Zero ZooKeeperPartition Sensitivity: Max Producer vs Consumer Throughput Capacity (MB/s)
Topic Schema & Partition Configuration
KRaft metadata ops: 0.6000000000000001 ops/s| Topic Name | Partitions | Retention | Replication | Cleanup Policy | Purpose & Semantics |
|---|---|---|---|---|---|
| order.events | 24 | 7 days | 3x | delete | Order lifecycle events (created, paid, fulfilled) |
| payment.transactions | 12 | 30 days | 3x | compact | Payment ledger (idempotent, financial audit) |
| inventory.updates | 12 | 7 days | 3x | compact | Stock count changes & reservations |
| order.dlq | 6 | 30 days | 3x | delete | Unrecoverable failed events for inspection |
| order.retry.5s | 6 | 1 day | 3x | delete | Retry tier 1 (5s exponential backoff) |
| order.retry.30s | 6 | 1 day | 3x | delete | Retry tier 2 (30s delay topic) |
| order.retry.5m | 6 | 1 day | 3x | delete | Retry tier 3 (5m delay topic) |
| order.reprocess | 6 | 7 days | 3x | delete | Manual reprocess buffer queue |