Sheet 07

Hop-by-Hop Network Latency Budget

End-to-end request latency decomposition, tail latency amplification (P95/P99), and SLA validation.

SLA CompliancePASS (92.2ms / 150ms)
Uncached P50
85.5 ms
Origin miss + DB
Cached P50
50.5 ms
Fast path (CDN + Redis)
Blended P50
51.2 ms
98% cached / 2% miss
P95 Tail Latency
92.2 ms
1.8x amplification
P99 Worst 1%
153.6 ms
3.0x amplification

Cumulative Hop Latency Waterfall (ms)

Hop-by-Hop Breakdown Matrix

Network HopHop Latency (ms)Cumulative (ms)% of TotalArchitectural Context
Client -> DNS5 ms5 ms5.8%Cached in browser/OS after 1st hit
DNS -> CDN Edge10 ms15 ms11.7%Anycast routing to nearest PoP
CDN -> Origin (Miss)30 ms45 ms35.1%Only 2% of traffic on cache miss
Origin -> LB2 ms47 ms2.3%NLB TCP handoff
LB -> Gateway2 ms49 ms2.3%mTLS proxying in private VPC
API Gateway3.5 ms52.5 ms4.1%JWT verify + token bucket + route
Gateway -> Service1 ms53.5 ms1.2%Service mesh sidecar hop (Envoy)
Service Processing20 ms73.5 ms23.4%Core business logic execution
Service -> Redis1 ms74.5 ms1.2%In-memory cache read
Service -> Postgres5 ms79.5 ms5.8%Indexed primary key / foreign key lookup
JSON Serialization1 ms80.5 ms1.2%DTO serialization
Reverse Egress Path5 ms85.5 ms5.8%TLS encapsulation back to client