Reading event lag without chasing every spike
Lag graphs look decisive until you sit with them for a week. A midday bump may match a batch job. A quiet Sunday dip may hide a stalled consumer that simply has nothing to process. When teams treat every rise as an anomaly, on-call rotation burns out and real failures blend into the noise.
Start from the business clock
Ask which user-visible deadlines attach to each event type. An order-confirm event that must land within two minutes deserves a tighter lens than a nightly preference sync. Write those deadlines beside the graph — not only in a design wiki no one opens during an incident.
Separate transport lag from processing lag
Streaming application analytics often mixes broker delay with slow handlers. If your chart cannot distinguish “waiting in the queue” from “being processed slowly,” anomaly detection will keep pointing at the wrong owner. A short annotation pass during an Event Flow Assessment usually clarifies this split.
Prefer windows your operators trust
Sliding windows that reset every few seconds produce theatrical charts and few decisions. Daily or hourly summaries that your team already discusses in standup tend to stick. Build anomaly rules on the windows people already argue about, then refine.
When lag still surprises you after these steps, the gap is usually missing context — not missing tooling. Bring the people who own producers and consumers into the same room and walk one recent spike end to end.