The Gardener and the Geiger Counter: On Two Kinds of Vigilance

We build systems and then we watch them. This is the fundamental pact of reliability. But the nature of that watching, the posture we assume and the tools we wield, diverges sharply. In our pursuit of uptime, two distinct philosophies emerge, embodied in two different tools: the synthetic check and the real-user metric. One is the gardener, the other the geiger counter. One tends, the other simply registers.

The synthetic check is the gardener. It follows a prescribed, deliberate path. It visits the same endpoints at the same intervals, performing the same ritualistic actions—a login here, an API call there, a full transaction flow. Its world is a planned garden. It knows where the paths should be, what should bloom and when. Its alarm is the discovery of a wilted petal, a broken gate, a path overgrown. This vigilance is proactive, a scheduled patrol. It offers the immense comfort of predictability and early warning. We can know a service is failing before a single real user has stumbled upon the fault. It is the watch set before the storm.

The Tremor in the Ground

The real-user metric, however, is the geiger counter. It does not patrol. It is merely held up to the environment, passively listening. Its data is not the result of a scripted action, but the faint, collective tremor of every actual footstep across the landscape. It registers the click that hesitated, the page load that strained, the API call from a forgotten browser on an old phone in a distant city. Its alarm is not a broken gate, but a shift in the radiation of normalcy—a spike in latency from a specific region, a slow creep in error rates for a particular cohort.

The geiger counter’s truth is messier, more ambiguous, and profoundly more honest. It tells you not that your garden path is clear, but that people are choosing to walk through the mud instead. It reveals problems you never thought to script a check for, because your script, like a gardener, only walks the paths you built. It hears the tremors of a fault line you didn't know existed.

Relying solely on the gardener’s report risks cultivating a beautiful, empty garden—a service that passes all its synthetic checks while real users quietly abandon it, frustrated by some unscripted friction. Trusting only the geiger counter, however, means you only ever react. You learn of the wilted flower when the first visitor complains of its scent. The silence of the counter is not confirmation of health, but merely an absence of catastrophic decay.

The art, then, is in holding both tools. The gardener ensures the infrastructure of the garden is intact, the fences strong, the water flowing. The geiger counter tells you if the soil is right, if the air is changing, if the visitors are happy. One maintains the system you designed; the other listens to the system as it is actually experienced. The first is vigilance over our intention; the second, vigilance over reality’s quiet, constant reply. To run a reliable service is to both tend the paths and listen for the footsteps, understanding that the map of our checks will never fully cover the territory of real use.

Notes & further reading

A few pages I came back to while writing this: