How we work
Instrumentation first
A system that cannot tell you what it is doing is a system you can only reason about by reading the code — and the code is always out of date.
The first thing we build is not the feature. It is the ability to see the feature: metrics, traces, structured logs, and a dashboard that shows the golden signals for whatever we are about to ship.
This is not ceremony. It is what makes every subsequent decision cheap.
What instrumentation-first buys you
- Deploy with a hypothesis. You know what "working" looks like in numbers before the code runs, so the deploy is a measurement rather than a hope.
- Debugging by query, not by archaeology. When a request misbehaves, the trace tells you which service, which query, which retry — in one lookup instead of an afternoon of log-grepping.
- Capacity conversations with evidence. "Do we need to scale it?" has an answer in the graph rather than an opinion in the meeting.
What we actually wire up
- RED metrics — rate, errors, duration — for every entry point.
- Traces across service boundaries, with the correlation id carried through queues, not just HTTP.
- Structured logs with the fields you will actually filter on: entity id, tenant, outcome.
- Business counters for the things your product measures: orders completed, forms submitted, jobs queued.
The order of work
- Skeleton with telemetry end to end — one request traced through the whole path, one dashboard showing it.
- The feature, behind the telemetry you just proved works.
- Alerting on the signals once you have watched them for a week and know what normal looks like.
Step 3 last is deliberate: alerts tuned before you know the baseline are just noise with a pager attached.
What it costs
A day or two at the start. What it saves is the first real incident in production, which is where an un-instrumented system spends its first week — and where trust in a new system is usually lost.
More notes
Read the rest
No newsletter and no automated follow-up. If we write again, it is because you asked us to.