Skip to main content
Nathan Claire Group
InsightsField Notes
Field Notes

What monitoring thousands of servers taught us about MTTR

6 min read
Nathan Claire Africa · Edge

After instrumenting hundreds of client environments, patterns emerge. The most common cause of high MTTR is not tool failure. It is tool fragmentation.

High Mean Time to Resolution is often blamed on poor tools. In practice, the deeper problem is frequently too many tools that do not understand one another.

A server monitoring tool identifies infrastructure pressure. An APM tool identifies latency. A database platform identifies a slow query. A log platform records errors. A network tool identifies packet loss. Each observation is useful. But engineers still have to build the relationship manually. That time becomes MTTR.

The investigation tax

Consider a production incident. The service desk receives complaints. Operations checks infrastructure. Infrastructure appears healthy. Application engineers investigate APM. A dependency appears slow. Database engineers are contacted. Logs are requested. Network teams investigate connectivity.

Thirty minutes becomes two hours. Not because nobody has the right data. Because the data is distributed across teams and systems.

Visibility is not enough

Monitoring tools are usually very good at answering narrow questions: Is this server healthy? Is this API slow? Did this query fail? Is this network link available? Incidents rarely respect those boundaries. A customer experiences one problem. The organisation sees six technical signals. That difference is where resolution time grows.

Topology changes the conversation

One of the most useful capabilities in observability is understanding relationships: Which service runs on this host? Which applications depend on this database? Which transactions use this API? Which customer journeys depend on this service? Which infrastructure supports this application?

When those relationships are mapped, an incident becomes easier to navigate. Instead of searching across systems, engineers follow the dependency chain.

Baselines beat static assumptions

Another pattern repeatedly seen in complex environments is that fixed thresholds create noise. 80% CPU may be abnormal for one host. For another, it may happen every weekday at 09:00. A response time of 800ms may be unacceptable for one API and completely normal for another.

Monitoring becomes more useful when current behaviour is compared with expected behaviour. That is why Edge includes anomaly and baseline concepts across the observability environment. The important question becomes: is this behaviour abnormal for this system right now?

Reduce the handoffs

Every handoff during an incident introduces delay: operations to application, application to database, database to network, network back to application.

A unified observability platform does not eliminate specialist teams. It gives them shared evidence. Everyone can begin from the same incident context.

MTTR is largely an information problem

The actual remediation for many incidents is surprisingly simple: restart the service, correct the query, increase capacity, fix the configuration, roll back the release, reroute traffic.

The difficult part is knowing which action is appropriate. That is why Edge is designed around correlation. Infrastructure, APM, Logs, Network, Database, Transactions and Overwatch should contribute to the same investigation.

Faster does not mean careless

Reducing MTTR should not mean automating every action. The goal is to reduce uncertainty: give engineers better context, show relationships, surface anomalies, preserve evidence, recommend appropriate next steps. Then allow teams to make informed decisions faster.

The lesson

The organisations that improve MTTR consistently are not necessarily the ones with the most monitoring tools. They are the ones where telemetry works together. Because during an incident, visibility matters. But connected visibility matters more.