IT Operations and Reliability Assessment

Site Reliability Engineering and Observability Maturity Assessment

Evaluates site reliability engineering and observability maturity across reliability governance, SLOs and error budgets, observability, release safety and production readiness, resilience and capacity, incident response and on-call, toil, automation and agent actions, and reliability learning, measurement and value.

Already have an account? Log in to start

Who it is for

  • Process Owner/Full Model Assessor
  • SRE and Reliability Engineering
  • Product Engineering and Service Owners
  • Platform and Observability Engineering
  • Incident Response and Operations
  • Engineering Leadership and Business Owners

Head of SRE or reliability engineering, platform engineering lead and engineering VP. Secondary: service owners and product engineering leads, incident commanders and on-call responders, observability engineers, AI and ML service teams, and business owners of critical services.

What you will gain

Shows where reliability targets are missing or ignored, where teams cannot see or debug what fails, where changes reach every user before anyone checks them, where recovery and fallback are untested, where on-call burns people out, where AI services and agents run without SLOs or limits, and where postmortem lessons never turn into fixes.

About this assessment

Most outages are not exotic: a configuration push that went to every region at once, a retry storm against a slow dependency, a page that fired 40 times a night until people muted it, a runbook last touched two years ago, a postmortem whose actions never closed. AI adds new ones: an LLM provider that hits its rate limit at peak, a prompt change that quietly halves answer quality, an agent that restarts the wrong cluster, and a triage assistant whose confident guess becomes the root cause. This assessment follows the reliability practice end to end: tiers, the SRE operating and engagement model, shared ownership and skills; user-centric SLIs, SLOs, error budgets and their use in decisions; telemetry standards, end-to-end traces, debugging, burn-rate alerting, cost and sensitive data; readiness, progressive delivery, flags and configuration, change to incident linkage and AI changes; resilience patterns, capacity, load, chaos, recovery and provider fallback; detection, command, on-call health, runbooks, status, postmortems and AI-assisted triage; toil, self-service, automated remediation, AI detection and agent actions; and KPIs, action follow-through, themes, game days, the cost and value of reliability, benchmarking, prediction and improvement. The model is self-contained: it owns every document it uses, and needs no other assessment. It tracks the DORA measures that bear on stability (change fail rate, rework rate and failed deployment recovery time) and leaves throughput measures (lead time and deployment frequency) to delivery assessments.

What we assess: 8 domains

Each domain is a group of related questions, scored on its own and rolled up into your overall result.

01 · 5 questions

1 Reliability Governance and Operating Model

The reliability policy and service tiers, the SRE operating model, engagement entry and exit, shared production ownership and SRE skills proven in practice

02 · 7 questions

2 SLOs and Error Budgets

User-centric SLIs, SLO definition and agreement, the error budget policy, SLO reporting and decisions on breaches, SLO recalibration, dependency reliability and SLOs for AI and LLM services

03 · 8 questions

3 Observability

The instrumentation standard and context propagation, end-to-end telemetry including AI and agent traces, exploratory debugging, burn-rate alerting and noise review, synthetic and real user monitoring, telemetry cost and cardinality, sensitive data in telemetry and the observability platform

04 · 5 questions

4 Release Safety and Production Readiness

Production readiness before launch, progressive delivery with automated analysis and rollback, feature flag and configuration change safety, linking incidents to changes and AI model, prompt and provider changes

05 · 6 questions

5 Resilience and Capacity

Failure-handling patterns, capacity forecasting and headroom, load testing, chaos experiments, recovery testing and fallback when AI model providers fail

06 · 7 questions

6 Incident Response and On-Call

SLO-driven detection, incident command, sustainable on-call, runbooks, incident status communication with human approval of external posts, blameless postmortems and AI-assisted triage

07 · 5 questions

7 Toil, Automation and Agent Actions

Toil measurement and caps, self-service reliability tooling, automated remediation, AI in operations for detection and correlation, and controls on AI agents acting in production

08 · 8 questions

8 Reliability Learning, Measurement and Value

Reliability KPIs, action prioritization and verified closure, cross-service risk themes, knowledge sharing and game days, the cost and value of reliability, benchmarking, predictive reliability and continual improvement

KPIs to track

Measures that show whether the improvements hold.

KPI
Tier 1 Services Meeting Their SLO - Share of Tier 1 services that met their SLO over the quarter. Target: 95% or more (model target).
Time to Mitigate Major Incidents - Detection to mitigation for major incidents at the median and 90th percentile. Target: median within 60 minutes and 90th percentile within 4 hours, or the tier target where tighter (model target).
Change Fail Rate - Share of deployments to Tier 1 services that caused a failure needing remediation. Target: under 15% (model target).
On-Call Shifts Within the Page Limit - Share of on-call shifts with no more pages than the On-Call Policy limit. Target: 90% or more (model target).
SRE Time Spent on Toil - Share of SRE time spent on toil, no team above the 50% cap. Target: under 30% (model target; cap from the Google SRE Book).

Framework alignment

Questions are written in plain language and mapped to:

  • Google SRE Book
  • Google SRE Workbook
  • Google SRE Workbook Ch. 4
  • Google SRE Workbook Ch. 5
  • The Site Reliability Workbook Ch. 6
  • DORA 2024
  • DORA 2025
  • DORA Capabilities
  • CNCF Observability Whitepaper
  • OpenTelemetry Specification
  • OpenTelemetry Semantic Conventions
  • W3C Trace Context
  • Principles of Chaos Engineering
  • COBIT 2019
  • ISO/IEC 20000-1:2018
  • ISO 22301:2019
  • ISO/IEC 27001:2022
  • ISO/IEC 27701
  • ISO/IEC 25010:2023
  • ISO 30401:2018
  • ISO 10015:2019
  • ISO 45003:2021
  • NIST SP 800-160 Vol. 2 Rev. 1
  • NIST AI RMF 1.0
  • ISO/IEC 42001:2023
  • NIST AI 600-1

Works best with

Practices this assessment relies on. Assessing them too gives a fuller picture.

None; this model is self-contained.
Overlap (see also, not prerequisites): SRE, DevOps and ITSM Convergence (v4.9.6), Monitoring and Event Management (v4.9.6), DevOps Engineering (v1.9.6), Incident Management (v9.9.6), Post-Incident Review and RCA Quality (v4.9.6), Capacity Performance Management (v6.9.6), AI Pipeline and MLOps (v11.9.6), Service Availability Management (v6.9.6), AI Use Case Lifecycle Management (v4.9.6), Business Continuity and Disaster Recovery Management (v6.9.6), Service Transition, Release and Deployment (v5.9.6) and Non-Human Identity and Secrets Management (v4.9.6) test related practices; this model keeps its own questions and documents so it can be used alone.

What you get

Maturity scores

An overall score and a score for each of the 8 domains.

Gap analysis

A clear view of where current practice falls short, and why it matters.

Improvement recommendations

Prioritized next steps to move each area to the next level.

Detailed report

Results you can share with leadership and track over time.

See where you stand on Site Reliability Engineering and Observability Maturity Assessment

Register, take the assessment, and get your maturity score with a clear improvement roadmap.

Register to take this assessment

Start Measuring Your Maturity Today

© 2026 ITSGovernance, part of SMCE. All rights reserved. Cookie settings