← All notes
LeadershipTechnology

How Technical Leaders Define Success Beyond Uptime

A contribution portfolio for balancing dependable operations with measurable improvement, reusable capability, simplification, and disciplined learning.

A stable quarter can describe two very different technology organizations.

In one, teams kept important services dependable while removing repeated work, improving a customer workflow, retiring a fragile dependency, and learning enough to reject a weak AI use case. In the other, nothing broke because nothing meaningful changed. Both may show green dashboards. Only one increased the organization’s ability to do useful work.

This is why technical leadership cannot be evaluated through incidents avoided or features shipped alone. Reliability is an obligation. Change is an input. Neither one, by itself, defines a positive contribution.

Leaders need a portfolio view that recognizes several kinds of progress without rewarding novelty for its own sake. The following framework separates five contribution modes: protect, improve, enable, retire, and learn.

Start with a contribution portfolio

Each material item on a technology roadmap should fit one primary contribution mode. A piece of work may support several modes, but naming the primary one forces a clearer claim.

Contribution modePositive condition it createsUseful evidenceCommon false signal
ProtectA valuable service, control, or capability remains dependable as conditions changeUser-centered reliability, reduced exposure, recovery readiness, control effectivenessNo incidents occurred
ImproveAn existing workflow becomes better for a named groupTotal task time, quality, rework, cost per successful outcome, user behaviorA feature shipped or a local step became faster
EnableOther teams can deliver a useful result with less delay or riskAdoption by intended teams, time to first compliant use, repeated work removedA platform or standard exists
RetireObsolete cost, complexity, risk, or cognitive load disappearsSystems removed, dependencies closed, spend ended, support demand reducedA replacement launched
LearnA consequential uncertainty becomes a decisionAssumption tested, evidence recorded, scope changed, investment continued or stoppedA pilot produced a demo

The modes make reliability and progress part of the same management system. Protecting a payment service during rapid growth can be a substantial contribution. Improving a support workflow can create direct value. A reusable deployment path can enable many teams. Retiring an unused model endpoint can reduce future cost and exposure. A well-designed experiment can save months of investment by showing that a proposed automation does not fit the work.

No mode is automatically more strategic than another. The portfolio becomes weak when one mode dominates without an explicit reason. A team that only protects may be preserving a system users have outgrown. A team that only improves may accumulate infrastructure it cannot sustain. A team that only enables may build platforms nobody adopts. A team that never retires will pay indefinitely for old decisions. A team that only learns may become a permanent pilot lab.

The leader’s first task is therefore allocation: what must be protected, what deserves improvement, which capability should be shared, what should leave the estate, and which uncertainty is important enough to investigate?

Give every contribution a progress contract

A contribution mode is still only a label. Before work receives serious capacity, give it a short progress contract with five fields:

  1. Beneficiary: Who should experience the change?
  2. Changed condition: What should become better, safer, easier, cheaper, or newly possible?
  3. Baseline: What is happening now, including hidden human effort?
  4. Guardrail: What must not deteriorate while the change is made?
  5. Decision evidence: What result will cause the team to continue, revise, expand, or stop?

Consider an internal AI assistant for support engineers. “Launch the assistant” is not a progress contract. A stronger contract might be:

Support engineers should find an approved answer to routine policy questions in less total time. The baseline includes search, reading, correction, and escalation. Unsupported-answer rate and permission enforcement must not deteriorate. The controlled rollout expands only if total resolution time falls and correction work remains within the agreed boundary.

This contract changes design choices. It discourages the team from optimizing response speed while ignoring verification. It makes document ownership part of the product. It prevents weekly active users from becoming the sole success measure. It also gives leaders a legitimate reason to stop even when the demonstration looks impressive.

The updated Technology Business Management Framework connects technology resources, consumption, performance, and cost to measurable organizational outcomes. Its portfolio logic is useful here: technical activity becomes governable when leaders can trace it to a decision and a value driver. The progress contract provides that trace at the initiative level without pretending every contribution can be converted into a precise financial return.

Treat protection as a changing condition

“Keep the system running” sounds static, but the operating environment rarely is.

Usage grows. Data becomes more sensitive. Teams release more often. An AI agent receives another tool. A model provider changes behavior. A workflow expands to a new country. Attack techniques evolve. Experienced people leave. A stable outcome under higher exposure may require considerable improvement underneath it.

Protection should therefore be stated as a condition under change:

  • maintain successful customer checkout while traffic and release frequency rise;
  • preserve permission boundaries as more sources enter a retrieval system;
  • keep recovery time within the target while dependencies increase;
  • maintain reporting accuracy while source schemas and business definitions change;
  • reduce reliance on one expert while the service continues to meet its objective.

This is different from claiming credit for hypothetical disasters. Evidence can include load, complexity, observed failure modes, evaluation results, control tests, incident exercises, and changes in manual toil. The related note on proving the value of invisible reliability work goes deeper into making that causal chain visible.

Protection also needs a boundary. A team can spend indefinitely pursuing a level of reliability users neither need nor notice. Google’s SRE guidance recommends user-centered service objectives and error budgets so product and reliability teams have a shared mechanism for deciding when to release and when to repair. The important leadership move is not copying one universal uptime target. It is agreeing on the service condition, the acceptable risk, and the action triggered when the boundary is crossed.

Once that floor is explicit, reliability stops being a vague argument against change. It becomes one of the constraints that make responsible change possible.

Measure improvement across the whole workflow

Technology work often makes one step faster while moving effort somewhere less visible.

A coding agent produces a change quickly, but review and correction take longer. A support assistant shortens search time, but employees must verify every citation. A data pipeline finishes sooner, but analysts spend more time reconciling definitions. A self-service portal reduces official tickets, but users ask local experts for help. A new model lowers inference cost while producing more escalations.

Local speed is useful only when it survives the rest of the workflow.

For improvement work, measure a chain rather than one attractive number:

  • flow: elapsed time from need to accepted result;
  • quality: correctness, completeness, safety, and fitness for the task;
  • human load: review, correction, escalation, and coordination effort;
  • economics: total cost per successful outcome, not price per model call;
  • durability: recurring work removed and new maintenance created;
  • experience: whether the intended user can complete the task with appropriate confidence.

Current AI engineering research makes this distinction concrete. In March 2026, METR reported that roughly half of the test-passing AI-generated pull requests it studied would not have been accepted by repository maintainers, after adjusting for reviewer noise. The researchers are careful about the study’s limits, including its benchmark subset, harness, and static review setup. The useful implication is narrow but important: passing an automated test and producing work acceptable in a real maintenance context are different claims.

Leaders should carry that discipline into their own systems. A model benchmark, ticket count, deployment rate, or automation percentage can be evidence, but it cannot stand in for the operating outcome.

When I teach data and AI, the important shift often comes after the first visible result. A learner begins to make stronger judgments when they can reproduce the output, find its failure conditions, and explain when it should be used. Technical organizations face the same test at a larger scale. Producing an answer is a capability; understanding the conditions around that answer is progress.

Evaluate enabling work through other teams

Platforms, standards, shared data products, paved roads, templates, and governance paths are easy to praise in the abstract. Their value appears in someone else’s work.

A platform team can launch a model gateway with routing, logging, cost controls, and approved providers. That is substantial output. The enabling contribution appears when a product team reaches a compliant production release faster, avoids rebuilding the same controls, and can diagnose a model change without specialist intervention.

For every enabling investment, name:

  • the teams expected to use it;
  • the difficult step it removes or makes safer;
  • the exception it will not handle;
  • the adoption evidence that matters;
  • the support and lifecycle owner;
  • the date when low adoption triggers redesign or retirement.

This prevents “build it and they will come” platform strategy. It also prevents forced adoption from manufacturing success. If teams use the shared path only because alternatives are forbidden, measure whether the path genuinely reduces lead time, cognitive load, repeated engineering, and operational risk.

Enabling work should create leverage, not merely centralize authority. A reusable evaluation harness that helps four product teams detect regressions is leverage. A committee that adds two weeks to every low-risk experiment is delay. A governed AI workspace that gives employees a safe route to useful tools is leverage. A policy document that sends every question to security is unpriced work.

This is where technical leaders must think like business leaders: the platform’s architecture matters, but its contribution is experienced through the capability it gives another part of the organization.

Count retirement and learning as deliberate outcomes

Organizations are much better at announcing new technology than ending old commitments.

A new assistant launches, but the old search tool remains. A cloud migration completes, but the previous environment stays available “temporarily.” A new dashboard appears beside six existing reports. A model pilot becomes a permanent service even though nobody accepted its operating cost. Each addition can look like progress while the technology estate becomes harder to understand.

Retirement deserves its own contribution mode because replacement is incomplete until the old obligation is gone. Useful evidence includes:

  • contracts ended and infrastructure removed;
  • identities, secrets, network paths, and data copies closed;
  • support and on-call responsibilities eliminated;
  • reports or meetings discontinued;
  • user workflows moved without preserving duplicate paths;
  • documented exceptions with owners and expiration dates.

Learning deserves equal care. A pilot creates value only when it resolves uncertainty that matters to a decision. “We proved the model can summarize a document” is usually weak learning. “We found that reviewers spend longer correcting summaries for this document class, so we will use extraction rules for required fields and keep generative summaries optional” changes an investment and a design.

Time-box learning work. State the assumption before the experiment. Name the evidence and the person authorized to act on it. Record what the organization will reuse, even when the proposal stops. A stopped initiative can be a positive contribution if it prevents a larger commitment on false premises.

This is the operating counterpart to choosing what not to build as part of AI strategy. Refusal, retirement, and revision are not anti-innovation. They keep attention and money available for work that can still matter.

Review the mix, not just the wins

A quarterly contribution review should not become a collection of success stories. Its purpose is to test the shape of the portfolio and improve allocation.

Use one page with five rows—protect, improve, enable, retire, and learn—and answer four questions for each:

  1. What changed for a user, the organization, or the system?
  2. Which evidence supports that claim, and where is attribution uncertain?
  3. What capacity and opportunity did the work consume?
  4. What decision follows now?

Then inspect the missing rows.

If there is no retirement work, ask which obligations are accumulating. If there is no learning work, ask whether uncertainty has been hidden inside delivery commitments. If enablement consumes substantial capacity but downstream teams show no improvement, challenge the platform thesis. If every improvement claim is a feature count, return to the workflow baseline. If protection absorbs nearly everything, decide whether the service is underfunded, overcomplicated, beyond its useful life, or temporarily facing justified risk.

Do not demand an equal allocation across the five modes. A security recovery period may require heavy protection. A young product may need learning. A mature estate may need retirement. The review should reveal whether the mix follows actual conditions or organizational habit.

Capacity must also be honest. The framework in Protect Reliability While Shipping AI Faster explains how to set a reliability floor and preserve the work needed to operate safely. A contribution portfolio adds the other side of the decision: once that floor is protected, where will the organization deliberately create improvement, leverage, simplification, or knowledge?

Stable and static are different

Technical leaders should be proud when essential systems are calm. They should also be able to explain what the organization can now do better because of the team’s work.

That explanation should not depend on novelty, a crowded roadmap, or a dramatic claim about a disaster that never happened. It should be visible in conditions: a service remained dependable under greater demand, a workflow improved end to end, another team gained reusable capability, an obsolete obligation disappeared, or an uncertain proposal became a defensible decision.

These are different forms of contribution, and serious technology organizations need all of them.

The standard is not constant change. It is deliberate movement while honoring the conditions people already depend on. Reliability sets a floor. The contribution portfolio shows what the team builds above it—and what it removes so the organization can keep moving.

More notes