←  All writing

,

The Gaps Agent-Scale Engineering Just Exposed

Coding agents can produce work faster than an organization can review and release it. When that happens, the constraint moves into the systems and people responsible for getting a change…

Brett Lee Avatar

Coding agents can produce work faster than an organization can review and release it. When that happens, the constraint moves into the systems and people responsible for getting a change into production. More output can mean longer queues and more work for the same engineers.

Anthropic gave us a concrete example last week. Its daily merged changes grew from roughly 2,500 in May to more than 30,000 in September. Source control became a bottleneck, and the company migrated its monorepo from Git to an internal system called Scion. That’s an unusual workload, but the underlying problem is familiar. Improve one part of a delivery system and you find the limits of the next. Anthropic’s engineering account

The recent announcements around automated review and agent governance are useful progress. My concern is what happens between those products, where ownership gets unclear and nobody has a complete view of the outcome. That’s the problem we’re addressing with CTOsphere at O’Side Systems.

There are five gaps I’d want an engineering leader to examine before increasing agent volume.

1. More code exposes the next bottleneck

Your team doesn’t need to produce 30,000 changes a day to have a capacity problem. If an agent finishes a task in 20 minutes and the pull request waits three days for review, faster generation has limited value. Adding a review bot might help, or it might move the queue into CI.

Individual tools can report useful timing data. The harder task is connecting those measurements across the delivery process and identifying where work actually stops. A rise in merged changes doesn’t explain how much human effort it took to get them through.

CTOsphere already records review stages after an agent hands off its work, including time to first review, review iterations, and approval to merge. It will bring those records together into a view that identifies the bottleneck across runs. It will also project which stage reaches capacity first at three or ten times the current volume.

The point is to find the constraint while there’s still time to change it. Asking the same engineers to clear a growing queue isn’t a scaling strategy.

2. Authorization has to survive the handoffs

GitHub’s push attribution preview records the authenticated identity that pushed a commit separately from its author and committer fields. That distinction matters because those fields are supplied by the client. They aren’t proof of who performed the push. GitHub’s announcement

Now follow one change through a tracker, an agent, a code host, and a review tool. The record needs to connect the person who authorized the work to the identity that executed it. Include the applicable policy. Record whether it was confirmed before execution began.

A collection of logs doesn’t automatically establish that chain. Someone has to connect them without losing the meaning of each identity. Missing evidence needs to be visible.

CTOsphere already classifies the credentials used by agent runs and checks completion claims against CI on the exact commit pushed. It also detects an agent recording its own decision as a human’s. It will connect authorization to execution in one evidence record per change, including the applicable policy version. That record will distinguish the pusher from the committer across supported code hosts and agent vendors.

The agent’s account needs independent evidence behind it.

3. Automated reviewers need evaluation too

Anthropic’s Code Review is now generally available. GitHub’s agentic autofix can investigate a code-scanning alert, propose a fix, rerun CodeQL, and open a draft pull request. These tools add useful capability, along with another set of decisions about cost and review effort. Anthropic’s release, GitHub’s release

Consider two reviewers flagging the same issue. If a human has to assess both findings, some of that effort is duplicated. If a reviewer produces ten findings and only three lead to useful corrections, the remaining seven still consume attention.

Using the same model to write and review a change can also leave shared blind spots. A different model won’t guarantee a better result, but it gives you a configuration worth testing against the work your team actually does.

CTOsphere separates bot review from human review and measures the time spent in each round. It will record each finding’s source and disposition. Deduplicating overlapping findings will make it possible to calculate cost per accepted finding. For task classes that require it, it will enforce a rule that the reviewer differs from the writer by model or vendor.

Acceptance alone won’t prove review quality. It will give leaders a more useful starting point than counting comments, with defects that escape review still part of the evaluation.

4. Evidence needs to travel with the work

HCLTech’s October 12 partnership announcement with Anthropic includes a dedicated business unit and support for governed enterprise deployments. I read that as another sign that operating agents is becoming a substantial engineering responsibility. HCLTech’s announcement

The practical test for any implementation is whether its evidence remains useful outside the platform that produced it. That might mean adding a second vendor or changing code hosts. You might need to hand a change history to someone without access to your tools. Those are ordinary business events. They shouldn’t make the record unreadable.

CTOsphere runs your choice of agent against your choice of code host and tracker, and keeps its own run record. It will export a self-contained evidence bundle for each change, using a consistent structure across supported tools. It will also evaluate workflows it didn’t execute against the same criteria.

That independence matters to teams that need to change suppliers without losing the history behind their decisions. It also makes the evaluation useful before they choose CTOsphere to run anything.

5. Model cost has to be measured against the outcome

Google launched Gemini 4 Argon at an introductory price of $2 per million input tokens and $10 per million output tokens. Its announced rates double after November 30, 2026. That model choice needs a review date. Google’s announcement and pricing terms

Token prices are only part of the decision. A cheaper run can become more expensive if it requires additional review or rework. A vendor benchmark can help identify a candidate, but your backlog is where you find out whether the choice holds up.

CTOsphere records model, token usage, and dollar cost alongside whether a change was accepted, rejected, or reworked. It will support price schedules with effective dates, so teams can replay recorded usage under future pricing. It will also block a model or configuration change when any declared evaluation criterion regresses, including criteria the change wasn’t intended to improve.

I want the decision to include the work it creates for people. An inference bill can go down while the cost of delivering an accepted change goes up.

Start with one real change

Before expanding agent use, take one change from ticket to production and reconstruct what happened. Connect the authorization to what the agent actually did. Check the evidence supporting its completion. Include the review effort and what a human had to change afterward.

That’s the starting point for our Agentic Delivery Control Assessment at O’Side Systems. We’ll measure the load on review, CI, and remediation, then model it at 3 and 10 times the current volume. We’ll compare two writer-and-reviewer configurations on accepted outcomes and total cost. That evaluation will include risk that gets through the checks.

You’ll leave with an operating-model recommendation and an evidence schema that CTOsphere or another system can populate. If the vendor stack you already have is sufficient, we’ll say so. Get in touch if you’d like to work through it.

CTOsphere‘s runtime is open source and vendor-neutral. The commercial layer will provide evidence and evaluation across the delivery process. The standard I care about is whether the organization can explain and sustain the work its agents produce.

Filed under

<br>

Tagged