The premise as filed is false, and the measurement says so
The ticket asked for a four-level agreement harness to be built because
"testmgr tiers compile at the default -O. No job passes -O3. Therefore the
matrix has never reported an -O3 failure — and it never could, for any pass,
however broken."
Every clause of that is contradicted by the archive:
| claim as filed | measured |
|---|---|
no job passes -O3 |
tools/optdiff.sh compiles and runs at -O2 and -O3, comparing stdout+stderr+exit code against an -O0 baseline, over all 1841 standalone Pascal and C test programs in 12 shards |
| nothing exercises it | the opt tier has run 701 times, first 2026-07-11, most recently 2026-08-28T09:41:46Z — today |
the matrix never reported an -O3 failure |
30 of 701 opt runs were non-GREEN; optdiff shards are named red in 16 of them, test-opt in 1 |
| it never could, however broken | done/ holds four such findings: regression-optdiff-o3-stack-frame-intrinsics, bug-o3-inline-breaks-frame-walk-intrinsics, bug-a-aarch64-o3-segfaults-the-compiler-on-an-empty-program, bug-o-o3-diverges-on-cmath-sign-bits-and-pascal-hijack |
The harness this ticket asks to be built already exists, and its
no-external-oracle property — "the other levels are the oracle, no
expected-output files to maintain" — is exactly how optdiff.sh was designed.
The reasoning in the ticket is sound; it was applied to a mechanism that was
already there.
The testmgr comment above the tier says it in one line:
opt: generate() adds OPT_SHARDS optdiff.sh jobs sweeping EVERY standalone Pascal/C test at-O0against-O2and-O3(stdout+rc must match). Idle watcher work, notfull.
That last clause is the whole finding.
The real gap, measured
covered_tiers("opt") returns opt alone. The tier is disjoint from the
nesting chain quick → native → limited → full, and it runs only as an idle
watcher phase (idle_opt) against whatever sha happens to be current when the
box is free.
Consequence, from the archive:
- 2296 distinct shas have a gate-tier verdict (quick/native/limited/full).
- 690 distinct shas have an opt-tier verdict.
- 690 of 2296 = 30.1% of gate-verdicted shas ever got
-O3coverage. - Nothing in a sha's verdict says which 30% it is in.
So the true statement is not "nobody runs -O3" but:
A GREEN verdict on a sha is silent about
-O3. Roughly 7 shas in 10 never got that coverage, and the report gives you no way to tell yours apart from the 3 that did.
That is still the same family as the skip-counted-as-pass bug — an absent signal read as a negative result — but one level further out: the job runs, the tier runs, and the attribution to a sha is what is missing. It is a report-format and tier-composition gap, which is squarely T's tool.
What survives from Track O's ask
Three things, all cheap, none requiring a new harness:
-O1is genuinely unswept. — DONE. The level loop covered 2 and 3 only. O asked for agreement across-O0/-O1/-O2/-O3, and-O1was the one level with no coverage anywhere in the matrix. Correction to my own estimate above: I wrote "+50%", which was wrong. optdiff does three compile+run passes today (the-O0baseline, then 2 and 3), so a fourth is +33% arithmetically. Measured on shard 0/60 with the same binary both halves: 49.5s → 65.3s, +31.9% — so the ~20 minute full sweep becomes ~27. Confirmed on an independent slice (shard 7/60, 30 programs):diff=0, no-O1divergence.- Verdict visibility. — DONE. A sha's report now states whether
optcovered it and, when it did not, how old the newest sweep is and which sha it ran at. This is the actual fix for the thing O correctly smelled: "no-O3failures for this sha" and "opt has not visited this sha" used to produce identical evidence in the report even though they are distinguishable in the archive. - Corpus density, not a new job. — handed to Track O.
w2stress.pasis worth having, but as a file in the test corpus, where the existing 12 shards sweep it automatically at every level forever, not as a bespoke harness. Track O hands the program over; no T machinery is needed to make it swept. Filed astask-o-hand-w2stress-to-the-corpus-so-optdiff-sweeps-it. It is the cheapest item and probably the highest value for the register-pressure campaign specifically, since the corpus is broad but not dense in in-place ALU shapes.
What landed
| item | commit | evidence |
|---|---|---|
verdict attribution (last_by_tier, last_run_at_tier, the -O3 report banner) |
ecacf87bd |
12 guards in tools/twatch_opt_coverage_devtest.py; all three breaks mutation-tested |
-O1 added to the sweep |
this commit | shard 0/60 timed both ways, shard 7/60 confirms diff=0 |
the w2stress.pas handover |
— | Track O's, filed separately |
The verdict-attribution change also closes a second hole found on the way: the
existing BREADTH banner reads last_full, which is the last replacing run
rather than the last full tier. Under the shipped default (mid_tier == deep_tier == full) those coincide, so nothing is wrong today — but with
mid_tier configured to limited, a limited run would refresh last_full
and silence a breadth warning while covering no cross target. last_by_tier
answers that question exactly, and is one mechanism for both.
Note the daemon runs the code it STARTED with, so the report banner appears
only after the next watcher restart; -O1 is read from the working tree per
sweep and takes effect on the next opt phase.
What this does to the -O2 promotion gate
The coordinator made this ticket a precondition on -O3 → -O2 promotion. That
precondition is substantially already met, and was met before the ticket was
filed: -O3 is swept over the whole corpus, and the campaign's four landed
passes have been through opt sweeps as ordinary corpus coverage — including the
GREEN 17/17 opt run at 03afd81fd (1208.8s wall, 12 optdiff shards, 5 test-opt
jobs) that Track T ran this session.
What promotion still lacks is attribution: nobody can currently point at a
verdict and say "this sha's -O3 was swept." Item 2 is what turns that into a
citable fact. Item 3 is what makes the sweep dense where the campaign actually
changed codegen. Neither is a reason to hold promotion indefinitely, and the
"first exposure wearing a promotion's clothes" framing does not survive the
measurement — the passes have had matrix exposure at -O3.
Recommendation to the coordinator: lift the hard precondition, keep item 3 as a
courtesy ask on Track O (hand over w2stress.pas), and let item 2 land on T's
own schedule.
Boundaries
- Still filed by Track O, still done by Track T; O found a real gap and named the wrong mechanism for it. The value of the filing is unchanged — 70% sha coverage with no verdict attribution is worth a p60 — and nothing here is a criticism of the reasoning, which was correct about the risk and wrong about the inventory.
- No compiler bug here, and T does not fix one if there were.
- The
{$Q+}FPC-oracle trap the ticket documents is real and correctly identified; it does not apply tooptdiff.sh, which uses no external oracle, for exactly the reason the ticket gives.
Method note
The premise was checked before it was implemented, against the archive rather
than against the ticket's own account of the inventory. The session rule that
caught it: verify the location/existence claim rather than taking it on
report — the same rule that found this ticket in backlog_new/ after the
coordinator's greps missed it. A confident "nothing does X" is a claim about an
inventory, and inventories are cheap to query.
One correction recorded against my own work here: my first archive read reported
the last opt run as 2026-07-31. The NDJSON archive is not date-ordered across
hosts, and a tail of the concatenation is not a chronological tail. Sorting by
date gives today. Same failure family as the rest of this ticket — a
convenient read of an inventory, taken for the inventory.
Correction, same day: the promotion-evidence paragraph above is WRONG
The section "What this does to the -O2 promotion gate" claims the campaign's
landed passes "have been through opt sweeps as ordinary corpus coverage —
including the GREEN 17/17 opt run at 03afd81fd". Both halves are false, and
the paragraph stands above only because rewriting a landed record falsifies it.
Measured with trackt optcov (built afterwards, e4c004a5e):
| pass | landed | opt coverage |
|---|---|---|
562965e1c |
2026-08-28 00:15 | SWEPT GREEN by the opt run at 0fbcbdebccd3 |
46c8cf47e |
2026-08-28 00:51 | SWEPT GREEN, same run |
c93292fe4 |
2026-08-28 20:03 | NOT swept — it landed nine hours after that sweep |
And 03afd81fd, the run I cited as the evidence, is dated 2026-08-27 23:02
— it predates all three passes. I reached for a GREEN opt run I had personally
watched and never checked its position relative to the commits it was supposed
to vouch for. A green result about the wrong tree is not weaker evidence; it is
no evidence.
So the recommendation in that section — lift the hard precondition — was right
for 562965e1c and 46c8cf47e and too broad for c93292fe4, which cannot
cite a sweep and should not be promoted until the next opt phase includes it.
The coordinator's per-pass citation rule catches exactly that case, which is the
argument for the rule rather than against it.
Note what caught it: not review, but building the instrument. optcov's first
live query contradicted a claim I had made an hour earlier and had no reason to
doubt. Same lesson as the rest of the ticket, applied to me — a confident claim
about an inventory is cheap to check and I checked the inventory I had just
been arguing about, while taking my own supporting citation on trust.
The strongest claim available for item 2, stated plainly
The report banner and trackt optcov resolve the same fact — which opt run
last swept a tree — by different code paths that share nothing. The banner
reads the watcher's own state (last_by_tier, falling back to a scan of
history); optcov reads the uncapped NDJSON archive and tests ancestry with
git. Run against the live plexus state on 2026-08-28 they returned the same run,
0fbcbdebccd3 at 2026-08-28T09:41:46Z.
That is two implementations, one answer, no shared code path — independent confirmation from inside a single lane, which is the most that can be claimed without a second pair of eyes and is worth more than either result alone. It will not be obvious to a later reader that the agreement was not tautological, so it is recorded here rather than left to be inferred.
Log
- 2026-08-28 — resolved, commit 48ea92a22.