August 30, 2026 · daily digest

cere-bro | 2026-08-30

cere-bro | 2026-08-30

The whole day is about metering, arriving from four directions at once. Salesforce starts charging for AI by business outcome instead of by seat. Anthropic quietly cuts Claude Code's effective weekly allowance by about 17 percent. Apple's headless Macs turn out to be the year's fastest-growing escape from metered cloud inference, up 29 percent to $10.4 billion. And three papers on one leaderboard all replace a forced dense decision with a sparse one plus an explicit way to say "no answer." The sharp cost lesson underneath: the agents everyone is now metering have no internal clock and overrate their own work by twenty points, so every budget ceiling has to be enforced outside the model.

🎯 Today's 5 for you
  1. ReadRoI: Reservoir of Importance. N:M sparsity (keep N weights of every M, the only pattern Nvidia's sparse tensor cores actually accelerate) has been stuck because learning the mask means one parameter per feasible pattern, and that count is combinatorial in M. RoI reparameterizes to one logit per position plus differentiable subset sampling, dropping mask parameters to O(M): 1.5x to 8.75x fewer, at matched quality, scaling to 7B. It is also the first paper in the recent "move the cost to a build step" run to actually publish what the build step costs. arXiv 2608.23048 · wiki summary.
  2. ReadYour Agents Are Not Time Aware. Your saved reading has been dominated by loop and harness engineering for a month (13 saves, still the top theme), and this is the sharpest harness result in weeks. Claude Code burns 2.5x more turns than Codex on the same model, and the model's runtime prediction is identical across both because it is anchored, not estimated: measured compression exponent 0.19-0.24, so predictions barely move as real duration moves. Scrub timestamps from the transcript and the error doubles, which says the "sense of time" was never internal. LessWrong · wiki summary.
  3. TrackApple's headless Macs are the fifth exit from auction-priced compute. Mac mini and Mac Studio are Apple's fastest-growing products, Mac revenue up 29% to $10.4B, bought by people running agents locally and developers dodging cloud bills. This is the compute-economics page's open question about whether the spot premium reaches inference, answered as substitution rather than as a price. The reason it works is specific: a solo agentic session is 140K tokens in, 396 out, single-tenant, which is the worst case for batch-based cloud economics and the best case for a big unified memory pool. The Information · wiki summary.
  4. SkimMCL: data pruning by concept coverage, with an audit trail. Every data-pruning method scores samples in embedding space. MCL's objection is mechanical and correct: an embedding is a lossy summary produced by a model trained to discard detail, and that detail is exactly the rare concepts you were pruning to preserve. Build an explicit entity-event-attribute graph instead, count rarity globally, select greedily by coverage. The payoff worth your attention is not the accuracy, it is that each kept sample has a named reason. arXiv 2608.22858 · wiki summary.
  5. TrackThe metering ladder gained two rungs in opposite directions. Salesforce is letting customers pay for Agentforce on business outcomes (revenue closed, service cost cut), one rung past the cost-per-task unit this wiki adopted on 08-16. Anthropic is going the other way, replacing Claude Code's temporary 50% boost with a permanent 25% on September 14, a ~17% effective cut. The application layer can price outcomes because it can observe them; the model layer cannot, so it rations. Both squeeze the same party in the middle: whoever runs the harness. The Information · The Decoder.

Safe to skip: the education pair (a Bocconi experiment where GPT-4o lifted marketing-assignment grades nearly a full point on a five-point scale without testing whether anyone learned anything, and AI Weekly's universities-choosing-opposite-futures piece) is real and has nothing for you. Pipeline note, stated plainly: HuggingFace has still not rolled its daily-papers date past 08-28 for a second consecutive day, all eight tracked subreddits returned nothing for a third consecutive day (the Reddit farmer has no OAuth credentials and unauthenticated access has been 403 since 2026), the general X scrape found no reachable Nitter instance for the fourth time in five days, and your bookmarks feed was healthy but you saved nothing new. So today's paper content comes from the Kurate cs.LG leaderboard and a LessWrong study rather than from HuggingFace, and the digest is short rather than padded.


TL;DR


Deep Dives

Your Agents Are Not Time Aware

Ask a coding agent how long a job will take and it says ninety minutes. Ask it about a different job and it says ninety minutes. Scrub the timestamps out of its transcript and its error doubles, which tells you the sense of time was never inside the model.

Source: Michael Ofengenden and Maksym Andriushchenko (MATS 10), LessWrong. Surfaced via The Decoder today. Links: Post · The Decoder · Wiki summary

flowchart LR
  T[Task] --> P[Prospective estimate<br/>how long will this take]
  P --> RUN[Agent runs<br/>external timer<br/>no artificial cap]
  RUN --> R{Retrospective estimate<br/>how long did that take}
  R -->|elapsed-time tool| A1[Near perfect]
  R -->|in-session, no tool| A2[Slightly worse]
  R -->|replayed transcript| A3[Degraded]
  R -->|timestamps scrubbed| A4[Error doubles]
  RUN --> SS[Self-score the work]
  SS --> BIAS[Overrated ~20 pts]
  H[Harness choice] -.->|2.5x turn difference| RUN
  H -.->|prediction unchanged| P
  classDef input fill:#dbeafe,stroke:#3b82f6,color:#1e3a8a
  classDef decision fill:#fef3c7,stroke:#f59e0b,color:#78350f
  classDef output fill:#d1fae5,stroke:#10b981,color:#065f46
  classDef warn fill:#fee2e2,stroke:#ef4444,color:#7f1d1d
  classDef aux fill:#e0e7ff,stroke:#6366f1,color:#312e81
  class T,H input
  class R decision
  class A1,A2 output
  class A3,A4,BIAS warn
  class P,RUN,SS aux

What is it about? Two CLI coding agents were asked to predict how long a task would take, then run it under an external timer with no time cap, then say afterwards how long it had actually taken. The test surfaces are ProgramBench (200 tasks reimplementing programs from compiled binaries) and AgentTime, a purpose-built suite of 235 tasks assembled from 18 existing benchmarks including AppWorld and OSWorld 2.0.

What problem does it solve? Long-running autonomous agents are supposed to be steerable with time instructions: finish in thirty minutes, keep iterating for two hours. Nobody had checked whether the agent has any idea what thirty minutes means for it. It does not.

What's the core novelty? Splitting the retrospective question four ways by information access, which turns a curiosity into a mechanism finding. With an elapsed-time tool the agent is near-perfect. In-session without one it is only slightly worse. On a replayed transcript it degrades badly, and with timestamps scrubbed the error doubles. Supporting this, transcript length correlates with runtime at r = 0.91, but controlling for length, in-session estimates correlate at only r = 0.4. The agent is reading its context for clocks and using length as a proxy. There is no internal duration state to find.

Key takeaways

Gaps in the study No cost figure anywhere, which is now the standing complaint against this whole research thread. The persona ablation measures what a model says when asked, not how it behaves. Two harnesses, both CLI coding agents, both on coding tasks, so whether the 2.5x turn ratio is a Claude-Code-versus-Codex fact or a generalizable stopping-policy fact is untested. And the obvious follow-up went unrun: an elapsed-time tool fixes retrospection, but does telling an agent its own token throughput fix prediction, which is the half that matters for control?

Industrial implication Budget enforcement cannot live in the model. If you want a time or token ceiling on an agent, the harness has to hold it, because the thing being capped cannot estimate its own consumption. That is one more decision taken away from the model, which is the mechanism agent harness engineering argues harnesses win by, and it retroactively justifies PILOT's (08-28) design, where a supervisor with authority to abort a running worker reads a streamed trace rather than asking the worker how it is doing. It also gives the wiki's pass^k complaint a candidate mechanism: Thinkingbox (08-25) measured a top model collapsing from 65.36% pass@1 to 25.25% pass^20 on stateful work, and an agent that overrates its own output by 20 points is a plausible partial explanation, because a harness trusting self-report cannot see the failures pass^k exposes.

Full summary


RoI: Reservoir of Importance

The technique meant to make the model cheaper had gotten expensive to train, and precisely in the aggressive-sparsity regime where the payoff would have been biggest.

Source: Kurate cs.LG leaderboard #9 this week. Ha Dinh, Xuan Duy Ta, Khoat Than, Khac-Hoai Nam Bui. Links: arXiv 2608.23048 · Wiki summary

flowchart LR
  W[Weight group<br/>M positions] --> PRIOR{Prior approach<br/>full categorical over<br/>all N:M patterns}
  PRIOR --> COMB[Parameters grow<br/>combinatorially in M]
  W --> ROI{RoI<br/>compact logit<br/>one per position}
  ROI --> SUB[Differentiable subset sampling<br/>WITHOUT replacement<br/>pick N of M]
  SUB --> OM[Parameters O of M<br/>1.5-8.75x fewer]
  OM --> MASK[N:M mask<br/>hardware-aligned]
  COMB -.->|blocked at 7B and<br/>aggressive N:M| X[Does not scale]
  MASK --> HW[Sparse tensor cores<br/>real speedup]
  classDef input fill:#dbeafe,stroke:#3b82f6,color:#1e3a8a
  classDef decision fill:#fef3c7,stroke:#f59e0b,color:#78350f
  classDef output fill:#d1fae5,stroke:#10b981,color:#065f46
  classDef warn fill:#fee2e2,stroke:#ef4444,color:#7f1d1d
  classDef aux fill:#e0e7ff,stroke:#6366f1,color:#312e81
  class W input
  class PRIOR,ROI decision
  class MASK,HW,OM output
  class COMB,X warn
  class SUB aux

What is it about? A cheaper way to learn which weights survive under N:M semi-structured sparsity. N:M means that within every contiguous group of M weights, exactly N are kept. It matters because it is the only sparsity pattern mainstream GPU hardware accelerates natively: Nvidia's Ampere-and-later sparse tensor cores implement 2:4 directly. Unstructured pruning keeps quality best and delivers almost no speedup, because scattered zeros still ride through dense matrix hardware. Structured pruning removes whole channels and costs real quality. N:M is the compromise the hardware vendors picked.

What problem does it solve? Picking the surviving N by weight magnitude is cheap and weak. Learning the mask is better, and the standard way to make a mask learnable is to put a relaxed probability distribution over the feasible N:M patterns, one trainable logit each. The number of patterns is M-choose-N. At 2:4 that is six and nobody notices. Push toward larger groups and more aggressive ratios and it explodes, and every one of those logits sits in optimizer state during the fine-tune. So the method fails exactly where you most wanted it.

What's the core novelty? Stop parameterizing the distribution over patterns and induce it instead. RoI keeps one compact logit per position inside the group and draws the survivors by differentiable subset sampling without replacement, picking N of M with gradients flowing through. Parameters fall from combinatorial in M to O(M). The title is the mental model: a reservoir of per-position importance you draw from, not a menu of every legal configuration.

Key takeaways

Gaps in the study No measured speedup. This is the conspicuous hole. The entire case for N:M over unstructured is that the hardware executes it, and the paper reports parameter counts and quality with no throughput or wall-clock number on sparse tensor cores. What got cheaper is learning the mask, not serving the model, and a reader could easily come away conflating the two. Beyond that: one model family, so nothing about mixture-of-experts models where per-expert weight usage is far sparser and which is the case that matters most in deployment. And "competitive performance" is doing work, because it is never shown that compact logits match full categorical parameterization on quality rather than merely tying it more cheaply. If expressiveness is lost, it should show up at the most aggressive sparsity, which is exactly where the parameter saving is largest and the baseline no longer fits to compare against.

Industrial implication This is one of the shortest paths from a compression paper to a watt saved, because the silicon is already deployed. Compute economics records that the binding constraint in 2026-08 moved to datacenter power, with OpenAI stating it is limited by power rather than budget or floorspace and designing Jalapeño to a tokens-per-second-per-megawatt objective, which reduces to tokens per joule. Sparsity improves that ratio by removing multiply-accumulates rather than raising the clock, and needs no new chip. The catch is the missing speedup number: until someone publishes one, the deployment case rests on the hardware's spec sheet rather than on this paper.

Full summary


MCL: Mapping the Concept Landscape

Everyone prunes training data by measuring distance in embedding space. An embedding is a lossy summary made by a model trained to throw away detail, and the detail it throws away is the rare concepts you were pruning in order to keep.

Source: Kurate cs.LG leaderboard #5 this week. Dongyue Wu, Tao Ma. Links: arXiv 2608.22858 · Wiki summary

flowchart LR
  P[Image-caption pair] --> G[Sample-level graph<br/>entities, events, attributes]
  G --> DG[(Dataset-level graph<br/>merged over corpus)]
  DG --> RARE[Global concept<br/>rarity counts]
  RARE --> GREEDY{Greedy selection<br/>max marginal gain in<br/>under-represented concepts}
  GREEDY --> KEEP[Pruned subset]
  GREEDY --> AUDIT[Audit trail<br/>which concept each<br/>sample was kept FOR]
  EMB[Prior work:<br/>embedding score] -.->|compression hides<br/>rare concepts| MISS[Rare concepts<br/>under-covered]
  classDef input fill:#dbeafe,stroke:#3b82f6,color:#1e3a8a
  classDef decision fill:#fef3c7,stroke:#f59e0b,color:#78350f
  classDef output fill:#d1fae5,stroke:#10b981,color:#065f46
  classDef warn fill:#fee2e2,stroke:#ef4444,color:#7f1d1d
  classDef aux fill:#e0e7ff,stroke:#6366f1,color:#312e81
  class P input
  class GREEDY decision
  class KEEP,AUDIT output
  class MISS,EMB warn
  class G,DG,RARE aux

What is it about? Data pruning, meaning throwing away most of a training set and keeping the subset that trains a model just as well. MCL is a way of choosing that subset without using feature embeddings at all.

What problem does it solve? The standard approach scores each sample by its position in a high-dimensional feature space and keeps whatever is hardest, most representative, or most diverse by some geometric criterion. The paper's objection is mechanical rather than philosophical. Two captions describing a common scene and a rare one can sit close together in embedding space if the rare element is a small part of the description, so a diversity criterion computed on those vectors is structurally blind to the rarity it exists to preserve. The observable symptom is pruned subsets that under-cover rare concepts, which is the one failure that matters, since keeping the tail is the entire point of keeping a subset.

What's the core novelty? Replace the compressed representation with an explicit symbolic one, then make rarity a global count instead of a local geometric property. Each image-caption pair becomes a small graph of entities, events and attributes. All those graphs merge into one dataset-level graph, so "how rare is this concept" stops being an estimate and becomes a count over the corpus. Selection is then greedy concept-coverage maximization, repeatedly taking the sample with the largest marginal gain in coverage of under-represented concepts. That greedy step is the standard approximation for maximum coverage, which is where the guarantee comes from.

Key takeaways

Gaps in the study Vision-language only. The whole construction rests on captions being present and reasonably complete, and the analogue for a text-only pre-training corpus, where there is no caption and no obvious entity-event-attribute decomposition, is unaddressed. That is where nearly all of the pruning money is. The graph extractor is also an unexamined dependency with an unfortunate error profile: every extraction mistake becomes a miscounted concept, rare concepts are the ones an extractor is least reliable on, and the method's advantage is concentrated in exactly that tail. No sensitivity analysis on extractor quality is reported. And there is no cost accounting: building a corpus-scale graph and running greedy maximum coverage is a real preprocessing job, plausibly far more expensive than one forward pass per sample.

Industrial implication The audit trail is worth more than the accuracy and the paper under-claims it. Yesterday's evaluation-license census found 110 of 124 eval units cannot license the claims attached to their numbers, because the artifact does not carry the evidence needed to replay the claim. Training-data selection has the identical structure and none of the scrutiny: a model card says a corpus was filtered and never says what the filter kept or dropped. MCL produces, as a free side effect, exactly the frozen substrate that census framework requires. A pruning method whose selections can be replayed and contested is a governance artifact, not only an efficiency one, and the obvious next move is to run the claim-replay audit on a pruned corpus rather than on an eval.

Full summary


Apple's headless Macs become the local-inference escape hatch

The compute-economics page listed four places auction-priced-out buyers could go. The fifth was not on the list and is growing 29 percent a year: a desktop with a big memory pool.

Source: The Information (Aaron Tilley). Paywalled past the opening. Links: Article · Wiki summary

What is it about? The hottest products at Apple are the Mac mini and Mac Studio, boxes sold with no monitor, keyboard or mouse. Mac revenue grew nearly 29% year over year to $10.4 billion in the June quarter, faster than any other Apple segment. The reported buyers are people running agents, meaning software that does multi-step work like editing and testing code or triaging an inbox, and AI developers who train and run models locally specifically to avoid cloud compute bills.

What problem does it solve? It is a market answer to a market problem this wiki has tracked all month. Compute economics recorded Nebius clearing Blackwell-generation capacity at 15% above its previous record price with contract durations collapsing, and named the squeezed class: startups needing hundreds to thousands of chips who cannot outbid a hyperscaler at auction. That page listed four exits (older generations, non-Nvidia silicon, post-training only, acquisition). This is a fifth, off the rented market entirely.

What's the core novelty? Nothing technical, and that is the story. Apple did not build these machines for this. What makes them work is memory capacity per dollar rather than peak FLOPs: unified memory puts one large pool in front of the GPU cores instead of a narrow dedicated VRAM budget, and capacity is what decides whether a model fits at all.

Key takeaways

Gaps in the study Most of the article is paywalled, so the causal attribution to AI workloads is The Information's framing rather than a segment breakdown Apple published. Apple does not report Mac mini and Mac Studio separately, and a Mac-wide 29% includes laptops and an M-series upgrade cycle. The AI-driven share of that $10.4 billion is not stated and should not be assumed to be most of it. The economics also have a hard ceiling nobody here is pricing: local wins for one long-context session and loses immediately on throughput, on models too large to fit, and on fine-tuning at any real scale. The 08-16 finding that one identical completed task spanned $550 to $23 across five frontier models is a reminder that model choice moves cost more than venue does, and the best models are not the ones running on a desk.

Industrial implication It marks a boundary on the Nvidia moat argument that this wiki had not drawn. Jensen Huang's chain, recorded on compute economics, runs CUDA continuity to versatility to fungibility to utilization to long depreciable life to financeable. Every link is about rented, shared, utilization-optimized infrastructure. A developer's Mac Studio is idle most of the day and gets bought anyway, because the comparison is not utilization against another datacenter GPU, it is total cost against a metered API for one person's work. The moat argument is well-formed for the datacenter and silent about the desk. And local inference runs on open weights, which is precisely what Nvidia's $12.9 billion Hugging Face purchase (08-28) is positioned around.

Full summary


FedCC: letting the teacher say "I don't know"

The opposite of a confident wrong answer is not a better answer. It is an absent one, and in this setting that is the entire fix.

Source: Kurate cs.LG leaderboard #1 this week. Wenxuan Ye, Onur Ayan, Xueli An, Georg Carle. Links: arXiv 2608.23031 · Wiki summary

What is it about? Distillation-based federated learning, where clients collaborate on a model without sharing raw data or weights. Each client runs its local model over a shared unlabeled public dataset and ships only the predictions. The server aggregates those into pseudo-labels and distils a global model. Bandwidth drops to the size of a prediction matrix.

What problem does it solve? Label distribution skew, the standing failure of the approach. Real clients hold non-identically-distributed data, so each local model is biased toward its own majority classes. Force such a model to classify a public sample from a class it has never seen and it does not output a flat distribution, it outputs a confident wrong one. The server would normally calibrate that with labels, and the public dataset has none. The errors aggregate and under severe skew the global model collapses toward random.

What's the core novelty? Give clients an additional unknown class so they can tag ambiguous samples instead of being forced to choose among classes they may never have seen, and calibrate pseudo-labels on the public data so majority-class confidence does not automatically outweigh minority-class uncertainty. A confidently wrong vote becomes an absent vote, which aggregation can handle.

Key takeaways

Gaps in the study The abstention rate is the number that decides usability and it is not foregrounded. If clients abstain on most samples under severe skew, effective communication is far sparser than the bandwidth argument implies, and there is a regime where the server has too few votes per sample to calibrate anything. The dependence on the public dataset's distributional overlap with client data is likewise unexamined, and one-class-per-client across ten classes is a clean synthetic stress test where real skew is long-tailed and partial. Nothing here is at language-model scale, and whether unknown means anything for a generative model with no fixed label set is not a small extension.

Industrial implication It sharpens a rule this wiki's knowledge distillation page has been building toward. The established finding there is that most teacher signal is worthless: TIP showed most teacher-generated tokens carry no learning signal so roughly 10% suffices, and token teachability (06-01) made per-token teachability the selection criterion. FedCC's teacher is not merely uninformative, it is actively harmful, and the fix is filtering at the source rather than at the sink. That is the general lesson for any pipeline aggregating model outputs without ground truth, which now includes most synthetic-data and LLM-judge stacks.

Full summary


Industry Pulse

A thin research day and a genuinely busy industry one. Two of the items below are legal or labor stories with real consequences, and two are pricing moves that matter more than they look.

Funding, valuations, and compute deals


Global View

Three institutions moved to meter AI work today, in three different units, and none of the units can be audited. Salesforce is pricing Agentforce on business outcomes like revenue closed and service cost cut; Anthropic is rationing Claude Code by a weekly allowance cut roughly 17% in effect; and Apple's buyers are voting for a fixed cost over a metered one, with Mac revenue up 29% to $10.4 billion on headless boxes bought to run agents locally. Set that against yesterday's evaluation-license census, which found 110 of 124 eval units cannot license the claims attached to their numbers because the artifact does not carry replayable evidence, and the shape is uncomfortable: "revenue grew because Agentforce closed more deals" is a counterfactual with no frozen substrate, no pinned evidence and no agreed semantics, which is precisely the three-part deficiency that census formalized. The industry has moved past cost-per-task, the unit this wiki adopted on 08-16 after DHH's 24x dollar spread on one identical task and a ~30% tokenizer differential broke dollars-per-token, and it has moved past it onto an instrument nobody has audited.

The entity being metered cannot measure itself, and that is today's sharpest cross-source finding. Agents are not time aware reports a compression exponent of 0.19 to 0.24 on duration prediction, meaning agents answer "about ninety minutes" almost regardless of task, and a ~20-point optimism gap on self-scored quality. The R-scrubbed ablation locates the problem precisely: remove timestamps from the transcript and error doubles, so the sense of time was never internal. This is the third dimension of the harness claim agent harness engineering has been building since 05-27, after omarsar0's 5x-30x cost-per-success swing (arXiv 2608.01347, 08-13) and AI4AI's roughly 2x accuracy swing: Claude Code takes 2.5x more turns than Codex on the same model, and the model's runtime prediction does not change at all. The industrial consequence is immediate and unbuilt. Salesforce needs to forecast agent consumption to price an outcome contract, Anthropic's users need to spend a shrinking weekly allowance deliberately, and neither can ask the agent, so budget enforcement has to live in the harness. That is exactly the party both pricing moves squeeze.

Today's three papers and today's hardware story are the same idea at four layers: stop paying for the decisions that do not matter, and keep a record of which ones you dropped. RoI selects N weights of M with 1.5x-8.75x fewer mask parameters, MCL selects training samples by counted concept coverage and emits a named reason for each, and FedCC lets a federated client abstain rather than vote wrong, reaching 67.3% where baselines go near-random. All three replace a forced dense decision with a sparse one plus an explicit way to decline, which is why they now share a new concept page at model pruning and sparsity. Two things make this more than a coincidence of one leaderboard. First, RoI is the first paper in this month's "move the expensive decision to a build step" run to actually publish the build-step price (in mask parameters and memory), which is the omission the 08-28 and 08-29 Looking Ahead sections both flagged against Self-OPD, TTPO and CritICL, so a standing prediction is partially resolved from an unexpected direction. Second, the industry is buying the same logic in hardware: sparse tensor cores cut multiply-accumulates rather than raising the clock, which is the only lever that helps in a market where compute economics records power, not budget or floorspace, as the binding constraint. The gap that remains is the one RoI shares with its whole subfield and it is glaring: no measured speedup on the hardware whose existence is the entire argument for N:M sparsity.


Looking Ahead

LLM-rated underrated, from Kurate: the cs.LG board is a pruning and optimizer board this week and two entries never reached HuggingFace. MCL at #5 (ai_rating 6.0, 2608.22858) gets a Deep Dive above. The one to watch instead is "Spectral Allocation: Why Muon Outperforms Adam, and How to Improve Muon" at #6, the highest AI rating on either board this week at 7.0 (2608.25990), covered here on 08-28. Two independent Muon papers on one 20-entry board (the other being a physical response-and-memory model for Muon optimization at #2) is the threshold this wiki uses for declaring a pattern, one short of three. Track it: if a third Muon analysis paper enters either Kurate top-20 by 2026-10-29, optimizer geometry has become a live subfield rather than a single result, and the practical question for this reader is whether spectral allocation interacts with sparsity, since both are claims about where update magnitude should go.