A theory that cannot fail is not a theory. So the framework was turned into pre-registered falsifiers and run against real data: Reddit comment dumps (billions of rows), Wikipedia edit histories, and GitHub repositories. Thresholds were frozen before the data was harvested. The headline result is a split exactly in the shape the theory predicts: the structural gear seals as a pass, while three more ambitious claims honestly deflate. Below is every verdict, with its real numbers and figure.
The paper names eight falsification tests plus a sharpening of the block test. Five now carry powered runs against real data; four are pending a live world-model training run (blocked on compute, not on more data).
| Test | The bet | Verdict | Key number |
|---|---|---|---|
| (ii′) | Dynamic Neff collapse is community-specific before endogenous cascades | SEALED PASS | 9/12 fire, binomial p = 1.7×10⁻⁷, fresh roster |
| (iii) | Early warning (critical slowing-down) precedes cascades | PARTIAL | beats calm null p = 0.02; can't tell endo/exo (AUC 0.60) |
| (iii′) | A substantive fraction of cascades are slow B-tipping | REFUTED | B-fraction 0.33 < π_B = 0.60; mostly R-tipping shocks |
| (i) | Attention / activity is conserved (zero-sum) at ecosystem scale | CONTRADICTED | finance-subreddit basket ballooned ~14× in the mania |
| (ii) | Blocks are independent in calm windows | WEAK SUPPORT | macro Neff 1.90 of 8, bottoms 0.47 at a real shock |
| (iv) | Forecast skill in the smooth regime beats baselines | PENDING | awaits a live world-model training run |
| (v) | Published fixed points are reliable | PENDING | awaits a live world-model training run |
| (vi) | Lucas invariance: drift stays in an absorbable band | PENDING | world-model training run + multi-regime calibration |
| (vii) | Regime occupancy (Soros): imitative < monotone | PENDING | world-model training run + live regime monitor |
Cross-cutting checks also ran: the GameStop counterfactual (overdetermination), the operator-signal detector, the GitHub cross-domain replication, and the EnKF forward forecast.
Tests (iv)–(vii) are the forward-forecasting falsifiers. They do not need more data; they need a live forecasting engine run forward: the modern instantiation (a trained world model plus an LLM/LRM ensemble). The binding constraint is a stronger world-model training run — a compute problem, not a data problem. This is independent research, and compute donations directly unblock these four tests. The paper is v0.5, in review; it reaches v1.0 when these turn green. To donate compute or collaborate, contact the author at wingston.sharon@gmail.com.
This is the load-bearing test: the whole criticality account turns on the claim that the effective number of independent blocks collapses across an onset. The honest story has a twist that took six runs to find, and it is a lesson in not testing the wrong quantity.
The theory's real claim is specificity: before an endogenous cascade, the existing community's frozen block partition collapses harder than a random reshuffle of the same people. We pre-registered that as the primary endpoint, with a frozen binomial rule, on a fresh roster of 12 r/wallstreetbets cascades disjoint from every prior run (COVID crash, Archegos, Coinbase, the NVDA earnings prints, Credit-Suisse, the 2024 election, and more). It passed cleanly.
validation/neff_v4/). Left: each cascade's canonical-Neff collapse against its own block-label-shuffle 90th percentile (dots); green bars fire, red do not. Right: the observed collapse sits at the very top of its own 300-shuffle distribution for most cascades. The three non-firing cascades are the mechanical / exogenous events (a direct listing, a single Fed rate decision, a stock split) — exactly where a frozen-block Neff should be silent.§ Why this is an honest pass, not a manufactured one. We did not relax the magnitude threshold an earlier run failed (that verdict stands, see below). We tested a different, theory-correct endpoint on fresh data. The September-2024 stimulus case clinches the logic: its raw collapse is only 0.065 — any magnitude bar would discard it — yet it beats every one of its 300 shuffles, because the signal lives in the community structure, not the magnitude.
Two earlier sealed runs tested whether the collapse magnitude exceeds a threshold derived from genuinely-quiet windows. They failed, and the failure is informative: it is why we switched to specificity.
validation/neff_v3/). The decisive discovery was in the null itself: short high-volume onset windows compress Neff generically, so quiet windows already drop a median ~0.10. Magnitude therefore cannot tell an endogenous cascade from a busy-but-quiet week on a continuously high-volume forum. The specificity gate (does the real partition beat a shuffle?) discriminates where magnitude cannot.§ The reconciliation. The dynamic collapse is a real structural signal that lives in the block partition (the shuffle test sees it four times) but is not a magnitude excursion beyond a quiet baseline — which the near-decomposability premise never required. Both halves are reported. The full six-pass arc and the synthesis are in validation/NEFF_COLLAPSE_SYNTHESIS.md.
The structural gear seals. The dynamical, predictive and conservation claims do not — and that is the thesis, measured: the impersonal machinery is real but load-bearing only on the endogenous, reflexive minority of episodes, and most real cascades sit outside it.
Does critical slowing-down (rising variance / autocorrelation) precede a cascade? With a semantic (embedding-based) observable rather than a scalar proxy, the detector beats a guard-banded calm null — but it cannot tell a genuine reflexive build from an exogenous shock.
validation/early_warning_powered/). The signal is real against a calm baseline but the endogenous-vs-exogenous ROC sits near AUC 0.60 — a partial positive, not a discriminator.§ This qualifies the paper's earlier headline negative: with a scalar proxy the signal washed out; with a vector observable, part of it survives. It does not overturn it — single embedding model, in-sample thresholds.
Early-warning theory only works for slow bifurcation (B-) tipping. The conjecture — named in advance as the most likely to fail — was that a substantive fraction of real cascades are B-tipping. On a 24-cascade labelled roster, they are not.
§ The bet failed honestly. Most real cascades arrive as sudden rate-induced shocks with no slow warning — which is exactly why early warning (iii) is only a partial positive. The two results are consistent.
Is activity zero-sum across a basket of related communities? At the basket scale, no: a finance/meme-subreddit total ballooned roughly fourteen-fold through the GameStop mania. Attention conservation holds as a local, normalized-measure statement, not as a global head-count budget across a porous boundary.
validation/conservation_ecosystem/). The basket is porous, so this cannot test the global claim — but at the scale measured, conservation is contradicted, matching the single-subreddit pilot.§ Honest scope: a porous basket cannot falsify the global zero-sum claim. What it shows is that the conserved object is a normalized measure over a closed population, not raw activity across an open ecosystem.
Was GameStop a Seldon Crisis (structurally overdetermined) or a Mule (one individual moved it)? At the coarse scale it reads as overdetermined: attention rose structurally before the flagship spiked, and the whole meme basket fired in one window.
An agent of non-negligible measure (an "operator") needs a first-class state. The detector separates a gradual internal buildup from a sudden external shock.
Do the findings survive a different platform? On GitHub repositories, the structural-overdetermination and impersonal-early-warning-weakness results replicate, and operator concentration generalizes — but the gradual-buildup timing is platform-specific.
The first strictly-causal forward forecast on a real block. It beats climatology and is best-calibrated, but does not beat a persistence (last-value) baseline. The load-bearing positive is the self-diagnosing monitor firing on a real regime break.
A different kind of empirical check: route the 100 most-discussed r/AskEconomics questions through the engine and see which layers fire. The distribution is the test of the thesis — and it confirms it by measurement. The dramatic machinery (criticality, reflexivity) is a rare special regime; the quiet slow-stock core does almost all the work.
The dramatic machinery (criticality ≈ 21, reflexivity ≈ 34) is a special regime. Most questions are slow-stock accounting (L1 ≈ 93) — exactly what the thesis predicts: the quiet core dominates, the fat tails are rare.
| # | Title | Layers | Scope | Score |
|---|
Read it whole in the paper (PDF), or revisit the mathematics behind each test.