Mathematics ↔ prose ↔ Lean
Implementation map
A theorem-route milestone can be locally compiled, partial, stated without a finished proof, planned, or blocked. The declaration catalog below is generated from source; the milestone ledger records the mathematical boundary.
Status vocabulary
The named declaration exists and the publishing gate compiled the Lean project.
Useful declarations compile, but the stated route still has named missing steps.
A target or Lean declaration is stated but its proof is incomplete. None is promoted to compiled.
The result is part of the roadmap but has no claimed local endpoint.
Progress requires a specific missing law transport, algorithm construction, or mathematical interface.
flowchart LR Math["Natural-language model and theorem"] --> Ledger["Assumption ledger"] Ledger --> Statement["Exact Lean statement"] Statement --> DAG["Proof-DAG leaves"] DAG --> Decl["Compiled declaration"] Decl --> Explain["Plain-English explanation"] Explain --> Map["Implementation map"] Map --> IDE["Research IDE mapping + dependency tree"] IDE -. "local compile request" .-> Decl Map -. "source link" .-> Decl Map -. "mathematical back-link" .-> Math Cards["Theorem and retrieval cards"] -. "route evidence only" .-> Ledger Cards -. "never a local proof certificate" .-> Map
Mathematical milestone map
Start with the mathematical claim and status. Open a row's evidence only when you need exact declarations, dependencies, and the remaining boundary.
| Result | Chapter | Status | Meaning and evidence |
|---|---|---|---|
Finite-arm pseudo-regret decompositionFOUNDATION-REGRET-DECOMPOSITION |
Foundations | Compiled | Finite-horizon pseudo-regret equals the sum over arms of each gap multiplied by its pull count. Lean evidence and boundary
|
Generated-history conditional sub-Gaussian reward lawPROBABILITY-GENERATED-COND-MGF |
Probability layer | Compiled | A selected successor reward on the canonical generated trajectory inherits the centered conditional MGF bound supplied by its step kernel. Lean evidence and boundary
|
Finite-index geometric all-time confidence unionPROBABILITY-FINTYPE-GEOMETRIC-ALL-TIME-UNION |
Probability layer | Compiled | If every index in a nonempty finite family receives an equal geometric confidence share at every time, the outer measure of any time-index failure is at most the total confidence budget. Lean evidence and boundary
|
Generated finite-arm empirical-mean all-time confidencePROBABILITY-GENERATED-FINTYPE-EMPIRICAL-MEAN-GEOMETRIC-ALL-TIME |
Probability layer | Compiled | On one canonical generated action/reward trajectory, every finite arm and every positive successor horizon obeys the existing random-pull-count empirical-mean radius outside an event of outer measure at most the total geometric confidence budget. Lean evidence and boundary
|
Generated finite-arm telescoping all-time empirical-mean confidencePROBABILITY-GENERATED-FINTYPE-EMPIRICAL-MEAN-TELESCOPING-ALL-TIME |
Probability layer | Compiled | On one canonical generated action/reward trajectory, every finite arm and positive successor horizon obeys the existing random-pull-count empirical-mean radius at share delta/((n+1)(n+2))/|A| outside an event of outer measure at most delta. Lean evidence and boundary
|
Fixed-policy telescoping anytime UCB confidence and regretUCB-FIXED-POLICY-TELESCOPING-ANYTIME-REGRET |
UCB | Compiled | One horizon-free scheduled UCB policy uses the telescoping per-round confidence share on its own generated finite history. On the same canonical action/reward trajectory measure, one all-time confidence event controls every positive-gap arm at every finite horizon, and each finite horizon has an explicit expected pseudo-regret bound. Lean evidence and boundary
|
Probability interfaces used by canonical ETC and ordinary UCBPROBABILITY-ETC-UCB-ROUTE-SURFACE |
Probability layer | Compiled | The generated-history law, conditional sub-Gaussian MGF, and finite-arm/time empirical-mean event actually required by the scoped ETC and horizon-indexed UCB routes compile through one external Book Map canary; the reusable countable adapter is exposed separately. Lean evidence and boundary
|
Canonical sub-Gaussian ETC expected regretETC-CANONICAL-SUBGAUSSIAN-REGRET |
ETC | Compiled | The generated ETC policy under finite-arm sub-Gaussian reward laws satisfies the explicit exploration-plus-wrong-commit expected pseudo-regret bound. Lean evidence and boundary
|
Canonical Rat ETC least-encoded tie ruleETC-CANONICAL-RAT-LEAST-TIE |
ETC | Compiled | The Rat commit oracle used by the measurable generated ETC policy is Mathlib's first-occurrence argmax on Fin K, hence chooses the least encoded arm among tied maxima. Lean evidence and boundary
|
Local ETC endpoint aligned with the LML theorem cardETC-LML-PORT |
ETC | Compiled | The local canonical ETC chapter route compiles; direct identity with the pinned LML declaration remains a separate cross-toolchain theorem-card route and is not claimed here. Lean evidence and boundary
|
Finite-arm sub-Gaussian UCB gap-sum boundUCB-FINITE-ARM-SUBGAUSSIAN |
UCB | Compiled | The generated selected-policy UCB action satisfies a textbook-shaped Real pseudo-regret gap-sum bound, including the zero-proxy case. Lean evidence and boundary
|
Finite-arm UCB expected-average consistencyUCB-EXPECTED-AVERAGE-CONSISTENCY |
UCB | Compiled | For the compiled finite-arm sub-Gaussian source, expected pseudo-regret divided by the horizon tends to zero. Lean evidence and boundary
|
Canonical horizon-indexed UCB confidence-to-consistency chainUCB-HORIZON-INDEXED-CANONICAL-CHAIN |
UCB | Compiled | For each explicit horizon and confidence budget, one generated pair-trajectory family carries the finite-arm/time confidence event through large-gap and pull-count bounds to finite-arm expected pseudo-regret; the scheduled family has vanishing expected average regret. Lean evidence and boundary
|
Pinned LML UCB theorem-card portUCB-LML-PORT |
UCB | Partial | Local ordinary-UCB and Real arm-stream one-policy results compile; only literal identity with the pinned upstream declaration remains a separate theorem-card/cross-toolchain gate. Lean evidence and boundary
|
Direct LeanMachineLearning toolchain identityLML-DIRECT-TOOLCHAIN-IDENTITY |
Frontier | Blocked | ABRL has compiled local ETC/UCB theorems shaped against the pinned LeanMachineLearning cards, but it does not import or consume the actual upstream Bandits.ETC.regret_le or Bandits.UCB.regret_le declarations. Lean evidence and boundary
|
Logarithmic elliptical-potential inequalityOFUL-ELLIPTICAL-POTENTIAL |
OFUL | Compiled | Clipped inverse-Gram quadratic widths are bounded by a dimension-scaled log-determinant growth term. Lean evidence and boundary
|
Conditional-MGF to ridge confidence ellipsoidOFUL-SELF-NORMALIZED-RIDGE-CONFIDENCE |
OFUL | Compiled | The finite-dimensional conditional-MGF and Gaussian-mixture route controls the ridge-estimation error in the regularized matrix norm. Lean evidence and boundary
|
Measurable horizon-free optimistic policyOFUL-MEASURABLE-GENERATED-POLICY |
OFUL | Compiled | A strict-fold finite-action selector turns ridge estimates and scheduled confidence radii into one measurable history algorithm without a terminal horizon parameter. Lean evidence and boundary
|
One-policy all-time OFUL confidenceOFUL-ALL-TIME-CONFIDENCE |
OFUL | Compiled | A telescoping confidence-budget schedule controls one countable failure event for the generated scalar-ridge policy at every deterministic horizon. Lean evidence and boundary
|
One-policy all-horizon OFUL pseudo-regretOFUL-ALL-HORIZON-HIGH-PROBABILITY-REGRET |
OFUL | Compiled | On the same canonical trajectory generated by the horizon-free telescoping policy, one outer-measure event controls the explicit pseudo-regret bound for every finite horizon. Lean evidence and boundary
|
Fixed-model OFUL expected-average consistencyOFUL-EXPECTED-AVERAGE-CONSISTENCY |
OFUL | Compiled | For the separate horizon-indexed fixed-model policy family, the canonical expected pseudo-regret bound is little-o of the horizon, so the corresponding expected average tends to zero. Lean evidence and boundary
|
Bounded stopping-time OFUL expected regretOFUL-BOUNDED-STOPPING-EXPECTED-REGRET |
OFUL | Compiled | For the same horizon-free telescoping generated policy, any stopping time bounded by a deterministic horizon has nonnegative expected stopped pseudo-regret bounded by the endpoint budget plus the explicit delta-weighted envelope. Lean evidence and boundary
|
Square-integrable random-horizon OFUL expected regretOFUL-UNBOUNDED-STOPPING-EXPECTED-REGRET |
OFUL | Compiled | Under an explicit square-integrable finite stopping-time contract, the stopped high-probability pseudo-regret is integrable and receives a second-moment-controlled expectation bound. Lean evidence and boundary
|
Posterior kernel equals the conditional environment lawTHOMPSON-POSTERIOR-KERNEL |
Thompson sampling | Compiled | When the observed environment-history pair has the canonical prior-likelihood joint law, the canonical posterior kernel is almost everywhere the conditional distribution of the environment given history. Lean evidence and boundary
|
Canonical one-step probability matchingTHOMPSON-CANONICAL-SAMPLER |
Thompson sampling | Compiled | Sampling an environment from the canonical posterior and applying the measurable best-action selector gives the same conditional action law as the posterior best action. Lean evidence and boundary
|
Probability matching on the actual recursive trajectoryTHOMPSON-RECURSIVE-PROBABILITY-MATCHING |
Thompson sampling | Compiled | For every round, the successor action on the recursively generated Thompson trajectory conditioned on its own finite history has the posterior-best-action conditional law. Lean evidence and boundary
|
Bayesian regret and clipped-UCB decompositionTHOMPSON-BAYES-CLIPPED-DECOMPOSITION |
Thompson sampling | Compiled | Probability matching transports finite-history scores so generated comparator-relative mean regret splits exactly into selector and selected-action clipped-score terms; it becomes Bayesian regret when the selector is mean-optimal. Lean evidence and boundary
|
Generated rewards align with the stationary latent arm streamTHOMPSON-LATENT-STREAM-SUPPORT |
Thompson sampling | Compiled | The actual recursive trajectory reward coordinates agree almost everywhere with the next-unused-coordinate reward read from the selected arm's latent stream. Lean evidence and boundary
|
Stationary latent-arm-stream Thompson regretTHOMPSON-STATIONARY-REGRET |
Thompson sampling | Compiled | Under the explicit pointwise mean-optimal selector, stationary Markov, bounded-mean, and centered sub-Gaussian contracts, the canonical generated Thompson trajectory satisfies E[R_n^Bayes] <= (2K+1)(u-l)+8 sqrt(sigma^2 K n log n). Lean evidence and boundary
|
General Thompson/LML Bayesian portTHOMPSON-GENERAL-PORT |
Thompson sampling | Partial | The stationary local endpoint is complete, but posterior-law producers outside that model and exact upstream compatibility remain separate obligations. Lean evidence and boundary
|
Tuned expected EXP3 regretEXP3-EXPECTED-REGRET |
EXP3 | Compiled | The generated predictable EXP3 process satisfies an explicit square-root expected-regret bound. Lean evidence and boundary
|
Per-horizon best-arm realized high-probability EXP3EXP3-BEST-ARM-REALIZED-HIGH-PROBABILITY |
EXP3 | Compiled | For each supplied positive horizon, finite comparator aggregation gives the generated horizon-tuned EXP3 law a best-supported-arm realized-regret tail; changing the horizon changes the parameters and law. Lean evidence and boundary
|
Countable scheduled quadratic fixed-MGF tailCONCENTRATION-COUNTABLE-SCHEDULED-QUADRATIC-TAIL |
Probability layer | Compiled | A countable union of indexwise deviation-and-variance events is controlled by the sum of their confidence shares and hence by a caller-supplied total budget. Lean evidence and boundary
|
All-positive-prefix EXP3 predictable-variance tailEXP3-PREDICTABLE-VARIANCE-GEOMETRIC-ALL-TIME |
EXP3 | Compiled | On one generated EXP3 trajectory law, geometric confidence shares control the joint selected-loss deviation and predictable-variance failures over every positive prefix by one outer budget. Lean evidence and boundary
|
All-positive-prefix EXP3 realized-deviation tailEXP3-REALIZED-DEVIATION-GEOMETRIC-ALL-TIME |
EXP3 | Compiled | On one fixed generated EXP3 process, the realized selected loss minus its predictable counterpart stays below its geometrically scheduled radius at every positive prefix outside one failure event of outer mass at most delta. Lean evidence and boundary
|
All-positive-prefix EXP3 predictable-regret tailEXP3-PREDICTABLE-REGRET-GEOMETRIC-ALL-TIME |
EXP3 | Compiled | For one fixed generated EXP3 process and one supported comparator, every positive-prefix predictable-regret failure is covered by a single geometrically budgeted event. Lean evidence and boundary
|
All-positive-prefix EXP3 realized-regret tailEXP3-REALIZED-REGRET-GEOMETRIC-ALL-TIME |
EXP3 | Compiled | For one generated EXP3 process and one supported comparator, the realized selected-loss regret at every positive prefix is controlled by the sum of the predictable-regret and realized-deviation schedules outside one event of outer mass at most delta. Lean evidence and boundary
|
Sparse-loss all-horizon high-probability EXP3EXP3-SPARSE-ALL-HORIZON |
EXP3 | Compiled | The best-arm realized-regret tail is controlled with the supplied sparsity-failure probability left explicit. Lean evidence and boundary
|
Finite-arm IID half-Tsallis logarithmic regretTSALLIS-IID-LOG |
Tsallis-FTRL | Compiled | IID probability arm laws with exact model means and positive non-best gaps yield a logarithmic reciprocal-gap regret bound. Lean evidence and boundary
|
History-adaptive expected-corruption all-regimes boundTSALLIS-HISTORY-ADAPTIVE-CORRUPTION |
Tsallis-FTRL | Compiled | A measurable predictable corruption model receives an internally selected refined or logarithmic regret bound. Lean evidence and boundary
|
Nonidentical drifting-mean dynamic regretTSALLIS-DYNAMIC-REGRET |
Tsallis-FTRL | Compiled | Predictable-environment regret to the actual moving best arm is bounded by the fixed-comparator route plus an explicit mean-drift penalty. Lean evidence and boundary
|
Generated oracle-restart switch-count dynamic regretTSALLIS-ORACLE-RESTART-GENERATED |
Tsallis-FTRL | Compiled | A change-point schedule built from population-mean switches generates a single restart trajectory whose expected dynamic regret is bounded by the square-root switch-count rate under the route's support assumptions. Lean evidence and boundary
|
Finite-horizon MDP and Bellman interfaceRL-FINITE-MDP-BELLMAN |
Finite-horizon RL | Compiled | Finite-horizon MDP data, measurable Markov policies, recursive value functions, optimal Bellman operators, and an attaining optimal policy are formalized locally. Lean evidence and boundary
|
Expected regret as an occupancy Bellman gapRL-OCCUPANCY-REGRET |
Finite-horizon RL | Compiled | A Markov policy's expected regret equals the occupancy-weighted Bellman optimality gap and is nonnegative; the optimal policy has zero regret. Lean evidence and boundary
|
Adaptive realized behavior-regret consistencyRL-ADAPTIVE-REALIZED-CONSISTENCY |
Finite-horizon RL | Compiled | With the explicit path-support, bounded-mean, sub-Gaussian, scheduling, and Standard Borel contracts, both the failure budget and average realized behavior-regret envelope tend to zero across windows. Lean evidence and boundary
|
Inverse-sqrt hittingAfter is a square-integrable finite stopping timeRL-UNBOUNDED-HITTINGAFTER-L2 |
Finite-horizon RL | Compiled | For each fixed threshold index and horizon greater than four, the genuine uncapped Mathlib hittingAfter has an L2 round count under the exact generated causal source. Lean evidence and boundary
|
Stopped realized behavior regret is integrable and below its hit threshold in expectationRL-UNBOUNDED-HITTINGAFTER-EXPECTED-UPPER-BOUND |
Finite-horizon RL | Compiled | For every fixed inverse-sqrt threshold index and horizon greater than four, the exact average realized behavior-regret process stopped at the uncapped hit is integrable and its integral is at most that threshold. Lean evidence and boundary
|
Generated adaptive cumulative Hoeffding UCBVI-CH chainRL-UCBVI-HOEFFDING-GENERATED-FOUNDATION |
Finite-horizon RL | Compiled | One generated adaptive process now carries exact aggregate transition numerators and visit denominators, a previous-Q clipped recurrent planner, a strict-prefix measurable policy, joint same-source singleton-Bernstein and optimal-tail confidence, Bellman optimism, raw generated episode pseudo-regret, actual-count charge summation, and a generated-filtration Bellman martingale. Lean evidence and boundary
|
Canonical known-reward Hoeffding UCBVI-CH terminalsRL-UCBVI-HOEFFDING-CANONICAL-TERMINALS |
Finite-horizon RL | Compiled | On the recurrent source's own trajectory measure, the probability that raw K-episode policy-value pseudo-regret exceeds 20 H sqrt(H) L sqrt(S A K) + 250 H^2 S^2 A L^2 is at most delta. The matching integrable expectation is at most that bound plus K H delta. Lean evidence and boundary
|
Budget-exhaustion stopping timeBWK-STOPPING-FOUNDATION |
Frontier | Compiled | An adapted natural-valued spending process reaches a fixed budget at a stopping time. Lean evidence and boundary
|
Bandits-with-knapsacks regret theoremBWK-FINAL-REGRET |
Frontier | Blocked | Stopping-time and several positive-cost budget adapters compile, but there is no full resource process, feasibility invariant, primal-dual comparison, and BwK regret theorem. Lean evidence and boundary
|
Generated bounded-reward KL-UCB confidence and regretKL-UCB-BOUNDED-GENERATED-REGRET |
UCB | Compiled | One horizon-free measurable policy uses the actual Bernoulli-KL confidence-set supremum on its generated reward history. On the same canonical trajectory measure, a telescoping all-time confidence event controls every positive-gap arm at every finite horizon and yields a conservative finite-time expected pseudo-regret bound. Lean evidence and boundary
|
Chapter 13 lower-bound semantic and deterministic spineTEXTBOOK-PART-IV-CH13-BASIC-IDEAS-LEAN-SPINE |
Part IV · Chapter 13 | Compiled | The Chapter 13 conversion window compiles explicit ENNReal worst-case/minimax semantics, a source-shaped least-explored alternative-arm theorem from the exact expected pull budget, and quantitative deterministic two-environment regret algebra whose cross-law pull discrepancy remains a visible error premise. Lean evidence and boundary
|
Chapter 14 relative-entropy and Bretagnolle–Huber spineTEXTBOOK-PART-IV-CH14-INFORMATION-THEORY-LEAN-SPINE |
Part IV · Chapter 14 | Compiled | The scoped §14.2 spine compiles extended-real measure relative entropy with explicit absolute-continuity, integrability, and singular branches; event-level Bernoulli data processing; binary endpoint analysis; and the unconditional Bretagnolle–Huber inequality in the exact D(P,Q) direction. Lean evidence and boundary
|
Chapter 15 unit-Gaussian likelihood-ratio and KL dependency sliceTEXTBOOK-PART-IV-CH15-GAUSSIAN-KL-DEPENDENCY-SLICE |
Part IV · Chapter 15 | Compiled | For real means mu and nu, the project constructs the unit-variance Gaussian arm laws, identifies their log Radon–Nikodym derivative under the first law, proves its integrability, and derives the exact extended-real identity D(N(mu,1),N(nu,1))=(mu-nu)^2/2. The changed-arm cost, source gap, exact information exponent one half, and unit-cube gap upper bound also compile. Lean evidence and boundary
|
Chapter 15 same-policy adaptive-history KL decompositionTEXTBOOK-PART-IV-CH15-SAME-POLICY-HISTORY-KL-DECOMPOSITION |
Part IV · Chapter 15 | Compiled | For finite arms, a countably generated reward space, arbitrary stationary Markov arm laws, and one common randomized history policy, the directed KL between the two canonical finite history laws equals the finite sum of first-law realized expected pull counts times the corresponding directed arm KL. The proof includes singular fibres and infinite arm KL through an extended-real conditional-kernel chain rule. Lean evidence and boundary
|
Chapter 16 consistency, d_inf, and Gaussian-candidate dependency sliceTEXTBOOK-PART-IV-CH16-CONSISTENCY-DINF-DEPENDENCY-SLICE |
Part IV · Chapter 16 | Compiled | The project states Definition 16.1's every-environment/every-positive-real-power consistency interface, proves closure and eventual power/log-growth consequences for two regret sequences, defines the source extended-real d_inf with strict confusing alternatives in the original-to-alternative KL direction, and computes an exact unit-Gaussian perturbed-alternative upper bound. Lean evidence and boundary
|
Chapter 16 instance-dependent asymptotic and finite-time source terminalsTEXTBOOK-PART-IV-CH16-SOURCE-TERMINALS |
Part IV · Chapter 16 | Blocked | The source-frozen endpoints are Theorem 16.2's unstructured-class liminf regret constant, Lemma 16.3's one-arm finite-time expected-pull inequality, and Theorem 16.4's unit-Gaussian local-envelope positive-part lower bound. No local declaration is presented as any of these terminals. Lean evidence and boundary
|
Chapter 17 exact thresholds, Claim 17.5, and tail-event dependency sliceTEXTBOOK-PART-IV-CH17-FIRST-MOMENT-AND-TAIL-DEPENDENCY-SLICE |
Part IV · Chapter 17 | Compiled | The project freezes the exact stochastic and adversarial Chapter 17 threshold surfaces, compiles Claim 17.5's first-moment deterministic-witness argument with integrability explicit, proves the 2delta-minus-delta event subtraction, and proves the deterministic quarter-horizon algebra following Eq. (17.8). Lean evidence and boundary
|
Chapter 17 stochastic and adversarial high-probability source terminalsTEXTBOOK-PART-IV-CH17-SOURCE-TERMINALS |
Part IV · Chapter 17 | Blocked | The source-frozen endpoints are Theorem 17.1, Corollaries 17.2–17.3, Theorem 17.4, Claims 17.6–17.7, and construction-level Eq. (17.8). No local declaration is presented as any of these terminals. Lean evidence and boundary
|
Theorem 13.1 Gaussian finite-arm minimax lower boundTEXTBOOK-PART-IV-THEOREM-13-1-GAUSSIAN-MINIMAX |
Part IV · Chapter 13 | Blocked | For k-armed unit-variance Gaussian bandits with mean vectors in the unit cube, the source states a universal-constant minimax lower bound of order sqrt(k n) for k greater than one and n at least k; Chapter 15 now freezes the exact proof target and compiles the Gaussian arm KL dependency, but BanditRLlib makes no local compiled-terminal claim. Lean evidence and boundary
|
Source-faithful delayed-feedback accountingDELAYED-FEEDBACK-SOURCE-ACCOUNTING |
Frontier | Compiled | For the frozen NeurIPS 2025 delayed best-of-both-worlds source, the library formalizes strict pre-action observability, outstanding rounds, their exact finite partition, paper-style end-of-round missing-feedback counts, and the explicit one-based indexing bridge. This is deterministic accounting, not a regret theorem. Lean evidence and boundary
|
Causal action-time view and new-feedback processingDELAYED-FEEDBACK-CAUSAL-PROCESSING |
Frontier | Compiled | The learner view exposes past actions and exactly the losses available before the next action. Observation-equivalent hidden worlds are indistinguishable to any typed causal decision rule, and the set-level update processes precisely the newly observed rounds. A separate downstream layer now constructs a one-round measure-valued rule; a measurable recursive policy kernel and the paper's ordered state updates remain open. Lean evidence and boundary
|
Delayed SAPO active-arm allocation leafDELAYED-SAPO-ACTIVE-ALLOCATION |
Frontier | Compiled | Algorithm 5's equal residual allocation over a nonempty active set is normalized and coordinatewise nonnegative whenever the inactive coordinates are nonnegative and carry at most unit mass. No claim is made that the unformalized EAP state maintains those premises. Lean evidence and boundary
|
Optimal-arm survival and causal one-round action lawDELAYED-SAPO-ELIMINATION-ACTION-LAW |
Frontier | Compiled | Algorithm 5 lines 7--8 compile as a source-exact elimination snapshot. The deterministic core of Lemma D.9 proves that an explicit optimal-arm-survival certificate closes the nonempty-active premise for line 15. With EAP's still-explicit nonnegativity and mass premises, the resulting vector induces a genuine one-round probability measure, and every allocation rule typed on the causal view returns the same measure in observation-equivalent hidden worlds. The source-shaped good-event projection that constructs the certificate is compiled separately; this milestone is not the full lemma, a measurable history kernel, or a regret endpoint. Lean evidence and boundary
|
Source-shaped good-event projection for optimal-arm survivalDELAYED-SAPO-GOOD-EVENT-D9-PROJECTION |
Frontier | Compiled | A source-shaped confidence snapshot defines ucbStar as the finite-arm infimum of the two upper-confidence surfaces used in the paper. Its elimination projection of Definition D.1 derives muStar <= ucbStar rather than assuming that inequality as an independent certificate, constructs the deterministic Lemma-D.9 survival certificate, and transports any externally supplied complement-good-event probability bound to an optimal-arm-elimination bound. Corollary D.8's six-event union assembly is compiled separately; the full Definition-D.1 event and the D.2--D.7 component concentration/counting producers remain open. Lean evidence and boundary
|
Corollary-D.8 union assembly to D.9 survivalDELAYED-SAPO-D8-D9-ASSEMBLY |
Frontier | Compiled | Six explicitly named failure components represent the clauses discharged by source Lemmas D.2--D.7. The compiled Corollary-D.8 layer proves that three 1/T^2 budgets and three 1/T budgets combine into the paper's deliberately loose 9/T complement-good-event bound, then transports a recorded full-event-to-elimination projection through the compiled D.9 consumer to bound optimal-arm elimination. The six concentration/counting bounds and the semantic projection are hypotheses, not claimed source theorems. Lean evidence and boundary
|
Lemma-D.10/D.12 width-direction diagnostic and conditional same-snapshot skeletonDELAYED-SAPO-D10-D12-GAP-ORDERING-AUDIT |
Frontier | Partial | Lean proves that the source inverse-square-root empirical width is antitone in a positive pull count and gives both a normalized count-one/count-four witness and a literal T=4 witness against the printed reverse transport. It also proves the exact source-shaped small-count implication count <= 192 log T -> 1 <= 10 width. A branched active-arm consumer uses current-UCB and the optimal-to-later factor-three edge only in the large-count branch, while the small-count branch uses bounded means plus an explicit source-width/count certificate. Together with an explicit later-to-earlier factor-ten width premise, this yields a conditional same-snapshot factor-20 consumer without transport to a later elimination snapshot. The recursive trajectory does not yet produce the branch, source-width/count, or factor-ten certificates. The earlier explicit four-edge consumer remains for comparison. These 19 declarations do not verify or refute source Lemmas D.10/D.12, main-text Lemma 4.2, or Theorem 4.1. Lean evidence and boundary
|
Source-frozen delayed best-of-both-worlds endpoint auditNEURIPS-2025-DELAYED-BOBW-CENTRAL-ENDPOINTS |
Frontier | Partial | The exact NeurIPS 2025 source is hash-frozen, a same-algorithm multi-regime contract compiles, and 107 named source-audit declarations compile across accounting, causality, processing, allocation, elimination, good-event projection/union assembly, the one-round action law, and a 19-declaration D.10/D.12 diagnostic/conditional/repair layer. That layer includes a literal T=4 direction witness, the exact source-shaped small-count scalar implication, and a large/small-count conditional same-snapshot factor-20 skeleton. It does not verify or refute source Lemmas D.10/D.12, main-text Lemma 4.2, or Theorem 4.1 because the recursive branch/count/width producers and same-prefix factor-ten comparison remain open. BanditRLlib does not yet implement the full Delayed SAPO trajectory, prove the D.2--D.7 component bounds on that trajectory, or prove either regret endpoint. Lean evidence and boundary
|
Balanced target-drift controlled evaluationTARGET-DRIFT-V2-CONTROLLED-EVALUATION |
Frontier | Planned | Version 2 reuses 30 frozen source cases while balancing 75 source-faithful and 75 injected-drift target-replicate triplets across compile-only, source-aware blueprint, and full ABRL conditions. Both variants use one matched field/value template, with a frozen text-only leakage diagnostic. The result-free protocol and component-tested code specify a pre-audit common workspace, opaque identifiers, content-addressed sealing, an agent-adapter interface, workflow-artifact presence/hash records, blind grading packets, and source/target-aware analysis with multiplicity-controlled secondary endpoints. Neutral replay is split into a host controller that never executes Lean, a canonical Docker launcher, a trusted in-image controller, and a restricted Lean worker. The sandbox receives only a pristine base snapshot, submitted patch, public declaration names, expected file hashes, and opaque/hash bindings; the complete sealed pack, operator metadata, source bank, condition, variant, and ground truth are excluded. Runtime binding covers the allowlisted Docker executable, version/daemon/signature-or-package ledger, image recipe/SBOM, exact argv, and actual launcher/controller/inner bytes. A provenance-bound multi-stage builder now derives the cache-complete image context from the exact common pre-audit Git snapshot, excludes evaluation and operator data, runs the full Lean and Tests targets, byte-manifests the cache, keeps builder-stage source out of the final image, and emits an image/toolchain/cache SBOM plus sealed provenance sidecars. A result-free Linux CI candidate build then produced an unpublished cache-complete image, a 121,277-file cache manifest, and matching build-input/log/SBOM hashes after an offline Lean 4.29.1 / Lake 5.0.0-src+f72c35b worker probe. The candidate image existed only on the ephemeral runner and is not a frozen production image or isolation evidence. The launcher verifies the manifest extracted from a digest-pinned image, the inner checker verifies every cached file, and the already restricted worker copies the seed into the per-run tmpfs replay. A real provider image, final published checker image, passed seven-probe checker isolation report, final seal, preregistered real-infrastructure smoke, and all primary runs remain pending; no model run or formalization outcome is reported. Lean evidence and boundary
|
Major theorem dependencies
The graph shows the main teaching spine. Module pages list the exact import dependencies for every Lean source file.
flowchart TB Model["FiniteBanditModel"] --> Decomp["pseudoRegret = Σ gap × pullCount"] Trace["ActionTrace / RewardTrace"] --> Decomp Policy["MeasurablePolicy"] --> Traj["historyStepKernelFamily / trajMeasure"] Kernel["Conditional reward-kernel contracts"] --> Traj Traj --> CondMGF["selected centered reward conditional MGF"] CondMGF --> Concentration["sub-Gaussian / martingale tails"] Decomp --> ETC["ETC expected regret"] Concentration --> ETC Decomp --> UCB["UCB gap-sum + average consistency"] Concentration --> UCB GramDet["OFUL Gram + rank-one determinant"] --> Ellipse["log-det + elliptical potential"] Ellipse --> SelfNorm["conditional-MGF self-normalized confidence"] CondMGF --> SelfNorm SelfNorm --> Ridge["ridge confidence ellipsoid"] Ridge --> Optimistic["measurable optimistic policy"] Optimistic --> AllTime["generated one-policy all-time confidence"] AllTime --> OFULRate["same-policy all-horizon pseudo-regret"] OFULRate --> StopBounded["bounded stopping consumer"] OFULRate --> StopL2["square-integrable stopping consumer"] Ridge --> OFULExpected["separate horizon-indexed expectation + consistency"] Prior["prior"] --> Posterior["posterior kernel"] Likelihood["likelihood kernel"] --> Posterior Posterior --> Match["one-step probability matching"] Match --> RecursiveTS["recursive generated TS trajectory"] Traj --> RecursiveTS RecursiveTS --> BayesDecomp["comparator/Bayesian decomposition"] OptimalSelector["pointwise mean-optimal selector"] --> BayesDecomp BayesDecomp --> Clipped["clipped confidence bridge"] Clipped --> Latent["stationary latent-arm stream"] Latent --> TS["generated stationary Bayesian regret"] Hedge["EXP3 potential + Hedge"] --> IW["IW support + conditional moments"] Traj --> IW IW --> EXP3Expected["horizon-tuned expected regret"] IW --> EXP3Window["horizon-tuned best-arm realized tail"] Concentration --> EXP3Window IW --> EXP3Pred["fixed-process predictable all-prefix event"] Concentration --> EXP3Dev["fixed-process realized-deviation all-prefix event"] EXP3Pred --> EXP3All["same-process comparator all-prefix regret"] EXP3Dev --> EXP3All IW --> EXP3Sparse["sparse/variance-sensitive extension"] FTRL["half-Tsallis simplex minimizer"] --> FTRLStab["one-step stability + penalty"] Traj --> TsallisGenerated["scheduled generated action law"] FTRLStab --> TsallisGenerated TsallisGenerated --> ScoreAlign["observed IW score alignment"] ScoreAlign --> AllRate["all-rate expected stability/regret"] AllRate --> SelfBound["fixed-gap self-bounding"] SelfBound --> TsallisIID["bounded IID logarithmic regret"] SelfBound --> Dynamic["corruption + dynamic extensions"] Dynamic --> Restart["population-mean oracle restart extension"] MDP["FiniteHorizonRL.MDP"] --> Bellman["optimal Bellman recursion"] Bellman --> Occupancy["expectedRegret_eq_occupancyGapRemaining"] GeneratedEpisodes["generated adaptive episode source"] --> CumState["strict-prefix aggregate counts"] CumState --> AggregateP["aggregate empirical transition row"] AggregateP --> RecurrentQ["previous-Q clipped UCBVI-CH planner"] RecurrentQ --> GreedyPolicy["measurable finite argmax policy"] CondMGF --> RLConfidence["same-law singleton + optimal-tail confidence"] CumState --> RLConfidence RLConfidence --> OptimismRL["all-episode Bellman optimism"] RecurrentQ --> OptimismRL Occupancy --> EpisodeRegret["generated episode pseudo-regret"] GreedyPolicy --> EpisodeRegret OptimismRL --> DecompRL["charge + Bellman-innovation decomposition"] EpisodeRegret --> DecompRL CumState --> CountSumRL["actual-count charge summation"] CondMGF --> MartingaleRL["generated-filtration innovation tail"] DecompRL --> UCBVITerminal["20/250 high-probability UCBVI-CH terminal"] CountSumRL --> UCBVITerminal MartingaleRL --> UCBVITerminal UCBVITerminal --> UCBVIExpected["expected regret + K H delta"] RLConfidence --> Behavior["natural-causal consistency extension"] StopL2 --> Hitting["uncapped inverse-sqrt hittingAfter L2"] Behavior --> Hitting Hitting --> ExpectedHit["stopped value integrable; expectation ≤ threshold"] UCBVITerminal -. "separate milestone" .-> BernsteinRL["Bernstein/minimax UCB-VI"]
Complete module inventory
Every project module is assigned to a teaching chapter. This exhaustive inventory is collapsed by default so that the mathematical milestones remain the primary reading surface.