Part IV — Lower Bounds for Bandits with Finitely Many Arms
Chapter 13: Lower Bounds: Basic Ideas
Theorem 13.1 compiles through Chapter 15 with c=1/54. Chapter 13 also compiles fixed-class minimax-optimality, the canonical iid Gaussian empirical-mean law, midpoint error events, the Chernoff companion, and both exact Mills-ratio bounds of Eq. (13.4) rescaled to the printed Eq. (13.1). The broader 1-subgaussian class with gaps in [0,1] now has a compiled fixed-horizon MOSS upper bound and constant-factor near-minimax theorem. The frozen main-text contract is complete: PR #105, authoritative-main checks, Pages deployment and live desktop/mobile acceptance pass for b38630c. Notes and Exercises remain optional and unformalized.
Source map
Bandit Algorithms, Tor Lattimore and Csaba Szepesvári, Cambridge University Press (2020), DOI 10.1017/9781108571401.
- §13.1 Main Ideas Underlying Minimax Lower Bounds (CUP starts p. 155 / author-online pp. 181–182 / PDF pp. 190–191)
- §13.2 Notes (CUP p. 158 / author-online p. 183 / PDF p. 192)
- §13.3 Bibliographic Remarks (CUP p. 158 / author-online p. 184 / PDF p. 193)
- §13.4 Exercises (CUP p. 159 / author-online pp. 184–185 / PDF pp. 193–194)
Section coverage
| Section | Status | Formalization boundary |
|---|---|---|
| Chapter opening and Theorem 13.1 | Compiled | Worst-case/minimax semantics, fixed-class minimax-optimality, and the unit-Gaussian c=1/54 theorem endpoint compile. |
| §13.1 Main Ideas Underlying Minimax Lower Bounds | Compiled | The canonical iid Gaussian empirical-mean law, midpoint error events, exact two-sided Eq. (13.1), least-explored-arm selection, one-coordinate construction, regret identities, history transport, tuning, and the final lower terminal compile. The Chernoff maximum-risk companion remains separately labeled. |
| §13.2 Notes | Source indexed | Game interpretation, flat-risk discussion, Pareto optimality, and rate terminology are indexed as optional enrichment and are not formalized. |
| §13.3 Bibliographic Remarks | Source indexed | The Abramowitz–Stegun source is mapped; both exact integral bounds of Eq. (13.4) compile in GaussianMillsRatio.lean. |
| §13.4 Exercises | Source indexed | Exercises 13.1 and 13.2 are indexed as explicitly optional and unformalized. |
Learning goals
- Read worst-case and minimax expected regret as explicit supremum and infimum operations.
- Read minimax optimality as attainment relative to a policy class, environment class, and horizon-indexed regret functional.
- Trace the canonical finite iid Gaussian product through summation and scaling to the exact N(mu,1/n) empirical-mean law.
- Trace both compiled Mills-ratio integral bounds through Gaussian density standardization to the exact two-sided Eq. (13.1); distinguish the weaker Chernoff companion.
- Derive a least-explored alternative arm from the exact expected pull-count budget.
- Separate the deterministic two-environment regret algebra from the statistical change-of-measure bridge supplied in Chapters 14–15.
- Trace how the exact Chapter 15 factor 1/27 yields Theorem 13.1 with the explicit universal constant 1/54.
Necessary definitions and statements
Worst-case and minimax expected regret
CompiledMinimax-optimal policy
CompiledGaussian iid mean and midpoint test companion
CompiledLeast-explored alternative
CompiledTwo-environment algebra
CompiledMinimal source-change proof flow
- Choose the base instance
Give arm zero mean Delta and every alternative mean zero.
- Find a lightly sampled alternative
Use the expected pull budget to choose i.succ with expected count at most n/m.
- Change one source
Raise only that alternative mean to 2 Delta; keep the policy fixed.
- Write both regret expressions
Expose the base identity and changed-environment lower expression without identifying their expectations.
- Apply indistinguishability
The compiled Chapter 15 history KL and Chapter 14 Bretagnolle–Huber theorem turn the lightly sampled alternative into a quantitative minimax conclusion.
Key source theorem and boundary
Theorem 13.1 (source statement; proof deferred to Chapter 15)
The source states the finite-arm Gaussian minimax order here and explicitly postpones its proof to Chapter 15.
Lean correspondence
Only declarations that exist in the current index and pass the verified build may render as compiled.
| Lean declaration | Status | Role and exact type |
|---|---|---|
BanditRLProof.MOSS.canonicalGapExpectedRegret_le | Compiled | Fixed-horizon Algorithm 7 bound 39 sqrt(nk) plus the gap sum on the actual canonical history law.Exact compact Lean statement |
BanditRLProof.LowerBounds.subgaussianMinimax_sandwich | Compiled | For unit-subgaussian arms with gaps in [0,1], lower constant 1/54 and MOSS upper constant 40, using identical policy and regret semantics.Exact compact Lean statement |
BanditRLProof.LowerBounds.moss_nearMinimax | Compiled | Main-prose constant-factor near-minimax consequence: MOSS worst-case regret is at most 2160 times minimax regret; k>1 and n>=k.Exact compact Lean statement |
BanditRLProof.Concentration.measure_exists_le_independent_partialSum_ge_le_subgaussian | Compiled | Finite maximal independent centered subgaussian bound with no cardinality loss, consumed by compiled MOSS peeling and regret integration.Exact compact Lean statement |
BanditRLProof.MOSS.historyAlgorithm | Compiled | Concrete measurable fixed-horizon Algorithm 7 history policy, used by the compiled common-history expected-regret theorem.Exact compact Lean statement |
BanditRLProof.MOSS.selected_index_gt_mean_add_half_gap | Compiled | Deterministic large-gap selection step under an explicit optimism-deficit premise, not a concentration bound.Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianMills_lower_integral | Compiled | Exact lower integral bound of Eq. (13.4).Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianMills_upper_integral | Compiled | Exact upper integral bound of Eq. (13.4), with denominator constant 4/pi.Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianSampleMeanZeroErrorProbability_source_bounds | Compiled | Exact printed Eq. (13.1) for n>0 and Delta>0, with denominator constants 16 and 32/pi.Exact compact Lean statement |
BanditRLProof.LowerBounds.worstCaseExpectedRegret | Compiled | Worst-case ENNReal supremum over an explicit environment class.Exact compact Lean statement |
BanditRLProof.LowerBounds.minimaxExpectedRegret | Compiled | Minimax ENNReal infimum over an explicit policy class.Exact compact Lean statement |
BanditRLProof.LowerBounds.IsMinimaxOptimal | Compiled | Admissibility plus attainment for fixed policy/environment classes and a horizon-indexed regret functional.Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianSampleMeanVariance_pos | Compiled | Nondegenerate variance 1/n for a positive sample size.Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianIIDObservationLaw | Compiled | Canonical finite product law of independent N(mu,1) coordinates.Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianIIDSumLaw | Compiled | Exact N(n mu,n) law of the coordinate sum by characteristic-function factorization.Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianIIDSampleMeanLaw | Compiled | Exact N(mu,1/n) pushforward law of the arithmetic mean for n>0.Exact compact Lean statement |
BanditRLProof.LowerBounds.twoPointGaussianThresholdDecision_zero_error_event | Compiled | The zero-mean midpoint decision error is exactly the source event [Delta/2,infinity).Exact compact Lean statement |
BanditRLProof.LowerBounds.twoPointGaussianThresholdDecision_gap_error_event | Compiled | The positive-mean midpoint decision error is exactly the symmetric lower-half event.Exact compact Lean statement |
BanditRLProof.LowerBounds.hasSubgaussianMGF_id_gaussianReal_zero | Compiled | Exact Gaussian MGF supplies the centered sub-Gaussian proxy.Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianSampleMeanThresholdRisk_le_exp | Compiled | Source-shaped two-hypothesis maximum-risk Chernoff companion exp(-n Delta^2/8), explicitly not Eq. (13.1).Exact compact Lean statement |
BanditRLProof.LowerBounds.expectedRegret_le_worstCaseExpectedRegret | Compiled | One member is below the class supremum.Exact compact Lean statement |
BanditRLProof.LowerBounds.minimaxExpectedRegret_le_worstCaseExpectedRegret | Compiled | The infimum is below every admissible policy value.Exact compact Lean statement |
BanditRLProof.LowerBounds.le_minimaxExpectedRegret | Compiled | A uniform policywise lower bound passes through the minimax infimum.Exact compact Lean statement |
BanditRLProof.LowerBounds.exists_alternative_le_average | Compiled | Reusable finite averaging leaf.Exact compact Lean statement |
BanditRLProof.LowerBounds.alternativeExpectedPullBudget_le | Compiled | Remove the nonnegative distinguished-arm contribution from the exact total.Exact compact Lean statement |
BanditRLProof.LowerBounds.exists_leastExploredAlternative | Compiled | Source-shaped Fin.succ alternative-arm conclusion.Exact compact Lean statement |
BanditRLProof.LowerBounds.baseEnvironmentRegret | Compiled | Equation (13.2) deterministic expression.Exact compact Lean statement |
BanditRLProof.LowerBounds.changedEnvironmentRegretLowerBound | Compiled | Equation (13.3) lower expression.Exact compact Lean statement |
BanditRLProof.LowerBounds.max_base_changed_regretLowerBound_ge_half_sub_error | Compiled | Quantitative two-environment algebra with the cross-law pull discrepancy exposed as an error premise.Exact compact Lean statement |
BanditRLProof.LowerBounds.max_base_changed_regretLowerBound_ge_half | Compiled | Zero-error directional corollary of the quantitative algebra.Exact compact Lean statement |
BanditRLProof.LowerBounds.unitGaussianMinimaxExpectedPseudoRegret_ge_one_div_fiftyFour_sqrt | Compiled | Chapter 13 source-order terminal, derived from the exact Chapter 15 theorem with c=1/54.Exact compact Lean statement |
Dependency graph
minimaxminimax / worst-case semanticsCompiledminimax-optimalfixed-class minimax optimalityCompiledgaussian-iid-meanfinite iid Gaussian empirical-mean lawCompiledgaussian-testmidpoint Gaussian error events and Chernoff upperCompiledeq-13-1exact two-sided Mills-ratio Eq. (13.1)Compiledbudgetexpected pull budgetCompiledleastleast-explored alternativeCompiledalgebratwo-environment algebraCompiledtransportsame-policy history KL transportCompiledtheorem-13-1Gaussian minimax terminalCompiledmoss-upperfixed-horizon MOSS common-history upper boundCompiledbroad-near-minimaxbroad-class near-minimax factor 2160CompiledReading path
- Read the source statement and its explicit Chapter 15 proof deferral.
- Inspect the minimax definitions and minimax-optimality predicate before the averaging lemma.
- Inspect the finite iid Gaussian mean-law bridge and midpoint error events, then trace the exact Mills-ratio Eq. (13.1) and the separate maximum-risk Chernoff companion.
- Check the Fin.succ indexing: source arms 2,…,k become Lean alternatives 0,…,m−1.
- Read the quantitative algebra theorem and locate its visible cross-environment error premise.
- Continue through the compiled Chapter 14 event-testing foundation and Chapter 15 Gaussian theorem, then inspect the c=1/54 order corollary.
Strict status and remaining gaps
- The frozen main-text contract is complete, including the broader finite-arm 1-subgaussian near-minimax consequence. Integrated proof, rendered export, structured review, PR, main, Pages and live acceptance are recorded for b38630c.
- Optional: Notes 13.2 and Exercises 13.1–13.2 are not formalized and do not block the chapter contract.