Part IV — Lower Bounds for Bandits with Finitely Many Arms
Chapter 16: Instance-Dependent Lower Bounds
Definition 16.1, Theorem 16.2, Lemma 16.3, and Theorem 16.4 compile with the source quantifiers, information branches, constants, and positive-part placement.
Source map
Bandit Algorithms, Tor Lattimore and Csaba Szepesvári, Cambridge University Press (2020), DOI 10.1017/9781108571401.
Chapter DOI. 10.1017/9781108571401.021 · CUP chapter page
- Chapter opening (CUP p. 177 / author-online p. 206 / PDF p. 215)
- §16.1 Asymptotic Bounds (CUP pp. 177–179 / author-online pp. 207–208 / PDF pp. 216–217; Definition 16.1 and Theorem 16.2)
- §16.2 Finite-Time Bounds (CUP p. 180 / author-online pp. 209–210 / PDF pp. 218–219; Lemma 16.3 and Theorem 16.4)
- §16.3 Notes (CUP p. 181 / author-online p. 210 / PDF p. 219)
- §16.4 Bibliographic Remarks (CUP p. 181 / author-online p. 211 / PDF p. 220)
- §16.5 Exercises (CUP pp. 181–184 / author-online pp. 211–214 / PDF pp. 220–223)
Learning goals
- Read consistency with its exact quantifier order: every environment and every real exponent p greater than zero.
- Keep d_inf extended-real, the confusing alternative strictly better, and KL directed from the original arm law to the alternative.
- Trace how consistency controls log(R_n(nu)+R_n(nu-prime))/log(n) before the liminf extraction.
- Separate Theorem 16.2's asymptotic product-class result from Lemma 16.3 and Theorem 16.4's finite-time Gaussian route.
Necessary definitions and statements
Distribution-class information cost
CompiledPer-arm asymptotic information constraint
CompiledFinite-time Gaussian lower-bound shape
CompiledInstance-dependent lower-bound proof flow
- Freeze consistency
Require R_n(pi,nu)/n^p to converge to zero for every environment in the class and every real p>0.
- Choose a confusing alternative
Change one suboptimal arm to a law in its component class whose mean is strictly above the original optimal mean and whose original-to-alternative KL approaches d_inf.
- Lift arm KL to history KL
Use the compiled one-arm specialization of the one-common-policy Lemma 15.1 identity to obtain the original-law realized expected pull-count cost.
- Charge both event errors
The compiled finite-mean environment producer identifies the original gap and changed optimality margin, closing the exact Lemma 16.3 inequality under the same canonical history laws.
- Extract the rate
Use consistency to bound each alternative cost, aggregate inverse costs with the extended-real inverse-infimum identity, and apply finite-count Fatou to obtain Theorem 16.2.
- Specialize finite time
The compiled Theorem 16.4 shifts a Gaussian mean by Delta_i(1+epsilon), proves local-class membership and exact KL, and retains the positive part and factor 2/(1+epsilon)^2.
Key source theorem and boundary
Definition 16.1, Theorem 16.2, Lemma 16.3, and Theorem 16.4
Chapter 16 turns one-arm change of measure into asymptotic and finite-time instance-dependent regret obstructions.
Lean correspondence
Only declarations that exist in the current index and pass the verified build may render as compiled.
| Lean declaration | Status | Role and exact type |
|---|---|---|
BanditRLProof.LowerBounds.IsConsistentRegret | Compiled | Exact scalar every-positive-real-power consistency predicate.Exact compact Lean statement |
BanditRLProof.LowerBounds.IsConsistentPolicyOver | Compiled | Generic environment-class wrapper preserving the source quantifier order.Exact compact Lean statement |
BanditRLProof.LowerBounds.IsConsistentRegret.add | Compiled | Closure for the two-environment regret sum used by Theorem 16.2.Exact compact Lean statement |
BanditRLProof.LowerBounds.IsConsistentRegret.eventually_add_le_rpow | Compiled | Every positive polynomial eventually dominates the regret sum.Exact compact Lean statement |
BanditRLProof.LowerBounds.IsConsistentRegret.eventually_log_add_div_log_le | Compiled | Direction-correct eventual logarithmic growth bound before the limsup step.Exact compact Lean statement |
BanditRLProof.LowerBounds.divergenceInfimum | Compiled | Extended-real distribution-class d_inf with strict mean improvement.Exact compact Lean statement |
BanditRLProof.LowerBounds.divergenceInfimum_le | Compiled | Any confusing alternative upper-bounds d_inf in the original-to-alternative KL direction.Exact compact Lean statement |
BanditRLProof.LowerBounds.parametricDivergenceInfimum | Compiled | Family-indexed form for parametric law classes.Exact compact Lean statement |
BanditRLProof.LowerBounds.parametricDivergenceInfimum_le | Compiled | Strictly better parameter candidate inequality.Exact compact Lean statement |
BanditRLProof.LowerBounds.unitGaussianDivergenceInfimum | Compiled | Unit-variance Gaussian parametric d_inf interface.Exact compact Lean statement |
BanditRLProof.LowerBounds.unitGaussianDivergenceInfimum_le_perturbed | Compiled | Exact cost of the candidate mean muStar+epsilon.Exact compact Lean statement |
BanditRLProof.LowerBounds.unitGaussianDivergenceInfimum_eq | Compiled | Exact unit-variance Gaussian Table 16.1 d_inf formula on the strict suboptimal branch.Exact compact Lean statement |
BanditRLProof.LowerBounds.banditHistoryRelativeEntropy_eq_expectedPulls_mul_of_only_arm_changed | Compiled | One-arm specialization of Lemma 15.1 with original-law expected pulls.Exact compact Lean statement |
BanditRLProof.LowerBounds.oneArmMajorityPullEvent | Compiled | Exact source majority event under the inclusive lastRound convention.Exact compact Lean statement |
BanditRLProof.LowerBounds.bretagnolleHuberScale_expectedPulls_mul_armKL_le_majorityErrors | Compiled | Bretagnolle–Huber information constraint for the two majority-event errors.Exact compact Lean statement |
BanditRLProof.LowerBounds.finiteHistoryGapPseudoRegret | Compiled | Realized finite-history pseudo-regret as an explicit finite sum of gap times pull count.Exact compact Lean statement |
BanditRLProof.LowerBounds.canonicalGapExpectedPseudoRegret_eq_sum_expectedPulls | Compiled | Canonical expected pseudo-regret regrouped as gap times first-law expected pulls for every arm.Exact compact Lean statement |
BanditRLProof.LowerBounds.oneArmMajority_probability_charge_le_expectedPseudoRegret | Compiled | Original-law majority-event probability charged by the positive gap of the changed arm.Exact compact Lean statement |
BanditRLProof.LowerBounds.oneArmMajority_compl_probability_charge_le_expectedPseudoRegret | Compiled | Changed-law complementary event charged by the minimum gap of every non-changed arm.Exact compact Lean statement |
BanditRLProof.LowerBounds.expectedPullCount_ge_log_gapPseudoRegret_of_only_arm_changed | Compiled | Exact factor-one-quarter finite-KL logarithmic consumer for explicit nonnegative gap vectors.Exact compact Lean statement |
BanditRLProof.LowerBounds.expectedPullCount_ge_log_regret_of_exp_testing_bound | Compiled | Scalar logarithmic rearrangement used after the source regret/error producers.Exact compact Lean statement |
BanditRLProof.LowerBounds.FiniteMeanBanditEnvironment | Compiled | Finite arm laws with means certified by Bochner integrals and a certified optimal arm.Exact compact Lean statement |
BanditRLProof.LowerBounds.oneArmMeanChange_produces_gap_contract | Compiled | Source mean-to-gap producer for one changed arm and a uniquely optimal alternative.Exact compact Lean statement |
BanditRLProof.LowerBounds.expectedPullCount_ge_log_regret_changeOfMeasure | Compiled | Exact Lemma 16.3 with original-law pulls, directed KL, and the source minimum.Exact compact Lean statement |
BanditRLProof.LowerBounds.UnitVarianceGaussianBanditEnvironment | Compiled | Unrestricted real mean vectors for the source unit-variance Gaussian class.Exact compact Lean statement |
BanditRLProof.LowerBounds.gaussianExpectedRegret_ge_finiteTimeInstanceDependent | Compiled | Exact Theorem 16.4 with local class, horizon set, positive parts, and published constants.Exact compact Lean statement |
BanditRLProof.LowerBounds.consistentPolicy_liminf_expectedRegret_div_log_ge | Compiled | Exact Theorem 16.2 over finite-mean unstructured classes, with extended-real d_inf and finite-sum liminf.Exact compact Lean statement |
BanditRLProof.LowerBounds.consistentPolicy_liminf_expectedPull_div_log_ge_inv_dInf | Compiled | Exact per-arm information constraint with all extended-real inverse-infimum branches.Exact compact Lean statement |
Dependency graph
ch14Chapter 14 event testingCompiledch15-gaussianChapter 15 unit-Gaussian arm KLCompiledconsistencyDefinition 16.1 consistency and log growthCompileddinfextended-real d_inf and candidate inequalitiesCompiledgaussian-dinfexact Gaussian d_inf equalityCompiledhistoryone-arm history KL and majority-event informationCompiledscalarfinite-KL and scalar log assemblyCompiledevent-regretcanonical gap pseudo-regret and both event-error chargesCompiledmean-gapfinite arm-law means to source gap vectorsCompiledasymptoticTheorem 16.2 liminf regret terminalCompiledfiniteLemma 16.3 and Theorem 16.4CompiledReading path
- Read Definition 16.1 and verify the order forall environment, forall real p>0.
- Read d_inf and Theorem 16.2 with strict alternative mean, original-to-alternative KL, and an unstructured product class.
- Trace the source event A={T_i(n)>n/2}, the two regret laws, and the compiled subpolynomial log-growth adapter.
- Read Lemma 16.3 before Theorem 16.4 and preserve the unit-Gaussian local class, selected horizon set, constants, and positive part.
- Inspect the finite-mean producer and all three source terminals; trace exact n-pull horizons, inverse-infimum aggregation, and finite-count Fatou in Theorem 16.2.
Strict status and remaining gaps
None recorded.