BanditRLlib
Lean gate passed before this site build; local proof declarations are shown as compiled.Lean-verified build · exact declarations linked.

Lean module · UCB

BanditRLProof.Algorithms.UCB

UCB surfaces

Module map

Declarations
142
Placeholders
0

Imports

BanditRLProof.ConcentrationSubGaussian, BanditRLProof.ConcentrationVariance, BanditRLProof.ExpectationPullCount, BanditRLProof.ExpectationSums, BanditRLProof.MeasurablePullCount, BanditRLProof.PolicyMeasurability, BanditRLProof.ProbabilityUnionBound, BanditRLProof.Regret

Imported by

BanditRLProof, BanditRLProof.Algorithms.MOSS, BanditRLProof.Algorithms.UCBConditionalRewardLaw, BanditRLProof.Algorithms.UCBRealHistoryIndex, BanditRLProof.Literature

Declarations

Open an item to read its exact compact statement and source link. Detailed teaching notes are linked when registered.

structure BanditRLProof.UCB.Spec Compiled

Parameters for a finite-arm UCB run.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.Spec

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

structure Spec (K : Nat) where
structure BanditRLProof.UCB.IndexState Compiled

State visible to an index policy at one time step.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.IndexState

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

structure IndexState (K : Nat) where
def BanditRLProof.UCB.score Compiled

Placeholder score surface for the first dependency-light layer. The Mathlib/LML migration will refine this to `mean + sqrt (2 * c * log n / pulls)`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.score

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def score (_spec : Spec K) (state : IndexState K) (arm : Fin K) : Rat
theorem BanditRLProof.UCB.score_eq_empiricalMean Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.score_eq_empiricalMean

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

@[simp] theorem score_eq_empiricalMean (spec : Spec K) (state : IndexState K) (arm : Fin K) : score spec state arm = state.empiricalMean arm
def BanditRLProof.UCB.confidenceScore Compiled

Real-valued UCB confidence score `empirical mean + radius`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceScore

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def confidenceScore {Arm : Type} (empiricalMean radius : Arm -> Real) (arm : Arm) : Real
theorem BanditRLProof.UCB.confidenceScore_apply Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceScore_apply

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

@[simp] theorem confidenceScore_apply {Arm : Type} (empiricalMean radius : Arm -> Real) (arm : Arm) : confidenceScore empiricalMean radius arm = empiricalMean arm + radius arm
theorem BanditRLProof.UCB.score_le_foldl_select Compiled Internal helper

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.score_le_foldl_select

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

private theorem score_le_foldl_select {K : Nat} (scores : Fin K -> Real) (init : Fin K) : forall l : List (Fin K), (forall a : Fin K, List.Mem a l -> scores a <= scores (l.foldl (fun best arm : Fin K => if scores best < scores arm then arm else best) init)) /\ scores init <= scores (l.foldl (fun best arm : Fin K => if scores best < scores arm then arm else best) init) | [] => by exact And.intro (by intro _ ha cases ha) (by simp) | arm :: rest => by let select := fun best arm : Fin K => if scores best < scores arm then arm else best let next := select init arm have ih
def BanditRLProof.UCB.scoreArgmax Compiled

Concrete finite-arm Real score argmax selector. The selector scans `List.finRange K`, keeps the previous arm on ties, and uses `hK` only to seed the nonempty finite arm set. This mirrors the ETC argmax oracle but targets the Real-valued UCB confidence-score surface.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.scoreArgmax

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def scoreArgmax {K : Nat} (hK : 0 < K) (scores : Fin K -> Real) : Fin K
theorem BanditRLProof.UCB.scoreArgmax_spec Compiled

The concrete Real score argmax dominates every arm score.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.scoreArgmax_spec

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem scoreArgmax_spec {K : Nat} (hK : 0 < K) (scores : Fin K -> Real) (a : Fin K) : scores a <= scores (scoreArgmax hK scores)
def BanditRLProof.UCB.confidenceScoreArgmaxAction Compiled

Concrete UCB action that maximizes the current confidence score.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceScoreArgmaxAction

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def confidenceScoreArgmaxAction {Omega : Type} {K : Nat} (hK : 0 < K) (empiricalMean : Omega -> Nat -> Fin K -> Real) (radius : Nat -> Fin K -> Real) : Omega -> Nat -> Fin K
theorem BanditRLProof.UCB.confidenceScoreArgmaxAction_score_max Compiled

The concrete confidence-score argmax action supplies score maximality against any comparison arm.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceScoreArgmaxAction_score_max

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem confidenceScoreArgmaxAction_score_max {Omega : Type} {K : Nat} (hK : 0 < K) (empiricalMean : Omega -> Nat -> Fin K -> Real) (radius : Nat -> Fin K -> Real) (omega : Omega) (t : Nat) (arm : Fin K) : confidenceScore (empiricalMean omega t) (radius t) arm <= confidenceScore (empiricalMean omega t) (radius t) (confidenceScoreArgmaxAction hK empiricalMean radius omega t)
theorem BanditRLProof.UCB.confidenceScoreArgmaxAction_score_max_of_selected Compiled

Selected-arm form of `confidenceScoreArgmaxAction_score_max`, matching the abstract selected-action bridge contract.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceScoreArgmaxAction_score_max_of_selected

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem confidenceScoreArgmaxAction_score_max_of_selected {Omega : Type} {K : Nat} (hK : 0 < K) (empiricalMean : Omega -> Nat -> Fin K -> Real) (radius : Nat -> Fin K -> Real) (omega : Omega) (t : Nat) (best chosen : Fin K) (hselected : confidenceScoreArgmaxAction hK empiricalMean radius omega t = chosen) : confidenceScore (empiricalMean omega t) (radius t) best <= confidenceScore (empiricalMean omega t) (radius t) chosen
def BanditRLProof.UCB.meanGap Compiled

Mean gap against a designated best arm for Real-valued UCB algebra.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.meanGap

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def meanGap {Arm : Type} (trueMean : Arm -> Real) (best arm : Arm) : Real
theorem BanditRLProof.UCB.meanGap_apply Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.meanGap_apply

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

@[simp] theorem meanGap_apply {Arm : Type} (trueMean : Arm -> Real) (best arm : Arm) : meanGap trueMean best arm = trueMean best - trueMean arm
theorem BanditRLProof.UCB.meanGap_le_two_radius_of_confidenceScore_max Compiled

UCB good-event algebra: if the best arm's true mean is below its upper confidence score, the chosen arm's true mean is above its lower confidence score, and the chosen arm maximizes the confidence score against the best arm, then the chosen arm's mean gap is at most twice its radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.meanGap_le_two_radius_of_confidenceScore_max

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem meanGap_le_two_radius_of_confidenceScore_max {Arm : Type} (trueMean empiricalMean radius : Arm -> Real) (best chosen : Arm) (hbest_upper : trueMean best <= confidenceScore empiricalMean radius best) (hchosen_lower : empiricalMean chosen - radius chosen <= trueMean chosen) (hscore : confidenceScore empiricalMean radius best <= confidenceScore empiricalMean radius chosen) : meanGap trueMean best chosen <= 2 * radius chosen
theorem BanditRLProof.UCB.not_two_radius_lt_meanGap_of_confidenceScore_max Compiled

Contrapositive consumer for the UCB good-event algebra: under the same good event and score-maximality hypotheses, a strict `2 * radius < gap` certificate rules out choosing that arm.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.not_two_radius_lt_meanGap_of_confidenceScore_max

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem not_two_radius_lt_meanGap_of_confidenceScore_max {Arm : Type} (trueMean empiricalMean radius : Arm -> Real) (best chosen : Arm) (hbest_upper : trueMean best <= confidenceScore empiricalMean radius best) (hchosen_lower : empiricalMean chosen - radius chosen <= trueMean chosen) (hscore : confidenceScore empiricalMean radius best <= confidenceScore empiricalMean radius chosen) (hgap_large : 2 * radius chosen < meanGap trueMean best chosen) : False
def BanditRLProof.UCB.upperConfidenceBad Compiled

Upper-confidence failure for a random empirical-mean surface.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.upperConfidenceBad

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def upperConfidenceBad {Omega Arm : Type} (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (arm : Arm) : Set Omega
def BanditRLProof.UCB.lowerConfidenceBad Compiled

Lower-confidence failure for a random empirical-mean surface.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lowerConfidenceBad

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def lowerConfidenceBad {Omega Arm : Type} (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (arm : Arm) : Set Omega
theorem BanditRLProof.UCB.measurableSet_upperConfidenceBad Compiled

Upper-confidence failure is measurable when the arm empirical mean is measurable.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measurableSet_upperConfidenceBad

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurableSet_upperConfidenceBad {Omega Arm : Type} [MeasurableSpace Omega] (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (arm : Arm) (hmeas : Measurable (fun omega : Omega => empiricalMean omega arm)) : MeasurableSet (upperConfidenceBad trueMean empiricalMean radius arm)
theorem BanditRLProof.UCB.measurableSet_lowerConfidenceBad Compiled

Lower-confidence failure is measurable when the arm empirical mean is measurable.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measurableSet_lowerConfidenceBad

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurableSet_lowerConfidenceBad {Omega Arm : Type} [MeasurableSpace Omega] (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (arm : Arm) (hmeas : Measurable (fun omega : Omega => empiricalMean omega arm)) : MeasurableSet (lowerConfidenceBad trueMean empiricalMean radius arm)
def BanditRLProof.UCB.confidenceBadEvent Compiled

The finite-arm UCB confidence bad event, as a union of upper/lower failures.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceBadEvent

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def confidenceBadEvent {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) : Set Omega
theorem BanditRLProof.UCB.measurableSet_confidenceBadEvent Compiled

The finite-arm UCB confidence bad event is measurable from per-arm empirical-mean measurability.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measurableSet_confidenceBadEvent

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurableSet_confidenceBadEvent {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (hmeas : forall arm : Arm, Measurable (fun omega : Omega => empiricalMean omega arm)) : MeasurableSet (confidenceBadEvent trueMean empiricalMean radius)
theorem BanditRLProof.UCB.not_upperConfidenceBad_of_not_confidenceBadEvent Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.not_upperConfidenceBad_of_not_confidenceBadEvent

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem not_upperConfidenceBad_of_not_confidenceBadEvent {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (omega : Omega) (arm : Arm) (hgood : omega ∉ confidenceBadEvent trueMean empiricalMean radius) : omega ∉ upperConfidenceBad trueMean empiricalMean radius arm
theorem BanditRLProof.UCB.not_lowerConfidenceBad_of_not_confidenceBadEvent Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.not_lowerConfidenceBad_of_not_confidenceBadEvent

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem not_lowerConfidenceBad_of_not_confidenceBadEvent {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (omega : Omega) (arm : Arm) (hgood : omega ∉ confidenceBadEvent trueMean empiricalMean radius) : omega ∉ lowerConfidenceBad trueMean empiricalMean radius arm
theorem BanditRLProof.UCB.meanGap_le_two_radius_of_not_confidenceBadEvent Compiled

Event-level UCB good-event consumer: outside the finite-arm confidence bad event, score maximality against the best arm implies the standard `gap <= 2 * chosenRadius` conclusion.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.meanGap_le_two_radius_of_not_confidenceBadEvent

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem meanGap_le_two_radius_of_not_confidenceBadEvent {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (omega : Omega) (best chosen : Arm) (hgood : omega ∉ confidenceBadEvent trueMean empiricalMean radius) (hscore : confidenceScore (empiricalMean omega) radius best <= confidenceScore (empiricalMean omega) radius chosen) : meanGap trueMean best chosen <= 2 * radius chosen
theorem BanditRLProof.UCB.measure_confidenceBadEvent_le_sum_upper_lower Compiled

Finite-arm union bound for the UCB confidence bad event. This is still an outer-measure bound: it does not require measurability of the upper/lower confidence failure events.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_confidenceBadEvent_le_sum_upper_lower

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_confidenceBadEvent_le_sum_upper_lower {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) : mu (confidenceBadEvent trueMean empiricalMean radius) <= (Finset.univ : Finset Arm).sum (fun arm => mu (upperConfidenceBad trueMean empiricalMean radius arm) + mu (lowerConfidenceBad trueMean empiricalMean radius arm))
def BanditRLProof.UCB.confidenceBadEventAt Compiled

Time-indexed UCB confidence bad event.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceBadEventAt

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def confidenceBadEventAt {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (t : Nat) : Set Omega
theorem BanditRLProof.UCB.measurableSet_confidenceBadEventAt Compiled

The time-indexed UCB confidence bad event is measurable from per-arm empirical mean measurability at that time.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measurableSet_confidenceBadEventAt

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurableSet_confidenceBadEventAt {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (t : Nat) (hmeas : forall arm : Arm, Measurable (fun omega : Omega => empiricalMean omega t arm)) : MeasurableSet (confidenceBadEventAt trueMean empiricalMean radius t)
def BanditRLProof.UCB.finiteHorizonConfidenceBadEvent Compiled

Finite-horizon union of time-indexed UCB confidence bad events.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.finiteHorizonConfidenceBadEvent

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def finiteHorizonConfidenceBadEvent {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (T : Nat) : Set Omega
theorem BanditRLProof.UCB.not_confidenceBadEventAt_of_not_finiteHorizonConfidenceBadEvent Compiled

Outside the finite-horizon confidence bad event, every time-indexed bad event inside the horizon is absent.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.not_confidenceBadEventAt_of_not_finiteHorizonConfidenceBadEvent

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem not_confidenceBadEventAt_of_not_finiteHorizonConfidenceBadEvent {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (T : Nat) (omega : Omega) (t : Nat) (ht : t < T) (hgood : omega ∉ finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) : omega ∉ confidenceBadEventAt trueMean empiricalMean radius t
theorem BanditRLProof.UCB.meanGap_le_two_radius_of_not_finiteHorizonConfidenceBadEvent Compiled

Finite-horizon good-event consumer: outside the finite-horizon confidence bad event, score maximality at any `t < T` gives the standard UCB gap-radius bound for the chosen arm.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.meanGap_le_two_radius_of_not_finiteHorizonConfidenceBadEvent

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem meanGap_le_two_radius_of_not_finiteHorizonConfidenceBadEvent {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (T : Nat) (omega : Omega) (t : Nat) (best chosen : Arm) (ht : t < T) (hgood : omega ∉ finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) (hscore : confidenceScore (empiricalMean omega t) (radius t) best <= confidenceScore (empiricalMean omega t) (radius t) chosen) : meanGap trueMean best chosen <= 2 * radius t chosen
theorem BanditRLProof.UCB.mem_finiteHorizonConfidenceBadEvent_of_two_radius_lt_meanGap_of_score_max Compiled

Contrapositive finite-horizon good-event consumer: if a chosen arm's gap is larger than twice its current radius and it beats the best arm's UCB score, the finite-horizon confidence bad event must occur.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.mem_finiteHorizonConfidenceBadEvent_of_two_radius_lt_meanGap_of_score_max

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem mem_finiteHorizonConfidenceBadEvent_of_two_radius_lt_meanGap_of_score_max {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (T : Nat) (omega : Omega) (t : Nat) (best chosen : Arm) (ht : t < T) (hscore : confidenceScore (empiricalMean omega t) (radius t) best <= confidenceScore (empiricalMean omega t) (radius t) chosen) (hgap_large : 2 * radius t chosen < meanGap trueMean best chosen) : omega ∈ finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T
theorem BanditRLProof.UCB.scoreMaxEvent_subset_finiteHorizonConfidenceBadEvent_of_two_radius_lt_meanGap Compiled

Event-level form of the finite-horizon large-gap consumer. This is the set inclusion shape needed before applying measure monotonicity in pull-count arguments.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.scoreMaxEvent_subset_finiteHorizonConfidenceBadEvent_of_two_radius_lt_meanGap

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem scoreMaxEvent_subset_finiteHorizonConfidenceBadEvent_of_two_radius_lt_meanGap {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (T : Nat) (t : Nat) (best chosen : Arm) (ht : t < T) (hgap_large : 2 * radius t chosen < meanGap trueMean best chosen) : {omega : Omega | confidenceScore (empiricalMean omega t) (radius t) best <= confidenceScore (empiricalMean omega t) (radius t) chosen} ⊆ finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_sum_upper_lower Compiled

Finite-horizon union bound for UCB confidence bad events. This assembles the single-time upper/lower confidence-event union bound across `t < T`. It does not produce concentration tails or simplify the resulting double finite sum.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_sum_upper_lower

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_sum_upper_lower {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (T : Nat) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => mu (upperConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (radius t) arm) + mu (lowerConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (radius t) arm)))
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_tail_sum Compiled

Finite-horizon tail-bound consumer for UCB confidence bad events. The hypotheses `hupper` and `hlower` are the per-time/per-arm concentration inputs for the upper and lower confidence failures. This wrapper only assembles those local tail budgets across `t < T` and finite arms.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_tail_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_tail_sum {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (upperTail lowerTail : Nat -> Arm -> ENNReal) (T : Nat) (hupper : forall t arm, t < T -> mu (upperConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (radius t) arm) <= upperTail t arm) (hlower : forall t arm, t < T -> mu (lowerConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (radius t) arm) <= lowerTail t arm) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => upperTail t arm + lowerTail t arm))
theorem BanditRLProof.UCB.upperConfidenceBad_subset_absDeviation Compiled

An upper-confidence failure implies an absolute empirical-mean deviation at least as large as the radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.upperConfidenceBad_subset_absDeviation

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem upperConfidenceBad_subset_absDeviation {Omega Arm : Type} (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (arm : Arm) : upperConfidenceBad trueMean empiricalMean radius arm ⊆ {omega | radius arm <= |empiricalMean omega arm - trueMean arm|}
theorem BanditRLProof.UCB.lowerConfidenceBad_subset_absDeviation Compiled

A lower-confidence failure implies an absolute empirical-mean deviation at least as large as the radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lowerConfidenceBad_subset_absDeviation

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lowerConfidenceBad_subset_absDeviation {Omega Arm : Type} (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (arm : Arm) : lowerConfidenceBad trueMean empiricalMean radius arm ⊆ {omega | radius arm <= |empiricalMean omega arm - trueMean arm|}
theorem BanditRLProof.UCB.measure_upperConfidenceBad_le_absDeviation Compiled

Measure monotonicity form of `upperConfidenceBad_subset_absDeviation`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_upperConfidenceBad_le_absDeviation

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_upperConfidenceBad_le_absDeviation {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (arm : Arm) : mu (upperConfidenceBad trueMean empiricalMean radius arm) <= mu {omega | radius arm <= |empiricalMean omega arm - trueMean arm|}
theorem BanditRLProof.UCB.measure_lowerConfidenceBad_le_absDeviation Compiled

Measure monotonicity form of `lowerConfidenceBad_subset_absDeviation`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_lowerConfidenceBad_le_absDeviation

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_lowerConfidenceBad_le_absDeviation {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) (trueMean : Arm -> Real) (empiricalMean : Omega -> Arm -> Real) (radius : Arm -> Real) (arm : Arm) : mu (lowerConfidenceBad trueMean empiricalMean radius arm) <= mu {omega | radius arm <= |empiricalMean omega arm - trueMean arm|}
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_absDeviation_tail_sum Compiled

Finite-horizon UCB confidence bad-event bound from absolute-deviation tails. This is the UCB-facing adapter for concentration inequalities that bound `mu {omega | radius <= |empiricalMean - trueMean|}`. The same absolute deviation tail controls both the upper and lower confidence failures.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_absDeviation_tail_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_absDeviation_tail_sum {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (tail : Nat -> Arm -> ENNReal) (T : Nat) (htail : forall t arm, t < T -> mu {omega | radius t arm <= |empiricalMean omega t arm - trueMean arm|} <= tail t arm) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => tail t arm + tail t arm))
def BanditRLProof.UCB.chebyshevAbsDeviationTail Compiled

Chebyshev tail budget for a UCB empirical mean at time `t` and arm `arm`. This is intentionally an abstract finite-variance budget: it does not prove the variance rate of an empirical mean or choose a log/sqrt UCB radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.chebyshevAbsDeviationTail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def chebyshevAbsDeviationTail {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (t : Nat) (arm : Arm) : ENNReal
theorem BanditRLProof.UCB.measure_absDeviation_le_chebyshev_tail Compiled

Single-time Chebyshev tail for the UCB absolute-deviation event, under an explicit mean-identification contract.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_absDeviation_le_chebyshev_tail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_absDeviation_le_chebyshev_tail {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hmem : MemLp (fun omega : Omega => empiricalMean omega t arm) 2 mu) (hradius : 0 < radius t arm) (hmean : integral mu (fun omega : Omega => empiricalMean omega t arm) = trueMean arm) : mu {omega | radius t arm <= |empiricalMean omega t arm - trueMean arm|} <= chebyshevAbsDeviationTail mu empiricalMean radius t arm
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_chebyshev_tail_sum Compiled

Finite-horizon UCB confidence bad-event bound from Chebyshev absolute-deviation tails. This is a concrete concentration producer for the abstract absolute-deviation tail adapter. It still leaves empirical-mean construction, variance-rate simplification, log/sqrt radius choice, pull-count bounds, and final regret to later leaves.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_chebyshev_tail_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_chebyshev_tail_sum {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (T : Nat) (hmem : forall t arm, t < T -> MemLp (fun omega : Omega => empiricalMean omega t arm) 2 mu) (hradius : forall t arm, t < T -> 0 < radius t arm) (hmean : forall t arm, t < T -> integral mu (fun omega : Omega => empiricalMean omega t arm) = trueMean arm) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => chebyshevAbsDeviationTail mu empiricalMean radius t arm + chebyshevAbsDeviationTail mu empiricalMean radius t arm))
def BanditRLProof.UCB.subGaussianOneSidedDeviationTail Compiled

One-sided sub-Gaussian tail budget for a UCB empirical mean at time `t` and arm `arm`. The proxy is for the centered variable `empiricalMean t arm - trueMean arm`. This one-sided budget is the sharper producer for the existing upper/lower confidence tail consumer; the absolute-deviation wrapper remains available for two-sided concentration statements.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianOneSidedDeviationTail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def subGaussianOneSidedDeviationTail {Arm : Type} (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (t : Nat) (arm : Arm) : ENNReal
theorem BanditRLProof.UCB.subGaussianOneSidedDeviationTail_le_exp_neg_budget Compiled

Radius-budget simplification for the one-sided UCB sub-Gaussian tail. If `radius^2` dominates `2 * proxy * budget`, the canonical exponential producer is bounded by `exp (-budget)`. This is the algebraic handoff between abstract sub-Gaussian tails and later log/sqrt UCB radius choices.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianOneSidedDeviationTail_le_exp_neg_budget

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianOneSidedDeviationTail_le_exp_neg_budget {Arm : Type} (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) (hradius_sq : 2 * ((proxy t arm : NNReal) : Real) * budget t arm <= (radius t arm) ^ 2) : subGaussianOneSidedDeviationTail radius proxy t arm <= ENNReal.ofReal (Real.exp (-(budget t arm)))
def BanditRLProof.UCB.subGaussianBudgetRadius Compiled

Concrete square-root radius associated with a one-sided sub-Gaussian budget. The budget is left abstract so later leaves can instantiate it with logarithmic schedules such as `log (T * |A| / delta)`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianBudgetRadius

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def subGaussianBudgetRadius {Arm : Type} (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) : Nat -> Arm -> Real
theorem BanditRLProof.UCB.subGaussianBudgetRadius_nonneg Compiled

The concrete square-root budget radius is nonnegative.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianBudgetRadius_nonneg

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianBudgetRadius_nonneg {Arm : Type} (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (t : Nat) (arm : Arm) : 0 <= subGaussianBudgetRadius proxy budget t arm
theorem BanditRLProof.UCB.subGaussianBudgetRadius_sq_domination Compiled

The concrete square-root budget radius satisfies the radius-square domination contract consumed by `subGaussianOneSidedDeviationTail_le_exp_neg_budget`. This uses `Real.sq_sqrt'`, so it does not need a separate nonnegativity assumption on `budget`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianBudgetRadius_sq_domination

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianBudgetRadius_sq_domination {Arm : Type} (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (t : Nat) (arm : Arm) : 2 * ((proxy t arm : NNReal) : Real) * budget t arm <= (subGaussianBudgetRadius proxy budget t arm) ^ 2
theorem BanditRLProof.UCB.subGaussianOneSidedDeviationTail_budgetRadius_le_exp_neg_budget Compiled

One-sided sub-Gaussian tail bound specialized to the concrete square-root budget radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianOneSidedDeviationTail_budgetRadius_le_exp_neg_budget

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianOneSidedDeviationTail_budgetRadius_le_exp_neg_budget {Arm : Type} (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) : subGaussianOneSidedDeviationTail (subGaussianBudgetRadius proxy budget) proxy t arm <= ENNReal.ofReal (Real.exp (-(budget t arm)))
theorem BanditRLProof.UCB.measure_upperConfidenceBad_le_subGaussian_tail Compiled

Single-time one-sided sub-Gaussian tail for an upper-confidence failure.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_upperConfidenceBad_le_subGaussian_tail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_upperConfidenceBad_le_subGaussian_tail {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (t : Nat) (arm : Arm) (hradius : 0 <= radius t arm) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (upperConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (radius t) arm) <= subGaussianOneSidedDeviationTail radius proxy t arm
theorem BanditRLProof.UCB.measure_upperConfidenceBad_le_subGaussian_exp_neg_budget Compiled

Single-time upper-confidence failure bound with an explicit exponential budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_upperConfidenceBad_le_subGaussian_exp_neg_budget

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_upperConfidenceBad_le_subGaussian_exp_neg_budget {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hradius : 0 <= radius t arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) (hradius_sq : 2 * ((proxy t arm : NNReal) : Real) * budget t arm <= (radius t arm) ^ 2) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (upperConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (radius t) arm) <= ENNReal.ofReal (Real.exp (-(budget t arm)))
theorem BanditRLProof.UCB.measure_upperConfidenceBad_le_subGaussian_budgetRadius Compiled

Single-time upper-confidence failure bound for the concrete square-root budget radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_upperConfidenceBad_le_subGaussian_budgetRadius

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_upperConfidenceBad_le_subGaussian_budgetRadius {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (upperConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (subGaussianBudgetRadius proxy budget t) arm) <= ENNReal.ofReal (Real.exp (-(budget t arm)))
theorem BanditRLProof.UCB.measure_lowerConfidenceBad_le_subGaussian_tail Compiled

Single-time one-sided sub-Gaussian tail for a lower-confidence failure.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_lowerConfidenceBad_le_subGaussian_tail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_lowerConfidenceBad_le_subGaussian_tail {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (t : Nat) (arm : Arm) (hradius : 0 <= radius t arm) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (lowerConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (radius t) arm) <= subGaussianOneSidedDeviationTail radius proxy t arm
theorem BanditRLProof.UCB.measure_lowerConfidenceBad_le_subGaussian_exp_neg_budget Compiled

Single-time lower-confidence failure bound with an explicit exponential budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_lowerConfidenceBad_le_subGaussian_exp_neg_budget

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_lowerConfidenceBad_le_subGaussian_exp_neg_budget {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hradius : 0 <= radius t arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) (hradius_sq : 2 * ((proxy t arm : NNReal) : Real) * budget t arm <= (radius t arm) ^ 2) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (lowerConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (radius t) arm) <= ENNReal.ofReal (Real.exp (-(budget t arm)))
theorem BanditRLProof.UCB.measure_lowerConfidenceBad_le_subGaussian_budgetRadius Compiled

Single-time lower-confidence failure bound for the concrete square-root budget radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_lowerConfidenceBad_le_subGaussian_budgetRadius

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_lowerConfidenceBad_le_subGaussian_budgetRadius {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (lowerConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (subGaussianBudgetRadius proxy budget t) arm) <= ENNReal.ofReal (Real.exp (-(budget t arm)))
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_oneSided_tail_sum Compiled

Finite-horizon UCB confidence bad-event bound from one-sided sub-Gaussian upper/lower tails. This is the sharper UCB-facing sub-Gaussian producer for the existing upper/lower tail consumer. It still leaves empirical-mean construction, proxy/radius simplification to the textbook log/sqrt form, pull-count bounds, and final regret to later leaves.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_oneSided_tail_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_subGaussian_oneSided_tail_sum {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (T : Nat) (hradius : forall t arm, t < T -> 0 <= radius t arm) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => subGaussianOneSidedDeviationTail radius proxy t arm + subGaussianOneSidedDeviationTail radius proxy t arm))
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_exp_neg_budget_sum Compiled

Finite-horizon confidence bad-event bound with explicit one-sided exponential budgets. This is the UCB radius-budget handoff: later leaves can instantiate `budget` with a log schedule and prove the displayed radius-square domination.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_exp_neg_budget_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_subGaussian_exp_neg_budget_sum {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (T : Nat) (hradius : forall t arm, t < T -> 0 <= radius t arm) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hradius_sq : forall t arm, t < T -> 2 * ((proxy t arm : NNReal) : Real) * budget t arm <= (radius t arm) ^ 2) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => ENNReal.ofReal (Real.exp (-(budget t arm))) + ENNReal.ofReal (Real.exp (-(budget t arm)))))
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_budgetRadius_sum Compiled

Finite-horizon confidence bad-event bound for the concrete square-root budget radius. This is the direct UCB-facing consumer for later logarithmic budget schedules.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_budgetRadius_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_subGaussian_budgetRadius_sum {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (budget : Nat -> Arm -> Real) (T : Nat) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean (subGaussianBudgetRadius proxy budget) T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => ENNReal.ofReal (Real.exp (-(budget t arm))) + ENNReal.ofReal (Real.exp (-(budget t arm)))))
theorem BanditRLProof.UCB.exp_neg_log_eq_inv Compiled

Elementary log-budget simplification used by UCB tail producers. The positivity hypothesis is the regularity contract for later concrete schedules such as `scale = T * |A| / delta`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.exp_neg_log_eq_inv

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem exp_neg_log_eq_inv {x : Real} (hx : 0 < x) : Real.exp (-(Real.log x)) = x⁻¹
def BanditRLProof.UCB.subGaussianLogBudgetRadius Compiled

Concrete square-root radius with a logarithmic budget. This is still schedule-agnostic: `scale` is the positive quantity whose inverse will become the one-sided tail budget after simplifying `exp (-log scale)`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianLogBudgetRadius

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def subGaussianLogBudgetRadius {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Nat -> Arm -> Real) : Nat -> Arm -> Real
theorem BanditRLProof.UCB.subGaussianLogBudgetRadius_apply Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianLogBudgetRadius_apply

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

@[simp] theorem subGaussianLogBudgetRadius_apply {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Nat -> Arm -> Real) (t : Nat) (arm : Arm) : subGaussianLogBudgetRadius proxy scale t arm = Real.sqrt (2 * ((proxy t arm : NNReal) : Real) * Real.log (scale t arm))
theorem BanditRLProof.UCB.subGaussianLogBudgetRadius_nonneg Compiled

The logarithmic square-root budget radius is nonnegative.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianLogBudgetRadius_nonneg

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianLogBudgetRadius_nonneg {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Nat -> Arm -> Real) (t : Nat) (arm : Arm) : 0 <= subGaussianLogBudgetRadius proxy scale t arm
theorem BanditRLProof.UCB.subGaussianLogBudgetRadius_sq_domination Compiled

The logarithmic square-root budget radius satisfies the square-domination contract with budget `log scale`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianLogBudgetRadius_sq_domination

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianLogBudgetRadius_sq_domination {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Nat -> Arm -> Real) (t : Nat) (arm : Arm) : 2 * ((proxy t arm : NNReal) : Real) * Real.log (scale t arm) <= (subGaussianLogBudgetRadius proxy scale t arm) ^ 2
theorem BanditRLProof.UCB.subGaussianOneSidedDeviationTail_logBudgetRadius_le_inv_scale Compiled

One-sided sub-Gaussian tail bound specialized to a logarithmic square-root budget radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianOneSidedDeviationTail_logBudgetRadius_le_inv_scale

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianOneSidedDeviationTail_logBudgetRadius_le_inv_scale {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) (hscale : 0 < scale t arm) : subGaussianOneSidedDeviationTail (subGaussianLogBudgetRadius proxy scale) proxy t arm <= ENNReal.ofReal ((scale t arm)⁻¹)
theorem BanditRLProof.UCB.measure_upperConfidenceBad_le_subGaussian_logBudgetRadius Compiled

Single-time upper-confidence failure bound for the logarithmic square-root budget radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_upperConfidenceBad_le_subGaussian_logBudgetRadius

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_upperConfidenceBad_le_subGaussian_logBudgetRadius {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (scale : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) (hscale : 0 < scale t arm) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (upperConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (subGaussianLogBudgetRadius proxy scale t) arm) <= ENNReal.ofReal ((scale t arm)⁻¹)
theorem BanditRLProof.UCB.measure_lowerConfidenceBad_le_subGaussian_logBudgetRadius Compiled

Single-time lower-confidence failure bound for the logarithmic square-root budget radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_lowerConfidenceBad_le_subGaussian_logBudgetRadius

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_lowerConfidenceBad_le_subGaussian_logBudgetRadius {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (scale : Nat -> Arm -> Real) (t : Nat) (arm : Arm) (hproxy : 0 < ((proxy t arm : NNReal) : Real)) (hscale : 0 < scale t arm) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (lowerConfidenceBad trueMean (fun omega arm => empiricalMean omega t arm) (subGaussianLogBudgetRadius proxy scale t) arm) <= ENNReal.ofReal ((scale t arm)⁻¹)
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_logBudgetRadius_inv_scale_sum Compiled

Finite-horizon confidence bad-event bound for logarithmic square-root budget radii. This is the schedule-agnostic log-budget producer. Later UCB leaves can set `scale t arm` to a concrete positive expression and then simplify the double sum.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_logBudgetRadius_inv_scale_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_subGaussian_logBudgetRadius_inv_scale_sum {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (scale : Nat -> Arm -> Real) (T : Nat) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hscale : forall t arm, t < T -> 0 < scale t arm) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean (subGaussianLogBudgetRadius proxy scale) T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => ENNReal.ofReal ((scale t arm)⁻¹) + ENNReal.ofReal ((scale t arm)⁻¹)))
def BanditRLProof.UCB.subGaussianConstantLogBudgetRadius Compiled

Logarithmic square-root radius with a constant positive scale. This is the direct finite-horizon shape for later choices such as `scale = T * |A| / delta`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianConstantLogBudgetRadius

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def subGaussianConstantLogBudgetRadius {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Real) : Nat -> Arm -> Real
theorem BanditRLProof.UCB.subGaussianConstantLogBudgetRadius_apply Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianConstantLogBudgetRadius_apply

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

@[simp] theorem subGaussianConstantLogBudgetRadius_apply {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Real) (t : Nat) (arm : Arm) : subGaussianConstantLogBudgetRadius proxy scale t arm = Real.sqrt (2 * ((proxy t arm : NNReal) : Real) * Real.log scale)
theorem BanditRLProof.UCB.subGaussianConstantLogBudgetRadius_nonneg Compiled

Constant logarithmic square-root budget radii are nonnegative.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianConstantLogBudgetRadius_nonneg

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianConstantLogBudgetRadius_nonneg {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Real) (t : Nat) (arm : Arm) : 0 <= subGaussianConstantLogBudgetRadius proxy scale t arm
theorem BanditRLProof.UCB.subGaussianConstantLogBudgetRadius_sq_domination Compiled

Constant logarithmic square-root budget radii satisfy the square-domination contract with budget `log scale`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianConstantLogBudgetRadius_sq_domination

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianConstantLogBudgetRadius_sq_domination {Arm : Type} (proxy : Nat -> Arm -> NNReal) (scale : Real) (t : Nat) (arm : Arm) : 2 * ((proxy t arm : NNReal) : Real) * Real.log scale <= (subGaussianConstantLogBudgetRadius proxy scale t arm) ^ 2
theorem BanditRLProof.UCB.constant_invScale_double_sum Compiled

Double finite sum of a constant inverse-scale one-sided tail budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.constant_invScale_double_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem constant_invScale_double_sum {Arm : Type} [Fintype Arm] (T : Nat) (scale : Real) : (Finset.range T).sum (fun _ => (Finset.univ : Finset Arm).sum (fun _ => ENNReal.ofReal scale⁻¹ + ENNReal.ofReal scale⁻¹)) = HSMul.hSMul T (HSMul.hSMul (Fintype.card Arm) (ENNReal.ofReal scale⁻¹ + ENNReal.ofReal scale⁻¹))
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_constantLogBudgetRadius_card Compiled

Finite-horizon confidence bad-event bound for a constant logarithmic scale, with the time/arm double sum folded into `T` and `Fintype.card Arm`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_constantLogBudgetRadius_card

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_subGaussian_constantLogBudgetRadius_card {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (scale : Real) (T : Nat) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hscale : 0 < scale) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean (subGaussianConstantLogBudgetRadius proxy scale) T) <= HSMul.hSMul T (HSMul.hSMul (Fintype.card Arm) (ENNReal.ofReal scale⁻¹ + ENNReal.ofReal scale⁻¹))
theorem BanditRLProof.UCB.constant_invScale_double_sum_le_of_real Compiled

Convert a constant inverse-scale finite-horizon ENNReal tail budget back to an ordinary real budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.constant_invScale_double_sum_le_of_real

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem constant_invScale_double_sum_le_of_real {Arm : Type} [Fintype Arm] (T : Nat) (scale delta : Real) (hscale : 0 < scale) (hreal : (T : Real) * ((Fintype.card Arm : Real) * (scale⁻¹ + scale⁻¹)) <= delta) : HSMul.hSMul T (HSMul.hSMul (Fintype.card Arm) (ENNReal.ofReal scale⁻¹ + ENNReal.ofReal scale⁻¹)) <= ENNReal.ofReal delta
def BanditRLProof.UCB.textbookDeltaScale Compiled

Textbook UCB finite-horizon scale for allocating two one-sided tails across `T` times and all arms. The factor `2` accounts for upper and lower confidence failures.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.textbookDeltaScale

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def textbookDeltaScale {Arm : Type} [Fintype Arm] (T : Nat) (delta : Real) : Real
theorem BanditRLProof.UCB.textbookDeltaScale_pos Compiled

The textbook delta scale is positive under the usual horizon/arm/delta contracts.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.textbookDeltaScale_pos

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem textbookDeltaScale_pos {Arm : Type} [Fintype Arm] [Nonempty Arm] (T : Nat) (delta : Real) (hT : 0 < T) (hdelta : 0 < delta) : 0 < textbookDeltaScale (Arm := Arm) T delta
theorem BanditRLProof.UCB.textbookDeltaScale_total_inv_budget_eq_delta Compiled

The textbook delta scale makes the folded constant inverse-scale tail budget equal to `delta` at the real-number level.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.textbookDeltaScale_total_inv_budget_eq_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem textbookDeltaScale_total_inv_budget_eq_delta {Arm : Type} [Fintype Arm] [Nonempty Arm] (T : Nat) (delta : Real) (hT : 0 < T) (hdelta : 0 < delta) : (T : Real) * ((Fintype.card Arm : Real) * ((textbookDeltaScale (Arm := Arm) T delta)⁻¹ + (textbookDeltaScale (Arm := Arm) T delta)⁻¹)) = delta
theorem BanditRLProof.UCB.constant_invScale_double_sum_textbookDeltaScale_le_delta Compiled

The folded constant-scale UCB tail budget with textbook delta scale is bounded by `delta`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.constant_invScale_double_sum_textbookDeltaScale_le_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem constant_invScale_double_sum_textbookDeltaScale_le_delta {Arm : Type} [Fintype Arm] [Nonempty Arm] (T : Nat) (delta : Real) (hT : 0 < T) (hdelta : 0 < delta) : HSMul.hSMul T (HSMul.hSMul (Fintype.card Arm) (ENNReal.ofReal (textbookDeltaScale (Arm := Arm) T delta)⁻¹ + ENNReal.ofReal (textbookDeltaScale (Arm := Arm) T delta)⁻¹)) <= ENNReal.ofReal delta
def BanditRLProof.UCB.subGaussianTextbookDeltaRadius Compiled

Textbook delta-scale logarithmic UCB radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadius

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def subGaussianTextbookDeltaRadius {Arm : Type} [Fintype Arm] (proxy : Nat -> Arm -> NNReal) (T : Nat) (delta : Real) : Nat -> Arm -> Real
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadius_apply Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadius_apply

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

@[simp] theorem subGaussianTextbookDeltaRadius_apply {Arm : Type} [Fintype Arm] (proxy : Nat -> Arm -> NNReal) (T : Nat) (delta : Real) (t : Nat) (arm : Arm) : subGaussianTextbookDeltaRadius proxy T delta t arm = Real.sqrt (2 * ((proxy t arm : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Arm) T delta))
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_textbookDeltaRadius_delta Compiled

Finite-horizon confidence bad-event bound for the textbook delta-scale logarithmic UCB radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_textbookDeltaRadius_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_subGaussian_textbookDeltaRadius_delta {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] [Nonempty Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (T : Nat) (delta : Real) (hT : 0 < T) (hdelta : 0 < delta) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) T) <= ENNReal.ofReal delta
theorem BanditRLProof.UCB.measure_scoreMaxEvent_le_subGaussian_textbookDeltaRadius_delta_of_gap Compiled

Large-gap score-max events under the textbook delta radius are controlled by the finite-horizon confidence budget. This is a probability-facing handoff for later pull-count arguments: once a chosen arm has gap larger than twice its current radius, selecting it by UCB score can only happen on the confidence bad event.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_scoreMaxEvent_le_subGaussian_textbookDeltaRadius_delta_of_gap

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_scoreMaxEvent_le_subGaussian_textbookDeltaRadius_delta_of_gap {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] [Nonempty Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (T : Nat) (delta : Real) (t : Nat) (best chosen : Arm) (hT : 0 < T) (hdelta : 0 < delta) (ht : t < T) (hgap_large : 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu {omega : Omega | confidenceScore (empiricalMean omega t) (subGaussianTextbookDeltaRadius proxy T delta t) best <= confidenceScore (empiricalMean omega t) (subGaussianTextbookDeltaRadius proxy T delta t) chosen} <= ENNReal.ofReal delta
theorem BanditRLProof.UCB.selectedEvent_subset_scoreMaxEvent_of_action_score_max Compiled

Selecting `chosen` is contained in the corresponding UCB score-max event when the action trace exposes score maximality against `best`. This is intentionally abstract: the concrete argmax/tie-breaking policy can later discharge `hscore_of_selected`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.selectedEvent_subset_scoreMaxEvent_of_action_score_max

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem selectedEvent_subset_scoreMaxEvent_of_action_score_max {Omega Arm : Type} (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (action : Omega -> Nat -> Arm) (t : Nat) (best chosen : Arm) (hscore_of_selected : forall omega, action omega t = chosen -> confidenceScore (empiricalMean omega t) (radius t) best <= confidenceScore (empiricalMean omega t) (radius t) chosen) : Set.Subset {omega : Omega | action omega t = chosen} {omega : Omega | confidenceScore (empiricalMean omega t) (radius t) best <= confidenceScore (empiricalMean omega t) (radius t) chosen}
theorem BanditRLProof.UCB.measure_selectedLargeGapEvent_le_subGaussian_textbookDeltaRadius_delta Compiled

Selected large-gap arms inherit the textbook delta probability budget once the selected-action trace certifies UCB score maximality. This is the action-trace-facing bridge before a concrete pull-count summation: selection plus a large-gap radius condition implies that the selected event is covered by the finite-horizon confidence bad event.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_selectedLargeGapEvent_le_subGaussian_textbookDeltaRadius_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_selectedLargeGapEvent_le_subGaussian_textbookDeltaRadius_delta {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] [Nonempty Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (action : Omega -> Nat -> Arm) (proxy : Nat -> Arm -> NNReal) (T : Nat) (delta : Real) (t : Nat) (best chosen : Arm) (hT : 0 < T) (hdelta : 0 < delta) (ht : t < T) (hgap_large : 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hscore_of_selected : forall omega, action omega t = chosen -> confidenceScore (empiricalMean omega t) (subGaussianTextbookDeltaRadius proxy T delta t) best <= confidenceScore (empiricalMean omega t) (subGaussianTextbookDeltaRadius proxy T delta t) chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu {omega : Omega | action omega t = chosen} <= ENNReal.ofReal delta
theorem BanditRLProof.UCB.selectedEventOn_subset_finiteHorizonConfidenceBadEvent_of_action_score_max Compiled

Finite-time selected-action events are covered by the finite-horizon confidence bad event when every selected time in the index set has a large enough gap and certifies UCB score maximality. This is the event-level bridge needed before turning selected-time collections into pull-count or suffix-time bounds.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.selectedEventOn_subset_finiteHorizonConfidenceBadEvent_of_action_score_max

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem selectedEventOn_subset_finiteHorizonConfidenceBadEvent_of_action_score_max {Omega Arm : Type} [Fintype Arm] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (action : Omega -> Nat -> Arm) (T : Nat) (times : Finset Nat) (best chosen : Arm) (htimes : forall t, t ∈ times -> t < T) (hscore_of_selected : forall omega t, t ∈ times -> action omega t = chosen -> confidenceScore (empiricalMean omega t) (radius t) best <= confidenceScore (empiricalMean omega t) (radius t) chosen) (hgap_large : forall t, t ∈ times -> 2 * radius t chosen < meanGap trueMean best chosen) : Set.Subset {omega : Omega | exists t, t ∈ times /\ action omega t = chosen} (finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T)
theorem BanditRLProof.UCB.measure_selectedLargeGapEventOn_le_subGaussian_textbookDeltaRadius_delta Compiled

The textbook delta budget also controls the event that a fixed arm is selected at any time from a finite index set, provided each such time satisfies the large-gap radius condition and selected-action score maximality.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_selectedLargeGapEventOn_le_subGaussian_textbookDeltaRadius_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_selectedLargeGapEventOn_le_subGaussian_textbookDeltaRadius_delta {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] [Nonempty Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (action : Omega -> Nat -> Arm) (proxy : Nat -> Arm -> NNReal) (T : Nat) (delta : Real) (times : Finset Nat) (best chosen : Arm) (hT : 0 < T) (hdelta : 0 < delta) (htimes : forall t, t ∈ times -> t < T) (hgap_large : forall t, t ∈ times -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hscore_of_selected : forall omega t, t ∈ times -> action omega t = chosen -> confidenceScore (empiricalMean omega t) (subGaussianTextbookDeltaRadius proxy T delta t) best <= confidenceScore (empiricalMean omega t) (subGaussianTextbookDeltaRadius proxy T delta t) chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu {omega : Omega | exists t, t ∈ times /\ action omega t = chosen} <= ENNReal.ofReal delta
theorem BanditRLProof.UCB.measure_confidenceScoreArgmax_selectedLargeGapEvent_le_subGaussian_textbookDeltaRadius_delta Compiled

Concrete confidence-score argmax version of the selected large-gap delta bound. The score-maximality contract is discharged by `confidenceScoreArgmaxAction`, so the remaining assumptions are the textbook radius/concentration contracts and the large-gap condition for the selected arm.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_confidenceScoreArgmax_selectedLargeGapEvent_le_subGaussian_textbookDeltaRadius_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_confidenceScoreArgmax_selectedLargeGapEvent_le_subGaussian_textbookDeltaRadius_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (t : Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (ht : t < T) (hgap_large : 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu {omega : Omega | confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen} <= ENNReal.ofReal delta
theorem BanditRLProof.UCB.measure_confidenceScoreArgmax_selectedLargeGapEventOn_le_subGaussian_textbookDeltaRadius_delta Compiled

Finite-time-set concrete confidence-score argmax version of the selected large-gap delta bound.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_confidenceScoreArgmax_selectedLargeGapEventOn_le_subGaussian_textbookDeltaRadius_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_confidenceScoreArgmax_selectedLargeGapEventOn_le_subGaussian_textbookDeltaRadius_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (times : Finset Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (htimes : forall t, t ∈ times -> t < T) (hgap_large : forall t, t ∈ times -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu {omega : Omega | exists t, t ∈ times /\ confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen} <= ENNReal.ofReal delta
theorem BanditRLProof.UCB.sum_measure_confidenceScoreArgmax_selectedLargeGapEventOn_le_card_mul_delta Compiled

Summing the single-time concrete score-argmax selected large-gap bounds over a finite time set gives a finite-count probability budget. This is the first counting-facing UCB bridge: it keeps the statement as a sum of selected-action event probabilities before converting it to a lower integral of selected-time indicators.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.sum_measure_confidenceScoreArgmax_selectedLargeGapEventOn_le_card_mul_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem sum_measure_confidenceScoreArgmax_selectedLargeGapEventOn_le_card_mul_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (times : Finset Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (htimes : forall t, t ∈ times -> t < T) (hgap_large : forall t, t ∈ times -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : times.sum (fun t : Nat => mu {omega : Omega | confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen}) <= (times.card : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_selectedLargeGapCountOn_le_card_mul_delta Compiled

Lower-integral selected-count budget for concrete score-argmax UCB over an explicit finite time set. The integrand is the finite sum of selected-action indicators over `times`. This is not yet the recursive `pullCount`, but it is the expectation-facing finite-count surface needed to bridge the selected-event probability bounds into pull-count and regret arguments.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_selectedLargeGapCountOn_le_card_mul_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_selectedLargeGapCountOn_le_card_mul_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (times : Finset Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (htimes : forall t, t ∈ times -> t < T) (hgap_large : forall t, t ∈ times -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => times.sum (fun t : Nat => (({omega' : Omega | confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega' t = chosen} : Set Omega).indicator (1 : Omega -> ENNReal)) omega)) <= (times.card : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_horizon_mul_delta Compiled

Recursive pull-count lower-integral budget for a concrete score-argmax UCB arm whose large-gap condition holds throughout the horizon. This specializes the finite-time selected-count bridge to `Finset.range T` and then uses the existing project-local `pullCount` lower-integral identity. It does not yet split the horizon into small-radius and large-radius phases.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_horizon_mul_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_horizon_mul_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (hgap_large : forall t, t < T -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_free_or_delta_sum Compiled

Threshold/suffix-shaped pull-count budget for concrete score-argmax UCB. Times in `freeTimes` are charged by the trivial probability bound `1`; every other horizon time must be listed in `chargedTimes` and satisfy the large-gap condition, so those selected events are charged by `delta`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_free_or_delta_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_free_or_delta_sum {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (freeTimes chargedTimes : Finset Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (hcharged_of_not_free : forall t, t < T -> t ∉ freeTimes -> t ∈ chargedTimes) (hgap_large : forall t, t ∈ chargedTimes -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (Finset.range T).sum (fun t : Nat => if t ∈ freeTimes then (1 : ENNReal) else ENNReal.ofReal delta)
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_freeBudget_add_horizon_delta Compiled

Budgeted form of the threshold/suffix pull-count split. The only new input is a bound on the free-time indicator sum. Future radius-threshold leaves can discharge `hfree_budget` by proving a cardinality bound for the low-radius/small-sample times.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_freeBudget_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_freeBudget_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (freeTimes chargedTimes : Finset Nat) (freeBudget : ENNReal) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (hfree_budget : (Finset.range T).sum (fun t : Nat => if t ∈ freeTimes then (1 : ENNReal) else 0) <= freeBudget) (hcharged_of_not_free : forall t, t < T -> t ∉ freeTimes -> t ∈ chargedTimes) (hgap_large : forall t, t ∈ chargedTimes -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= freeBudget + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.freeTimes_indicator_sum_le_card Compiled

The ENNReal indicator count of a finite set of free horizon times is bounded by the total number of declared free times.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.freeTimes_indicator_sum_le_card

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem freeTimes_indicator_sum_le_card (T : Nat) (freeTimes : Finset Nat) : (Finset.range T).sum (fun t : Nat => if t ∈ freeTimes then (1 : ENNReal) else 0) <= (freeTimes.card : ENNReal)
theorem BanditRLProof.UCB.selectedSmallPullCount_sum_eq_min_pullCount Compiled

Along one concrete action trace, the number of selected times whose previous pull count is still below threshold `B` is the minimum of the terminal pull count and `B`. This is the pathwise source of the usual UCB small-count budget: selected occurrences with `pullCount < B` can happen at most `B` times, regardless of the ambient horizon length.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.selectedSmallPullCount_sum_eq_min_pullCount

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem selectedSmallPullCount_sum_eq_min_pullCount {Action : Type} [DecidableEq Action] (action : ActionTrace Action) (chosen : Action) (T B : Nat) : (Finset.range T).sum (fun t : Nat => if action t = chosen ∧ pullCount action chosen t < B then (1 : Nat) else 0) = Nat.min (pullCount action chosen T) B
theorem BanditRLProof.UCB.selectedSmallPullCount_sum_le_threshold Compiled

Pathwise UCB small-count budget in Nat form.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.selectedSmallPullCount_sum_le_threshold

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem selectedSmallPullCount_sum_le_threshold {Action : Type} [DecidableEq Action] (action : ActionTrace Action) (chosen : Action) (T B : Nat) : (Finset.range T).sum (fun t : Nat => if action t = chosen ∧ pullCount action chosen t < B then (1 : Nat) else 0) <= B
theorem BanditRLProof.UCB.selectedSmallPullCount_indicator_sum_le_threshold Compiled

ENNReal-facing pathwise UCB small-count budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.selectedSmallPullCount_indicator_sum_le_threshold

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem selectedSmallPullCount_indicator_sum_le_threshold {Action : Type} [DecidableEq Action] (action : ActionTrace Action) (chosen : Action) (T B : Nat) : (Finset.range T).sum (fun t : Nat => if action t = chosen ∧ pullCount action chosen t < B then (1 : ENNReal) else 0) <= (B : ENNReal)
theorem BanditRLProof.UCB.lintegral_selectedSmallPullCount_indicator_sum_le_threshold Compiled

Probability-facing version of the pathwise selected-small budget. No measurability assumption is needed for this upper bound: the lower integral is dominated pointwise by the constant `B`, and the measure is a probability measure.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_selectedSmallPullCount_indicator_sum_le_threshold

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_selectedSmallPullCount_indicator_sum_le_threshold {Omega Action : Type} [MeasurableSpace Omega] [DecidableEq Action] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (action : Omega -> ActionTrace Action) (chosen : Action) (T B : Nat) : MeasureTheory.lintegral mu (fun omega : Omega => (Finset.range T).sum (fun t : Nat => if action omega t = chosen ∧ pullCount (action omega) chosen t < B then (1 : ENNReal) else 0)) <= (B : ENNReal)
theorem BanditRLProof.UCB.selectedPullCount_sum_eq_pullCount Compiled

The selected-time Nat indicator sum is exactly the recursive pull count.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.selectedPullCount_sum_eq_pullCount

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem selectedPullCount_sum_eq_pullCount {Action : Type} [DecidableEq Action] (action : ActionTrace Action) (chosen : Action) (T : Nat) : (Finset.range T).sum (fun t : Nat => if action t = chosen then (1 : Nat) else 0) = pullCount action chosen T
theorem BanditRLProof.UCB.selectedPullCount_indicator_sum_eq_natCast_pullCount Compiled

ENNReal-facing selected-time indicator identity for the recursive pull count.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.selectedPullCount_indicator_sum_eq_natCast_pullCount

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem selectedPullCount_indicator_sum_eq_natCast_pullCount {Action : Type} [DecidableEq Action] (action : ActionTrace Action) (chosen : Action) (T : Nat) : (Finset.range T).sum (fun t : Nat => if action t = chosen then (1 : ENNReal) else 0) = ((pullCount action chosen T : Nat) : ENNReal)
theorem BanditRLProof.UCB.selectedPullCount_indicator_sum_eq_selectedSmall_add_selectedLargePullCount Compiled

Every selected time is either a selected-small time or a selected-large-count time, split by the threshold `B`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.selectedPullCount_indicator_sum_eq_selectedSmall_add_selectedLargePullCount

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem selectedPullCount_indicator_sum_eq_selectedSmall_add_selectedLargePullCount {Action : Type} [DecidableEq Action] (action : ActionTrace Action) (chosen : Action) (T B : Nat) : (Finset.range T).sum (fun t : Nat => if action t = chosen then (1 : ENNReal) else 0) = (Finset.range T).sum (fun t : Nat => if action t = chosen ∧ pullCount action chosen t < B then (1 : ENNReal) else 0) + (Finset.range T).sum (fun t : Nat => if action t = chosen ∧ B <= pullCount action chosen t then (1 : ENNReal) else 0)
theorem BanditRLProof.UCB.natCast_pullCount_le_threshold_add_selectedLargePullCount_indicator_sum Compiled

Pointwise ENNReal UCB count budget after isolating selected-large-count times. The selected-small part is charged by `B`; only selected times whose prior pull count is at least `B` remain for a future large-gap tail bound.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.natCast_pullCount_le_threshold_add_selectedLargePullCount_indicator_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem natCast_pullCount_le_threshold_add_selectedLargePullCount_indicator_sum {Action : Type} [DecidableEq Action] (action : ActionTrace Action) (chosen : Action) (T B : Nat) : ((pullCount action chosen T : Nat) : ENNReal) <= (B : ENNReal) + (Finset.range T).sum (fun t : Nat => if action t = chosen ∧ B <= pullCount action chosen t then (1 : ENNReal) else 0)
theorem BanditRLProof.UCB.measurableSet_selectedLargePullCount Compiled

Measurability of a selected-large-count event for a fixed time.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measurableSet_selectedLargePullCount

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurableSet_selectedLargePullCount {Omega Action : Type} [MeasurableSpace Omega] [MeasurableSpace Action] [MeasurableSingletonClass Action] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] [DecidableEq Action] (action : Omega -> ActionTrace Action) (haction : forall t : Nat, Measurable (fun omega : Omega => action omega t)) (chosen : Action) (t B : Nat) : MeasurableSet {omega : Omega | action omega t = chosen ∧ B <= pullCount (action omega) chosen t}
theorem BanditRLProof.UCB.lintegral_selectedLargePullCount_indicator_sum_eq_sum_measure Compiled

The lower integral of selected-large-count indicators is the corresponding finite sum of event measures.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_selectedLargePullCount_indicator_sum_eq_sum_measure

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_selectedLargePullCount_indicator_sum_eq_sum_measure {Omega Action : Type} [MeasurableSpace Omega] [MeasurableSpace Action] [MeasurableSingletonClass Action] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] [DecidableEq Action] (mu : Measure Omega) (action : Omega -> ActionTrace Action) (haction : forall t : Nat, Measurable (fun omega : Omega => action omega t)) (chosen : Action) (T B : Nat) : MeasureTheory.lintegral mu (fun omega : Omega => (Finset.range T).sum (fun t : Nat => if action omega t = chosen ∧ B <= pullCount (action omega) chosen t then (1 : ENNReal) else 0)) = (Finset.range T).sum (fun t : Nat => mu {omega : Omega | action omega t = chosen ∧ B <= pullCount (action omega) chosen t})
theorem BanditRLProof.UCB.measure_confidenceScoreArgmax_selectedLargePullCountEvent_le_subGaussian_textbookDeltaRadius_delta Compiled

Single-time selected-large-count event budget for concrete score-argmax UCB. If the event is nonempty but the deterministic large-gap inequality fails, the pointwise large-count-to-large-gap contract gives a contradiction. Otherwise it reduces to the existing selected-event `delta` bound.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_confidenceScoreArgmax_selectedLargePullCountEvent_le_subGaussian_textbookDeltaRadius_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_confidenceScoreArgmax_selectedLargePullCountEvent_le_subGaussian_textbookDeltaRadius_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (t B : Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (ht : t < T) (hlarge_count_gap : forall omega : Omega, confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen -> B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu {omega : Omega | confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen ∧ B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t} <= ENNReal.ofReal delta
theorem BanditRLProof.UCB.sum_measure_confidenceScoreArgmax_selectedLargePullCountEvent_le_horizon_mul_delta Compiled

Finite-horizon sum budget for selected-large-count concrete score-argmax events.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.sum_measure_confidenceScoreArgmax_selectedLargePullCountEvent_le_horizon_mul_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem sum_measure_confidenceScoreArgmax_selectedLargePullCountEvent_le_horizon_mul_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (B : Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (hlarge_count_gap : forall omega t, t < T -> confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen -> B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : (Finset.range T).sum (fun t : Nat => mu {omega : Omega | confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen ∧ B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t}) <= (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_selectedLargePullCount_indicator_sum_le_horizon_mul_delta Compiled

Lower-integral finite-sum budget for selected-large-count concrete score-argmax events.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_selectedLargePullCount_indicator_sum_le_horizon_mul_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_selectedLargePullCount_indicator_sum_le_horizon_mul_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (B : Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hlarge_count_gap : forall omega t, t < T -> confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen -> B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => (Finset.range T).sum (fun t : Nat => if confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen ∧ B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t then (1 : ENNReal) else 0)) <= (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_threshold_add_horizon_delta_of_selectedLargePullCount Compiled

Integrated UCB pull-count budget from a selected-large-count large-gap source.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_threshold_add_horizon_delta_of_selectedLargePullCount

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_threshold_add_horizon_delta_of_selectedLargePullCount {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (B : Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hlarge_count_gap : forall omega t, t < T -> confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen -> B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_freeCard_add_horizon_delta Compiled

Concrete cardinality-budget version of the threshold/suffix pull-count split. This discharges the abstract `freeBudget` input with `freeTimes.card`. A later radius-threshold leaf can instantiate `freeTimes` and prove its cardinality is the usual logarithmic/gap-dependent budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_freeCard_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_freeCard_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (freeTimes chargedTimes : Finset Nat) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (hcharged_of_not_free : forall t, t < T -> t ∉ freeTimes -> t ∈ chargedTimes) (hgap_large : forall t, t ∈ chargedTimes -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (freeTimes.card : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
def BanditRLProof.UCB.subGaussianTextbookDeltaRadiusChargedTimes Compiled

Horizon times where the textbook delta radius is already small enough for the selected arm to satisfy the large-gap condition.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadiusChargedTimes

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def subGaussianTextbookDeltaRadiusChargedTimes {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) : Finset Nat
def BanditRLProof.UCB.subGaussianTextbookDeltaRadiusFreeTimes Compiled

Horizon times not yet discharged by the textbook large-gap radius condition. The next cardinality leaf can bound this concrete set by a closed-form gap/log/sample threshold.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadiusFreeTimes

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def subGaussianTextbookDeltaRadiusFreeTimes {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) : Finset Nat
theorem BanditRLProof.UCB.mem_subGaussianTextbookDeltaRadiusChargedTimes_iff Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.mem_subGaussianTextbookDeltaRadiusChargedTimes_iff

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

@[simp] theorem mem_subGaussianTextbookDeltaRadiusChargedTimes_iff {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) : t ∈ subGaussianTextbookDeltaRadiusChargedTimes trueMean proxy T delta best chosen ↔ t < T ∧ 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen
theorem BanditRLProof.UCB.mem_subGaussianTextbookDeltaRadiusFreeTimes_iff Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.mem_subGaussianTextbookDeltaRadiusFreeTimes_iff

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

@[simp] theorem mem_subGaussianTextbookDeltaRadiusFreeTimes_iff {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) : t ∈ subGaussianTextbookDeltaRadiusFreeTimes trueMean proxy T delta best chosen ↔ t < T ∧ ¬ 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadiusChargedTimes_of_not_free Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadiusChargedTimes_of_not_free

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadiusChargedTimes_of_not_free {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) : t < T -> t ∉ subGaussianTextbookDeltaRadiusFreeTimes trueMean proxy T delta best chosen -> t ∈ subGaussianTextbookDeltaRadiusChargedTimes trueMean proxy T delta best chosen
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadiusChargedTimes_gap_large Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadiusChargedTimes_gap_large

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadiusChargedTimes_gap_large {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) : t ∈ subGaussianTextbookDeltaRadiusChargedTimes trueMean proxy T delta best chosen -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusFreeCard_add_horizon_delta Compiled

Concrete radius-threshold split for the textbook delta UCB pull-count budget. This instantiates the abstract `freeTimes`/`chargedTimes` split with the large-gap predicate induced by `subGaussianTextbookDeltaRadius`. It leaves the closed-form cardinality bound for the concrete free-time set to the next leaf.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusFreeCard_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusFreeCard_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (hT : 0 < T) (hdelta : 0 < delta) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= ((subGaussianTextbookDeltaRadiusFreeTimes trueMean proxy T delta best chosen).card : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadiusFreeTimes_card_le_threshold Compiled

If every horizon time at or beyond threshold `B` satisfies the textbook large-gap radius condition, then the concrete free-time set has cardinality at most `B`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadiusFreeTimes_card_le_threshold

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadiusFreeTimes_card_le_threshold {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (B : Nat) (hlarge_after : forall t, t < T -> B <= t -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) : (subGaussianTextbookDeltaRadiusFreeTimes trueMean proxy T delta best chosen).card <= B
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadiusFreeTimes_card_le_threshold_ennreal Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadiusFreeTimes_card_le_threshold_ennreal

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadiusFreeTimes_card_le_threshold_ennreal {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (B : Nat) (hlarge_after : forall t, t < T -> B <= t -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) : ((subGaussianTextbookDeltaRadiusFreeTimes trueMean proxy T delta best chosen).card : ENNReal) <= (B : ENNReal)
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusThreshold_add_horizon_delta Compiled

Threshold-budget version of the concrete textbook-radius UCB pull-count split. The only new deterministic input is that all times `t >= B` in the horizon satisfy the large-gap radius condition. A later leaf can instantiate `B` with a closed-form logarithmic/gap-dependent expression.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusThreshold_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusThreshold_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (B : Nat) (hT : 0 < T) (hdelta : 0 < delta) (hlarge_after : forall t, t < T -> B <= t -> 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadius_large_gap_of_lt_half_meanGap Compiled

Half-gap radius condition in the textbook form implies the large-gap condition consumed by the UCB selected-event and pull-count budget wrappers.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadius_large_gap_of_lt_half_meanGap

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadius_large_gap_of_lt_half_meanGap {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) (hhalf : subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen / 2) : 2 * subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusHalfGapThreshold_add_horizon_delta Compiled

Half-gap threshold version of the concrete textbook-radius UCB pull-count budget. This is the surface normally targeted by the remaining logarithmic/gap algebra: prove that after threshold `B`, the textbook radius is below half the chosen arm's gap.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusHalfGapThreshold_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusHalfGapThreshold_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (B : Nat) (hT : 0 < T) (hdelta : 0 < delta) (hhalf_after : forall t, t < T -> B <= t -> subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen / 2) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadius_lt_half_meanGap_of_sq_lt Compiled

Square-form deterministic algebra for the textbook delta radius: if the quantity under the square root is below `(gap / 2)^2`, the radius is below half the gap.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadius_lt_half_meanGap_of_sq_lt

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadius_lt_half_meanGap_of_sq_lt {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) (hgap_pos : 0 < meanGap trueMean best chosen) (hsq : 2 * ((proxy t chosen : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) < (meanGap trueMean best chosen / 2) ^ 2) : subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen / 2
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadius_lt_half_meanGap_of_eight_mul_lt_sq Compiled

Common UCB algebra form for the textbook delta radius: the sufficient condition `8 * proxy * log(scale) < gap^2` implies `radius < gap / 2`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadius_lt_half_meanGap_of_eight_mul_lt_sq

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadius_lt_half_meanGap_of_eight_mul_lt_sq {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) (hgap_pos : 0 < meanGap trueMean best chosen) (height : 8 * ((proxy t chosen : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) < (meanGap trueMean best chosen) ^ 2) : subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen / 2
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusEightProxyLogThreshold_add_horizon_delta Compiled

Eight-proxy-log threshold version of the concrete textbook-radius UCB pull-count budget. The remaining closed-form work is to prove the displayed square inequality from a concrete choice of `B` and whatever sample-count/proxy monotonicity the eventual empirical-mean construction provides.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusEightProxyLogThreshold_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusEightProxyLogThreshold_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (B : Nat) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (height_after : forall t, t < T -> B <= t -> 8 * ((proxy t chosen : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) < (meanGap trueMean best chosen) ^ 2) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadius_lt_half_meanGap_of_proxy_lt_gap_sq_div Compiled

Proxy-small form of the textbook radius half-gap algebra. Under a positive logarithmic scale, bounding the selected arm's proxy by `gap^2 / (8 * log scale)` implies the usual eight-proxy-log condition and hence `radius < gap / 2`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadius_lt_half_meanGap_of_proxy_lt_gap_sq_div

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadius_lt_half_meanGap_of_proxy_lt_gap_sq_div {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hproxy_small : ((proxy t chosen : NNReal) : Real) < (meanGap trueMean best chosen) ^ 2 / (8 * Real.log (textbookDeltaScale (Arm := Fin K) T delta))) : subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen / 2
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusProxyThreshold_add_horizon_delta Compiled

Proxy-small threshold version of the concrete textbook-radius UCB pull-count budget. This is the handoff expected from a later empirical-mean/sample-count leaf: after threshold `B`, prove the selected arm's sub-Gaussian proxy is below the displayed gap/log scale.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusProxyThreshold_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusProxyThreshold_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (B : Nat) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hproxy_small_after : forall t, t < T -> B <= t -> ((proxy t chosen : NNReal) : Real) < (meanGap trueMean best chosen) ^ 2 / (8 * Real.log (textbookDeltaScale (Arm := Fin K) T delta))) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadius_lt_half_meanGap_of_proxy_le_variance_div_count Compiled

Sample-count proxy form of the textbook radius half-gap algebra. If the selected arm's proxy is bounded by `varianceProxy / count`, then a count threshold of the form `8 * varianceProxy * log(scale) < gap^2 * count` implies the proxy-small condition and hence `radius < gap / 2`.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadius_lt_half_meanGap_of_proxy_le_variance_div_count

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadius_lt_half_meanGap_of_proxy_le_variance_div_count {K : Nat} (trueMean : Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (t : Nat) (varianceProxy : NNReal) (count : Nat) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hcount_pos : 0 < count) (hproxy_le : ((proxy t chosen : NNReal) : Real) <= ((varianceProxy : NNReal) : Real) / (count : Real)) (hcount_large : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) < (meanGap trueMean best chosen) ^ 2 * (count : Real)) : subGaussianTextbookDeltaRadius proxy T delta t chosen < meanGap trueMean best chosen / 2
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountThreshold_add_horizon_delta Compiled

Sample-count threshold version of the concrete textbook-radius UCB pull-count budget. This keeps the probabilistic/concentration assumptions abstract, but turns the remaining radius-threshold algebra into explicit count and proxy contracts.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountThreshold_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountThreshold_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (B : Nat) (varianceProxy : NNReal) (count : Nat -> Fin K -> Nat) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hcount_pos_after : forall t, t < T -> B <= t -> 0 < count t chosen) (hproxy_le_after : forall t, t < T -> B <= t -> ((proxy t chosen : NNReal) : Real) <= ((varianceProxy : NNReal) : Real) / (count t chosen : Real)) (hcount_large_after : forall t, t < T -> B <= t -> 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) < (meanGap trueMean best chosen) ^ 2 * (count t chosen : Real)) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.subGaussianTextbookDeltaRadius_count_large_of_threshold_lt_bound Compiled

Closed threshold-to-count algebra: if the real threshold `8 * varianceProxy * log(scale) / gap^2` is below `B`, and `B <= count`, then the count is large enough for the sample-count UCB radius condition.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianTextbookDeltaRadius_count_large_of_threshold_lt_bound

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem subGaussianTextbookDeltaRadius_count_large_of_threshold_lt_bound {K : Nat} (trueMean : Fin K -> Real) (T : Nat) (delta : Real) (best chosen : Fin K) (varianceProxy : NNReal) (B count : Nat) (hgap_pos : 0 < meanGap trueMean best chosen) (hthreshold_lt_B : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) / (meanGap trueMean best chosen) ^ 2 < (B : Real)) (hB_le_count : B <= count) : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) < (meanGap trueMean best chosen) ^ 2 * (count : Real)
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountLowerBound_add_horizon_delta Compiled

Lower-bound-on-count version of the concrete textbook-radius UCB pull-count budget. A later adaptive trace leaf can aim to prove `B <= count t chosen` after the same threshold `B`; this wrapper then supplies the usual `B + T * delta` pull-count budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountLowerBound_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountLowerBound_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (best chosen : Fin K) (B : Nat) (varianceProxy : NNReal) (count : Nat -> Fin K -> Nat) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hB_pos : 0 < B) (hthreshold_lt_B : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) / (meanGap trueMean best chosen) ^ 2 < (B : Real)) (hcount_lower_after : forall t, t < T -> B <= t -> B <= count t chosen) (hproxy_le_after : forall t, t < T -> B <= t -> ((proxy t chosen : NNReal) : Real) <= ((varianceProxy : NNReal) : Real) / (count t chosen : Real)) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusRecursiveSampleCount_add_horizon_delta Compiled

Recursive sample-count adapter for the selected-large-count UCB budget. For selected times whose previous recursive pull count is at least `B`, a variance-over-count proxy bound plus the closed real threshold certificate implies the textbook radius is below half the gap. The selected-large-count wrapper then yields the usual `B + T * delta` pull-count budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusRecursiveSampleCount_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusRecursiveSampleCount_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (B : Nat) (best chosen : Fin K) (varianceProxy : NNReal) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hB_pos : 0 < B) (hthreshold_lt_B : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) / (meanGap trueMean best chosen) ^ 2 < (B : Real)) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy_le_selected_large : forall omega t, t < T -> confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen -> B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t -> ((proxy t chosen : NNReal) : Real) <= ((varianceProxy : NNReal) : Real) / (pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t : Real)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta Compiled

Source-count version of the recursive sample-count UCB budget. This wrapper is meant for later empirical-mean leaves: they can expose their own history-derived `sampleCount`, prove it agrees with recursive `pullCount` on selected-large events, and provide the usual variance-over-count proxy bound for that source count. The existing recursive sample-count adapter then gives the same `B + T * delta` pull-count budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmax_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (B : Nat) (best chosen : Fin K) (varianceProxy : NNReal) (sampleCount : Omega -> Nat -> Fin K -> Nat) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hB_pos : 0 < B) (hthreshold_lt_B : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) / (meanGap trueMean best chosen) ^ 2 < (B : Real)) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hsampleCount_eq_pullCount_selected_large : forall omega t, t < T -> confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen -> B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t -> sampleCount omega t chosen = pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t) (hproxy_le_sampleCount_selected_large : forall omega t, t < T -> confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t = chosen -> B <= pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen t -> ((proxy t chosen : NNReal) : Real) <= ((varianceProxy : NNReal) : Real) / (sampleCount omega t chosen : Real)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount ((confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta)) omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_historyAction_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta Compiled

History-action source-count version of the textbook-radius UCB pull-count budget. If an externally generated history trace agrees with the concrete score-argmax UCB trace throughout the horizon, and its own recursive pull count supplies the variance-over-count proxy contract on selected-large events, then that history trace inherits the same `B + T * delta` selected-arm count budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_historyAction_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_historyAction_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (B : Nat) (best chosen : Fin K) (varianceProxy : NNReal) (historyAction : Omega -> ActionTrace (Fin K)) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hB_pos : 0 < B) (hthreshold_lt_B : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) / (meanGap trueMean best chosen) ^ 2 < (B : Real)) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hhistoryAction_eq_argmax : forall omega t, t < T -> historyAction omega t = confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t) (hproxy_le_history_selected_large : forall omega t, t < T -> historyAction omega t = chosen -> B <= pullCount (historyAction omega) chosen t -> ((proxy t chosen : NNReal) : Real) <= ((varianceProxy : NNReal) : Real) / (pullCount (historyAction omega) chosen t : Real)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount (historyAction omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
theorem BanditRLProof.UCB.lintegral_generatedActionTrace_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta Compiled

Generated-policy source-count version of the textbook-radius UCB pull-count budget. This packages the previous history-action wrapper for a concrete `Policy.generatedActionTrace`. Pointwise equality with score argmax over all time coordinates transfers measurability from the generated policy trace to the score-argmax trace, and the existing history-action adapter supplies the `B + T * delta` selected-arm count budget.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_generatedActionTrace_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_generatedActionTrace_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta {Omega State : Type} [MeasurableSpace Omega] [MeasurableSpace State] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (B : Nat) (best chosen : Fin K) (varianceProxy : NNReal) (policy : Policy.MeasurablePolicy State (Fin K)) (state : Nat -> Omega -> State) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hB_pos : 0 < B) (hthreshold_lt_B : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) / (meanGap trueMean best chosen) ^ 2 < (B : Real)) (hstate : forall t : Nat, Measurable (state t)) (hgenerated_eq_argmax : forall omega t, (Policy.generatedActionTrace policy state omega) t = confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t) (hproxy_le_generated_selected_large : forall omega t, t < T -> (Policy.generatedActionTrace policy state omega) t = chosen -> B <= pullCount (Policy.generatedActionTrace policy state omega) chosen t -> ((proxy t chosen : NNReal) : Real) <= ((varianceProxy : NNReal) : Real) / (pullCount (Policy.generatedActionTrace policy state omega) chosen t : Real)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount (Policy.generatedActionTrace policy state omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
def BanditRLProof.UCB.identityActionPolicy Compiled

Identity measurable policy on an action space.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.identityActionPolicy

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def identityActionPolicy (Action : Type) [MeasurableSpace Action] : Policy.MeasurablePolicy Action Action where
def BanditRLProof.UCB.confidenceScoreArgmaxGeneratedState Compiled

State process whose value is the current concrete UCB score-argmax action. This is a thin policy/state adapter: a generated trace using `identityActionPolicy` over this state is definitionally the concrete score-argmax action trace.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceScoreArgmaxGeneratedState

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def confidenceScoreArgmaxGeneratedState {Omega : Type} {K : Nat} (hK : 0 < K) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) : Nat -> Omega -> Fin K
def BanditRLProof.UCB.confidenceScoreArgmaxGeneratedTrace Compiled

Concrete UCB score-argmax action trace expressed as a generated policy trace.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.confidenceScoreArgmaxGeneratedTrace

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def confidenceScoreArgmaxGeneratedTrace {Omega : Type} {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) : Omega -> ActionTrace (Fin K)
theorem BanditRLProof.UCB.lintegral_confidenceScoreArgmaxGeneratedTrace_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta Compiled

Generated-trace instantiation of the textbook-radius UCB pull-count budget. The generated trace is built from the identity action policy and the concrete score-argmax state, so the generated-policy equality contract from the previous wrapper is discharged definitionally.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.lintegral_confidenceScoreArgmaxGeneratedTrace_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem lintegral_confidenceScoreArgmaxGeneratedTrace_pullCount_le_textbookDeltaRadiusSampleCountSource_add_horizon_delta {Omega : Type} [MeasurableSpace Omega] {K : Nat} (hK : 0 < K) [MeasurableSpace (Fin K)] [MeasurableSingletonClass (Fin K)] [MeasurableSpace Nat] [MeasurableAdd₂ Nat] [OpensMeasurableSpace Nat] (mu : Measure Omega) [MeasureTheory.IsProbabilityMeasure mu] (trueMean : Fin K -> Real) (empiricalMean : Omega -> Nat -> Fin K -> Real) (proxy : Nat -> Fin K -> NNReal) (T : Nat) (delta : Real) (B : Nat) (best chosen : Fin K) (varianceProxy : NNReal) (hT : 0 < T) (hdelta : 0 < delta) (hgap_pos : 0 < meanGap trueMean best chosen) (hlog_pos : 0 < Real.log (textbookDeltaScale (Arm := Fin K) T delta)) (hB_pos : 0 < B) (hthreshold_lt_B : 8 * ((varianceProxy : NNReal) : Real) * Real.log (textbookDeltaScale (Arm := Fin K) T delta) / (meanGap trueMean best chosen) ^ 2 < (B : Real)) (haction : forall t : Nat, Measurable (fun omega : Omega => confidenceScoreArgmaxAction hK empiricalMean (subGaussianTextbookDeltaRadius proxy T delta) omega t)) (hproxy_le_generated_selected_large : forall omega t, t < T -> (confidenceScoreArgmaxGeneratedTrace hK empiricalMean proxy T delta omega) t = chosen -> B <= pullCount (confidenceScoreArgmaxGeneratedTrace hK empiricalMean proxy T delta omega) chosen t -> ((proxy t chosen : NNReal) : Real) <= ((varianceProxy : NNReal) : Real) / (pullCount (confidenceScoreArgmaxGeneratedTrace hK empiricalMean proxy T delta omega) chosen t : Real)) (hproxy : forall t arm, t < T -> 0 < ((proxy t arm : NNReal) : Real)) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : MeasureTheory.lintegral mu (fun omega : Omega => ((pullCount (confidenceScoreArgmaxGeneratedTrace hK empiricalMean proxy T delta omega) chosen T : Nat) : ENNReal)) <= (B : ENNReal) + (T : ENNReal) * ENNReal.ofReal delta
def BanditRLProof.UCB.subGaussianAbsDeviationTail Compiled

Two-sided sub-Gaussian tail budget for a UCB empirical mean at time `t` and arm `arm`. The proxy is for the centered variable `empiricalMean t arm - trueMean arm`. This is still abstract: a later empirical-mean construction must prove the sub-Gaussian proxy and choose the usual log/sqrt radius.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.subGaussianAbsDeviationTail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def subGaussianAbsDeviationTail {Arm : Type} (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (t : Nat) (arm : Arm) : ENNReal
theorem BanditRLProof.UCB.measure_absDeviation_le_subGaussian_tail Compiled

Single-time two-sided sub-Gaussian tail for the UCB absolute-deviation event.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_absDeviation_le_subGaussian_tail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_absDeviation_le_subGaussian_tail {Omega Arm : Type} [MeasurableSpace Omega] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (t : Nat) (arm : Arm) (hradius : 0 <= radius t arm) (hsubG : ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu {omega | radius t arm <= |empiricalMean omega t arm - trueMean arm|} <= subGaussianAbsDeviationTail radius proxy t arm
theorem BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_tail_sum Compiled

Finite-horizon UCB confidence bad-event bound from abstract sub-Gaussian absolute-deviation tails. This is the UCB-facing sub-Gaussian producer layer. It still leaves empirical mean construction, proxy simplification, log/sqrt radius choice, pull-count bounds, and final regret to later leaves.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.measure_finiteHorizonConfidenceBadEvent_le_subGaussian_tail_sum

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measure_finiteHorizonConfidenceBadEvent_le_subGaussian_tail_sum {Omega Arm : Type} [MeasurableSpace Omega] [Fintype Arm] (mu : Measure Omega) [IsFiniteMeasure mu] (trueMean : Arm -> Real) (empiricalMean : Omega -> Nat -> Arm -> Real) (radius : Nat -> Arm -> Real) (proxy : Nat -> Arm -> NNReal) (T : Nat) (hradius : forall t arm, t < T -> 0 <= radius t arm) (hsubG : forall t arm, t < T -> ProbabilityTheory.HasSubgaussianMGF (fun omega : Omega => empiricalMean omega t arm - trueMean arm) (proxy t arm) mu) : mu (finiteHorizonConfidenceBadEvent trueMean empiricalMean radius T) <= (Finset.range T).sum (fun t => (Finset.univ : Finset Arm).sum (fun arm => subGaussianAbsDeviationTail radius proxy t arm + subGaussianAbsDeviationTail radius proxy t arm))
def BanditRLProof.UCB.obligationNames Compiled

The proof-DAG leaves usually needed for UCB regret formalization.

Used in these reading views: Bandit Book · Reinforcement Learning Book

4. UCB: confidence events to regret

Canonical node identitydeclaration:BanditRLProof.UCB.obligationNames

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

def obligationNames : List String