BanditRLlib
Lean gate passed before this site build; local proof declarations are shown as compiled.Lean-verified build · exact declarations linked.

Lean module · Foundations

BanditRLProof.Algorithms.HOOConcentration

Count-dependent concentration for the actual chronological HOO trajectory, including its first reward.

Module map

Declarations
14
Placeholders
0

Imports

BanditRLProof.Algorithms.HOOConditionalMGF

Imported by

BanditRLProof.Algorithms.HOOConfidence

Declarations

Open an item to read its exact compact statement and source link. Detailed teaching notes are linked when registered.

def BanditRLProof.HOO.regionNoise Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.regionNoise

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def regionNoise (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (i : ℕ) (Y : ℕ → ℝ) : ℝ
def BanditRLProof.HOO.regionCount Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.regionCount

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def regionCount (ν ρ : ℝ) (v : Node) (i : ℕ) (Y : ℕ → ℝ) : ℝ
theorem BanditRLProof.HOO.action_prefixExtension_at Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.action_prefixExtension_at

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem action_prefixExtension_at (ν ρ : ℝ) (Y : ℕ → ℝ) (n : ℕ) : action ν ρ (prefixExtension n (Preorder.frestrictLe n Y)) n = action ν ρ Y n
theorem BanditRLProof.HOO.measurable_action_piLE Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.measurable_action_piLE

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurable_action_piLE (ν ρ : ℝ) (n : ℕ) : Measurable[Filtration.piLE n] (fun Y : ℕ → ℝ => action ν ρ Y n)
theorem BanditRLProof.HOO.measurable_coordinate_piLE Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.measurable_coordinate_piLE

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurable_coordinate_piLE (n : ℕ) : Measurable[Filtration.piLE n] (fun Y : ℕ → ℝ => Y n)
theorem BanditRLProof.HOO.region_compensated_adapted Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_compensated_adapted

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_compensated_adapted (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (tilt : ℝ) : StronglyAdapted Filtration.piLE (fun i Y => tilt * regionNoise ν ρ law v i Y - tilt^2/8 * regionCount ν ρ v i Y)
theorem BanditRLProof.HOO.region_compensated_successor Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_compensated_successor

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_compensated_successor (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt : ℝ) : Concentration.HasCondMGFUpperBoundAt (Filtration.piLE n) (Filtration.piLE.le n) (fun Y => tilt * regionNoise ν ρ law v (n+1) Y - tilt^2/8 * regionCount ν ρ v (n+1) Y) 1 0 (trajectory ν ρ law)
theorem BanditRLProof.HOO.region_compensated_initial Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_compensated_initial

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_compensated_initial (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (tilt : ℝ) : Concentration.HasMGFUpperBoundAt (fun Y => tilt * regionNoise ν ρ law v 0 Y - tilt^2/8 * regionCount ν ρ v 0 Y) 1 0 (trajectory ν ρ law)
theorem BanditRLProof.HOO.region_noise_count_tail Compiled

A regional noise/count tail for the real HOO process. Both the initial and conditional MGF obligations are derived from its bounded reward kernels.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_noise_count_tail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_noise_count_tail (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt threshold countBudget : ℝ) (htilt : 0 ≤ tilt) : (trajectory ν ρ law) {Y | threshold ≤ ∑ i ∈ Finset.range n, regionNoise ν ρ law v i Y ∧ (∑ i ∈ Finset.range n, regionCount ν ρ v i Y) ≤ countBudget} ≤ ENNReal.ofReal (Real.exp (-tilt * threshold + tilt^2/8 * countBudget))
theorem BanditRLProof.HOO.sum_regionCount_eq_visits Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.sum_regionCount_eq_visits

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem sum_regionCount_eq_visits (ν ρ : ℝ) (v : Node) (n : ℕ) (Y : ℕ → ℝ) : (∑ i ∈ Finset.range n, regionCount ν ρ v i Y) = (visits (history ν ρ Y n) v : ℝ)
theorem BanditRLProof.HOO.sum_regionNoise_eq_rewardSum_sub_means Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.sum_regionNoise_eq_rewardSum_sub_means

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem sum_regionNoise_eq_rewardSum_sub_means (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) (Y : ℕ → ℝ) : (∑ i ∈ Finset.range n, regionNoise ν ρ law v i Y) = rewardSum (history ν ρ Y n) v - ∑ i ∈ Finset.range n, regionCount ν ρ v i Y * nodeMean law (action ν ρ Y i)
theorem BanditRLProof.HOO.region_negative_noise_count_tail Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_negative_noise_count_tail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_negative_noise_count_tail (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt threshold countBudget : ℝ) (htilt : 0 ≤ tilt) : (trajectory ν ρ law) {Y | threshold ≤ -(∑ i ∈ Finset.range n, regionNoise ν ρ law v i Y) ∧ (visits (history ν ρ Y n) v : ℝ) ≤ countBudget} ≤ ENNReal.ofReal (Real.exp (-tilt * threshold + tilt^2/8 * countBudget))
theorem BanditRLProof.HOO.region_noise_visits_tail Compiled

Optimized upper tail, retaining the actual regional visit count in the event.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_noise_visits_tail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_noise_visits_tail (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (threshold countBudget : ℝ) (hthreshold : 0 ≤ threshold) (hcount : 0 < countBudget) : (trajectory ν ρ law) {Y | threshold ≤ ∑ i ∈ Finset.range n, regionNoise ν ρ law v i Y ∧ (visits (history ν ρ Y n) v : ℝ) ≤ countBudget} ≤ ENNReal.ofReal (Real.exp (-2 * threshold^2 / countBudget))
theorem BanditRLProof.HOO.region_negative_noise_visits_tail Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_negative_noise_visits_tail

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_negative_noise_visits_tail (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (threshold countBudget : ℝ) (hthreshold : 0 ≤ threshold) (hcount : 0 < countBudget) : (trajectory ν ρ law) {Y | threshold ≤ -(∑ i ∈ Finset.range n, regionNoise ν ρ law v i Y) ∧ (visits (history ν ρ Y n) v : ℝ) ≤ countBudget} ≤ ENNReal.ofReal (Real.exp (-2 * threshold^2 / countBudget))