Lean module · Foundations
BanditRLProof.Algorithms.HOOConditionalMGF
Bounded-reward conditional MGF producers for the actual HOO step kernel. Region selection depends on the observed prefix, never on the next reward.
Module map
Imports
BanditRLProof.Algorithms.HOOTrajectory, BanditRLProof.ConcentrationConditionalMGF
Imported by
Declarations
Open an item to read its exact compact statement and source link. Detailed teaching notes are linked when registered.
def
BanditRLProof.HOO.nodeMean
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.nodeMeanReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def nodeMean (law : Kernel Node ℝ) (v : Node) : ℝ
theorem
BanditRLProof.HOO.bounded_node_subgaussian
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.bounded_node_subgaussianReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem bounded_node_subgaussian (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ v, ∀ᵐ y ∂law v, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) : HasSubgaussianMGF (fun y => y - nodeMean law v) (1/4 : ℝ≥0) (law v)
theorem
BanditRLProof.HOO.bounded_node_fixedMGF
Compiled
The new setting supplies the existing fixed-MGF interface from bounded reward laws, rather than assuming a conditional confidence theorem.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.bounded_node_fixedMGFReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem bounded_node_fixedMGF (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ v, ∀ᵐ y ∂law v, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (tilt : ℝ) : Concentration.HasMGFUpperBoundAt (fun y => y - nodeMean law v) tilt (tilt^2/8) (law v)
def
BanditRLProof.HOO.selectedNode
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.selectedNodeReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def selectedNode (ν ρ : ℝ) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) : Node
def
BanditRLProof.HOO.regionIncrement
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.regionIncrementReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def regionIncrement (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) (y : ℝ) : ℝ
def
BanditRLProof.HOO.regionSelected
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.regionSelectedReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def regionSelected (ν ρ : ℝ) (v : Node) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) : ℝ
theorem
BanditRLProof.HOO.region_step_fixedMGF
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.region_step_fixedMGFReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem region_step_fixedMGF (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) (tilt : ℝ) : Concentration.HasMGFUpperBoundAt (regionIncrement ν ρ law v n h) tilt (tilt^2/8 * regionSelected ν ρ v n h) (stepKernel ν ρ law n h)
theorem
BanditRLProof.HOO.region_step_compensated_integral_le_one
Compiled
Predictable variance is paid only when this region is selected. This is the one-step exponential process needed for count-dependent concentration.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.region_step_compensated_integral_le_oneReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem region_step_compensated_integral_le_one (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) (tilt : ℝ) : (∫ y, Real.exp (tilt * regionIncrement ν ρ law v n h y - tilt^2/8 * regionSelected ν ρ v n h) ∂stepKernel ν ρ law n h) ≤ 1
theorem
BanditRLProof.HOO.measurable_selectedNode
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.measurable_selectedNodeReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_selectedNode (ν ρ : ℝ) (n : ℕ) : Measurable (selectedNode ν ρ n)
theorem
BanditRLProof.HOO.measurable_regionSelected
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.measurable_regionSelectedReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_regionSelected (ν ρ : ℝ) (v : Node) (n : ℕ) : Measurable (regionSelected ν ρ v n)
theorem
BanditRLProof.HOO.measurable_regionIncrement
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.measurable_regionIncrementReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_regionIncrement (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) : Measurable (fun p : ((i : Finset.Iic n) → ℝ) × ℝ => regionIncrement ν ρ law v n p.1 p.2)
def
BanditRLProof.HOO.regionCompensated
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.regionCompensatedReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def regionCompensated (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) (tilt : ℝ) (p : ((i : Finset.Iic n) → ℝ) × ℝ) : ℝ
theorem
BanditRLProof.HOO.measurable_regionCompensated
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.measurable_regionCompensatedReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_regionCompensated (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) (tilt : ℝ) : Measurable (regionCompensated ν ρ law v n tilt)
theorem
BanditRLProof.HOO.integrable_regionCompensated_exp
Compiled
All exponential moments are integrable under the joint prefix/reward law. This supplies the global integrability required by conditional MGF iteration.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.integrable_regionCompensated_expReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem integrable_regionCompensated_exp (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt s : ℝ) (μ : Measure ((i : Finset.Iic n) → ℝ)) [IsProbabilityMeasure μ] : Integrable (fun p => Real.exp (s * regionCompensated ν ρ law v n tilt p)) (μ ⊗ₘ stepKernel ν ρ law n)
theorem
BanditRLProof.HOO.trajectory_region_condExp_le_one
Compiled
The conditional exponential inequality holds for the actual constructed trajectory and its observed prefix, without a supplied concentration premise.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.trajectory_region_condExp_le_oneReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem trajectory_region_condExp_le_one (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt : ℝ) : (trajectory ν ρ law)[fun Y => Real.exp (regionCompensated ν ρ law v n tilt (Preorder.frestrictLe n Y, Y (n+1))) | MeasurableSpace.comap (Preorder.frestrictLe n) inferInstance] ≤ᵐ[trajectory ν ρ law] fun _ => 1
theorem
BanditRLProof.HOO.trajectory_region_condMGF
Compiled
Actual HOO successor increments now inhabit the shared conditional MGF interface. The only probabilistic premise is bounded support of each reward law.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HOO.trajectory_region_condMGFReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem trajectory_region_condMGF (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt : ℝ) : Concentration.HasCondMGFUpperBoundAt (MeasurableSpace.comap (Preorder.frestrictLe n) inferInstance) (Preorder.measurable_frestrictLe n).comap_le (fun Y => regionCompensated ν ρ law v n tilt (Preorder.frestrictLe n Y, Y (n+1))) 1 0 (trajectory ν ρ law)