BanditRLlib
Lean gate passed before this site build; local proof declarations are shown as compiled.Lean-verified build · exact declarations linked.

Lean module · Foundations

BanditRLProof.Algorithms.HOOConditionalMGF

Bounded-reward conditional MGF producers for the actual HOO step kernel. Region selection depends on the observed prefix, never on the next reward.

Module map

Declarations
16
Placeholders
0

Imports

BanditRLProof.Algorithms.HOOTrajectory, BanditRLProof.ConcentrationConditionalMGF

Imported by

BanditRLProof.Algorithms.HOOConcentration

Declarations

Open an item to read its exact compact statement and source link. Detailed teaching notes are linked when registered.

def BanditRLProof.HOO.nodeMean Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.nodeMean

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def nodeMean (law : Kernel Node ℝ) (v : Node) : ℝ
theorem BanditRLProof.HOO.bounded_node_subgaussian Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.bounded_node_subgaussian

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem bounded_node_subgaussian (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ v, ∀ᵐ y ∂law v, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) : HasSubgaussianMGF (fun y => y - nodeMean law v) (1/4 : ℝ≥0) (law v)
theorem BanditRLProof.HOO.bounded_node_fixedMGF Compiled

The new setting supplies the existing fixed-MGF interface from bounded reward laws, rather than assuming a conditional confidence theorem.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.bounded_node_fixedMGF

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem bounded_node_fixedMGF (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ v, ∀ᵐ y ∂law v, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (tilt : ℝ) : Concentration.HasMGFUpperBoundAt (fun y => y - nodeMean law v) tilt (tilt^2/8) (law v)
def BanditRLProof.HOO.selectedNode Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.selectedNode

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def selectedNode (ν ρ : ℝ) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) : Node
def BanditRLProof.HOO.regionIncrement Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.regionIncrement

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def regionIncrement (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) (y : ℝ) : ℝ
def BanditRLProof.HOO.regionSelected Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.regionSelected

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def regionSelected (ν ρ : ℝ) (v : Node) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) : ℝ
theorem BanditRLProof.HOO.region_step_fixedMGF Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_step_fixedMGF

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_step_fixedMGF (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) (tilt : ℝ) : Concentration.HasMGFUpperBoundAt (regionIncrement ν ρ law v n h) tilt (tilt^2/8 * regionSelected ν ρ v n h) (stepKernel ν ρ law n h)
theorem BanditRLProof.HOO.region_step_compensated_integral_le_one Compiled

Predictable variance is paid only when this region is selected. This is the one-step exponential process needed for count-dependent concentration.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.region_step_compensated_integral_le_one

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem region_step_compensated_integral_le_one (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (h : (i : Finset.Iic n) → ℝ) (tilt : ℝ) : (∫ y, Real.exp (tilt * regionIncrement ν ρ law v n h y - tilt^2/8 * regionSelected ν ρ v n h) ∂stepKernel ν ρ law n h) ≤ 1
theorem BanditRLProof.HOO.measurable_selectedNode Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.measurable_selectedNode

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurable_selectedNode (ν ρ : ℝ) (n : ℕ) : Measurable (selectedNode ν ρ n)
theorem BanditRLProof.HOO.measurable_regionSelected Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.measurable_regionSelected

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurable_regionSelected (ν ρ : ℝ) (v : Node) (n : ℕ) : Measurable (regionSelected ν ρ v n)
theorem BanditRLProof.HOO.measurable_regionIncrement Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.measurable_regionIncrement

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurable_regionIncrement (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) : Measurable (fun p : ((i : Finset.Iic n) → ℝ) × ℝ => regionIncrement ν ρ law v n p.1 p.2)
def BanditRLProof.HOO.regionCompensated Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.regionCompensated

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

noncomputable def regionCompensated (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) (tilt : ℝ) (p : ((i : Finset.Iic n) → ℝ) × ℝ) : ℝ
theorem BanditRLProof.HOO.measurable_regionCompensated Compiled

No declaration docstring is present; use the chapter context and exact statement below.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.measurable_regionCompensated

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem measurable_regionCompensated (ν ρ : ℝ) (law : Kernel Node ℝ) (v : Node) (n : ℕ) (tilt : ℝ) : Measurable (regionCompensated ν ρ law v n tilt)
theorem BanditRLProof.HOO.integrable_regionCompensated_exp Compiled

All exponential moments are integrable under the joint prefix/reward law. This supplies the global integrability required by conditional MGF iteration.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.integrable_regionCompensated_exp

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem integrable_regionCompensated_exp (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt s : ℝ) (μ : Measure ((i : Finset.Iic n) → ℝ)) [IsProbabilityMeasure μ] : Integrable (fun p => Real.exp (s * regionCompensated ν ρ law v n tilt p)) (μ ⊗ₘ stepKernel ν ρ law n)
theorem BanditRLProof.HOO.trajectory_region_condExp_le_one Compiled

The conditional exponential inequality holds for the actual constructed trajectory and its observed prefix, without a supplied concentration premise.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.trajectory_region_condExp_le_one

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem trajectory_region_condExp_le_one (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt : ℝ) : (trajectory ν ρ law)[fun Y => Real.exp (regionCompensated ν ρ law v n tilt (Preorder.frestrictLe n Y, Y (n+1))) | MeasurableSpace.comap (Preorder.frestrictLe n) inferInstance] ≤ᵐ[trajectory ν ρ law] fun _ => 1
theorem BanditRLProof.HOO.trajectory_region_condMGF Compiled

Actual HOO successor increments now inhabit the shared conditional MGF interface. The only probabilistic premise is bounded support of each reward law.

Used in these reading views: Bandit Book

1. Finite bandits, traces, and regret

Canonical node identitydeclaration:BanditRLProof.HOO.trajectory_region_condMGF

Reading membership is not a proof dependency. Exact assumptions remain in the Lean statement.

theorem trajectory_region_condMGF (ν ρ : ℝ) (law : Kernel Node ℝ) [IsMarkovKernel law] (hbound : ∀ a, ∀ᵐ y ∂law a, y ∈ Set.Icc (0 : ℝ) 1) (v : Node) (n : ℕ) (tilt : ℝ) : Concentration.HasCondMGFUpperBoundAt (MeasurableSpace.comap (Preorder.frestrictLe n) inferInstance) (Preorder.measurable_frestrictLe n).comap_le (fun Y => regionCompensated ν ρ law v n tilt (Preorder.frestrictLe n Y, Y (n+1))) 1 0 (trajectory ν ρ law)