Lean module · Foundations
BanditRLProof.Algorithms.MusicalChairsRealized
Generated source map for this Lean module.
Module map
Imports
BanditRLProof.Algorithms.MusicalChairsCoordinationTime, BanditRLProof.Algorithms.MusicalChairsCoordinationRegret, BanditRLProof.Algorithms.MusicalChairsLearnerRegret
Imported by
Declarations
Open an item to read its exact compact statement and source link. Detailed teaching notes are linked when registered.
theorem
BanditRLProof.MusicalChairs.reward_coordinate_integrable
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.reward_coordinate_integrableReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem reward_coordinate_integrable {k D : ℕ} (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (t : Fin D) (a : Fin k) : Integrable (fun r : Fin D → Fin k → ℝ => r t a) (rewardLaw nu D)
def
BanditRLProof.MusicalChairs.scheduleRealizedRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.scheduleRealizedRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def scheduleRealizedRegret {n k D T : ℕ} (mu : Fin k → ℝ) (j : Fin T → Fin D) (a : Fin T → Fin n → Fin k) (r : Fin D → Fin k → ℝ) : ℝ
theorem
BanditRLProof.MusicalChairs.integrable_scheduleRealizedRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.integrable_scheduleRealizedRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem integrable_scheduleRealizedRegret {n k D T : ℕ} (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (mu : Fin k → ℝ) (j : Fin T → Fin D) (a : Fin T → Fin n → Fin k) : Integrable (scheduleRealizedRegret mu j a) (rewardLaw nu D)
theorem
BanditRLProof.MusicalChairs.scheduleRealizedRegret_mean
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.scheduleRealizedRegret_meanReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem scheduleRealizedRegret_mean {n k D T : ℕ} (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (j : Fin T → Fin D) (a : Fin T → Fin n → Fin k) : (∫ r, scheduleRealizedRegret (armMean nu) j a r ∂rewardLaw nu D) = ∑ t : Fin T, globalRoundRegret (armMean nu) (a t)
theorem
BanditRLProof.MusicalChairs.measurable_scheduleRealizedRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_scheduleRealizedRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_scheduleRealizedRegret {n k D T : ℕ} (mu : Fin k → ℝ) (j : Fin T → Fin D) : Measurable (fun z : (Fin T → Fin n → Fin k) × (Fin D → Fin k → ℝ) => scheduleRealizedRegret mu j z.1 z.2)
theorem
BanditRLProof.MusicalChairs.integrable_randomScheduleRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.integrable_randomScheduleRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem integrable_randomScheduleRegret {α : Type*} [MeasurableSpace α] {n k D T : ℕ} (P : Measure α) [IsFiniteMeasure P] (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (mu : Fin k → ℝ) (j : Fin T → Fin D) (a : α → Fin T → Fin n → Fin k) (ha : Measurable a) : Integrable (fun z : α × (Fin D → Fin k → ℝ) => scheduleRealizedRegret mu j (a z.1) z.2) (P.prod (rewardLaw nu D))
theorem
BanditRLProof.MusicalChairs.randomScheduleRegret_mean
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.randomScheduleRegret_meanReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem randomScheduleRegret_mean {α : Type*} [MeasurableSpace α] {n k D T : ℕ} (P : Measure α) [IsFiniteMeasure P] (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (j : Fin T → Fin D) (a : α → Fin T → Fin n → Fin k) (ha : Measurable a) : (∫ z, scheduleRealizedRegret (armMean nu) j (a z.1) z.2 ∂P.prod (rewardLaw nu D)) = ∫ x, ∑ t : Fin T, globalRoundRegret (armMean nu) (a x t) ∂P
def
BanditRLProof.MusicalChairs.explorationRealizedRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.explorationRealizedRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def explorationRealizedRegret {n k S : ℕ} (mu : Fin k → ℝ) (x : Fin S → Fin n → Fin k) (r : Fin S → Fin k → ℝ) (H : ℕ) : ℝ
def
BanditRLProof.MusicalChairs.continuationRealizedRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.continuationRealizedRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def continuationRealizedRegret {n k L : ℕ} (hk : 0 < k) (mu : Fin k → ℝ) (d : Fin L → Fin n → Fin k) (r : Fin L → Fin k → ℝ) : ℝ
theorem
BanditRLProof.MusicalChairs.exploration_schedule_pseudo
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.exploration_schedule_pseudoReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem exploration_schedule_pseudo {n k S : ℕ} (hk : 0 < k) (mu : Fin k → ℝ) (x : Fin S → Fin n → Fin k) (H : ℕ) : (∑ t : Fin (min H S), globalRoundRegret mu (x (Fin.castLE (Nat.min_le_right H S) t))) = explorationPrefixRegret hk mu x H
theorem
BanditRLProof.MusicalChairs.continuation_schedule_pseudo
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.continuation_schedule_pseudoReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem continuation_schedule_pseudo {n k L : ℕ} (hk : 0 < k) (mu : Fin k → ℝ) (d : Fin L → Fin n → Fin k) : (∑ t : Fin L, globalRoundRegret mu (continuationAction hk d t)) = pathCoordinationRegret hk (topArms mu n) mu d
theorem
BanditRLProof.MusicalChairs.integrable_explorationRealizedRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.integrable_explorationRealizedRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem integrable_explorationRealizedRegret {n k S : ℕ} (hk : 0 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (mu : Fin k → ℝ) (H : ℕ) : Integrable (fun z : (Fin S → Fin n → Fin k) × (Fin S → Fin k → ℝ) => explorationRealizedRegret mu z.1 z.2 H) (explorationRewardLaw hk nu)
theorem
BanditRLProof.MusicalChairs.explorationRealizedRegret_mean
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.explorationRealizedRegret_meanReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem explorationRealizedRegret_mean {n k S : ℕ} (hk : 0 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (H : ℕ) : (∫ z : (Fin S → Fin n → Fin k) × (Fin S → Fin k → ℝ), explorationRealizedRegret (armMean nu) z.1 z.2 H ∂explorationRewardLaw hk nu) = ∫ z : (Fin S → Fin n → Fin k) × (Fin S → Fin k → ℝ), explorationPrefixRegret hk (armMean nu) z.1 H ∂explorationRewardLaw hk nu
abbrev
BanditRLProof.MusicalChairs.FullSample
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.FullSampleReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
abbrev FullSample (n k S H : ℕ)
def
BanditRLProof.MusicalChairs.completeLearnerLaw
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.completeLearnerLawReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def completeLearnerLaw {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) : Measure (FullSample n k S H)
theorem
BanditRLProof.MusicalChairs.completeLearnerLaw_first_preserving
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.completeLearnerLaw_first_preservingReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem completeLearnerLaw_first_preserving {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] : MeasurePreserving (Prod.fst : FullSample n k S H → _) (completeLearnerLaw hk nu) (explorationContinuationLaw hk nu (H-S))
theorem
BanditRLProof.MusicalChairs.explorationContinuationLaw_first_preserving
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.explorationContinuationLaw_first_preservingReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem explorationContinuationLaw_first_preserving {n k S L : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] : MeasurePreserving (Prod.fst : ((Fin S → Fin n → Fin k) × (Fin S → Fin k → ℝ)) × (Fin L → Fin n → Fin k) → _) (explorationContinuationLaw hk nu L) (explorationRewardLaw (by omega) nu)
theorem
BanditRLProof.MusicalChairs.completeLearnerLaw_exploration_preserving
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.completeLearnerLaw_exploration_preservingReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem completeLearnerLaw_exploration_preserving {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] : MeasurePreserving (fun z : FullSample n k S H => z.1.1) (completeLearnerLaw hk nu) (explorationRewardLaw (by omega) nu)
def
BanditRLProof.MusicalChairs.realizedLearnerRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.realizedLearnerRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def realizedLearnerRegret {n k S H : ℕ} (hk : 0 < k) (mu : Fin k → ℝ) (z : FullSample n k S H) : ℝ
theorem
BanditRLProof.MusicalChairs.integral_preserving_pullback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.integral_preserving_pullbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem integral_preserving_pullback {α β : Type*} [MeasurableSpace α] [MeasurableSpace β] {P : Measure α} {Q : Measure β} (g : α → β) (hg : MeasurePreserving g P Q) (f : β → ℝ) (hf : Integrable f Q) : (∫ x, f (g x) ∂P) = ∫ y, f y ∂Q
theorem
BanditRLProof.MusicalChairs.measurable_continuationSchedule
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_continuationScheduleReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_continuationSchedule {n k L : ℕ} (hk : 0 < k) : Measurable (fun d : Fin L → Fin n → Fin k => fun t : Fin L => continuationAction hk d t)
theorem
BanditRLProof.MusicalChairs.integrable_realizedLearnerRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.integrable_realizedLearnerRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem integrable_realizedLearnerRegret {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (mu : Fin k → ℝ) : Integrable (realizedLearnerRegret (n := n) (S := S) (H := H) (by omega) mu) (completeLearnerLaw hk nu)
theorem
BanditRLProof.MusicalChairs.continuationRealizedRegret_mean_joint
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.continuationRealizedRegret_mean_jointReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem continuationRealizedRegret_mean_joint {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) : (∫ z : FullSample n k S H, continuationRealizedRegret (by omega) (armMean nu) z.1.2 z.2 ∂completeLearnerLaw hk nu) = ∫ z, pathCoordinationRegret (by omega) (trueTopArms nu n) (armMean nu) z.2 ∂explorationContinuationLaw (n := n) (T := S) hk nu (H-S)
theorem
BanditRLProof.MusicalChairs.realizedLearnerRegret_expected_eq_pseudo
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.realizedLearnerRegret_expected_eq_pseudoReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem realizedLearnerRegret_expected_eq_pseudo {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) : (∫ z : FullSample n k S H, realizedLearnerRegret (by omega) (armMean nu) z ∂completeLearnerLaw hk nu) = ∫ z, learnerRegret (n := n) (S := S) (H := H) (by omega) (armMean nu) z.1.1 z.2 ∂explorationContinuationLaw (n := n) (T := S) hk nu (H-S)
theorem
BanditRLProof.MusicalChairs.source_expected_realizedLearnerRegret_le
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.source_expected_realizedLearnerRegret_leReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem source_expected_realizedLearnerRegret_le {n k H : ℕ} (hn : 0 < n) (hnk : n < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (eps delta : ℝ) (heps : 0 < eps) (hepsgap : eps < boundaryGap (armMean nu) n hn hnk) (hdelta : 0 < delta) (hdelta1 : delta < 1) : (∫ z : FullSample n k (explorationLength k eps delta) H, realizedLearnerRegret (by omega) (armMean nu) z ∂completeLearnerLaw (by omega) nu) ≤ min ((n : ℝ)*H) ((n : ℝ)*explorationLength k eps delta + 8*(n : ℝ)^2 + delta*((n : ℝ)*H))
def
BanditRLProof.MusicalChairs.continuationFeedback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.continuationFeedbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def continuationFeedback {n k L : ℕ} (hk : 0 < k) (d : Fin L → Fin n → Fin k) (r : Fin L → Fin k → ℝ) (i : Fin n) (t : Fin L) : ExplorationFeedback k
def
BanditRLProof.MusicalChairs.learnerFeedback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.learnerFeedbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def learnerFeedback {n k S H : ℕ} (hk : 0 < k) (z : FullSample n k S H) (i : Fin n) (t : Fin H) : ExplorationFeedback k
theorem
BanditRLProof.MusicalChairs.learnerFeedback_explore
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.learnerFeedback_exploreReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem learnerFeedback_explore {n k S H : ℕ} (hk : 0 < k) (z : FullSample n k S H) (i : Fin n) (t : Fin H) (ht : t.val < S) : learnerFeedback hk z i t = explorationFeedback z.1.1.1 z.1.1.2 i ⟨t.val,ht⟩
theorem
BanditRLProof.MusicalChairs.learnerFeedback_coordinate
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.learnerFeedback_coordinateReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem learnerFeedback_coordinate {n k S H : ℕ} (hk : 0 < k) (z : FullSample n k S H) (i : Fin n) (u : Fin (H-S)) : learnerFeedback hk z i ⟨S+u.val,by omega⟩ = continuationFeedback hk z.1.2 z.2 i u
theorem
BanditRLProof.MusicalChairs.learnerFeedback_arm
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.learnerFeedback_armReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem learnerFeedback_arm {n k S H : ℕ} (hk : 0 < k) (z : FullSample n k S H) (i : Fin n) (t : Fin H) : (learnerFeedback hk z i t).arm = learnerAction hk z.1.1.1 z.1.2 t.val i
theorem
BanditRLProof.MusicalChairs.learnerFeedback_collision
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.learnerFeedback_collisionReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem learnerFeedback_collision {n k S H : ℕ} (hk : 0 < k) (z : FullSample n k S H) (i : Fin n) (t : Fin H) : (learnerFeedback hk z i t).collided = collisionBit (learnerAction hk z.1.1.1 z.1.2 t.val) i
theorem
BanditRLProof.MusicalChairs.learnerFeedback_completed_exploration
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.learnerFeedback_completed_explorationReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem learnerFeedback_completed_exploration {n k S H : ℕ} (hk : 0 < k) (hSH : S ≤ H) (z : FullSample n k S H) (i : Fin n) : (fun t : Fin S => learnerFeedback hk z i (Fin.castLE hSH t)) = explorationFeedback z.1.1.1 z.1.1.2 i
theorem
BanditRLProof.MusicalChairs.learnedConfig_from_feedback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.learnedConfig_from_feedbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem learnedConfig_from_feedback {n k S H : ℕ} (hk : 1 < k) (hSH : S ≤ H) (z : FullSample n k S H) (i : Fin n) : (learnedConfig hk z.1.1).val i = localCandidateSet (fun t : Fin S => learnerFeedback (by omega) z i (Fin.castLE hSH t))
theorem
BanditRLProof.MusicalChairs.continuationFeedback_local_update
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.continuationFeedback_local_updateReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem continuationFeedback_local_update {n k L : ℕ} (hk : 0 < k) (d : Fin L → Fin n → Fin k) (r : Fin L → Fin k → ℝ) (i : Fin n) (t : Fin L) : trajectory (extendedCoordinationDraws hk d) (t.val+1) i = localUpdate (trajectory (extendedCoordinationDraws hk d) t.val i) (continuationFeedback hk d r i t).arm (continuationFeedback hk d r i t).collided
theorem
BanditRLProof.MusicalChairs.learnerFeedback_prefix
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.learnerFeedback_prefixReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem learnerFeedback_prefix {n k S H : ℕ} (hk : 0 < k) (z w : FullSample n k S H) (i : Fin n) (t : Fin H) (hx : ∀ u : Fin S, u.val ≤ t.val → z.1.1.1 u = w.1.1.1 u) (hr : ∀ u : Fin S, u.val ≤ t.val → z.1.1.2 u = w.1.1.2 u) (hd : ∀ u : Fin (H-S), S+u.val ≤ t.val → z.1.2 u = w.1.2 u) (hy : ∀ u : Fin (H-S), S+u.val ≤ t.val → z.2 u = w.2 u) : learnerFeedback hk z i t = learnerFeedback hk w i t
theorem
BanditRLProof.MusicalChairs.finite_sum_split_at
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.finite_sum_split_atReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem finite_sum_split_at {H S : ℕ} (hSH : S ≤ H) (f : Fin H → ℝ) : (∑ t : Fin H, f t) = (∑ t : Fin S, f (Fin.castLE hSH t)) + ∑ u : Fin (H-S), f ⟨S+u.val,by omega⟩
theorem
BanditRLProof.MusicalChairs.realizedLearnerRegret_eq_feedback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.realizedLearnerRegret_eq_feedbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem realizedLearnerRegret_eq_feedback {n k S H : ℕ} (hk : 0 < k) (mu : Fin k → ℝ) (z : FullSample n k S H) : realizedLearnerRegret hk mu z = ∑ t : Fin H, ((∑ a ∈ topArms mu n, mu a) - ∑ i : Fin n, (learnerFeedback hk z i t).reward)
theorem
BanditRLProof.MusicalChairs.measurable_feedback_mk
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_feedback_mkReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_feedback_mk {α : Type*} [MeasurableSpace α] {k : ℕ} (a : α → Fin k) (c : α → Bool) (r : α → ℝ) (ha : Measurable a) (hc : Measurable c) (hr : Measurable r) : Measurable (fun x => (⟨a x,c x,r x⟩ : ExplorationFeedback k))
theorem
BanditRLProof.MusicalChairs.measurable_explorationFeedback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_explorationFeedbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_explorationFeedback {n k S : ℕ} (i : Fin n) (t : Fin S) : Measurable (fun z : (Fin S → Fin n → Fin k) × (Fin S → Fin k → ℝ) => explorationFeedback z.1 z.2 i t)
theorem
BanditRLProof.MusicalChairs.measurable_continuationFeedback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_continuationFeedbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_continuationFeedback {n k L : ℕ} (hk : 0 < k) (i : Fin n) (t : Fin L) : Measurable (fun z : (Fin L → Fin n → Fin k) × (Fin L → Fin k → ℝ) => continuationFeedback hk z.1 z.2 i t)
theorem
BanditRLProof.MusicalChairs.measurable_learnerFeedback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_learnerFeedbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_learnerFeedback {n k S H : ℕ} (hk : 0 < k) (i : Fin n) (t : Fin H) : Measurable (fun z : FullSample n k S H => learnerFeedback hk z i t)
theorem
BanditRLProof.MusicalChairs.measurable_learnerTrace
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_learnerTraceReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_learnerTrace {n k S H : ℕ} (hk : 0 < k) : Measurable (fun z : FullSample n k S H => fun i t => learnerFeedback hk z i t)
def
BanditRLProof.MusicalChairs.visibleLearnerLaw
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.visibleLearnerLawReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def visibleLearnerLaw {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) : Measure (Fin n → Fin H → ExplorationFeedback k)
def
BanditRLProof.MusicalChairs.visibleRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.visibleRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def visibleRegret {n k H : ℕ} (mu : Fin k → ℝ) (f : Fin n → Fin H → ExplorationFeedback k) : ℝ
theorem
BanditRLProof.MusicalChairs.measurable_feedback_reward
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_feedback_rewardReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_feedback_reward {k : ℕ} : Measurable (ExplorationFeedback.reward : ExplorationFeedback k → ℝ)
theorem
BanditRLProof.MusicalChairs.measurable_visibleRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.measurable_visibleRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_visibleRegret {n k H : ℕ} (mu : Fin k → ℝ) : Measurable (visibleRegret (n := n) (H := H) mu)
theorem
BanditRLProof.MusicalChairs.visibleRegret_pullback
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.visibleRegret_pullbackReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem visibleRegret_pullback {n k S H : ℕ} (hk : 0 < k) (mu : Fin k → ℝ) (z : FullSample n k S H) : visibleRegret mu (fun i t => learnerFeedback hk z i t) = realizedLearnerRegret hk mu z
theorem
BanditRLProof.MusicalChairs.integrable_visibleRegret
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.integrable_visibleRegretReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem integrable_visibleRegret {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (mu : Fin k → ℝ) : Integrable (visibleRegret (n := n) (H := H) mu) (visibleLearnerLaw (S := S) hk nu)
theorem
BanditRLProof.MusicalChairs.visibleRegret_expected_eq_realized
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.visibleRegret_expected_eq_realizedReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem visibleRegret_expected_eq_realized {n k S H : ℕ} (hk : 1 < k) (nu : Fin k → Measure ℝ) (mu : Fin k → ℝ) : (∫ f, visibleRegret (n := n) (H := H) mu f ∂visibleLearnerLaw (S := S) hk nu) = ∫ z : FullSample n k S H, realizedLearnerRegret (by omega) mu z ∂completeLearnerLaw hk nu
theorem
BanditRLProof.MusicalChairs.source_expected_visibleRegret_le
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Indexed settings: Multi-agent bandits
Canonical node identity
declaration:BanditRLProof.MusicalChairs.source_expected_visibleRegret_leReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem source_expected_visibleRegret_le {n k H : ℕ} (hn : 0 < n) (hnk : n < k) (nu : Fin k → Measure ℝ) [∀ a, IsProbabilityMeasure (nu a)] (hb : ∀ a, ∀ᵐ y ∂nu a, y ∈ Set.Icc (0 : ℝ) 1) (eps delta : ℝ) (heps : 0 < eps) (hepsgap : eps < boundaryGap (armMean nu) n hn hnk) (hdelta : 0 < delta) (hdelta1 : delta < 1) : (∫ f, visibleRegret (n := n) (H := H) (armMean nu) f ∂visibleLearnerLaw (S := explorationLength k eps delta) (by omega) nu) ≤ min ((n : ℝ)*H) ((n : ℝ)*explorationLength k eps delta + 8*(n : ℝ)^2 + delta*((n : ℝ)*H))