Lean module · Foundations
BanditRLProof.Algorithms.HeavyTailHistory
Sample-index truncation computed solely from the finite observed history.
Module map
Imports
BanditRLProof.Algorithms.ArmStreamPolicy, BanditRLProof.HeavyTailTruncation
Imported by
Declarations
Open an item to read its exact compact statement and source link. Detailed teaching notes are linked when registered.
def
BanditRLProof.HeavyTail.historyAction
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.historyActionReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
def historyAction (initial : Fin K) (n : ℕ) (h : History.FinitePairHistory (Fin K) ℝ n) : ActionTrace (Fin K)
def
BanditRLProof.HeavyTail.historyReward
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.historyRewardReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
def historyReward (n : ℕ) (h : History.FinitePairHistory (Fin K) ℝ n) : RewardTrace ℝ
theorem
BanditRLProof.HeavyTail.measurable_historyAction
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.measurable_historyActionReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_historyAction (initial : Fin K) (n t : ℕ) : Measurable (fun h => historyAction initial n h t)
theorem
BanditRLProof.HeavyTail.measurable_historyReward
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.measurable_historyRewardReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_historyReward (n t : ℕ) : Measurable (fun h : History.FinitePairHistory (Fin K) ℝ n => historyReward n h t)
def
BanditRLProof.HeavyTail.historyTruncatedMean
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.historyTruncatedMeanReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
noncomputable def historyTruncatedMean (initial : Fin K) (B : ℕ → ℝ) (n : ℕ) (h : History.FinitePairHistory (Fin K) ℝ n) (arm : Fin K) : ℝ
theorem
BanditRLProof.HeavyTail.measurable_historyTruncatedMean
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.measurable_historyTruncatedMeanReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem measurable_historyTruncatedMean (initial : Fin K) (B : ℕ → ℝ) (n : ℕ) (arm : Fin K) : Measurable (fun h => historyTruncatedMean initial B n h arm)
theorem
BanditRLProof.HeavyTail.history_count_trace
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.history_count_traceReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem history_count_trace (initial : Fin K) (a : ActionTrace (Fin K)) (r : RewardTrace ℝ) (arm : Fin K) (n t : ℕ) (ht : t ≤ n+1) : pullCount (historyAction initial n (History.finitePairHistoryOfTrace a r n)) arm t = pullCount a arm t
theorem
BanditRLProof.HeavyTail.historyTruncatedMean_trace
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.historyTruncatedMean_traceReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem historyTruncatedMean_trace (initial : Fin K) (B : ℕ → ℝ) (a : ActionTrace (Fin K)) (r : RewardTrace ℝ) (arm : Fin K) (n : ℕ) : historyTruncatedMean initial B n (History.finitePairHistoryOfTrace a r n) arm = sumRewards a (fun t => truncate (B (pullCount a arm t)) (r t)) arm (n+1) / pullCount a arm (n+1)
theorem
BanditRLProof.HeavyTail.truncated_observed_sum
Compiled
On selected observations, the fixed arm count is the selected arm count. This is the pathwise connection to the latent fixed-prefix confidence theorem.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.truncated_observed_sumReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem truncated_observed_sum {Ω : Type*} (a : Ω → ActionTrace (Fin K)) (stream : Ω → UCB.ArmRewardStream K) (B : ℕ → ℝ) (ω : Ω) (arm : Fin K) (n : ℕ) : sumRewards (a ω) (fun t => truncate (B (pullCount (a ω) arm t)) (UCB.rewardFromArmStream a stream ω t)) arm n = ∑ s ∈ Finset.range (pullCount (a ω) arm n), truncate (B s) (stream ω s arm)
theorem
BanditRLProof.HeavyTail.historyTruncatedMean_latent
Compiled
No declaration docstring is present; use the chapter context and exact statement below.
Used in these reading views: Bandit Book
1. Finite bandits, traces, and regret
Canonical node identity
declaration:BanditRLProof.HeavyTail.historyTruncatedMean_latentReading membership is not a proof dependency. Exact assumptions remain in the Lean statement.
theorem historyTruncatedMean_latent (initial : Fin K) (select) (B : ℕ → ℝ) (stream : UCB.ArmRewardStream K) (arm : Fin K) (n : ℕ) : historyTruncatedMean initial B n (ArmStreamPolicy.history initial select stream n) arm = (∑ s ∈ Finset.range (pullCount (ArmStreamPolicy.action initial select stream) arm (n+1)), truncate (B s) (stream s arm)) / pullCount (ArmStreamPolicy.action initial select stream) arm (n+1)