BanditRLlib
Lean gate passed before this site build; local proof declarations are shown as compiled.

Lean module · Tsallis-FTRL

BanditRLProof.TsallisSqrtScheduleFixedGap

# Square-root schedule fixed-gap bound for half-Tsallis FTRL This module instantiates the scheduled refined stability-penalty theorem with `eta t = 1 / (2 * sqrt (t + 1))`. The schedule contracts and its unified coefficient are bounded explicitly before the fixed-gap theorem is consumed.

Module map

Declarations
17
Placeholders
0

Imports

BanditRLProof.TsallisScheduledRefinedStabilityPenalty

Imported by

BanditRLProof, BanditRLProof.TsallisFiniteArmIIDCorruptedRewardLaw, BanditRLProof.TsallisFiniteBanditMeanLoss, BanditRLProof.TsallisScheduledIndependentMeanGap, BanditRLProof.TsallisSqrtScheduleSelfBoundingOptimization

Declarations

Open an item to read its exact compact statement and source link. Detailed teaching notes are linked when registered.

def BanditRLProof.Tsallis.sampledScheduledHalfTsallisSqrtSchedule Compiled

The concrete small-rate schedule used by the fixed-gap route.

noncomputable def sampledScheduledHalfTsallisSqrtSchedule (t : Nat) : Real
def BanditRLProof.Tsallis.sampledScheduledHalfTsallisHarmonicBudget Compiled

The finite harmonic budget through the inclusive horizon.

noncomputable def sampledScheduledHalfTsallisHarmonicBudget (horizon : Nat) : Real
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisHarmonicBudget_eq_harmonic Compiled

The local real-valued budget is the real cast of Mathlib's rational harmonic number.

theorem sampledScheduledHalfTsallisHarmonicBudget_eq_harmonic (horizon : Nat) : sampledScheduledHalfTsallisHarmonicBudget horizon = (harmonic (horizon + 1) : Real)
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisHarmonicBudget_le_one_add_log Compiled

Mathlib's finite harmonic estimate gives the explicit logarithmic budget.

theorem sampledScheduledHalfTsallisHarmonicBudget_le_one_add_log (horizon : Nat) : sampledScheduledHalfTsallisHarmonicBudget horizon <= 1 + Real.log (((horizon + 1 : Nat) : Real))
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisSqrtSchedule_pos Compiled

No declaration docstring is present; use the chapter context and exact statement below.

theorem sampledScheduledHalfTsallisSqrtSchedule_pos (t : Nat) : 0 < sampledScheduledHalfTsallisSqrtSchedule t
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisSqrtSchedule_le_half Compiled

No declaration docstring is present; use the chapter context and exact statement below.

theorem sampledScheduledHalfTsallisSqrtSchedule_le_half (t : Nat) : sampledScheduledHalfTsallisSqrtSchedule t <= 1 / 2
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisSqrtSchedule_succ_le Compiled

No declaration docstring is present; use the chapter context and exact statement below.

theorem sampledScheduledHalfTsallisSqrtSchedule_succ_le (t : Nat) : sampledScheduledHalfTsallisSqrtSchedule (t + 1) <= sampledScheduledHalfTsallisSqrtSchedule t
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisSqrtSchedule_four_mul_sq Compiled

No declaration docstring is present; use the chapter context and exact statement below.

theorem sampledScheduledHalfTsallisSqrtSchedule_four_mul_sq (t : Nat) : 4 * (sampledScheduledHalfTsallisSqrtSchedule t) ^ 2 = 1 / (((t + 1 : Nat) : Real))
theorem BanditRLProof.Tsallis.sqrt_succ_sub_sqrt_le_one_div_sqrt_succ Compiled Internal helper

No declaration docstring is present; use the chapter context and exact statement below.

private theorem sqrt_succ_sub_sqrt_le_one_div_sqrt_succ (t : Nat) : Real.sqrt (((t + 2 : Nat) : Real)) - Real.sqrt (((t + 1 : Nat) : Real)) <= 1 / Real.sqrt (((t + 2 : Nat) : Real))
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisRefinedCoefficient_sqrtSchedule_nonneg Compiled

No declaration docstring is present; use the chapter context and exact statement below.

theorem sampledScheduledHalfTsallisRefinedCoefficient_sqrtSchedule_nonneg (t : Nat) : 0 <= sampledScheduledHalfTsallisRefinedCoefficient sampledScheduledHalfTsallisSqrtSchedule t
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisRefinedCoefficient_sqrtSchedule_le Compiled

No declaration docstring is present; use the chapter context and exact statement below.

theorem sampledScheduledHalfTsallisRefinedCoefficient_sqrtSchedule_le (t : Nat) : sampledScheduledHalfTsallisRefinedCoefficient sampledScheduledHalfTsallisSqrtSchedule t <= 5 / Real.sqrt (((t + 1 : Nat) : Real))
theorem BanditRLProof.Tsallis.sampledScheduledHalfTsallisRefinedCoefficient_sqrtSchedule_sq_le Compiled

No declaration docstring is present; use the chapter context and exact statement below.

theorem sampledScheduledHalfTsallisRefinedCoefficient_sqrtSchedule_sq_le (t : Nat) : (sampledScheduledHalfTsallisRefinedCoefficient sampledScheduledHalfTsallisSqrtSchedule t) ^ 2 <= 25 / (((t + 1 : Nat) : Real))
theorem BanditRLProof.Tsallis.integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_of_selfBounding Compiled

The square-root schedule closes any matching self-bounding route with a finite harmonic budget and an explicit reciprocal-gap factor.

theorem integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_of_selfBounding {Env : Type u} {Action : Type v} [MeasurableSpace Env] [StandardBorelSpace Env] [MeasurableSpace Action] [MeasurableSingletonClass Action] [StandardBorelSpace Action] [Nonempty Action] [DecidableEq Action] (prior : Measure Env) [IsProbabilityMeasure prior] (arms : Finset Action) (harms : arms.Nonempty) (loss : Exp3.PredictableLossVector Env Action) {best : Action} (hbest : best ∈ arms) (horizon : Nat) (gap : Action -> Real) (hgapPos : ∀ action, action ∈ arms.erase best -> 0 < gap action) (corruption : Real) (hselfBounding : let selector := canonicalHalfTsallisScheduleGeneratedSelectorMeasurability arms harms sampledScheduledHalfTsallisSqrtSchedule loss let mu := prior ⊗ₘ sampledScheduledHalfTsallisTrajectoryKernel arms harms sampledScheduledHalfTsallisSqrtSchedule selector.finiteHistory loss.environment (Finset.range (horizon + 1)).sum (fun t => (arms.erase best).sum (fun action => gap action * sampledScheduledHalfTsallisExpectedProbabilityAt mu arms harms sampledScheduledHalfTsallisSqrtSchedule t action)) - corruption <= integral mu (sampledScheduledHalfTsallisPredictableEnvironmentRegret arms harms sampledScheduledHalfTsallisSqrtSchedule loss (pointMass best) horizon)) : let selector := canonicalHalfTsallisScheduleGeneratedSelectorMeasurability arms harms sampledScheduledHalfTsallisSqrtSchedule loss let mu := prior ⊗ₘ sampledScheduledHalfTsallisTrajectoryKernel arms harms sampledScheduledHalfTsallisSqrtSchedule selector.finiteHistory loss.environment integral mu (sampledScheduledHalfTsallisPredictableEnvironmentRegret arms harms sampledScheduledHalfTsallisSqrtSchedule loss (pointMass best) horizon) <= sampledScheduledHalfTsallisHarmonicBudget horizon * (1 + 25 * (arms.erase best).sum (fun action => 1 / gap action)) + corruption
theorem BanditRLProof.Tsallis.integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_fixedGap Compiled

The square-root schedule closes the exact fixed-gap route with a finite harmonic budget and an explicit reciprocal-gap factor.

theorem integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_fixedGap {Env : Type u} {Action : Type v} [MeasurableSpace Env] [StandardBorelSpace Env] [MeasurableSpace Action] [MeasurableSingletonClass Action] [StandardBorelSpace Action] [Nonempty Action] [DecidableEq Action] (prior : Measure Env) [IsProbabilityMeasure prior] (arms : Finset Action) (harms : arms.Nonempty) (loss : Exp3.PredictableLossVector Env Action) {best : Action} (hbest : best ∈ arms) (horizon : Nat) (gap : Action -> Real) (hgapPos : ∀ action, action ∈ arms.erase best -> 0 < gap action) (hgapLaw : ∀ t sample action, action ∈ arms -> Exp3.predictableLossAt loss t sample action - Exp3.predictableLossAt loss t sample best = gap action) (corruption : Real) (hcorruption : 0 <= corruption) : let selector := canonicalHalfTsallisScheduleGeneratedSelectorMeasurability arms harms sampledScheduledHalfTsallisSqrtSchedule loss let mu := prior ⊗ₘ sampledScheduledHalfTsallisTrajectoryKernel arms harms sampledScheduledHalfTsallisSqrtSchedule selector.finiteHistory loss.environment integral mu (sampledScheduledHalfTsallisPredictableEnvironmentRegret arms harms sampledScheduledHalfTsallisSqrtSchedule loss (pointMass best) horizon) <= sampledScheduledHalfTsallisHarmonicBudget horizon * (1 + 25 * (arms.erase best).sum (fun action => 1 / gap action)) + corruption
theorem BanditRLProof.Tsallis.integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_expectedGap Compiled

The square-root schedule also closes a coordinatewise expected-gap law; no samplewise fixed-gap identity is required.

theorem integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_expectedGap {Env : Type u} {Action : Type v} [MeasurableSpace Env] [StandardBorelSpace Env] [MeasurableSpace Action] [MeasurableSingletonClass Action] [StandardBorelSpace Action] [Nonempty Action] [DecidableEq Action] (prior : Measure Env) [IsProbabilityMeasure prior] (arms : Finset Action) (harms : arms.Nonempty) (loss : Exp3.PredictableLossVector Env Action) {best : Action} (hbest : best ∈ arms) (horizon : Nat) (gap : Action -> Real) (hgapPos : ∀ action, action ∈ arms.erase best -> 0 < gap action) (hgapLaw : let selector := canonicalHalfTsallisScheduleGeneratedSelectorMeasurability arms harms sampledScheduledHalfTsallisSqrtSchedule loss let mu := prior ⊗ₘ sampledScheduledHalfTsallisTrajectoryKernel arms harms sampledScheduledHalfTsallisSqrtSchedule selector.finiteHistory loss.environment HasScheduledExpectedGapLaw mu arms harms sampledScheduledHalfTsallisSqrtSchedule loss best gap horizon) (corruption : Real) (hcorruption : 0 <= corruption) : let selector := canonicalHalfTsallisScheduleGeneratedSelectorMeasurability arms harms sampledScheduledHalfTsallisSqrtSchedule loss let mu := prior ⊗ₘ sampledScheduledHalfTsallisTrajectoryKernel arms harms sampledScheduledHalfTsallisSqrtSchedule selector.finiteHistory loss.environment integral mu (sampledScheduledHalfTsallisPredictableEnvironmentRegret arms harms sampledScheduledHalfTsallisSqrtSchedule loss (pointMass best) horizon) <= sampledScheduledHalfTsallisHarmonicBudget horizon * (1 + 25 * (arms.erase best).sum (fun action => 1 / gap action)) + corruption
theorem BanditRLProof.Tsallis.integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_log_fixedGap Compiled

The concrete square-root schedule has an explicit logarithmic fixed-gap regret bound, obtained from Mathlib's finite harmonic estimate.

theorem integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_log_fixedGap {Env : Type u} {Action : Type v} [MeasurableSpace Env] [StandardBorelSpace Env] [MeasurableSpace Action] [MeasurableSingletonClass Action] [StandardBorelSpace Action] [Nonempty Action] [DecidableEq Action] (prior : Measure Env) [IsProbabilityMeasure prior] (arms : Finset Action) (harms : arms.Nonempty) (loss : Exp3.PredictableLossVector Env Action) {best : Action} (hbest : best ∈ arms) (horizon : Nat) (gap : Action -> Real) (hgapPos : ∀ action, action ∈ arms.erase best -> 0 < gap action) (hgapLaw : ∀ t sample action, action ∈ arms -> Exp3.predictableLossAt loss t sample action - Exp3.predictableLossAt loss t sample best = gap action) (corruption : Real) (hcorruption : 0 <= corruption) : let selector := canonicalHalfTsallisScheduleGeneratedSelectorMeasurability arms harms sampledScheduledHalfTsallisSqrtSchedule loss let mu := prior ⊗ₘ sampledScheduledHalfTsallisTrajectoryKernel arms harms sampledScheduledHalfTsallisSqrtSchedule selector.finiteHistory loss.environment integral mu (sampledScheduledHalfTsallisPredictableEnvironmentRegret arms harms sampledScheduledHalfTsallisSqrtSchedule loss (pointMass best) horizon) <= (1 + Real.log (((horizon + 1 : Nat) : Real))) * (1 + 25 * (arms.erase best).sum (fun action => 1 / gap action)) + corruption
theorem BanditRLProof.Tsallis.integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_log_expectedGap Compiled

Mathlib's harmonic estimate turns the coordinatewise expected-gap route into the same explicit logarithmic square-root-schedule bound.

theorem integral_sampledScheduledHalfTsallisPredictableEnvironmentRegret_pointMass_le_sqrtSchedule_log_expectedGap {Env : Type u} {Action : Type v} [MeasurableSpace Env] [StandardBorelSpace Env] [MeasurableSpace Action] [MeasurableSingletonClass Action] [StandardBorelSpace Action] [Nonempty Action] [DecidableEq Action] (prior : Measure Env) [IsProbabilityMeasure prior] (arms : Finset Action) (harms : arms.Nonempty) (loss : Exp3.PredictableLossVector Env Action) {best : Action} (hbest : best ∈ arms) (horizon : Nat) (gap : Action -> Real) (hgapPos : ∀ action, action ∈ arms.erase best -> 0 < gap action) (hgapLaw : let selector := canonicalHalfTsallisScheduleGeneratedSelectorMeasurability arms harms sampledScheduledHalfTsallisSqrtSchedule loss let mu := prior ⊗ₘ sampledScheduledHalfTsallisTrajectoryKernel arms harms sampledScheduledHalfTsallisSqrtSchedule selector.finiteHistory loss.environment HasScheduledExpectedGapLaw mu arms harms sampledScheduledHalfTsallisSqrtSchedule loss best gap horizon) (corruption : Real) (hcorruption : 0 <= corruption) : let selector := canonicalHalfTsallisScheduleGeneratedSelectorMeasurability arms harms sampledScheduledHalfTsallisSqrtSchedule loss let mu := prior ⊗ₘ sampledScheduledHalfTsallisTrajectoryKernel arms harms sampledScheduledHalfTsallisSqrtSchedule selector.finiteHistory loss.environment integral mu (sampledScheduledHalfTsallisPredictableEnvironmentRegret arms harms sampledScheduledHalfTsallisSqrtSchedule loss (pointMass best) horizon) <= (1 + Real.log (((horizon + 1 : Nat) : Real))) * (1 + 25 * (arms.erase best).sum (fun action => 1 / gap action)) + corruption