Numerical canonical KL bound for the actual standardized RGO
AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOKLDimension.standardized_rgo_unique_prox_and_kl_le_dimension · theorem · Teaching coverage
Mathematical statement
Let E be a finite-dimensional complete real Hilbert space with its Borel structure, including rank zero, and S a measurable parameter space. Let V be globally C2 with kappa≥1 and kappa^-1 norm(v)^2≤D²V(x)[v,v]≤norm(v)^2 for every x,v. For measurable eta/y with every eta(s)>0, there exists a measurable unique stationary proximal point p. Define the actual normalized volume tilt mu, its actual quadratic RGO reweighting R, its actual affine standardization r about that same p, the displayed smooth residual rho, and gamma=stdGaussian E. For every s, r(s) is a probability, absolutely continuous with respect to gamma, canonical KL is finite, gradient rho(s) is L2(r(s)), and canonical KL(r(s)||gamma).toReal≤eta(s)^2*real(finrank E)/2. No step-size upper bound, caller witness, law, coherence, domain or desired-bound certificate is assumed.
Lean statement · standardized_rgo_unique_prox_and_kl_le_dimension
Let E be a finite-dimensional complete real Hilbert space with its Borel structure, including rank zero, and S a measurable parameter space. Let V be globally C2 with kappa>=1 and kappa^-1 norm(v)^2<=D²V(x)[v,v]<=norm(v)^2 for every x,v. For measurable eta/y with every eta(s)>0, there exists a measurable unique stationary proximal point p. Define the actual normalized volume tilt mu, its actual quadratic RGO reweighting R, its actual affine standardization r about that same p, the displayed smooth residual rho, and gamma=stdGaussian E. For every s, r(s) is a probability, absolutely continuous with respect to gamma, canonical KL is finite, gradient rho(s) is L2(r(s)), and canonical KL(r(s)||gamma).toReal<=eta(s)^2*real(finrank E)/2. No step-size upper bound, caller witness, law, coherence, domain or desired-bound certificate is assumed.
Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.
theorem standardized_rgo_unique_prox_and_kl_le_dimension
{E S : Type*} [NormedAddCommGroup E] [InnerProductSpace ℝ E]
[CompleteSpace E] [FiniteDimensional ℝ E] [MeasurableSpace E] [BorelSpace E]
[MeasurableSpace S] {V : E → ℝ} {κ : ℝ}
(hκ : 1 ≤ κ) (hV : ContDiff ℝ 2 V)
(hH : ∀ x v : E, κ⁻¹*‖v‖^2 ≤ fderiv ℝ (fderiv ℝ V) x v v ∧
fderiv ℝ (fderiv ℝ V) x v v ≤ ‖v‖^2)
{eta : S → ℝ} {y : S → E} (heta : Measurable eta) (hy : Measurable y)
(hpos : ∀ s, 0 < eta s) :
∃ p : S → E, Measurable p ∧
(∀ s, p s+eta s • gradient V (p s)=y s) ∧
(∀ s z, z+eta s • gradient V z=y s → z=p s) ∧
let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
let mu := (volume : Measure E).tilted (fun x => -V x)
let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
let gamma := stdGaussian E
∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
_root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
MemLp (gradient (rho s)) 2 (r s) ∧
(_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
(eta s)^2*(Module.finrank ℝ E : ℝ)/2Proof roadmap
- 1Produce the actual unique-prox law
The actual canonical KL/Fisher producer supplies measurable p, stationarity and uniqueness. The displayed volume tilt, quadratic reweighting and affine pushforward are the source posterior; probability, absolute continuity, finite canonical KL and the score L2 domain are actual outputs.
- 2Identify the numerical-Fisher witness internally
The position/Fisher producer initially returns another stationary p prime. Uniqueness of p gives equality pointwise; Lean Core function extensionality gives equality of the families. Rewriting its entire output transports rho, Q, r, gradients and integration laws. The caller supplies no coherence condition.
- 3Reuse the actual numerical Fisher estimate
The same-law position/Fisher parent already proves the actual second moment at most d and the score-energy bound at most eta squared times that moment. Its final output is the numerical Fisher bound below. This proof calls that genuine producer and does not repeat its moment or gradient-growth proof.
- 4Retain canonical KL and its true domains
At the identical posterior and residual potential, the canonical KL/Fisher parent supplies the half-Fisher inequality together with actual probability, absolute continuity, finite canonical KL and score integrability. It is the finite canonical ENNReal KL real value, rather than a chosen density entropy or totalized infinite value.
- 5Compose with the exact real coefficient
Multiply the actual numerical Fisher inequality by nonnegative one half and use order transitivity. Exact real arithmetic gives eta squared d divided by two. No division by d, eta or energy occurs, so zero-dimensional and zero-energy cases are retained.
- 6Exercise actual posterior consumers
Actual tests specialize eta=2, the positive unbounded measurable family eta(s)=s²+1 with y(s)=s v, and the zero-dimensional constant potential. The last test uses the real finrank zero upper bound and canonical KL nonnegativity to prove the actual finite KL real value is zero. T2 and the W2/FIRST step remain separate.
Full assumptions and notation
All objects and hypotheses
- Finite complete real Hilbert/Borel E and measurable S. Finite rank zero and measurable families are explicit authored extensions; Unit recovers fixed source parameters.
- V is globally C2 and kappa≥1, with the exact normalized evaluated Hessian bounds kappa^-1 norm(v)^2≤D²V(x)[v,v]≤norm(v)^2 for all x,v.
- eta/y are measurable and eta(s)>0 at every s, without an upper restriction.
- Actual unique measurable p, probability/AC/finite canonical KL and true smooth-rho gradient L2 are internally produced outputs. Finite KL is retained before toReal; canonical logRN is not pointwise differentiated.
Mathematical proof
1. Produce the actual unique-prox law
The actual canonical KL/Fisher producer supplies measurable p, stationarity and uniqueness. The displayed volume tilt, quadratic reweighting and affine pushforward are the source posterior; probability, absolute continuity, finite canonical KL and the score L2 domain are actual outputs.
Corresponding Lean step
standardized_rgo_unique_prox_and_kl_le_fisher; hpm; hstat; huniq; hk
2. Identify the numerical-Fisher witness internally
The position/Fisher producer initially returns another stationary p prime. Uniqueness of p gives equality pointwise; Lean Core function extensionality gives equality of the families. Rewriting its entire output transports rho, Q, r, gradients and integration laws. The caller supplies no coherence condition.
Corresponding Lean step
standardized_rgo_position_and_fisher; hstat'; huniq; Lean Core funext; rw [hp] at hd
3. Reuse the actual numerical Fisher estimate
The same-law position/Fisher parent already proves the actual second moment at most d and the score-energy bound at most eta squared times that moment. Its final output is the numerical Fisher bound below. This proof calls that genuine producer and does not repeat its moment or gradient-growth proof.
Corresponding Lean step
hd.2 s; hscoreposition; hscorebound; same literal real finrank cast
4. Retain canonical KL and its true domains
At the identical posterior and residual potential, the canonical KL/Fisher parent supplies the half-Fisher inequality together with actual probability, absolute continuity, finite canonical KL and score integrability. It is the finite canonical ENNReal KL real value, rather than a chosen density entropy or totalized infinite value.
Corresponding Lean step
hk s; hprob; hac; hfin; hrho2; hkl
5. Compose with the exact real coefficient
Multiply the actual numerical Fisher inequality by nonnegative one half and use order transitivity. Exact real arithmetic gives eta squared d divided by two. No division by d, eta or energy occurs, so zero-dimensional and zero-energy cases are retained.
Corresponding Lean step
mul_le_mul_of_nonneg_left hscorebound; norm_num; calc; ring
6. Exercise actual posterior consumers
Actual tests specialize eta=2, the positive unbounded measurable family eta(s)=s²+1 with y(s)=s v, and the zero-dimensional constant potential. The last test uses the real finrank zero upper bound and canonical KL nonnegativity to prove the actual finite KL real value is zero. T2 and the W2/FIRST step remain separate.
Corresponding Lean step
actual_fixed_posterior; actual_variable_step_family; rank_zero_actual_canonical_kl; finrank_euclideanSpace
Lean verification
The exact proof begins folded immediately after the mathematical argument; the statement is folded beside the claim above.
Lean proof · standardized_rgo_unique_prox_and_kl_le_dimension
Produce the actual unique-prox law; Identify the numerical-Fisher witness internally; Reuse the actual numerical Fisher estimate; Retain canonical KL and its true domains; Compose with the exact real coefficient; Exercise actual posterior consumers
Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.
theorem standardized_rgo_unique_prox_and_kl_le_dimension
{E S : Type*} [NormedAddCommGroup E] [InnerProductSpace ℝ E]
[CompleteSpace E] [FiniteDimensional ℝ E] [MeasurableSpace E] [BorelSpace E]
[MeasurableSpace S] {V : E → ℝ} {κ : ℝ}
(hκ : 1 ≤ κ) (hV : ContDiff ℝ 2 V)
(hH : ∀ x v : E, κ⁻¹*‖v‖^2 ≤ fderiv ℝ (fderiv ℝ V) x v v ∧
fderiv ℝ (fderiv ℝ V) x v v ≤ ‖v‖^2)
{eta : S → ℝ} {y : S → E} (heta : Measurable eta) (hy : Measurable y)
(hpos : ∀ s, 0 < eta s) :
∃ p : S → E, Measurable p ∧
(∀ s, p s+eta s • gradient V (p s)=y s) ∧
(∀ s z, z+eta s • gradient V z=y s → z=p s) ∧
let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
let mu := (volume : Measure E).tilted (fun x => -V x)
let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
let gamma := stdGaussian E
∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
_root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
MemLp (gradient (rho s)) 2 (r s) ∧
(_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
(eta s)^2*(Module.finrank ℝ E : ℝ)/2 := by
obtain ⟨p, hpm, hstat, huniq, hk⟩ :=
StandardizedRGOKLFisher.standardized_rgo_unique_prox_and_kl_le_fisher
hκ hV hH heta hy hpos
obtain ⟨p', hpm', hstat', hd⟩ :=
StandardizedRGOPositionFisher.standardized_rgo_position_and_fisher
hκ hV hH heta hy hpos
have hp : p'=p := funext (fun s => huniq s (p' s) (hstat' s))
rw [hp] at hd
let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
let mu := (volume : Measure E).tilted (fun x => -V x)
let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
let gamma := stdGaussian E
refine ⟨p, hpm, hstat, huniq, ?_⟩
change ∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
_root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
MemLp (gradient (rho s)) 2 (r s) ∧
(_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
(eta s)^2*(Module.finrank ℝ E : ℝ)/2
intro s
obtain ⟨hprob, hac, hfin, hrho2, hkl⟩ := hk s
obtain ⟨hprobR, hCrho, hCQ, hgrho0, hgQ0, hHrho, hHQ, hrtilt,
hprobr, hposition2, hpositionint, hpositionbound, hscore2,
hscoreposition, hscorebound⟩ := hd.2 s
change (∫ u, ‖gradient (rho s) u‖^2 ∂r s) ≤
(eta s)^2*(Module.finrank ℝ E : ℝ) at hscorebound
refine ⟨hprob, hac, hfin, hrho2, ?_⟩
calc
_ ≤ (1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s) := hkl
_ ≤ (1/2 : ℝ)*((eta s)^2*(Module.finrank ℝ E : ℝ)) :=
mul_le_mul_of_nonneg_left hscorebound (by norm_num)
_ = (eta s)^2*(Module.finrank ℝ E : ℝ)/2 := by ring
end
end AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOKLDimensionScope and omitted-condition boundaries
- Authored sufficient actual standardizedRGO numerical canonical KL≤eta²finrank/2 intermediate for SPHMC FIRST4.6. Literal normalized globally C2/Hessian source assumptions, all positive eta and explicitly authored measurable-family/rank0 extension. Unique measurable actual prox, probability/AC/finitecanonicalKL and true smoothrho gradientL2 internally produced. Choose43p, internally use43uniqueness with31stationarity, transport every rho/Q/r output before numeric Fisher composition. No new positionmoment proof, no caller coherence/domain/law/numericbound certificate. GaussianT2/W2/FIRST4.6, fullsamplers/main/realcost/composition/reader/main/live/PURIFIED remain separate. Actual focused3827PASS; independent wholeproof/blind/source/exactcommit/shared admission pending.
Sources, dependencies, and reuse
Source and reuse
Samplinglib parents called
AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOKLFisher.standardized_rgo_unique_prox_and_kl_le_fisherAutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOPositionFisher.standardized_rgo_position_and_fisher
Mathlib API called (external library)
- mul_le_mul_of_nonneg_left
Mathematical sources
- SPHMC arXiv2609.06906v1 S2 normalized hypotheses/prox/RGO/KL; S4.Ex8 standardized posterior, FIRST S4.E6/S4.SS1.p4.3 numerical KL/Fisher ingredient. — Authored sufficient actual standardizedRGO numerical canonical KL<=eta²finrank/2 intermediate for SPHMC FIRST4.6. Literal normalized globally C2/Hessian source assumptions, all positive eta and explicitly authored measurable-family/rank0 extension. Unique measurable actual prox, probability/AC/finitecanonicalKL and true smoothrho gradientL2 internally produced. Choose43p, internally use43uniqueness with31stationarity, transport every rho/Q/r output before numeric Fisher composition. No new positionmoment proof, no caller coherence/domain/law/numericbound certificate. GaussianT2/W2/FIRST4.6, fullsamplers/main/realcost/composition/reader/main/live/PURIFIED remain separate. Actual focused3827PASS; independent wholeproof/blind/source/exactcommit/shared admission pending.
Samplinglib prose is not a quotation or a source-equivalence certificate. Definitions and aliases are explained as constructions, not counted as new mathematical proofs.