Canonical KL bound for the actual standardized RGO
AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOKLFisher.standardized_rgo_unique_prox_and_kl_le_fisher · theorem · Teaching coverage
Mathematical statement
Under the source normalized globally C2 Hessian bounds kappa^-1 I≤Hessian V≤I, kappa≥1, and positive measurable eta with measurable y, there exists a measurable unique stationary proximal point p. Let R be the actual quadratic reweighting of volume.tilted(-V), let r be its actual affine standardization about the same p, and gamma=stdGaussian E. Then r is a probability absolutely continuous with respect to gamma, canonical KL is finite, the true smooth residual-potential gradient is in L2(r), and KL(r||gamma).toReal≤half integral norm(gradient rho)^2 dr. E is finite complete real Hilbert/Borel, including rank0; no eta upper bound or caller coherence/density/domain/inequality certificate is assumed.
Lean statement · standardized_rgo_unique_prox_and_kl_le_fisher
Under the source normalized globally C2 Hessian bounds kappa^-1 I<=Hessian V<=I, kappa>=1, and positive measurable eta with measurable y, there exists a measurable unique stationary proximal point p. Let R be the actual quadratic reweighting of volume.tilted(-V), let r be its actual affine standardization about the same p, and gamma=stdGaussian E. Then r is a probability absolutely continuous with respect to gamma, canonical KL is finite, the true smooth residual-potential gradient is in L2(r), and KL(r||gamma).toReal<=half integral norm(gradient rho)^2 dr. E is finite complete real Hilbert/Borel, including rank0; no eta upper bound or caller coherence/density/domain/inequality certificate is assumed.
Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.
theorem standardized_rgo_unique_prox_and_kl_le_fisher
{E S : Type*} [NormedAddCommGroup E] [InnerProductSpace ℝ E]
[CompleteSpace E] [FiniteDimensional ℝ E] [MeasurableSpace E] [BorelSpace E]
[MeasurableSpace S] {V : E → ℝ} {κ : ℝ}
(hκ : 1 ≤ κ) (hV : ContDiff ℝ 2 V)
(hH : ∀ x v : E, κ⁻¹*‖v‖^2 ≤ fderiv ℝ (fderiv ℝ V) x v v ∧
fderiv ℝ (fderiv ℝ V) x v v ≤ ‖v‖^2)
{eta : S → ℝ} {y : S → E} (heta : Measurable eta) (hy : Measurable y)
(hpos : ∀ s, 0 < eta s) :
∃ p : S → E, Measurable p ∧
(∀ s, p s+eta s • gradient V (p s)=y s) ∧
(∀ s z, z+eta s • gradient V z=y s → z=p s) ∧
let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
let mu := (volume : Measure E).tilted (fun x => -V x)
let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
let gamma := stdGaussian E
∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
_root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
MemLp (gradient (rho s)) 2 (r s) ∧
(_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
(1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s)Proof roadmap
- 1Produce one unique proximal point
Use the actual relative-entropy producer to obtain a measurable stationary p and uniqueness; its actual posterior already has absolute continuity and finite canonical KL. Actual32 supplies the probability output used below in Step3. All are derived from the source V/Hessian/eta assumptions.
- 2Reconcile the square-root-density witness
The actual square-root-density producer initially returns p prime. Apply uniqueness to its stationarity, prove equality of the two functions by funext, and rewrite the entire dependent output. Thus rho, Z, q, f and r all refer to the same actual p; no coherence premise is supplied.
- 3Retrieve the real density and analytic domains
The actual32 outputs give q=exp(-rho)/Z, raw f=exp(-rho/2)/sqrtZ, f²=q and mass1. They also give C2 f, actual fL2 and gradientL2 under gamma, and qlogqL1. No compact-support or limit certificate is required.
- 4Apply the noncompact Gaussian function LSI
Apply the actual42 theorem to this raw f, deriving integrability of Phi(f²) from f²=q and qlogqL1. The result is homogeneous entropy with exact variance-one coefficient2, on the actual canonical Gaussian.
- 5Identify the finite canonical KL
The actual33 entropy identity uses canonical klDiv, with actual probability, absolute continuity and finiteness. Substitute f²=q and mass1 into the homogeneous entropy; log1=0 removes its mass term. No pointwise derivative of a Radon–Nikodym version is taken.
- 6Retain the exact half coefficient
Use actual32 quarter-energy identity for the true smooth rho gradient under the same literal r. Substitution in the Gaussian coefficient2 yields exactly half, with the actual Fisher integral finite because gradient rho is L2(r).
- 7Exercise actual posterior consumers
Tests specialize the actual volume tilt and affine posterior at eta2, at the positive unbounded family eta(s)=s²+1 with y(s)=s v, and at the zero-dimensional constant potential. The last case proves actual canonical KL.toReal=0 using the zero score and nonnegativity. Gaussian T2 and the W2 portion of FIRST4.6 remain separate.
Full assumptions and notation
All objects and hypotheses
- Finite-dimensional complete real Hilbert/Borel E; measurable parameter space S. Rank0 is an explicit authored extension.
- V is globally C2, kappa≥1 and kappa^-1 norm(v)^2≤D²V(x)[v,v]≤norm(v)^2 for every x,v, exactly the source normalized potential bounds.
- eta/y are measurable and eta(s)>0 for every s; the measurable family is an authored extension, with Unit recovering source fixed parameters. No eta≤1 hypothesis is added.
- Actual p, all probability/AC/finite entropy/score domains and the half-Fisher inequality are produced internally. Canonical KL is finite before toReal is used; only the smooth rho is differentiated.
Mathematical proof
1. Produce one unique proximal point
Use the actual relative-entropy producer to obtain a measurable stationary p and uniqueness; its actual posterior already has absolute continuity and finite canonical KL. Actual32 supplies the probability output used below in Step3. All are derived from the source V/Hessian/eta assumptions.
Corresponding Lean step
standardized_rgo_unique_prox_and_finite_entropy
2. Reconcile the square-root-density witness
The actual square-root-density producer initially returns p prime. Apply uniqueness to its stationarity, prove equality of the two functions by funext, and rewrite the entire dependent output. Thus rho, Z, q, f and r all refer to the same actual p; no coherence premise is supplied.
Corresponding Lean step
huniq; hstat'; funext; rw [hp] at hd
3. Retrieve the real density and analytic domains
The actual32 outputs give q=exp(-rho)/Z, raw f=exp(-rho/2)/sqrtZ, f²=q and mass1. They also give C2 f, actual fL2 and gradientL2 under gamma, and qlogqL1. No compact-support or limit certificate is required.
Corresponding Lean step
standardized_rgo_sqrt_density_domain; hq; hmass; hfC; hf2; hg2; hqint
4. Apply the noncompact Gaussian function LSI
Apply the actual42 theorem to this raw f, deriving integrability of Phi(f²) from f²=q and qlogqL1. The result is homogeneous entropy with exact variance-one coefficient2, on the actual canonical Gaussian.
Corresponding Lean step
gaussian_logSobolev_of_contDiff; hphi; hLSI
5. Identify the finite canonical KL
The actual33 entropy identity uses canonical klDiv, with actual probability, absolute continuity and finiteness. Substitute f²=q and mass1 into the homogeneous entropy; log1=0 removes its mass term. No pointwise derivative of a Radon–Nikodym version is taken.
Corresponding Lean step
hKLq; hfin; hsq; hmass; Real.log_one
6. Retain the exact half coefficient
Use actual32 quarter-energy identity for the true smooth rho gradient under the same literal r. Substitution in the Gaussian coefficient2 yields exactly half, with the actual Fisher integral finite because gradient rho is L2(r).
Corresponding Lean step
he; hrho2; rw [he]; ring
7. Exercise actual posterior consumers
Tests specialize the actual volume tilt and affine posterior at eta2, at the positive unbounded family eta(s)=s²+1 with y(s)=s v, and at the zero-dimensional constant potential. The last case proves actual canonical KL.toReal=0 using the zero score and nonnegativity. Gaussian T2 and the W2 portion of FIRST4.6 remain separate.
Corresponding Lean step
actual_fixed_posterior; actual_variable_step_family; rank_zero_actual_canonical_kl
Lean verification
The exact proof begins folded immediately after the mathematical argument; the statement is folded beside the claim above.
Lean proof · standardized_rgo_unique_prox_and_kl_le_fisher
Produce one unique proximal point; Reconcile the square-root-density witness; Retrieve the real density and analytic domains; Apply the noncompact Gaussian function LSI; Identify the finite canonical KL; Retain the exact half coefficient; Exercise actual posterior consumers
Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.
theorem standardized_rgo_unique_prox_and_kl_le_fisher
{E S : Type*} [NormedAddCommGroup E] [InnerProductSpace ℝ E]
[CompleteSpace E] [FiniteDimensional ℝ E] [MeasurableSpace E] [BorelSpace E]
[MeasurableSpace S] {V : E → ℝ} {κ : ℝ}
(hκ : 1 ≤ κ) (hV : ContDiff ℝ 2 V)
(hH : ∀ x v : E, κ⁻¹*‖v‖^2 ≤ fderiv ℝ (fderiv ℝ V) x v v ∧
fderiv ℝ (fderiv ℝ V) x v v ≤ ‖v‖^2)
{eta : S → ℝ} {y : S → E} (heta : Measurable eta) (hy : Measurable y)
(hpos : ∀ s, 0 < eta s) :
∃ p : S → E, Measurable p ∧
(∀ s, p s+eta s • gradient V (p s)=y s) ∧
(∀ s z, z+eta s • gradient V z=y s → z=p s) ∧
let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
let mu := (volume : Measure E).tilted (fun x => -V x)
let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
let gamma := stdGaussian E
∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
_root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
MemLp (gradient (rho s)) 2 (r s) ∧
(_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
(1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s) := by
obtain ⟨p, hpm, hstat, huniq, hk⟩ :=
StandardizedRGORelativeEntropy.standardized_rgo_unique_prox_and_finite_entropy
hκ hV hH heta hy hpos
obtain ⟨p', hpm', hstat', hd⟩ :=
StandardizedRGOSqrtDensity.standardized_rgo_sqrt_density_domain
hκ hV hH heta hy hpos
have hp : p'=p := funext (fun s => huniq s (p' s) (hstat' s))
rw [hp] at hd
let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
let mu := (volume : Measure E).tilted (fun x => -V x)
let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
let gamma := stdGaussian E
let Z := fun s => ∫ u, Real.exp (-rho s u) ∂gamma
let q := fun s u => Real.exp (-rho s u)/Z s
let f := fun s u => Real.exp (-rho s u/2)/Real.sqrt (Z s)
refine ⟨p, hpm, hstat, huniq, ?_⟩
change ∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
_root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
MemLp (gradient (rho s)) 2 (r s) ∧
(_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
(1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s)
intro s
obtain ⟨hZpos, hZle, hrtilt, hrden, hprob, hq, hmass, hfC, hf2,
hg2, hrho2, hqint, hgf, hglog, he⟩ := hd s
obtain ⟨hac, hfin, hllr, hlog, hrhoint, hKLq, hKLrho⟩ := hk s
change (∫ u, q s u ∂gamma)=1 at hmass
change (∫ u, ‖gradient (f s) u‖^2 ∂gamma) =
(1/4 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s) at he
change (_root_.InformationTheory.klDiv (r s) gamma).toReal =
(∫ u, q s u*Real.log (q s u) ∂gamma) at hKLq
have hsq : ∀ u, (f s u)^2=q s u := fun u => (hq u).2
have hphi : Integrable (fun u => (f s u)^2*Real.log ((f s u)^2)) gamma := by
simpa only [hsq] using hqint
have hLSI := AutoSamplingTheory.TechnicalLemmas.FunctionalInequalities.GaussianLogSobolev.gaussian_logSobolev_of_contDiff
(f s) hfC hf2 hg2 hphi
change (∫ u, (f s u)^2*Real.log ((f s u)^2) ∂gamma) -
(∫ u, (f s u)^2 ∂gamma)*Real.log (∫ u, (f s u)^2 ∂gamma) ≤
2 * ∫ u, ‖gradient (f s) u‖^2 ∂gamma at hLSI
refine ⟨hprob, hac, hfin, hrho2, ?_⟩
calc
_ = ∫ u, q s u*Real.log (q s u) ∂gamma := hKLq
_ ≤ 2 * ∫ u, ‖gradient (f s) u‖^2 ∂gamma := by
simpa only [hsq, hmass, Real.log_one, mul_zero, sub_zero] using hLSI
_ = (1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s) := by
rw [he]
ring
end
end AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOKLFisherSource assumptions versus formal assumptions
| Source | Actual Lean | Difference kind | Why it matters |
|---|---|---|---|
| Fixed source eta>0,y and normalized globally C2 V/Hessian bounds. | Measurable eta/y family, internally produced unique measurable prox, same literal actual standardized posterior. | source-implicit | Family/rank0 are explicit authored extensions; Unit recovers fixed source hypotheses without an eta cap. |
| GaussianLSI invoked for the standardized posterior. | Same actual32/33 witness, raw sqrt-density actual C2/L2/entropy domains, actual42 LSI2. | source-implicit | Omitted domain and coherence obligations are internally derived, not added as caller premises. |
| KL/Fisher normalization under variance-one Gaussian. | Canonical finite KL identity and actual quarter Fisher yield coefficienthalf. | same | Smooth rho is differentiated; canonical logRN representative remains AE only. |
| Talagrand/W2/FIRST4.6 and sampler/main/cost composition. | Authored sufficient same-unique-prox canonical KL<=Fisher/2 leaf for the literal standardized RGO. Exact source normalized C2/Hessian assumptions; all positive eta, actual measurable-family extension incl rank0. Probability/AC/finite KL/scoreL2 and same witness are internally derived. Coherent32/33 actual rho/Z/q/f/r transported by uniqueness, true Gaussian functionLSI42 coefficient2 and actual32 energyquarter. No extra witness/coherence/density/law/desiredbound certificate. GaussianT2/W2/FIRST4.6/fullW12/sampling/both mains/error/work/expectedcost/main/live/PURIFIED remain separate. Actual focused3826 PASS; independent wholeproof/blind/source/exactcommit/shared admission pending. | unresolved | No transport inequality or unbounded-cost transfer follows from this KL leaf alone. |
Authored sufficient same-unique-prox canonical KL<=Fisher/2 leaf for the literal standardized RGO. Exact source normalized C2/Hessian assumptions; all positive eta, actual measurable-family extension incl rank0. Probability/AC/finite KL/scoreL2 and same witness are internally derived. Coherent32/33 actual rho/Z/q/f/r transported by uniqueness, true Gaussian functionLSI42 coefficient2 and actual32 energyquarter. No extra witness/coherence/density/law/desiredbound certificate. GaussianT2/W2/FIRST4.6/fullW12/sampling/both mains/error/work/expectedcost/main/live/PURIFIED remain separate. Actual focused3826 PASS; independent wholeproof/blind/source/exactcommit/shared admission pending.
Encoder–denoiser: accepted · equivalent-after-elaboration
A generalization is not a source correction. Proposed missing conditions require separate independent repair review. No proposed repair silently changes the original theorem.
Scope and omitted-condition boundaries
- Authored sufficient same-unique-prox canonical KL≤Fisher/2 leaf for the literal standardized RGO. Exact source normalized C2/Hessian assumptions; all positive eta, actual measurable-family extension incl rank0. Probability/AC/finite KL/scoreL2 and same witness are internally derived. Coherent32/33 actual rho/Z/q/f/r transported by uniqueness, true Gaussian functionLSI42 coefficient2 and actual32 energyquarter. No extra witness/coherence/density/law/desiredbound certificate. GaussianT2/W2/FIRST4.6/fullW12/sampling/both mains/error/work/expectedcost/main/live/PURIFIED remain separate. Actual focused3826 PASS; independent wholeproof/blind/source/exactcommit/shared admission pending.
Sources, dependencies, and reuse
Source and reuse
Samplinglib parents called
AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOSqrtDensity.standardized_rgo_sqrt_density_domainAutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGORelativeEntropy.standardized_rgo_unique_prox_and_finite_entropyAutoSamplingTheory.TechnicalLemmas.FunctionalInequalities.GaussianLogSobolev.gaussian_logSobolev_of_contDiff
Mathlib API called (external library)
- Real.log_one
Mathematical sources
- SPHMC arXiv2609.06906v1 S2 normalized hypotheses/prox/RGO/KL definitions; S4.Ex8 actual standardized posterior and S4.E6 omitted GaussianLSI component. — Authored sufficient same-unique-prox canonical KL<=Fisher/2 leaf for the literal standardized RGO. Exact source normalized C2/Hessian assumptions; all positive eta, actual measurable-family extension incl rank0. Probability/AC/finite KL/scoreL2 and same witness are internally derived. Coherent32/33 actual rho/Z/q/f/r transported by uniqueness, true Gaussian functionLSI42 coefficient2 and actual32 energyquarter. No extra witness/coherence/density/law/desiredbound certificate. GaussianT2/W2/FIRST4.6/fullW12/sampling/both mains/error/work/expectedcost/main/live/PURIFIED remain separate. Actual focused3826 PASS; independent wholeproof/blind/source/exactcommit/shared admission pending.
Samplinglib prose is not a quotation or a source-equivalence certificate. Definitions and aliases are explained as constructions, not counted as new mathematical proofs.