Samplinglib
Lean gate not recorded for this source state main · 9bb7a7394ab0

StandardizedRGOKLFisher: mathematical reading route

Read the statements and derivations in source order. Every result has its own optional Lean statement and proof. Source assumptions, library reuse and unproved boundaries are kept explicit.

  1. Canonical KL bound for the actual standardized RGO
Samplinglib mathematical lesson

Canonical KL bound for the actual standardized RGO

AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOKLFisher.standardized_rgo_unique_prox_and_kl_le_fisher · theorem · Teaching coverage

Read this first

Mathematical statement

Under the source normalized globally C2 Hessian bounds kappa^-1 I≤Hessian V≤I, kappa≥1, and positive measurable eta with measurable y, there exists a measurable unique stationary proximal point p. Let R be the actual quadratic reweighting of volume.tilted(-V), let r be its actual affine standardization about the same p, and gamma=stdGaussian E. Then r is a probability absolutely continuous with respect to gamma, canonical KL is finite, the true smooth residual-potential gradient is in L2(r), and KL(r||gamma).toReal≤half integral norm(gradient rho)^2 dr. E is finite complete real Hilbert/Borel, including rank0; no eta upper bound or caller coherence/density/domain/inequality certificate is assumed.

\[D_{\mathrm{KL}}(r\Vert\gamma)\le\frac12\int\|\nabla\rho(u)\|^2\,dr(u),\quad r=(x\mapsto\eta^{-1/2}(x-p))_{\#}\mathrm{RGO}_{\eta,y},\quad\gamma=\mathrm{stdGaussian}(E).\]
Lean statement · standardized_rgo_unique_prox_and_kl_le_fisher

Under the source normalized globally C2 Hessian bounds kappa^-1 I<=Hessian V<=I, kappa>=1, and positive measurable eta with measurable y, there exists a measurable unique stationary proximal point p. Let R be the actual quadratic reweighting of volume.tilted(-V), let r be its actual affine standardization about the same p, and gamma=stdGaussian E. Then r is a probability absolutely continuous with respect to gamma, canonical KL is finite, the true smooth residual-potential gradient is in L2(r), and KL(r||gamma).toReal<=half integral norm(gradient rho)^2 dr. E is finite complete real Hilbert/Borel, including rank0; no eta upper bound or caller coherence/density/domain/inequality certificate is assumed.

Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.

theorem standardized_rgo_unique_prox_and_kl_le_fisher
    {E S : Type*} [NormedAddCommGroup E] [InnerProductSpace ℝ E]
    [CompleteSpace E] [FiniteDimensional ℝ E] [MeasurableSpace E] [BorelSpace E]
    [MeasurableSpace S] {V : E → ℝ} {κ : ℝ}
    (hκ : 1 ≤ κ) (hV : ContDiff ℝ 2 V)
    (hH : ∀ x v : E, κ⁻¹*‖v‖^2 ≤ fderiv ℝ (fderiv ℝ V) x v v ∧
      fderiv ℝ (fderiv ℝ V) x v v ≤ ‖v‖^2)
    {eta : S → ℝ} {y : S → E} (heta : Measurable eta) (hy : Measurable y)
    (hpos : ∀ s, 0 < eta s) :
    ∃ p : S → E, Measurable p ∧
      (∀ s, p s+eta s • gradient V (p s)=y s) ∧
      (∀ s z, z+eta s • gradient V z=y s → z=p s) ∧
      let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
        Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
      let mu := (volume : Measure E).tilted (fun x => -V x)
      let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
      let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
      let gamma := stdGaussian E
      ∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
        _root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
        MemLp (gradient (rho s)) 2 (r s) ∧
        (_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
          (1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s)

Exact module and namespace context

Proof roadmap

  1. 1Produce one unique proximal point

    Use the actual relative-entropy producer to obtain a measurable stationary p and uniqueness; its actual posterior already has absolute continuity and finite canonical KL. Actual32 supplies the probability output used below in Step3. All are derived from the source V/Hessian/eta assumptions.

  2. 2Reconcile the square-root-density witness

    The actual square-root-density producer initially returns p prime. Apply uniqueness to its stationarity, prove equality of the two functions by funext, and rewrite the entire dependent output. Thus rho, Z, q, f and r all refer to the same actual p; no coherence premise is supplied.

  3. 3Retrieve the real density and analytic domains

    The actual32 outputs give q=exp(-rho)/Z, raw f=exp(-rho/2)/sqrtZ, f²=q and mass1. They also give C2 f, actual fL2 and gradientL2 under gamma, and qlogqL1. No compact-support or limit certificate is required.

  4. 4Apply the noncompact Gaussian function LSI

    Apply the actual42 theorem to this raw f, deriving integrability of Phi(f²) from f²=q and qlogqL1. The result is homogeneous entropy with exact variance-one coefficient2, on the actual canonical Gaussian.

  5. 5Identify the finite canonical KL

    The actual33 entropy identity uses canonical klDiv, with actual probability, absolute continuity and finiteness. Substitute f²=q and mass1 into the homogeneous entropy; log1=0 removes its mass term. No pointwise derivative of a Radon–Nikodym version is taken.

  6. 6Retain the exact half coefficient

    Use actual32 quarter-energy identity for the true smooth rho gradient under the same literal r. Substitution in the Gaussian coefficient2 yields exactly half, with the actual Fisher integral finite because gradient rho is L2(r).

  7. 7Exercise actual posterior consumers

    Tests specialize the actual volume tilt and affine posterior at eta2, at the positive unbounded family eta(s)=s²+1 with y(s)=s v, and at the zero-dimensional constant potential. The last case proves actual canonical KL.toReal=0 using the zero score and nonnegativity. Gaussian T2 and the W2 portion of FIRST4.6 remain separate.

Full assumptions and notation

All objects and hypotheses

  • Finite-dimensional complete real Hilbert/Borel E; measurable parameter space S. Rank0 is an explicit authored extension.
  • V is globally C2, kappa≥1 and kappa^-1 norm(v)^2≤D²V(x)[v,v]≤norm(v)^2 for every x,v, exactly the source normalized potential bounds.
  • eta/y are measurable and eta(s)>0 for every s; the measurable family is an authored extension, with Unit recovering source fixed parameters. No eta≤1 hypothesis is added.
  • Actual p, all probability/AC/finite entropy/score domains and the half-Fisher inequality are produced internally. Canonical KL is finite before toReal is used; only the smooth rho is differentiated.

Mathematical proof

1. Produce one unique proximal point

Use the actual relative-entropy producer to obtain a measurable stationary p and uniqueness; its actual posterior already has absolute continuity and finite canonical KL. Actual32 supplies the probability output used below in Step3. All are derived from the source V/Hessian/eta assumptions.

\[p_s+\eta_s\nabla V(p_s)=y_s,\quad z+\eta_s\nabla V(z)=y_s\Longrightarrow z=p_s.\]
Corresponding Lean step

standardized_rgo_unique_prox_and_finite_entropy

2. Reconcile the square-root-density witness

The actual square-root-density producer initially returns p prime. Apply uniqueness to its stationarity, prove equality of the two functions by funext, and rewrite the entire dependent output. Thus rho, Z, q, f and r all refer to the same actual p; no coherence premise is supplied.

\[p'_s+\eta_s\nabla V(p'_s)=y_s\Longrightarrow p'=p,\quad(\rho',Z',q',f',r')=(\rho,Z,q,f,r).\]
Corresponding Lean step

huniq; hstat'; funext; rw [hp] at hd

3. Retrieve the real density and analytic domains

The actual32 outputs give q=exp(-rho)/Z, raw f=exp(-rho/2)/sqrtZ, f²=q and mass1. They also give C2 f, actual fL2 and gradientL2 under gamma, and qlogqL1. No compact-support or limit certificate is required.

\[q=Z^{-1}e^{-\rho},\quad f=Z^{-1/2}e^{-\rho/2},\quad f^2=q,\quad\int q\,d\gamma=1,\quad f,\nabla f\in L^2(\gamma),\ q\log q\in L^1(\gamma).\]
Corresponding Lean step

standardized_rgo_sqrt_density_domain; hq; hmass; hfC; hf2; hg2; hqint

4. Apply the noncompact Gaussian function LSI

Apply the actual42 theorem to this raw f, deriving integrability of Phi(f²) from f²=q and qlogqL1. The result is homogeneous entropy with exact variance-one coefficient2, on the actual canonical Gaussian.

\[\int f^2\log f^2\,d\gamma-\left(\int f^2\,d\gamma\right)\log\left(\int f^2\,d\gamma\right)\le2\int\|\nabla f\|^2\,d\gamma.\]
Corresponding Lean step

gaussian_logSobolev_of_contDiff; hphi; hLSI

5. Identify the finite canonical KL

The actual33 entropy identity uses canonical klDiv, with actual probability, absolute continuity and finiteness. Substitute f²=q and mass1 into the homogeneous entropy; log1=0 removes its mass term. No pointwise derivative of a Radon–Nikodym version is taken.

\[D_{\mathrm{KL}}(r\Vert\gamma)=\int q\log q\,d\gamma=\operatorname{Ent}_{\gamma}(f^2).\]
Corresponding Lean step

hKLq; hfin; hsq; hmass; Real.log_one

6. Retain the exact half coefficient

Use actual32 quarter-energy identity for the true smooth rho gradient under the same literal r. Substitution in the Gaussian coefficient2 yields exactly half, with the actual Fisher integral finite because gradient rho is L2(r).

\[\int\|\nabla f\|^2\,d\gamma=\frac14\int\|\nabla\rho\|^2\,dr\quad\Longrightarrow\quad D_{\mathrm{KL}}(r\Vert\gamma)\le\frac12\int\|\nabla\rho\|^2\,dr.\]
Corresponding Lean step

he; hrho2; rw [he]; ring

7. Exercise actual posterior consumers

Tests specialize the actual volume tilt and affine posterior at eta2, at the positive unbounded family eta(s)=s²+1 with y(s)=s v, and at the zero-dimensional constant potential. The last case proves actual canonical KL.toReal=0 using the zero score and nonnegativity. Gaussian T2 and the W2 portion of FIRST4.6 remain separate.

\[\eta=2;\quad\eta(s)=s^2+1;\quad\dim E=0\Longrightarrow D_{\mathrm{KL}}(r\Vert\gamma)=0.\]
Corresponding Lean step

actual_fixed_posterior; actual_variable_step_family; rank_zero_actual_canonical_kl

Lean verification

The exact proof begins folded immediately after the mathematical argument; the statement is folded beside the claim above.

Lean proof · standardized_rgo_unique_prox_and_kl_le_fisher

Produce one unique proximal point; Reconcile the square-root-density witness; Retrieve the real density and analytic domains; Apply the noncompact Gaussian function LSI; Identify the finite canonical KL; Retain the exact half coefficient; Exercise actual posterior consumers

Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.

Download module (.lean)
theorem standardized_rgo_unique_prox_and_kl_le_fisher
    {E S : Type*} [NormedAddCommGroup E] [InnerProductSpace ℝ E]
    [CompleteSpace E] [FiniteDimensional ℝ E] [MeasurableSpace E] [BorelSpace E]
    [MeasurableSpace S] {V : E → ℝ} {κ : ℝ}
    (hκ : 1 ≤ κ) (hV : ContDiff ℝ 2 V)
    (hH : ∀ x v : E, κ⁻¹*‖v‖^2 ≤ fderiv ℝ (fderiv ℝ V) x v v ∧
      fderiv ℝ (fderiv ℝ V) x v v ≤ ‖v‖^2)
    {eta : S → ℝ} {y : S → E} (heta : Measurable eta) (hy : Measurable y)
    (hpos : ∀ s, 0 < eta s) :
    ∃ p : S → E, Measurable p ∧
      (∀ s, p s+eta s • gradient V (p s)=y s) ∧
      (∀ s z, z+eta s • gradient V z=y s → z=p s) ∧
      let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
        Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
      let mu := (volume : Measure E).tilted (fun x => -V x)
      let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
      let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
      let gamma := stdGaussian E
      ∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
        _root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
        MemLp (gradient (rho s)) 2 (r s) ∧
        (_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
          (1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s) := by
  obtain ⟨p, hpm, hstat, huniq, hk⟩ :=
    StandardizedRGORelativeEntropy.standardized_rgo_unique_prox_and_finite_entropy
      hκ hV hH heta hy hpos
  obtain ⟨p', hpm', hstat', hd⟩ :=
    StandardizedRGOSqrtDensity.standardized_rgo_sqrt_density_domain
      hκ hV hH heta hy hpos
  have hp : p'=p := funext (fun s => huniq s (p' s) (hstat' s))
  rw [hp] at hd
  let rho := fun s u => V (p s+Real.sqrt (eta s) • u)-V (p s)-
    Real.sqrt (eta s)*inner ℝ (gradient V (p s)) u
  let mu := (volume : Measure E).tilted (fun x => -V x)
  let R := fun s => mu.tilted (fun x => -‖x-y s‖^2/(2*eta s))
  let r := fun s => (R s).map (fun x => (Real.sqrt (eta s))⁻¹ • (x-p s))
  let gamma := stdGaussian E
  let Z := fun s => ∫ u, Real.exp (-rho s u) ∂gamma
  let q := fun s u => Real.exp (-rho s u)/Z s
  let f := fun s u => Real.exp (-rho s u/2)/Real.sqrt (Z s)
  refine ⟨p, hpm, hstat, huniq, ?_⟩
  change ∀ s, IsProbabilityMeasure (r s) ∧ r s ≪ gamma ∧
    _root_.InformationTheory.klDiv (r s) gamma ≠ ⊤ ∧
    MemLp (gradient (rho s)) 2 (r s) ∧
    (_root_.InformationTheory.klDiv (r s) gamma).toReal ≤
      (1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s)
  intro s
  obtain ⟨hZpos, hZle, hrtilt, hrden, hprob, hq, hmass, hfC, hf2,
    hg2, hrho2, hqint, hgf, hglog, he⟩ := hd s
  obtain ⟨hac, hfin, hllr, hlog, hrhoint, hKLq, hKLrho⟩ := hk s
  change (∫ u, q s u ∂gamma)=1 at hmass
  change (∫ u, ‖gradient (f s) u‖^2 ∂gamma) =
    (1/4 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s) at he
  change (_root_.InformationTheory.klDiv (r s) gamma).toReal =
    (∫ u, q s u*Real.log (q s u) ∂gamma) at hKLq
  have hsq : ∀ u, (f s u)^2=q s u := fun u => (hq u).2
  have hphi : Integrable (fun u => (f s u)^2*Real.log ((f s u)^2)) gamma := by
    simpa only [hsq] using hqint
  have hLSI := AutoSamplingTheory.TechnicalLemmas.FunctionalInequalities.GaussianLogSobolev.gaussian_logSobolev_of_contDiff
    (f s) hfC hf2 hg2 hphi
  change (∫ u, (f s u)^2*Real.log ((f s u)^2) ∂gamma) -
    (∫ u, (f s u)^2 ∂gamma)*Real.log (∫ u, (f s u)^2 ∂gamma) ≤
    2 * ∫ u, ‖gradient (f s) u‖^2 ∂gamma at hLSI
  refine ⟨hprob, hac, hfin, hrho2, ?_⟩
  calc
    _ = ∫ u, q s u*Real.log (q s u) ∂gamma := hKLq
    _ ≤ 2 * ∫ u, ‖gradient (f s) u‖^2 ∂gamma := by
      simpa only [hsq, hmass, Real.log_one, mul_zero, sub_zero] using hLSI
    _ = (1/2 : ℝ)*(∫ u, ‖gradient (rho s) u‖^2 ∂r s) := by
      rw [he]
      ring

end
end AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.StandardizedRGOKLFisher

Exact module and namespace context

Scope and omitted-condition boundaries
  • Authored sufficient same-unique-prox canonical KL≤Fisher/2 leaf for the literal standardized RGO. Exact source normalized C2/Hessian assumptions; all positive eta, actual measurable-family extension incl rank0. Probability/AC/finite KL/scoreL2 and same witness are internally derived. Coherent32/33 actual rho/Z/q/f/r transported by uniqueness, true Gaussian functionLSI42 coefficient2 and actual32 energyquarter. No extra witness/coherence/density/law/desiredbound certificate. GaussianT2/W2/FIRST4.6/fullW12/sampling/both mains/error/work/expectedcost/main/live/PURIFIED remain separate. Actual focused3826 PASS; independent wholeproof/blind/source/exactcommit/shared admission pending.
Sources, dependencies, and reuse

Source and reuse

Samplinglib parents called

Mathlib API called (external library)

  • Real.log_one

Mathematical sources

  • SPHMC arXiv2609.06906v1 S2 normalized hypotheses/prox/RGO/KL definitions; S4.Ex8 actual standardized posterior and S4.E6 omitted GaussianLSI component. — Authored sufficient same-unique-prox canonical KL<=Fisher/2 leaf for the literal standardized RGO. Exact source normalized C2/Hessian assumptions; all positive eta, actual measurable-family extension incl rank0. Probability/AC/finite KL/scoreL2 and same witness are internally derived. Coherent32/33 actual rho/Z/q/f/r transported by uniqueness, true Gaussian functionLSI42 coefficient2 and actual32 energyquarter. No extra witness/coherence/density/law/desiredbound certificate. GaussianT2/W2/FIRST4.6/fullW12/sampling/both mains/error/work/expectedcost/main/live/PURIFIED remain separate. Actual focused3826 PASS; independent wholeproof/blind/source/exactcommit/shared admission pending.

Samplinglib prose is not a quotation or a source-equivalence certificate. Definitions and aliases are explained as constructions, not counted as new mathematical proofs.