Samplinglib
Lean gate not recorded for this source state main · 0e31a3cda412

RGOCalculus: mathematical reading route

Read the statements and derivations in source order. Every result has its own optional Lean statement and proof. Source assumptions, library reuse and unproved boundaries are kept explicit.

  1. RGO calculus: curvature, normalized target and condition-number update
ASTIS mathematical exposition

RGO calculus: curvature, normalized target and condition-number update

AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.RGOCalculus.rgo_calculus · theorem · Teaching coverage

Statement

Let E be a finite-dimensional real inner-product space with its Borel sigma algebra. Let U:E→R be C² with κ⁻¹||v||²≤D²U(x)[v,v]≤||v||² at every x,v, where κ>0. Given nonnegative precision r, positive variance a and centers u,y, put W=U+r||·−u||²/2, α=κ⁻¹+r, β=1+r, K=β/α, r+=r+a⁻¹ and w=(r+)⁻¹(ru+a⁻¹y). Then W is α-strongly convex and its gradient is β-Lipschitz; its exponential weight is integrable with positive integral. Both the normalized law of W and that of the updated potential are probabilities. The normalized law after adding ||·−y||²/(2a) is precisely that updated law, and the supplied condition-number bounds obey the displayed identity.

\[\begin{gathered}W=U+\tfrac r2\|\cdot-u\|^2,\quad r^+=r+a^{-1},\quad w=(r^+)^{-1}(ru+a^{-1}y),\\R^{W}_{a,y}=R^{U}_{(r^+)^{-1},w},\qquad K^+=\frac{\beta+a^{-1}}{\alpha+a^{-1}}=\frac{(a\beta+1)K}{a\beta+K}.\end{gathered}\]

All objects and hypotheses

  • The derivatives are genuine derivatives of the C² potential; the Hessian is not a separately supplied field. The quadratic-form bounds hold everywhere.
  • κ>0 is the positive condition-number convention of the source. The ratio β/α uses the supplied bounds, not necessarily optimal constants. In dimension zero it need not be at least one.
  • r is a nonnegative real precision, represented by NNReal. Its zero value means A=∞, not a zero variance. The second variance a is strictly positive.
  • All laws are normalized relative to canonical Euclidean volume. No minimizer, moment estimate, integrability or kernel identity is supplied as a hidden premise.

Mathematical proof

1. Shift both curvature bounds by the precision

The quadratic term has Hessian rI, so its addition changes the lower bound to α and upper bound to β. The existing analytic theorem turns the lower bound into strong convexity and uses Hessian symmetry and the operator norm bound to prove actual gradient Lipschitz continuity. The C² premise rules out treating a totalized derivative as an arbitrary field.

\[D^2W=D^2U+rI,\qquad \alpha I\preceq D^2W\preceq\beta I,\qquad\|\nabla W(x)-\nabla W(z)\|\le\beta\|x-z\|.\]
Corresponding Lean step

hreg directly reuses QuadraticRegularization. Its NNReal constants are m=κ⁻¹, L=1 and t=r. This is an integration call, not another proof of the Hessian or Rayleigh argument.

2. Prove normalization before manipulating Gibbs laws

For any nonnegative precision t, the regularized potential is differentiable and has strictly positive strong-convexity modulus κ⁻¹+t. The existing Gaussian-envelope proof gives integrability without a supplied minimizer. Strict positivity of the exponential and nonzero canonical volume make its integral positive. Apply this at t=0, t=r and t=r+1/a.

\[Z_{t,z}=\int_Ee^{-U(x)-t\|x-z\|^2/2}\,dx,\qquad0<Z_{t,z}<\infty.\]
Corresponding Lean step

hI reuses StrongConvexGibbsIntegrability after hreg; hIU and hIW specialize it. integral_exp_pos and isProbabilityMeasure_tilted certify positivity and mass one. Integrable plus a positive real integral prevents the totalized tilted API from returning zero.

3. Complete the square, retaining its constant

Write s=1/a. The two quadratic penalties combine into one centered at w, plus a constant independent of x. It is the normalized laws that agree: their unnormalized integrals differ by exp(−c). Reuse the existing normalized quadratic-tilt theorem, which already proves and cancels this constant with positive normalizers.

\[\frac r2\|x-u\|^2+\frac s2\|x-y\|^2=\frac{r+s}{2}\|x-w\|^2+c,\qquad c=\frac{rs}{2(r+s)}\|u-y\|^2.\]
Corresponding Lean step

RGOClosure.quadratic_tilt_tilt supplies the completed-square law identity for the probability base volume.tilted(−U). No new square-completion lemma or duplicate RGO definition is introduced.

4. Translate the tilt identity to the paper's potential laws

Nested tilting adds exponents, provided the first exponential is integrable. This was proved above. Identify the quadratic tilt of the Gibbs base with the volume-normalized regularized potential, and perform the same identification after the second tilt. The output is equality of actual probability measures, not a proportionality assertion.

\[\bigl(dx\,\mathrm{tilted}(-U)\bigr)\,\mathrm{tilted}(-q_r)=dx\,\mathrm{tilted}(-(U+q_r)),\qquad q_r(x)=\tfrac r2\|x-u\|^2.\]
Corresponding Lean step

htilt applies Mathlib tilted_tilted using hIU. The final hcomp rewrite uses hIW for the second volume tilt. The separately returned updated probability certificate excludes equality of two zero fallback measures.

5. Derive the recursive condition-number identity

The updated constants are α+1/a and β+1/a. Multiply numerator and denominator by a, then multiply both by K=β/α; the denominator becomes (aα+1)K=aβ+K. All canceled factors are strictly positive: α, β, a and aβ+K. This ratio is the bridge to the already proved scalar contraction of ill-conditioned recursive stages; it does not execute those stages.

\[\frac{\beta+a^{-1}}{\alpha+a^{-1}}=\frac{a\beta+1}{a\alpha+1}=\frac{(a\beta+1)(\beta/\alpha)}{a\beta+\beta/\alpha}.\]
Corresponding Lean step

hα, hβ and hden justify denominator nonvanishing; field_simp checks the remaining field identity. The focused test feeds this actual curvature ratio into RecursiveCondition.contraction_bounds at a=(h+K)/β, proving K/2≤K+≤4K/5 for K≥2 and 0<h<1/4. This tests the scalar consumer, not implementation of the sampler.

Lean statement · rgo_calculus

Let-bindings retain the paper's W, α, β, K, updated precision and center without adding global wrapper definitions. NNReal packages the nonnegative precision and Lipschitz constant; κ and a remain positive real numbers. The conclusion returns analytic properties, normalization certificates, an exact measure equality and the source ratio identity.

Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.

theorem rgo_calculus {U : E → ℝ} {κ a : ℝ} (hκ : 0 < κ)
    (hU : ContDiff ℝ 2 U)
    (hH : ∀ x v : E, κ⁻¹ * ‖v‖ ^ 2 ≤ (fderiv ℝ (fderiv ℝ U) x v) v ∧
      (fderiv ℝ (fderiv ℝ U) x v) v ≤ ‖v‖ ^ 2)
    (r : ℝ≥0) (ha : 0 < a) (u y : E) :
    let W := fun x => U x + (r : ℝ) / 2 * ‖x - u‖ ^ 2
    let α := κ⁻¹ + (r : ℝ)
    let β : ℝ≥0 := 1 + r
    let K := (β : ℝ) / α
    let rp := (r : ℝ) + a⁻¹
    let w := rp⁻¹ • ((r : ℝ) • u + a⁻¹ • y)
    StrongConvexOn Set.univ α W ∧
      LipschitzWith β (gradient W) ∧
      Integrable (fun x => Real.exp (-W x)) (volume : Measure E) ∧
      0 < ∫ x, Real.exp (-W x) ∂(volume : Measure E) ∧
      IsProbabilityMeasure ((volume : Measure E).tilted (fun x => -W x)) ∧
      IsProbabilityMeasure ((volume : Measure E).tilted
        (fun x => -(U x + rp / 2 * ‖x - w‖ ^ 2))) ∧
      (volume : Measure E).tilted (fun x => -(W x + a⁻¹ / 2 * ‖x - y‖ ^ 2)) =
        volume.tilted (fun x => -(U x + rp / 2 * ‖x - w‖ ^ 2)) ∧
      ((β : ℝ) + a⁻¹) / (α + a⁻¹) = (a * (β : ℝ) + 1) * K /
        (a * (β : ℝ) + K)

Exact module and namespace context

Lean proof · rgo_calculus

The integration follows three existing ASTIS parents and Mathlib's normalized-tilt composition. General local hreg/hI helpers are reused at every precision; no minimum, moment or normalizer is postulated.

Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.

theorem rgo_calculus {U : E → ℝ} {κ a : ℝ} (hκ : 0 < κ)
    (hU : ContDiff ℝ 2 U)
    (hH : ∀ x v : E, κ⁻¹ * ‖v‖ ^ 2 ≤ (fderiv ℝ (fderiv ℝ U) x v) v ∧
      (fderiv ℝ (fderiv ℝ U) x v) v ≤ ‖v‖ ^ 2)
    (r : ℝ≥0) (ha : 0 < a) (u y : E) :
    let W := fun x => U x + (r : ℝ) / 2 * ‖x - u‖ ^ 2
    let α := κ⁻¹ + (r : ℝ)
    let β : ℝ≥0 := 1 + r
    let K := (β : ℝ) / α
    let rp := (r : ℝ) + a⁻¹
    let w := rp⁻¹ • ((r : ℝ) • u + a⁻¹ • y)
    StrongConvexOn Set.univ α W ∧
      LipschitzWith β (gradient W) ∧
      Integrable (fun x => Real.exp (-W x)) (volume : Measure E) ∧
      0 < ∫ x, Real.exp (-W x) ∂(volume : Measure E) ∧
      IsProbabilityMeasure ((volume : Measure E).tilted (fun x => -W x)) ∧
      IsProbabilityMeasure ((volume : Measure E).tilted
        (fun x => -(U x + rp / 2 * ‖x - w‖ ^ 2))) ∧
      (volume : Measure E).tilted (fun x => -(W x + a⁻¹ / 2 * ‖x - y‖ ^ 2)) =
        volume.tilted (fun x => -(U x + rp / 2 * ‖x - w‖ ^ 2)) ∧
      ((β : ℝ) + a⁻¹) / (α + a⁻¹) = (a * (β : ℝ) + 1) * K /
        (a * (β : ℝ) + K) := by
  let W := fun x => U x + (r : ℝ) / 2 * ‖x - u‖ ^ 2
  let m : ℝ≥0 := ⟨κ⁻¹, (inv_pos.mpr hκ).le⟩
  have hbounds : ∀ x v : E,
      (m : ℝ) * ‖v‖ ^ 2 ≤ (fderiv ℝ (fderiv ℝ U) x v) v ∧
      (fderiv ℝ (fderiv ℝ U) x v) v ≤ (1 : ℝ≥0) * ‖v‖ ^ 2 := by
    intro x v
    exact ⟨(hH x v).1, by simpa using (hH x v).2⟩
  have hreg (t : ℝ≥0) (z : E) :=
    TechnicalLemmas.Analysis.QuadraticRegularization.strongConvexOn_and_lipschitzWith_gradient_add_quadratic
      hU hbounds (r := t) z
  have hI (t : ℝ≥0) (z : E) :
      Integrable (fun x => Real.exp (-(U x + (t : ℝ) / 2 * ‖x - z‖ ^ 2)))
        (volume : Measure E) := by
    apply TechnicalLemmas.Analysis.StrongConvexGibbsIntegrability.integrable_exp_neg_of_strongConvexOn
      (m := ((m + t : ℝ≥0) : ℝ))
    · exact add_pos_of_pos_of_nonneg (inv_pos.mpr hκ) t.coe_nonneg
    · exact (hU.add (contDiff_const.mul
        ((contDiff_id.sub contDiff_const).norm_sq (𝕜 := ℝ)))).differentiable
        (by norm_num)
    · exact (hreg t z).1
  have hIU : Integrable (fun x => Real.exp (-U x)) (volume : Measure E) := by
    simpa only [NNReal.coe_zero, zero_div, zero_mul, add_zero] using hI 0 u
  have hIW : Integrable (fun x => Real.exp (-W x)) (volume : Measure E) := hI r u
  have : IsProbabilityMeasure ((volume : Measure E).tilted (fun x => -U x)) :=
    isProbabilityMeasure_tilted hIU
  have htilt (t : ℝ) (z : E) :
      ((volume : Measure E).tilted (fun x => -U x)).tilted
          (fun x => -(t / 2) * ‖x - z‖ ^ 2) =
        volume.tilted (fun x => -(U x + t / 2 * ‖x - z‖ ^ 2)) := by
    rw [tilted_tilted hIU]
    congr 1
    funext x
    simp only [Pi.add_apply]
    ring
  refine ⟨(hreg r u).1, (hreg r u).2, hIW, integral_exp_pos hIW,
    isProbabilityMeasure_tilted hIW, ?_, ?_, ?_⟩
  · have hIplus := hI (r + ⟨a⁻¹, (inv_pos.mpr ha).le⟩)
      (((r : ℝ) + a⁻¹)⁻¹ • ((r : ℝ) • u + a⁻¹ • y))
    exact isProbabilityMeasure_tilted hIplus
  · have hcomp := RGOClosure.quadratic_tilt_tilt
      ((volume : Measure E).tilted (fun x => -U x)) r.coe_nonneg (inv_pos.mpr ha) u y
    rw [htilt, htilt, tilted_tilted hIW] at hcomp
    convert hcomp using 1
    congr 1
    funext x
    simp only [Pi.add_apply, W]
    ring
  · have hα : 0 < κ⁻¹ + (r : ℝ) :=
      add_pos_of_pos_of_nonneg (inv_pos.mpr hκ) r.coe_nonneg
    have hβ : 0 < (1 : ℝ) + r := by positivity
    have hnext : 0 < κ⁻¹ + (r : ℝ) + a⁻¹ := add_pos hα (inv_pos.mpr ha)
    have hden : 0 < a * (1 + (r : ℝ)) + (1 + r) / (κ⁻¹ + r) :=
      add_pos (mul_pos ha hβ) (div_pos hβ hα)
    simp only [NNReal.coe_add, NNReal.coe_one]
    field_simp [hκ.ne', ha.ne', hα.ne', hnext.ne', hden.ne']

end AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.RGOCalculus

Exact module and namespace context

Scope and omitted-condition boundaries

  • Source-level RGO potential calculus only. No implementable sampler, recursive accuracy, reference-point cost, invariance, mixing or actual-input expected query cost. κ>0 is the positive condition-number convention; r=0 retains A=infinity. Finite-dimensional real inner-product spaces, including dimension zero, generalize Euclidean coordinates.
  • A=∞ is represented through its zero precision. The theorem does not claim a zero-variance Gaussian law.
  • The updated potentials differ by an additive constant before normalization. No equality of unnormalized densities or partition functions is asserted.
  • The constants are valid curvature/smoothness bounds. No optimal-condition-number, covariance or transport estimate follows from this packet alone.

Source and reuse

ASTIS parents called

Mathlib API called (external library)

  • tilted_tilted
  • integral_exp_pos
  • isProbabilityMeasure_tilted
  • ContDiff.norm_sq
  • ContDiff.differentiable

Mathematical sources

ASTIS prose is not a quotation or a source-equivalence certificate. Definitions and aliases are explained as constructions, not counted as new mathematical proofs.