Samplinglib
Lean gate not recorded for this source state main · 9bb7a7394ab0

Actual Poisson rejection query tails with explicit constants

Fan Chen, Sinho Chewi, Jianfeng Lu and Matthew S. Zhang are the source authors. The exact expanded supporting tail inequality and proof below are an independent ASTIS derivation, not a quotation of the printed external tail formula or author endorsement.

arXiv:2609.06906v1 · Appendix A.1 and Theorem A.4(2); independently derived bounded-program query-tail prerequisite · faithful paraphrase

Complete source statement (Samplinglib restatement)

Under the displayed measurable bounded-estimator experiment, the actual full-batch query count satisfies P(C>2B(e-1)m+L)<=delta and P(C>K(B)L)<=delta, where K(B)=2B(e-1)(exp(2B)+1/log(2))+1. Acceptance probability is derived from the actual parent program and is not an extra hypothesis. The first inequality retains the integer ceiling; the second is an explicit single-log bound for fixed B. Both hold for every B>0, including arbitrarily small B, and every 0<delta<1.

  • S, X and A are arbitrary measurable spaces. Q:S->X is a Markov kernel and nu is a fixed probability law on A.
  • B>0 is fixed across parameters. W:((S times X) times A)->Real is jointly measurable and |W((s,x),z)|<=B for every s,x,z.
  • A default x0:X is supplied for the parent output construction; the cost bound does not depend on its value.
  • At each parameter s an attempt independently draws x~Q(s), N~Poisson(2B), an infinite iid auxiliary sequence z~nu^ℕ, of which only the first N entries are read, and U~Uniform[0,1]. It accepts when U<=product_{i<N}(B+W((s,x),z_i))/(2B). Whole attempts are iid.
  • C is the extended nonnegative sum of N_n over all attempts n whose preceding attempts failed, including the first successful batch. On never-success it is the sum over every batch.
  • For every parameter s and failure tolerance 0<delta<1, set L=log(2/delta) and m=ceil(exp(2B)L).

Actual full-batch tail and explicit single-log constant

\[L=\log(2/\delta),\quad m=\lceil e^{2B}L\rceil,\quad K(B)=2B(e-1)(e^{2B}+1/\log2)+1,\qquad \mathbb P(C>2B(e-1)m+L)\le\delta,\quad\mathbb P(C>K(B)L)\le\delta.\]

Read the formalized proofs

Each statement and proof below has its own closed Lean disclosure. Samplinglib parents, Mathlib calls and external mathematical sources are distinguished in each proof.

Samplinglib mathematical lesson

Actual Poisson rejection query tails with explicit constants

AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.PoissonQueryTail.poisson_query_tail · theorem · Teaching coverage

Read this first

Mathematical statement

Under the displayed measurable bounded-estimator experiment, the actual full-batch query count satisfies P(C>2B(e-1)m+L)≤delta and P(C>K(B)L)≤delta, where K(B)=2B(e-1)(exp(2B)+1/log(2))+1. Acceptance probability is derived from the actual parent program and is not an extra hypothesis. The first inequality retains the integer ceiling; the second is an explicit single-log bound for fixed B. Both hold for every B>0, including arbitrarily small B, and every 0<delta<1.

\[L=\log(2/\delta),\quad m=\lceil e^{2B}L\rceil,\quad K(B)=2B(e-1)(e^{2B}+1/\log2)+1,\qquad \mathbb P(C>2B(e-1)m+L)\le\delta,\quad\mathbb P(C>K(B)L)\le\delta.\]
Lean statement · poisson_query_tail

Two explicit high-probability bounds for the same actual full-batch Poisson rejection cost.

Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.

theorem poisson_query_tail {S X A : Type*}
    [MeasurableSpace S] [MeasurableSpace X] [MeasurableSpace A]
    (Q : Kernel S X) [IsMarkovKernel Q] (ν : Measure A) [IsProbabilityMeasure ν]
    (W : (S × X) × A → ℝ) (hW : Measurable W)
    (B : ℝ) (hB : 0 < B) (hb : ∀ s x z, |W ((s,x),z)| ≤ B) (x₀ : X)
    (s : S) (δ : ℝ) (hδ : 0 < δ) (hδ1 : δ < 1) :
    let Λ := attemptLaw (Q s) ν (⟨2 * B, by positivity⟩ : ℝ≥0)
    let E := accepted (fun p : X × A => W ((s,p.1),p.2)) B
    let ρ := Measure.infinitePi (fun _ : ℕ => Λ)
    let C := totalCost E (fun p => (p.2.1 : ℝ≥0∞))
    let L := Real.log (2 / δ)
    let m := ⌈Real.exp (2 * B) * L⌉₊
    ρ {ω | ENNReal.ofReal (2 * B * (Real.exp 1 - 1) * m + L) < C ω} ≤ ENNReal.ofReal δ ∧
    ρ {ω | ENNReal.ofReal
      ((2 * B * (Real.exp 1 - 1) * (Real.exp (2 * B) + 1 / Real.log 2) + 1) * L) < C ω}
        ≤ ENNReal.ofReal δ

Exact module and namespace context

Proof roadmap

  1. 1Use the same actual program and its proved acceptance probability

    The existing production theorem supplies p_s≥exp(-2B) for the actual acceptance event under the actual four-coordinate attempt law. Definitional equality aligns both definitions. Mapping the attempt to its N coordinate gives Poisson(2B); measurability follows from product coordinates and finite products on each discrete N stratum.

  2. 2Compare the stopped cost to a deterministic prefix on each path

    If any attempt j<m succeeds, every charged term at index n≥m vanishes because the earlier-success predicate is false. Therefore C is at most S_m=sum_{n<m}N_n on this event. A large stopped cost thus requires either all m attempts to fail or a large fixed-prefix sum. This comparison uses no stopping-time/count independence.

  3. 3Integrate the actual Poisson exponential moment

    First prove integrability of exp(N) using the convergent exponential series weighted by the Poisson mass. The true count law then gives E exp(N)=exp(2B(e-1)). The finite-coordinate pushforward of the iid stream is the finite product measure, so product integration gives E exp(S_m)=exp(2Bm(e-1)).

  4. 4Apply exponential Markov to the fixed prefix

    Exponentiation sends S_m>2Bm(e-1)+L into an event where exp(S_m) exceeds the corresponding positive threshold. Markov and the exact exponential moment cancel the Poisson contribution, leaving exp(-L). All conversions to extended nonnegative integrals have integrability or positivity witnesses.

  5. 5Budget the probability of all preceding failures

    The actual iid cylinder law gives failure probability (1-p_s)^m. For a=exp(-2B), the inequality 1-p_s≤exp(-a) follows from p_s≥a and 1-a≤exp(-a). The ceiling choice ensures a*m≥L. The failure term is therefore at most exp(-L). Probability finiteness is established before taking real parts.

  6. 6Combine both events at the requested failure tolerance

    The union bound gives at most 2exp(-L). With L=log(2/delta), this equals delta. The nonnegative total cost is left as its full infinite sum, so the bound covers all paths, including any never-success path; it is not a theorem only about attempt counts.

  7. 7Expose the single-log coefficient and its dependence on B

    Because 0<delta<1, L≥log(2)>0. Thus m≤exp(2B)L+1≤(exp(2B)+1/log(2))L. The resulting larger threshold K(B)L has a smaller exceedance event. K depends on B: converting this to a universal terminal gradient-cost statement still needs a uniform B bound and the concrete per-estimator gradient cost.

Full assumptions and notation

All objects and hypotheses

  • S, X and A are arbitrary measurable spaces. Q:S→X is a Markov kernel and nu is a fixed probability law on A.
  • B>0 is fixed across parameters. W:((S times X) times A)→Real is jointly measurable and |W((s,x),z)|≤B for every s,x,z.
  • A default x0:X is supplied for the parent output construction; the cost bound does not depend on its value.
  • At each parameter s an attempt independently draws x~Q(s), N~Poisson(2B), an infinite iid auxiliary sequence z~nu^ℕ, of which only the first N entries are read, and U~Uniform[0,1]. It accepts when U≤product_{i<N}(B+W((s,x),z_i))/(2B). Whole attempts are iid.
  • C is the extended nonnegative sum of N_n over all attempts n whose preceding attempts failed, including the first successful batch. On never-success it is the sum over every batch.
  • For every parameter s and failure tolerance 0<delta<1, set L=log(2/delta) and m=ceil(exp(2B)L).

Mathematical proof

1. Use the same actual program and its proved acceptance probability

The existing production theorem supplies p_s≥exp(-2B) for the actual acceptance event under the actual four-coordinate attempt law. Definitional equality aligns both definitions. Mapping the attempt to its N coordinate gives Poisson(2B); measurability follows from product coordinates and finite products on each discrete N stratum.

\[p_s=\Lambda_s(E_s)\ge e^{-2B},\qquad (N)_\#\Lambda_s=\operatorname{Poisson}(2B).\]
Corresponding Lean step

poisson_rejection_output; actual_attempt_count_law; measurable_accepted

2. Compare the stopped cost to a deterministic prefix on each path

If any attempt j<m succeeds, every charged term at index n≥m vanishes because the earlier-success predicate is false. Therefore C is at most S_m=sum_{n<m}N_n on this event. A large stopped cost thus requires either all m attempts to fail or a large fixed-prefix sum. This comparison uses no stopping-time/count independence.

\[\{C>t\}\subseteq\{\text{all }i<m\text{ fail}\}\cup\{S_m>t\},\qquad S_m=\sum_{i<m}N_i.\]
Corresponding Lean step

totalCost_le_prefix; cost_tail_subset

3. Integrate the actual Poisson exponential moment

First prove integrability of exp(N) using the convergent exponential series weighted by the Poisson mass. The true count law then gives E exp(N)=exp(2B(e-1)). The finite-coordinate pushforward of the iid stream is the finite product measure, so product integration gives E exp(S_m)=exp(2Bm(e-1)).

\[\mathbb E e^N=e^{2B(e-1)},\qquad\mathbb E e^{S_m}=e^{2Bm(e-1)}.\]
Corresponding Lean step

poisson_exponential_integrable; poisson_exponential_moment; fixed_prefix_exponential_moment

4. Apply exponential Markov to the fixed prefix

Exponentiation sends S_m>2Bm(e-1)+L into an event where exp(S_m) exceeds the corresponding positive threshold. Markov and the exact exponential moment cancel the Poisson contribution, leaving exp(-L). All conversions to extended nonnegative integrals have integrability or positivity witnesses.

\[\mathbb P(S_m>2Bm(e-1)+L)\le e^{-L}.\]
Corresponding Lean step

fixed_prefix_chernoff; fixed_prefix_chernoff_shift

5. Budget the probability of all preceding failures

The actual iid cylinder law gives failure probability (1-p_s)^m. For a=exp(-2B), the inequality 1-p_s≤exp(-a) follows from p_s≥a and 1-a≤exp(-a). The ceiling choice ensures a*m≥L. The failure term is therefore at most exp(-L). Probability finiteness is established before taking real parts.

\[(1-p_s)^m\le e^{-e^{-2B}m}\le e^{-L},\qquad e^{-2B}\lceil e^{2B}L\rceil\ge L.\]
Corresponding Lean step

failure_power_exponential_bound; poisson_tail_budget

6. Combine both events at the requested failure tolerance

The union bound gives at most 2exp(-L). With L=log(2/delta), this equals delta. The nonnegative total cost is left as its full infinite sum, so the bound covers all paths, including any never-success path; it is not a theorem only about attempt counts.

\[\mathbb P(C>2B(e-1)m+L)\le 2e^{-L}=\delta.\]
Corresponding Lean step

full_batch_cost_tail; full_batch_cost_tail_of_budget; delta_log_budget; full_batch_cost_delta_tail

7. Expose the single-log coefficient and its dependence on B

Because 0<delta<1, L≥log(2)>0. Thus m≤exp(2B)L+1≤(exp(2B)+1/log(2))L. The resulting larger threshold K(B)L has a smaller exceedance event. K depends on B: converting this to a universal terminal gradient-cost statement still needs a uniform B bound and the concrete per-estimator gradient cost.

\[m\le(e^{2B}+1/\log2)L,\qquad2B(e-1)m+L\le K(B)L.\]
Corresponding Lean step

ceil_threshold_le_single_log; measure_mono

Lean verification

The exact proof begins folded immediately after the mathematical argument; the statement is folded beside the claim above.

Lean proof · poisson_query_tail

Actual parent acceptance bound, coordinate law, pathwise prefix truncation, Poisson exponential series, iid product moment, exponential Markov, failure budget and ceiling comparison.

Braces mark parameters Lean can infer; square brackets request structures such as a measurable space or probability measure. Named hypotheses are mathematical premises, not facts established by this declaration. Section parameters are described in the mathematical hypotheses above; the module link retains their exact source context.

Download module (.lean)
theorem poisson_query_tail {S X A : Type*}
    [MeasurableSpace S] [MeasurableSpace X] [MeasurableSpace A]
    (Q : Kernel S X) [IsMarkovKernel Q] (ν : Measure A) [IsProbabilityMeasure ν]
    (W : (S × X) × A → ℝ) (hW : Measurable W)
    (B : ℝ) (hB : 0 < B) (hb : ∀ s x z, |W ((s,x),z)| ≤ B) (x₀ : X)
    (s : S) (δ : ℝ) (hδ : 0 < δ) (hδ1 : δ < 1) :
    let Λ := attemptLaw (Q s) ν (⟨2 * B, by positivity⟩ : ℝ≥0)
    let E := accepted (fun p : X × A => W ((s,p.1),p.2)) B
    let ρ := Measure.infinitePi (fun _ : ℕ => Λ)
    let C := totalCost E (fun p => (p.2.1 : ℝ≥0∞))
    let L := Real.log (2 / δ)
    let m := ⌈Real.exp (2 * B) * L⌉₊
    ρ {ω | ENNReal.ofReal (2 * B * (Real.exp 1 - 1) * m + L) < C ω} ≤ ENNReal.ofReal δ ∧
    ρ {ω | ENNReal.ofReal
      ((2 * B * (Real.exp 1 - 1) * (Real.exp (2 * B) + 1 / Real.log 2) + 1) * L) < C ω}
        ≤ ENNReal.ofReal δ := by
  dsimp only
  let r : ℝ≥0 := ⟨2 * B, by positivity⟩
  let Λ := attemptLaw (Q s) ν r
  let E := accepted (fun p : X × A => W ((s,p.1),p.2)) B
  have hE : MeasurableSet E := measurable_accepted _ (hW.comp (by fun_prop)) B
  have hlaw : Λ.map (fun p => p.2.1) = poissonMeasure r :=
    actual_attempt_count_law (Q s) ν r
  obtain ⟨R, hR, hs⟩ :=
    AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.PoissonRejection.poisson_rejection_output
      Q ν W hW B hB hb x₀
  obtain ⟨_, _, _, _, _, _, _, _, haccept, _, _⟩ := hs s
  change ENNReal.ofReal (Real.exp (-2 * B)) ≤ Λ E at haccept
  have ht := full_batch_cost_delta_tail Λ E hE
    (fun p => p.2.1) (by fun_prop) B hB hlaw haccept δ hδ hδ1
  refine ⟨ht, ?_⟩
  have hlog : Real.log 2 ≤ Real.log (2 / δ) := by
    apply Real.log_le_log (by norm_num)
    apply (le_div_iff₀ hδ).2
    linarith
  have hc := ceil_threshold_le_single_log B (Real.log (2 / δ)) hB.le hlog
  refine (measure_mono (fun ω hω => ?_)).trans ht
  exact lt_of_le_of_lt (ENNReal.ofReal_le_ofReal hc) hω


end AutoSamplingTheory.ExampleCases.SmoothedPicardHMC.PoissonQueryTail

Exact module and namespace context

Source assumptions versus formal assumptions

SourceActual LeanDifference kindWhy it matters
The FORS rejection mechanism uses a proposal, Poisson batch and independent auxiliary draws.Same four-coordinate attempt law and first-success full-batch cost as the existing production theorem; Markov parameter family and fixed auxiliary law are explicit.generalizationThe parameterized measurable presentation supports repeated source calls without substituting an abstract cost variable.
The bounded mechanism uses B>0 and estimator values in [-B,B].One B>0 and jointly measurable W bounded everywhere by B for all parameters; no B>=1 assumption.sameThe tail proof retains arbitrarily small positive B.
The algorithm repeatedly draws whole Poisson batches until acceptance.C sums every reached full batch, including success; its infinite-sum definition also covers never-success paths.source-implicitThe proof uses a pathwise comparison and true iid-prefix law, never current count/acceptance independence.
SPHMC A.4(2) requires a single-log high-probability query bound with a universal constant in its stated regime.For 0<delta<1, the exact ceiling threshold and explicit K(B)log(2/delta) tail are proved for estimator calls.API-limitationUniform B and concrete per-estimator gradient cost remain necessary source adapters; this is a prerequisite rather than A.4 completion.
External arXiv:2608.05022v1 Theorem2.3 prints 3B exp(2B) log(2/delta) for unrestricted B>0.The new supporting bound is 2B(e-1)ceil(exp(2B)L)+L, and K(B)L, where L=log(2/delta).unresolvedThe independent small-B audit identified a possible-source-error in the printed threshold. This separate valid derivation neither asserts that formula nor silently edits or formally repairs it.
The complete terminal routine includes clipping, target approximation, reference construction and query accounting.Those remaining obligations and both paper main results are not claimed. A default x0 is supplied solely for the existing actual-output theorem.API-limitationThe cost bound is about the actual bounded rejection program and is independent of x0; no TV-to-unbounded-cost transfer occurs.

Counts full-batch estimator evaluations, including the successful batch, not automatically gradient queries or wall-clock time. A universal terminal-state constant requires uniform control of B and a separate cost account for each estimator call and other work. Actual clipped gradient estimators, target log-weight identification, Renyi error, reference points and initialization remain separate. This independently derived supporting inequality does not assert or silently repair the unrestricted printed 3B exp(2B) log(2/delta) threshold in external Theorem 2.3.

Encoder–denoiser: accepted · domain-mismatch

Detected semantic differences

  • domains: Explicit measurable parameter-family generalization. — Independent reviewer accepted publication delta 1.
  • assumptions: Fixed B>0 and everywhere bounded W, including small B. — Independent reviewer accepted publication delta 2.
  • objects: Cost includes successful full batch and all never-success paths. — Independent reviewer accepted publication delta 3.
  • constant_dependencies: K(B) is not automatically a universal gradient-cost constant. — Independent reviewer accepted publication delta 4.
  • conclusion: New thresholds do not silently repair the external possible-source-error. — Independent reviewer accepted publication delta 5.
  • scopes: Clipping, target, Renyi, initialization and gradient accounting remain separate. — Independent reviewer accepted publication delta 6.

A generalization is not a source correction. Proposed missing conditions require separate independent repair review. No proposed repair silently changes the original theorem.

Scope and omitted-condition boundaries
  • Counts full-batch estimator evaluations, including the successful batch, not automatically gradient queries or wall-clock time. A universal terminal-state constant requires uniform control of B and a separate cost account for each estimator call and other work. Actual clipped gradient estimators, target log-weight identification, Renyi error, reference points and initialization remain separate. This independently derived supporting inequality does not assert or silently repair the unrestricted printed 3B exp(2B) log(2/delta) threshold in external Theorem 2.3.
Sources, dependencies, and reuse

Source and reuse

Samplinglib parents called

Mathlib API called (external library)

  • MeasureTheory.Measure.infinitePi
  • ProbabilityTheory.poissonMeasure
  • MeasureTheory.meas_ge_le_lintegral_div
  • MeasureTheory.integral_fintype_prod_eq_pow
  • Nat.le_ceil
  • Nat.ceil_lt_add_one

Mathematical sources

Samplinglib prose is not a quotation or a source-equivalence certificate. Definitions and aliases are explained as constructions, not counted as new mathematical proofs.

Which proof obligations and prerequisites are covered?

  • Independently verified prerequisite Actual bounded Poisson estimator-count tail needed before terminal gradient-cost accounting