Using perturbation analysis for gradient estimation, averaging and updating in a stochastic approximation algorithm

Abstract

We propose a gradient updating procedure for using both “present” and “past” data to improve the convergence properties of a stochastic approximation algorithm. This procedure utilizes second derivatives estimated by perturbation analysis techniques. Experimental evidence provided by simulation runs appear to confirm the improvement in convergence rate gained by this modified algorithm.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 34 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.