Controlled Stochastic Processes for Simulated Annealing
Axel Ringh
Abstract:
Simulated annealing solves optimization problems by means of a random walk in an energy landscape based on the objective function and a temperature parameter. By slowly decreasing the temperature, the algorithm converges to the global optimal solution, also for nonconvex functions. However, if the temperature is decreased too quickly, this procedure often gets stuck in local minima. To overcome this, we here present a new perspective on simulated annealing. More precisely, we consider the cooling landscape as a curve of probability measures and prove that there exists a minimal norm velocity field which solves the continuity equation. The latter is a differential equation which governs the evolution of the aforementioned curve. The solution is the weak gradient of an integrable function, which is in line with the interpretation of the velocity field as a derivative of optimal transport maps. We also show that controlling stochastic annealing processes by superimposing this velocity field would allow them to follow arbitrarily fast cooling schedules. Using these findings, we design novel interacting particle-based optimization methods, based convergent optimal transport-based approximations to this control, that accelerate simulated annealing processes. This acceleration behavior is also validated on a number of numerical experiments.
Tid: Fr 2026-11-27 kl 11.00 - 12.00
Plats: Seminar room 3721
Språk: English
Medverkande: Axel Ringh, Chalmers U of Tech & U Gothenburg
Bio:
Axel Ringh received the M.Sc. degree in Engineering Physics in 2014, and the Ph.D. degree in Applied and Computational Mathematics in 2019, both from KTH Royal Institute of Technology, Stockholm, Sweden. From 2019 to 2021 he was a postdoctoral researcher with the Department of Electronic and Computer Engineering, the Hong Kong University of Science and Technology, Hong Kong S.A.R, China, and since 2021 he is WASP recruited faculty with the Department of Mathematical Sciences, Chalmers University of Technology and University of Gothenburg, Gothenburg, Sweden (2021-2025 as assistant professor, and from 2025 as associate professor). His research lies in the field of applied mathematics, more specifically at the intersection of optimization, control theory, machine learning, inverse problems, and signal processing. He specializes in areas such as computational optimal transport, inverse optimal control, stochastic processes for optimization and sampling, and questions related to the notion of phases of a matrix.
