Symplectic Runge-Kutta Schemes for Adjoint Equations, Automatic Differentiation, Optimal Control, and More Articles uri icon

publication date

  • February 2016

start page

  • 3

end page

  • 33

issue

  • 1

volume

  • 58

International Standard Serial Number (ISSN)

  • 0036-1445

Electronic International Standard Serial Number (EISSN)

  • 1095-7200

abstract

  • The study of the sensitivity of the solution of a system of differential equations with respect to changes in the initial conditions leads to the introduction of an adjoint system, whose discretization is related to reverse accumulation in automatic differentiation. Similar adjoint systems arise in optimal control and other areas, including classical mechanics. Ad-joint systems are introduced in such a way that they exactly preserve a relevant quadratic invariant (more precisely, an inner product). Symplectic Runge-Kutta and partitioned Runge-Kutta methods are defined through the exact conservation of a differential geometric structure, but may be characterized by the fact that they preserve exactly quadratic invariants of the system being integrated. Therefore, the symplecticness (or lack of symplecticness) of a Runge-Kutta or partitioned Runge-Kutta integrator should be relevant to understanding its performance when applied to the computation of sensitivities, to optimal control problems, and in other applications requiring the use of adjoint systems. This paper examines the links between symplectic integration and those applications and presents in a new, unified way a number of results currently scattered among or implicit in the literature. In particular, we show how some common procedures, such as the direct method in optimal control theory and the computation of sensitivities via reverse accumulation, imply, probably unbeknownst to the user, "hidden" integrations with symplectic partitioned Runge-Kutta schemes.

subjects

  • Mathematics

keywords

  • runge-kutta methods; partitioned runge-kutta methods; symplectic integration; hamiltonian systems; variational equations; adjoint equations; computation of sensitivities; lagrange multipliers; automatic differentiation; optimal control; lagrangian mechanics; reflected and transposed runge-kutta schemes; differential-algebraic problems; constrained controls; order conditions; discrete mechanics; integrators; systems