Conference Publication Details
Mandatory Fields
Pearlmutter B.;Siskind J.
Lecture Notes in Computational Science and Engineering
Using programming language theory to make automatic differentiation sound and efficient
2008
October
Published
1
()
Optional Fields
Forward mode Lambda calculus Multiple transformation Nesting Optimization
79
90
This paper discusses a new automatic differentiation (AD) system that correctly and automatically accepts nested and dynamic use of the AD operators, without any manual intervention. The system is based on a new formulation of AD as highly generalized first-class citizens in a λ-calculus, which is briefly described. Because the λ-calculus is the basis for modern programming-language implementation techniques, integration of AD into the λ-calculus allows AD to be integrated into an aggressive compiler. We exhibit a research compiler which does this integration. Using novel analysis techniques, it accepts source code involving free use of a first-class forward AD operator and generates object code which attains numerical performance comparable to, or better than, the most aggressive existing AD systems. © 2008 Springer-Verlag Berlin Heidelberg.
10.1007/978-3-540-68942-3_8
Grant Details