Paper Info
Title
Automatic Differentiation using Constraint Handling Rules in Prolog.
Abstract
Automatic differentiation is a technique which allows a programmer to define a numerical computation via compositions of a broad range of numeric and computational primitives and have the underlying system support the computation of partial derivatives of the result with respect to any of its inputs, without making any finite difference approximations, and without manipulating large symbolic expressions representing the computation. This note describes a novel approach to reverse mode automatic differentiation using constraint logic programmming, specifically, the constraint handling rules (CHR) library of SWI Prolog, resulting in a very small (50 lines of code) implementation. When applied to a differentiation-based implementation of the inside-outside algorithm for parameter learning in probabilistic grammars, the CHR based implementations outperformed two well-known frameworks for optimising differentiable functions, Theano and TensorFlow, by a large margin.
Year
Venue
Field
2017
arXiv: Mathematical Software
Constraint satisfaction,Theano,Programming language,Expression (mathematics),Computer science,Constraint programming,Automatic differentiation,Algorithm,Theoretical computer science,Prolog,Constraint logic programming,Constraint Handling Rules
DocType
Volume
Citations 
Journal
abs/1706.00231
1
PageRank 
References 
Authors
0.35
0
1
Name
Order
Citations
PageRank
Samer Abdallah131.76