RSEConUK 2019 has ended
The Fourth Conference of Research Software Engineering was held at the University of Birmingham.

Content from all sessions is licensed under a Creative Commons Attribution 2.0 UK: England & Wales License.
Back To Schedule
Wednesday, September 18 • 15:30 - 15:55
#5C1 - Tools and Case Studies - Autograd: A cool software trick for avoiding maths

Log in to save this to your schedule, view media, leave feedback and see who's attending!

With the ever-growing popularity of deep learning, much attention has been focused on tools to improve researcher efficiency. Backpropagation, the crucial step in training neural networks, is nothing but the chain rule with memoization. Autograd automates the computation of such gradients of a function. This enables the user to quickly explore the model space, by saving them from either having to code up exact analytical derivatives or make do with finite differences. This works whenever one can express a function using common differentiable python, numpy and scipy primitives (those with .deriv).
This talk will describe the algorithm behind automatic differentiation and illustrate key steps with examples. Brief guidance will follow on how to make use of Autograd within your own projects. I will finish by reviewing some of the more recent advances and the exciting use cases to which these methods are being applied!

avatar for Pashmina Cameron

Pashmina Cameron

Sr RSE Lead, Microsoft Research Cambridge
Deep learning, Machine Learning, Computer vision, C++, Python

Wednesday September 18, 2019 15:30 - 15:55
1. Bramall - Elgar Concert Hall Aston Webb Building