Loading…
Attending this event?
Welcome to the Fourth Conference of Research Software Engineering, held at the University of Birmingham. For directions to and during the event, see the campus maps page.

In the Aston Webb Building near to the registration/reception desk, a cloakroom is available in room G30 along with a quiet room in G31.
Wednesday, September 18 • 15:30 - 15:55
#5C1 - Tools and Case Studies - Autograd: A cool software trick for avoiding maths

Log in to save this to your schedule and see who's attending!

With the ever-growing popularity of deep learning, much attention has been focused on tools to improve researcher efficiency. Backpropagation, the crucial step in training neural networks, is nothing but the chain rule with memoization. Autograd automates the computation of such gradients of a function. This enables the user to quickly explore the model space, by saving them from either having to code up exact analytical derivatives or make do with finite differences. This works whenever one can express a function using common differentiable python, numpy and scipy primitives (those with .deriv).
This talk will describe the algorithm behind automatic differentiation and illustrate key steps with examples. Brief guidance will follow on how to make use of Autograd within your own projects. We will finish by reviewing some of the more recent advances and the exciting use cases to which these methods are being applied!

Speakers
avatar for Pashmina Cameron

Pashmina Cameron

Sr RSE Lead, Microsoft Research Cambridge
Machine learning, Computer vision, NLP, Healthcare, C++, Python


Wednesday September 18, 2019 15:30 - 15:55
5. Nuffield Building, Room G17 Nuffield Building