RSEConUK 2019 has ended
The Fourth Conference of Research Software Engineering was held at the University of Birmingham.

Content from all sessions is licensed under a Creative Commons Attribution 2.0 UK: England & Wales License.
Back To Schedule
Wednesday, September 18 • 14:30 - 14:55
#4D3 - Cloud Technologies and Case Studies - How to build and run an international open-data image repository

Log in to save this to your schedule, view media, leave feedback and see who's attending!

Image Data Resource (IDR, https://idr.openmicroscopy.org) is a public data repository containing over 100TB of life sciences imaging data from published studies in a searchable and reusable format. It is built from existing open-source tools but significant work was required to deploy and keep it running as a production service. I will talk about the journey from our first ever use of cloud services to scaling up a single- server system into the reliable public resource that exists today, including design choices, the mistakes we made, and the challenges we still face.

I will introduce some of the tools we use including Ansible, OpenStack, and Docker, but with a focus on the benefits of reproducible deployments rather than going into too much technical detail of particular tools. All of our infrastructure is open source and I will explain why, and provide links for people interested in finding out more.

This talk will hopefully provide an insight into how a public data services like this could be set up by your institution, including many of the considerations you may not have thought of.

avatar for Simon Li

Simon Li

Software and Operations Engineer, Open Microscopy Environment
I'm interested in using advantage of modern cloud technologies to build infrastructure for publishing and analysing open-data, supporting the bug push towards open-science. I'm also interested in what makes a successful interdisciplinary collaboration.

Wednesday September 18, 2019 14:30 - 14:55 BST
4. Aston Webb, Room WG12 Aston Webb Building