Innovating Faster with a Micro-Service Architecture using SBT, Continuous Delivery, and LXC

*
Accepted Session
Short Form
Intermediate
Scheduled: Tuesday, June 18, 2013 from 2:30 – 3:15pm in B204

Excerpt

A case study of the tools and techniques used at Gilt Groupe to develop and deploy a system composed of over 200 micro-services.

Description

Over the past 4 years, the production architecture at the Gilt Groupe has evolved from a single monolithic web application to a highly-distributed collection of more than 200 micro-services and small web applications. This architectural shift allows greater scalability and faster, less coupled development of new features, but also presents challenges around maintaining consistent development, testing, and deployment processes. We solved these challenges by enabling continuous integration and delivery with a novel collection of tools and infrastructure support we refer to as ‘Ion Cannon’.

In this talk, I’ll discuss the history and motivation behind this architectural shift , and share some quick wins and early stumbles. Then I’ll show how we use SBT for development and packaging; the architecture of Ion Cannon; and why we selected LXC as a lightweight virtualization solution for production deployment.

Speaking experience

I've given talks on a variety of topics at OSCON, YAPC, various user groups, and internally at Yahoo and Gilt Groupe. Slides for a subset of these are available at http://kevin.scaldeferri.com/dist/. I've presented portions of this talk at PDXScala and at Gilt, but some parts are new.

Speaker