Gearman: From the Worker's Perspective

*
Accepted Session
Short Form
Scheduled: Tuesday, June 21, 2011 from 11:00 – 11:45am in B301

Excerpt

Many people view topics like Map/Reduce and queue systems as advanced concepts that require in-depth knowledge and time consuming software setup. Gearman is changing all that by making this barrier to entry as low as possible with an open source, distributed job queuing system.

Description

Many people view topics like Map/Reduce and queue systems as advanced concepts that require in-depth knowledge and time consuming software setup. Gearman is changing all that by making this barrier to entry as low as possible with an open source, distributed job queuing system.

In this talk we’ll start with problems such as:
• Map/Reduce style problems
• Pipeline processing
• Scatter/gather queries
• Asynchronous queuing of tasks
We’ll get to the root of these problems and show how Gearman can be used to solve them efficiently. Armed with distributed architectures and examples, we will explore how to integrate these concepts into custom applications. This knowledge can greatly benefit those building scale-out, fault tolerant, and/or cloud based solutions.

Speaking experience

Speaker

  • 220px brian aker

    Brian Aker

    Data Differential LLC

    Biography

    Brian has spent his life working on the details of how to build and scale out systems. He is currently working on a new MicroKernel designed MySQL called Drizzle and is building the plumbing required for a new generation of large scale computer deployment. He also spends time working on Apache Modules, Memcached, and Gearman.

    In the past, he has been involved with projects for the Army Engineer Corps, The VirtualHospital, Splunk, MySQL, Slashdot, and was a Distinguished Engineer at Sun Microsystems. He calls Seattle his home since that is where his dog Rosalynd is.

    Sessions