Sidekiq in Practice

by Nate Berkopec

Are you using Sidekiq to process your background jobs, but struggling with it as your application scales? Sidekiq can scale to 5,000 jobs per second with just a little effort and knowledge: in Sidekiq in Practice, I'll show you how.

Sidekiq in Practice takes a step-by-step approach towards building a complex, real-world application that runs a massive volume of jobs through Sidekiq.

Contents include:

1. How to understand scaling: how many processes and servers you need, and how to autoscale them efficiently.

2. Idempotency: Increase your scalability by discarding "unique jobs" and instead use basic computer science to make jobs work regardless of the number of times they are enqueued

3. Memory bloat. How to reduce and diagnose memory problems that are causing you to deal with massive server bills.

4. Concurrency settings, thread safety, queue design and structures, database pool sizes, and more.

Sidekiq Pro and/or Enterprise are not required. The workshop mostly covers features in Sidekiq OSS.

100 pages, ebook

About the author

Nate Berkopec is the author of the Complete Guide to Rails Performance, the creator of the Rails Performance Workshop, and the maintainer of Puma, the Ruby web application server.

Nate currently lives in Taos, New Mexico.

Reviews

[Petr Kopač · Rating 5 out of 5]

Very useful. It gives insights into several different aspects of why Sidekiq jobs have problems and how to address them. I am using it as reference material for my work.

[Adam Wan · Rating 5 out of 5]

This is one of the few books on sidekiq. Not bad.