Simple, efficient background processing for Ruby
Go to file
Mike Perham 3b00587ea0 merge master 2017-04-14 09:31:12 -07:00
.github tweak 2017-03-16 13:44:33 -07:00
bin merge master 2017-02-20 10:12:49 -08:00
examples Remove more USR1 references 2017-01-03 15:41:48 -08:00
lib Re-implement set to avoid TLS, shout out to #2152 2017-04-05 10:56:06 -07:00
myapp Make Sidekiq Web UI RTL-friendly (#3381) 2017-03-16 13:51:29 -07:00
test oops 2017-03-24 12:06:27 -07:00
web Improve Hebrew translations (#3422) 2017-04-04 10:50:45 -07:00
.gitignore Rework job processing in light of Rails 5's Reloader (#3235) 2017-01-17 14:58:08 -08:00
.travis.yml Integrate Percy.io for visual regression tests (#3316) 2017-01-18 14:19:48 -08:00
3.0-Upgrade.md Use new proc syntax instead all Proc.new 2015-06-10 23:10:16 +03:00
4.0-Upgrade.md Add note, fixes #2977 2016-05-18 08:55:35 -07:00
5.0-Upgrade.md Verify graceful handling of ill-formed job payloads, fixes #3406 2017-03-24 11:59:48 -07:00
COMM-LICENSE Section 3.2 is too broad 2016-03-08 09:05:19 -08:00
Changes.md merge master 2017-04-14 09:31:12 -07:00
Ent-Changes.md change links 2017-04-06 10:31:30 -07:00
Gemfile Fix minitest warnings (#3300) 2017-01-02 12:06:02 -08:00
LICENSE Move copyright to contribsys 2014-07-17 13:53:54 -07:00
Pro-2.0-Upgrade.md Note that Redis Sentinel should be safe to use 2015-07-02 11:15:20 -07:00
Pro-3.0-Upgrade.md Remove note about ephemeral_hostname 2016-04-26 10:23:45 -07:00
Pro-Changes.md change links 2017-04-06 10:31:30 -07:00
README.md Update supported Ruby and Rails versions, fixes #3318 2017-01-17 13:02:06 -08:00
Rakefile Minimize Ruby warnings in test suite 2016-11-23 14:50:11 -08:00
code_of_conduct.md Add code of conduct 2016-01-22 10:08:58 -08:00
sidekiq.gemspec Remove test files, this isn’t used by anyone 2017-02-04 09:06:32 -08:00

README.md

Sidekiq

Gem Version Code Climate Build Status Gitter Chat

Simple, efficient background processing for Ruby.

Sidekiq uses threads to handle many jobs at the same time in the same process. It does not require Rails but will integrate tightly with Rails to make background processing dead simple.

Sidekiq is compatible with Resque. It uses the exact same message format as Resque so it can integrate into an existing Resque processing farm. You can have Sidekiq and Resque run side-by-side at the same time and use the Resque client to enqueue jobs in Redis to be processed by Sidekiq.

Performance

Version Latency Garbage created for 10,000 jobs Time to process 100,000 jobs Throughput
Sidekiq 4.0.0 10ms 151 MB 22 sec 4500 jobs/sec
Sidekiq 3.5.1 22ms 1257 MB 125 sec 800 jobs/sec
Resque 1.25.2 - - 420 sec 240 jobs/sec
DelayedJob 4.1.1 - - 465 sec 215 jobs/sec

Requirements

Sidekiq supports CRuby 2.2.2+ and JRuby 9k.

All Rails releases >= 4.0 are officially supported.

Redis 2.8 or greater is required. 3.0.3+ is recommended for large installations with thousands of worker threads.

Installation

gem install sidekiq

Getting Started

See the Getting Started wiki page and follow the simple setup process. You can watch this Youtube playlist to learn all about Sidekiq and see its features in action. Here's the Web UI:

Web UI

Want to Upgrade?

I also sell Sidekiq Pro and Sidekiq Enterprise, extensions to Sidekiq which provide more features, a commercial-friendly license and allow you to support high quality open source development all at the same time. Please see the Sidekiq homepage for more detail.

Subscribe to the quarterly newsletter to stay informed about the latest features and changes to Sidekiq and its bigger siblings.

Problems?

Please do not directly email any Sidekiq committers with questions or problems. A community is best served when discussions are held in public.

If you have a problem, please review the FAQ and Troubleshooting wiki pages. Searching the issues for your problem is also a good idea.

Useful resources:

  • Product documentation is in the wiki.
  • Release announcements are made to the @sidekiq Twitter account.
  • Here's a Reddit forum dedicated to Sidekiq discussion
  • The Sidekiq tag on Stack Overflow has lots of useful Q & A.

No support via Twitter, 140 characters is not enough.

Every Friday morning is Sidekiq happy hour: I video chat and answer questions. See the Sidekiq support page for details.

Thanks

Sidekiq stays fast by using the JProfiler java profiler to find and fix performance problems on JRuby. Unfortunately MRI does not have good multithreaded profiling tools.

License

Please see LICENSE for licensing details.

Author

Mike Perham, @mperham / @sidekiq, http://www.mikeperham.com / http://www.contribsys.com