1
0
Fork 0
mirror of https://github.com/mperham/sidekiq.git synced 2022-11-09 13:52:34 -05:00
Simple, efficient background processing for Ruby
Find a file
Mike Perham 7e7afa117d Merge pull request #624 from ardell/master
Improve hard shutdown procedure to reduce risk of dropping jobs. #623
2013-01-16 14:40:32 -08:00
bin Use non-successful exit code when something goes wrong 2013-01-07 16:17:29 -05:00
examples Update examples/sidekiq 2013-01-10 11:36:31 +05:30
lib Clear workers in redis before terminating worker threads. #623 2013-01-16 17:07:47 -05:00
myapp Manage the retrying/deleting of jobs in the Web UI through the 'jid' 2012-11-26 11:24:24 -05:00
test Allow specification of retry_queue in sidekiq_options 2013-01-15 17:28:52 -08:00
web Update beacon to be more noticable. 2013-01-03 11:23:20 -05:00
.gitignore enhanced UI - see http://d.pr/i/rcGz 2012-10-29 14:50:21 -06:00
.rvmrc Explicate the ruby version 2013-01-16 13:16:34 -08:00
.travis.yml Enable ruby 2.0 testing 2012-12-11 20:23:44 -08:00
Changes.md Update changes, bump version 2013-01-16 13:08:20 -08:00
COMM-LICENSE Add commercial license for Sidekiq Pro 2012-10-04 09:34:56 -07:00
config.ru Add delete and retry now operations to web UI 2012-03-29 20:55:16 -07:00
Gemfile Merge simplified UI, fixes #481 2012-11-02 12:55:45 -07:00
LICENSE Add commercial license for Sidekiq Pro 2012-10-04 09:34:56 -07:00
Rakefile Test cleanup 2012-03-17 21:36:33 -07:00
README.md Copy fix. 2012-12-15 23:40:35 -05:00
sidekiq.gemspec connection pool version bump 2012-12-18 20:06:47 -08:00

Sidekiq

Build Status Dependency Status

Simple, efficient message processing for Ruby.

Sidekiq uses threads to handle many messages at the same time in the same process. It does not require Rails but will integrate tightly with Rails 3 to make background message processing dead simple.

Sidekiq is compatible with Resque. It uses the exact same message format as Resque so it can integrate into an existing Resque processing farm. You can have Sidekiq and Resque run side-by-side at the same time and use the Resque client to enqueue messages in Redis to be processed by Sidekiq.

At the same time, Sidekiq uses multithreading so it is much more memory efficient than Resque (which forks a new process for every job). You'll find that you might need 50 200MB resque processes to peg your CPU whereas one 300MB Sidekiq process will peg the same CPU and perform the same amount of work. Please see my blog post on Resque's memory efficiency and how I was able to shrink a Carbon Five client's resque processing farm from 9 machines to 1 machine.

Requirements

I test on Ruby 1.9.3 and JRuby 1.6.x in 1.9 mode. Other versions/VMs are untested but I will do my best to support them. Ruby 1.8 is not supported.

Redis 2.0 or greater is required.

Installation

gem install sidekiq

Getting Started

See the sidekiq home page for the simple 4-step process. You can watch Railscast #366 to see Sidekiq in action.

More Information

Please see the sidekiq wiki for more information. #sidekiq on irc.freenode.net is dedicated to this project, but bug reports or feature requests suggestions should still go through issues on Github.

There's also a mailing list via Librelist that you can subscribe to by sending an email to sidekiq@librelist.org with a greeting in the body. To unsubscribe, send an email to sidekiq-unsubscribe@librelist.org and that's it! Once archiving begins, you'll be able to visit the archives to see past threads.

Problems?

Please do not directly email any Sidekiq committers with questions or problems. A community is best served when discussions are held in public.

If you have a problem, please review the FAQ and Troubleshooting wiki pages. Searching the issues for your problem is also a good idea. If that doesn't help, feel free to email the Sidekiq mailing list or open a new issue. The mailing list is the preferred place to ask questions on usage. If you are encountering what you think is a bug, please open an issue.

License

Please see LICENSE for licensing details.

Author

Mike Perham, @mperham, http://mikeperham.com