1
0
Fork 0
mirror of https://github.com/mperham/sidekiq.git synced 2022-11-09 13:52:34 -05:00
Simple, efficient background processing for Ruby
Find a file
Mike Perham 29dca70e24
Introduce Sidekiq::Capsule (#5487)
* Initial work on Sidekiq::Config

* Initial work on Sidekiq::Config

* reduce dependencies in deploy marks

* bare sidekiq and webapp

* Modify runtime to work with Capsules

* Cleanup

* Rename test files to remove test_ prefix

* Update test suite and standard rules to be more compliant

* Move constant definition outside code, per standard formatting

* Loads of changes for introduction of Capsules

* Remove Redis adapter abstraction

* update capsule overview

* Ensure Sidekiq.redis uses the correct pool for jobs running within a Capsule

* Use default_capsule for safety

* Slow down the beat to halve its Redis overhead

* move config fixtures into cfg/

* Add capsule middleware test

* use accessor
2022-08-25 10:15:11 -07:00
.github See if ruby 2.5 works in github 2022-08-05 11:21:37 -07:00
bare Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
bin Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
docs Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
examples Update standard rules (#5360) 2022-06-05 07:44:52 -07:00
lib Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
myapp Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
test Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
web Merge branch 'main' into 7-0 2022-08-22 10:27:53 -07:00
.gitignore Add yarddoc files to gitignore, remove yardoc from rake tasks, update api file 2022-06-14 17:26:58 -07:00
.standard.yml Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
.yalphabetize.yml Add yalphabetize for yaml normalisation (#5199) 2022-05-10 14:40:39 -07:00
.yardopts Hide endpoints tagged as private from build 2022-06-20 15:06:49 -07:00
Changes.md Merge branch 'main' into 7-0 2022-08-22 10:27:53 -07:00
code_of_conduct.md Add code of conduct 2016-01-22 10:08:58 -08:00
COMM-LICENSE.txt Rename master branch to main 2021-10-12 07:49:36 -07:00
config.rb Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
Ent-Changes.md merge main 2022-07-12 13:37:45 -07:00
Gemfile Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
LICENSE.txt Add .txt extension 2022-05-11 12:34:20 -07:00
Pro-Changes.md merge main 2022-08-03 10:28:05 -07:00
Rakefile Introduce Sidekiq::Capsule (#5487) 2022-08-25 10:15:11 -07:00
README.md 7.0 notes, fix CI 2022-05-10 14:29:44 -07:00
sidekiq.gemspec Require redis-rb 4.5.0, fixes #5394 2022-07-12 14:18:17 -07:00

Sidekiq

Gem Version Build

Simple, efficient background processing for Ruby.

Sidekiq uses threads to handle many jobs at the same time in the same process. It does not require Rails but will integrate tightly with Rails to make background processing dead simple.

Performance

Version Latency Garbage created for 10k jobs Time to process 100k jobs Throughput Ruby
Sidekiq 6.0.2 3 ms 156 MB 14.0 sec 7100 jobs/sec MRI 2.6.3
Sidekiq 6.0.0 3 ms 156 MB 19 sec 5200 jobs/sec MRI 2.6.3
Sidekiq 4.0.0 10 ms 151 MB 22 sec 4500 jobs/sec
Sidekiq 3.5.1 22 ms 1257 MB 125 sec 800 jobs/sec
Resque 1.25.2 - - 420 sec 240 jobs/sec
DelayedJob 4.1.1 - - 465 sec 215 jobs/sec

This benchmark can be found in bin/sidekiqload and assumes a Redis network latency of 1ms.

Requirements

  • Redis: 6.0+
  • Ruby: MRI 2.7+ or JRuby 9.3+.

Sidekiq 7.0 supports Rails 6.0+ but does not require it.

Installation

bundle add sidekiq

Getting Started

See the Getting Started wiki page and follow the simple setup process. You can watch this YouTube playlist to learn all about Sidekiq and see its features in action. Here's the Web UI:

Web UI

Want to Upgrade?

Upgrade notes between each major version can be found in the docs/ directory.

I also sell Sidekiq Pro and Sidekiq Enterprise, extensions to Sidekiq which provide more features, a commercial-friendly license and allow you to support high quality open source development all at the same time. Please see the Sidekiq homepage for more detail.

Problems?

Please do not directly email any Sidekiq committers with questions or problems. A community is best served when discussions are held in public.

If you have a problem, please review the FAQ and Troubleshooting wiki pages. Searching the issues for your problem is also a good idea.

Sidekiq Pro and Sidekiq Enterprise customers get private email support. You can purchase at https://sidekiq.org; email support@contribsys.com for help.

Useful resources:

  • Product documentation is in the wiki.
  • Occasional announcements are made to the @sidekiq Twitter account.
  • The Sidekiq tag on Stack Overflow has lots of useful Q & A.

Every Friday morning is Sidekiq happy hour: I video chat and answer questions. See the Sidekiq support page for details.

Contributing

Please see the contributing guidelines.

License

Please see LICENSE for licensing details.

Author

Mike Perham, @getajobmike / @sidekiq, https://www.mikeperham.com / https://www.contribsys.com