1
0
Fork 0
mirror of https://github.com/mperham/sidekiq.git synced 2022-11-09 13:52:34 -05:00
mperham--sidekiq/Pro-Changes.md

386 lines
9.4 KiB
Markdown
Raw Normal View History

Sidekiq Pro Changelog
=======================
2013-11-23 15:40:39 -05:00
Please see [http://sidekiq.org/pro](http://sidekiq.org/pro) for more details and how to buy.
2013-05-07 00:17:44 -04:00
2015-01-10 01:22:03 -05:00
2015-03-14 23:55:09 -04:00
2.0.1
-----------
- Add `batch.callback_queue` so batch callbacks can use a higher
priority queue than jobs. [#2200]
2015-03-18 12:23:42 -04:00
- Gracefully recover if someone runs `SCRIPT FLUSH` on Redis. [#2240]
- Ignore errors when attempting `bulk_requeue`, allowing clean shutdown
2015-03-14 23:55:09 -04:00
2015-02-18 11:30:31 -05:00
2.0.0
2015-01-10 01:22:03 -05:00
-----------
2015-01-29 14:39:41 -05:00
- See [the Upgrade Notes](Pro-2.0-Upgrade.md) for detailed notes.
2015-01-10 01:22:03 -05:00
2015-01-07 12:49:53 -05:00
1.9.2
-----------
2015-01-07 14:14:59 -05:00
- As of 1/1/2015, Sidekiq Pro is hosted on a new dedicated server.
Happy new year and let's hope for 100% uptime!
2015-01-07 12:49:53 -05:00
- Fix bug in reliable\_fetch where jobs could be duplicated if a Sidekiq
process crashed and you were using weighted queues. [#2120]
2014-10-14 15:22:11 -04:00
1.9.1
-----------
- **SECURITY** Fix XSS in batch description, thanks to intercom.io for reporting the
issue. If you don't use batch descriptions, you don't need the fix.
2014-10-06 17:29:26 -04:00
1.9.0
2014-09-17 13:39:22 -04:00
-----------
2014-10-03 16:43:25 -04:00
- Add new expiring jobs feature [#1982]
- Show batch expiration on Batch details page [#1981]
2014-09-17 13:39:22 -04:00
- Add '$' batch success token to the pubsub support. [#1953]
2014-08-31 23:14:22 -04:00
1.8.0
-----------
2014-09-07 11:46:57 -04:00
- Fix race condition where Batches can complete
2014-08-31 23:14:22 -04:00
before they have been fully defined or only half-defined. Requires
Sidekiq 3.2.3. [#1919]
2014-08-31 23:27:30 -04:00
1.7.6
-----------
- Quick release to verify #1919
1.7.5
-----------
- Fix job filtering within the Dead tab.
2014-08-11 13:40:01 -04:00
- Add APIs and wiki documentation for invalidating jobs within a batch.
2014-06-16 16:49:32 -04:00
1.7.4
-----------
- Awesome ANSI art startup banner!
2014-06-01 16:21:05 -04:00
1.7.3
-----------
- Batch callbacks should use the same queue as the associated jobs.
2014-05-31 14:59:38 -04:00
1.7.2
2014-05-31 00:19:38 -04:00
-----------
- **DEPRECATION** Use `Batch#on(:complete)` instead of `Batch#notify`.
The specific Campfire, HipChat, email and other notification schemes
will be removed in 2.0.0.
- Remove batch from UI when successful. [#1745]
- Convert batch callbacks to be asynchronous jobs for error handling [#1744]
2014-05-15 00:20:41 -04:00
1.7.1
-----------
- Fix for paused queues being processed for a few seconds when starting
a new Sidekiq process.
- Add a 5 sec delay when starting reliable fetch on Heroku to minimize
any duplicate job processing with another process shutting down.
2014-04-17 23:53:03 -04:00
1.7.0
-----------
- Add ability to pause reliable queues via API.
```ruby
q = Sidekiq::Queue.new("critical")
q.pause!
q.paused? # => true
q.unpause!
```
Sidekiq polls Redis every 10 seconds for paused queues so pausing will take
a few seconds to take effect.
2014-03-28 11:25:40 -04:00
1.6.0
2014-03-27 00:36:07 -04:00
-----------
- Compatible with Sidekiq 3.
1.5.1
-----------
- Due to a breaking API change in Sidekiq 3.0, this version is limited
to Sidekiq 2.x.
2014-03-20 22:12:58 -04:00
1.5.0
-----------
- Fix issue on Heroku where reliable fetch could orphan jobs [#1573]
2014-02-15 15:56:27 -05:00
1.4.3
2014-02-01 16:54:07 -05:00
-----------
- Reverse sorting of Batches in Web UI [#1098]
2014-02-15 15:56:27 -05:00
- Refactoring for Sidekiq 3.0, Pro now requires Sidekiq 2.17.5
2014-02-01 16:54:07 -05:00
2014-01-21 23:42:39 -05:00
1.4.2
2014-01-20 18:05:16 -05:00
-----------
- Tolerate expired Batches in the web UI.
- Fix 100% CPU usage when using weighted queues and reliable fetch.
2014-01-03 19:13:52 -05:00
1.4.1
2013-12-19 00:22:20 -05:00
-----------
- Add batch progress bar to batch detail page. [#1398]
2014-01-03 19:13:52 -05:00
- Fix race condition in initializing Lua scripts
2013-12-19 00:22:20 -05:00
2013-12-15 17:22:04 -05:00
1.4.0
2013-12-07 16:51:13 -05:00
-----------
- Default batch expiration has been extended to 3 days, from 1 day previously.
2013-12-07 23:37:34 -05:00
- Batches now sort in the Web UI according to expiry time, not creation time.
2013-12-07 16:51:13 -05:00
- Add user-configurable batch expiry. If your batches might take longer
than 72 hours to process, you can extend the expiration date.
2013-12-07 23:37:34 -05:00
2013-12-07 16:51:13 -05:00
```ruby
b = Sidekiq::Batch.new
b.expires_in 5.days
...
```
2013-11-29 13:45:49 -05:00
1.3.2
-----------
- Lazy load Lua scripts so a Redis connection is not required on bootup.
2013-11-28 18:39:31 -05:00
1.3.1
-----------
- Fix a gemspec packaging issue which broke the Batch UI.
2013-11-24 17:15:05 -05:00
1.3.0
2013-11-07 10:57:34 -05:00
-----------
2013-11-23 15:40:39 -05:00
Thanks to @jonhyman for his contributions to this Sidekiq Pro release.
2013-11-17 16:39:52 -05:00
2013-11-23 15:57:31 -05:00
This release includes new functionality based on the SCAN command newly
added to Redis 2.8. Pro still works with Redis 2.4 but some
functionality will be unavailable.
- Job Filtering in the Web UI!
You can now filter retries and scheduled jobs in the Web UI so you
only see the jobs relevant to your needs. Queues cannot be filtered;
Redis does not provide the same SCAN operation on the LIST type.
2013-11-24 17:15:05 -05:00
**Redis 2.8**
2013-11-26 00:36:48 -05:00
![Filtering](https://f.cloud.github.com/assets/2911/1619465/f47529f2-5657-11e3-8cd1-33899eb72aad.png)
- SCAN support in the Sidekiq::SortedSet API. Here's an example that
finds all jobs which contain the substring "Warehouse::OrderShip"
and deletes all matching retries. If the set is large, this API
2013-11-11 00:22:50 -05:00
will be **MUCH** faster than standard iteration using each.
2013-11-24 17:15:05 -05:00
**Redis 2.8**
```ruby
2013-11-23 15:40:39 -05:00
Sidekiq::RetrySet.new.scan("Warehouse::OrderShip") do |job|
job.delete
end
```
2013-11-23 15:52:41 -05:00
2013-11-07 10:57:34 -05:00
- Sidekiq::Batch#jobs now returns the set of JIDs added to the batch.
- Sidekiq::Batch#jids returns the complete set of JIDs associated with the batch.
2013-11-11 00:22:50 -05:00
- Sidekiq::Batch#remove\_jobs(jid, jid, ...) removes JIDs from the set, allowing early termination of jobs if they become irrelevant according to application logic.
- Sidekiq::Batch#include?(jid) allows jobs to check if they are still
relevant to a Batch and exit early if not.
2013-11-28 18:52:07 -05:00
- Sidekiq::SortedSet#find\_job(jid) now uses server-side Lua if possible **Redis 2.6** [jonhyman]
2013-11-22 13:34:59 -05:00
- The statsd integration now sets global job counts:
2013-11-23 15:40:39 -05:00
```ruby
2013-11-22 13:34:59 -05:00
jobs.count
jobs.success
jobs.failure
2013-11-23 15:40:39 -05:00
```
2013-11-23 15:52:41 -05:00
2013-11-23 15:40:39 -05:00
- Change shutdown logic to push leftover jobs in the private queue back
into the public queue when shutting down with Reliable Fetch. This
2013-11-23 15:57:31 -05:00
allows the safe decommission of a Sidekiq Pro process when autoscaling. [jonhyman]
2013-11-28 18:52:07 -05:00
- Add support for weighted random fetching with Reliable Fetch [jonhyman]
2013-11-23 15:40:39 -05:00
- Pro now requires Sidekiq 2.17.0
2013-11-07 10:57:34 -05:00
2013-10-21 16:45:11 -04:00
1.2.5
-----------
2013-11-03 13:07:35 -05:00
- Convert Batch UI to use Sidekiq 2.16's support for extension localization.
- Update reliable\_push to work with Sidekiq::Client refactoring in 2.16
2013-10-21 16:45:11 -04:00
- Pro now requires Sidekiq 2.16.0
2013-10-03 23:52:36 -04:00
1.2.4
-----------
- Convert Batch UI to Bootstrap 3
- Pro now requires Sidekiq 2.15.0
- Add Sidekiq::Batch::Status#delete [#1205]
2013-08-25 16:41:21 -04:00
1.2.3
-----------
- Pro now requires Sidekiq 2.14.0
- Fix bad exception handling in batch callbacks [#1134]
- Convert Batch UI to ERB
2013-08-17 15:52:51 -04:00
1.2.2
-----------
- Problem with reliable fetch which could lead to lost jobs when Sidekiq
is shut down normally. Thanks to MikaelAmborn for the report. [#1109]
2013-08-11 23:35:37 -04:00
1.2.1
-----------
- Forgot to push paging code necessary for `delete_job` performance.
2013-08-10 15:51:23 -04:00
1.2.0
2013-07-27 19:16:25 -04:00
-----------
2013-08-10 15:51:23 -04:00
- **LEAK** Fix batch key which didn't expire in Redis. Keys match
2013-08-07 16:45:08 -04:00
/b-[a-f0-9]{16}-pending/, e.g. "b-4f55163ddba10aa0-pending" [#1057]
2013-08-10 15:51:23 -04:00
- **Reliable fetch now supports multiple queues**, using the algorithm spec'd
by @jackrg [#1102]
2013-07-27 19:16:25 -04:00
- Fix issue with reliable\_push where it didn't return the JID for a pushed
job when sending previously cached jobs to Redis.
2013-08-10 15:51:23 -04:00
- Add fast Sidekiq::Queue#delete\_job(jid) API which leverages Lua so job lookup is
2013-11-24 17:15:05 -05:00
100% server-side. Benchmark vs Sidekiq's Job#delete API. **Redis 2.6**
2013-07-28 19:11:36 -04:00
```
Sidekiq Pro API
0.030000 0.020000 0.050000 ( 1.640659)
Sidekiq API
17.250000 2.220000 19.470000 ( 22.193300)
```
2013-07-27 19:16:25 -04:00
2013-08-07 16:45:08 -04:00
- Add fast Sidekiq::Queue#delete\_by\_class(klass) API to remove all
2013-11-24 17:15:05 -05:00
jobs of a given type. Uses server-side Lua for performance. **Redis 2.6**
2013-07-27 19:16:25 -04:00
2013-05-25 22:58:27 -04:00
1.1.0
2013-05-08 23:16:03 -04:00
-----------
- New `sidekiq/pro/reliable_push` which makes Sidekiq::Client resiliant
to Redis network failures. [#793]
- Move `sidekiq/reliable_fetch` to `sidekiq/pro/reliable_fetch`
1.0.0
-----------
- Sidekiq Pro changelog moved to mperham/sidekiq for public visibility.
- Add new Rack endpoint for easy polling of batch status via JavaScript. See `sidekiq/rack/batch_status`
0.9.3
-----------
- Fix bad /batches path in Web UI
- Fix Sinatra conflict with sidekiq-failures
0.9.2
-----------
- Fix issue with lifecycle notifications not firing.
0.9.1
-----------
- Update due to Sidekiq API changes.
0.9.0
-----------
- Rearchitect Sidekiq's Fetch code to support different fetch
strategies. Add a ReliableFetch strategy which works with Redis'
RPOPLPUSH to ensure we don't lose messages, even when the Sidekiq
process crashes unexpectedly. [mperham/sidekiq#607]
0.8.2
-----------
- Reimplement existing notifications using batch on_complete events.
0.8.1
-----------
- Rejigger batch callback notifications.
0.8.0
-----------
- Add new Batch 'callback' notification support, for in-process
notification.
- Symbolize option keys passed to Pony [mperham/sidekiq#603]
- Batch no longer requires the Web UI since Web UI usage is optional.
You must require is manually in your Web process:
```ruby
require 'sidekiq/web'
require 'sidekiq/batch/web'
mount Sidekiq::Web => '/sidekiq'
```
0.7.1
-----------
- Worker instances can access the associated jid and bid via simple
accessors.
- Batches can now be modified while being processed so, e.g. a batch
job can add additional jobs to its own batch.
```ruby
def perform(...)
batch = Sidekiq::Batch.new(bid) # instantiate batch associated with this job
batch.jobs do
SomeWorker.perform_async # add another job
end
end
```
- Save error backtraces in batch's failure info for display in Web UI.
- Clean up email notification a bit.
0.7.0
-----------
- Add optional batch description
- Mutable batches. Batches can now be modified to add additional jobs
at runtime. Example would be a batch job which needs to create more
jobs based on the data it is processing.
```ruby
batch = Sidekiq::Batch.new(bid)
batch.jobs do
# define more jobs here
end
```
- Fix issues with symbols vs strings in option hashes
0.6.1
-----------
- Webhook notification support
0.6
-----------
- Redis pubsub
- Email polish
0.5
-----------
- Batches
- Notifications
- Statsd middleware