mperham--sidekiq/Pro-Changes.md

Sidekiq Pro Changelog

Please see http://sidekiq.org/pro for more details and how to buy.

HEAD

This release offers new functionality based on the SCAN command newly added to Redis 2.8.

• Job Filtering in the Web UI! You can now filter retries and scheduled jobs in the Web UI so you only see the jobs relevant to your needs. Queues cannot be filtered; Redis does not provide the same SCAN operation on the LIST type.
• SCAN support in the Sidekiq::SortedSet API. Here's an example that finds all jobs which contain the substring "Warehouse::OrderShip" and deletes all matching retries. If the set is large, this API will be much faster than standard iteration using each.

  Sidekiq::RetrySet.new.scan("Warehouse::OrderShip") do |entry|
    entry.delete
  end

• Sidekiq::Batch#jobs now returns the set of JIDs added to the batch.
• Sidekiq::Batch#jids returns the complete set of JIDs associated with the batch.
• Pro now requires 2.17.0

1.2.5

• Convert Batch UI to use Sidekiq 2.16's support for extension localization.
• Update reliable_push to work with Sidekiq::Client refactoring in 2.16
• Pro now requires Sidekiq 2.16.0

1.2.4

• Convert Batch UI to Bootstrap 3
• Pro now requires Sidekiq 2.15.0
• Add Sidekiq::Batch::Status#delete [#1205]

1.2.3

• Pro now requires Sidekiq 2.14.0
• Fix bad exception handling in batch callbacks [#1134]
• Convert Batch UI to ERB

1.2.2

• Problem with reliable fetch which could lead to lost jobs when Sidekiq is shut down normally. Thanks to MikaelAmborn for the report. [#1109]

1.2.1

• Forgot to push paging code necessary for delete_job performance.

1.2.0

• LEAK Fix batch key which didn't expire in Redis. Keys match /b-[a-f0-9]{16}-pending/, e.g. "b-4f55163ddba10aa0-pending" [#1057]
• Reliable fetch now supports multiple queues, using the algorithm spec'd by @jackrg [#1102]
• Fix issue with reliable_push where it didn't return the JID for a pushed job when sending previously cached jobs to Redis.
• Add fast Sidekiq::Queue#delete_job(jid) API which leverages Lua so job lookup is 100% server-side. Benchmark vs Sidekiq's Job#delete API:

Sidekiq Pro API
  0.030000   0.020000   0.050000 (  1.640659)
Sidekiq API
 17.250000   2.220000  19.470000 ( 22.193300)

• Add fast Sidekiq::Queue#delete_by_class(klass) API to remove all jobs of a given type. Uses server-side Lua for performance.

1.1.0

• New sidekiq/pro/reliable_push which makes Sidekiq::Client resiliant to Redis network failures. [#793]
• Move sidekiq/reliable_fetch to sidekiq/pro/reliable_fetch

1.0.0

• Sidekiq Pro changelog moved to mperham/sidekiq for public visibility.
• Add new Rack endpoint for easy polling of batch status via JavaScript. See sidekiq/rack/batch_status

0.9.3

• Fix bad /batches path in Web UI
• Fix Sinatra conflict with sidekiq-failures

0.9.2

• Fix issue with lifecycle notifications not firing.

0.9.1

• Update due to Sidekiq API changes.

0.9.0

• Rearchitect Sidekiq's Fetch code to support different fetch strategies. Add a ReliableFetch strategy which works with Redis' RPOPLPUSH to ensure we don't lose messages, even when the Sidekiq process crashes unexpectedly. [mperham/sidekiq#607]

0.8.2

• Reimplement existing notifications using batch on_complete events.

0.8.1

• Rejigger batch callback notifications.

0.8.0

• Add new Batch 'callback' notification support, for in-process notification.
• Symbolize option keys passed to Pony [mperham/sidekiq#603]
• Batch no longer requires the Web UI since Web UI usage is optional. You must require is manually in your Web process:

require 'sidekiq/web'
require 'sidekiq/batch/web'
mount Sidekiq::Web => '/sidekiq'

0.7.1

• Worker instances can access the associated jid and bid via simple accessors.
• Batches can now be modified while being processed so, e.g. a batch job can add additional jobs to its own batch.

def perform(...)
  batch = Sidekiq::Batch.new(bid) # instantiate batch associated with this job
  batch.jobs do
    SomeWorker.perform_async # add another job
  end
end

• Save error backtraces in batch's failure info for display in Web UI.
• Clean up email notification a bit.

0.7.0

• Add optional batch description
• Mutable batches. Batches can now be modified to add additional jobs at runtime. Example would be a batch job which needs to create more jobs based on the data it is processing.

batch = Sidekiq::Batch.new(bid)
batch.jobs do
  # define more jobs here
end

• Fix issues with symbols vs strings in option hashes

0.6.1

• Webhook notification support

0.6

• Redis pubsub
• Email polish

0.5

• Batches
• Notifications
• Statsd middleware