Mike Perham
7408387ee0
Refactor fetch strategy, fix queueing to lpush and rpop.
2013-01-05 21:17:08 -08:00
Mike Perham
2055377187
Don't clear workers set until actually shutting down, #492
2012-11-09 20:40:23 -08:00
Mike Perham
110cc1dc42
Update Celluloid API usage, use .async, fixes #500
2012-11-03 19:56:06 -07:00
Jake Mack
e6c306de15
Removed -s flag, simplified queue logic
2012-07-31 13:58:50 -07:00
Jake Mack
05aa2b2552
Performance enhancing codes
2012-07-27 16:03:01 -07:00
Jake Mack
c779018af8
Implemented a strictly ordered queue switch
2012-07-27 15:18:11 -07:00
Mike Perham
1d0f6b03dc
Bloody hack to shutdown the Fetcher quickly, since Celluloid's terminate is not working as I expect
2012-05-11 21:25:38 -07:00
Mike Perham
091d88bc33
Various cleanups
2012-04-18 20:13:10 -07:00
Mike Perham
be90cb2da4
Play even nicer with celluloid
2012-04-18 17:06:46 -07:00
Ryan LeCompte
e980ed7c3c
use #after instead of retry to place nicely with celluloid
2012-04-18 17:00:57 -07:00
Ryan LeCompte
b4715d7bed
graceful error rescue and retry in fetcher
2012-04-18 16:31:17 -07:00
Ryan LeCompte
bceacec766
ensure that after applying weights, all queues are represented in the blpop command
2012-04-03 23:35:46 -07:00
Ryan LeCompte
a72d3185c1
initialize queue names only once
2012-04-03 20:38:03 -07:00
Ryan LeCompte
e529d78c73
re-introduce weighted queues
2012-04-03 20:19:29 -07:00
Mike Perham
efb2273461
Fix queue name with namespace, fixes #109
2012-04-03 07:09:43 -07:00
Mike Perham
b58d125659
Clean up requires
2012-03-31 12:45:24 -07:00
Mike Perham
da01d927a6
Refactor fetch, X-treme termination!
2012-03-30 20:59:08 -07:00
Mike Perham
4d14c2f7fa
Simpler fetch logic/design
2012-03-30 19:52:25 -07:00
Mike Perham
5fdc297e10
Redesign message poll [WIP]
...
Instead of using the manager to constantly poll the Redis server, use a dedicated Fetcher actor + BLPOP with a timeout. This should dramatically reduce Sidekiq's network chattiness.
2012-03-30 19:52:25 -07:00