[XD-2238] Improve module deployment distribution Created: 14/Oct/14 Updated: 27/Oct/14 Resolved: 27/Oct/14
|Fix Version/s:||1.1 M1|
|Reporter:||Patrick Peralta||Assignee:||Patrick Peralta|
|Remaining Estimate:||Not Specified|
|Time Spent:||Not Specified|
|Original Estimate:||Not Specified|
(More) even distribution of modules across containers starting up within seconds of each other.
When a container joins the XD cluster (via ZooKeeper) it triggers stream/job module deployments for modules that need to be deployed. If multiple containers are being started at around the same time, this can result in the first few containers taking all of the deployments while leaving the rest without any deployments.
To solve this, we will introduce a "quiet period" where no deployments will be triggered within n seconds of a container joining, where n will have a default value (perhaps 5 to 10 seconds). This value will be configurable.
|Comment by Patrick Peralta [ 22/Oct/14 ]|