Details
Description
1. We'll need a system which give better control of what yarn/xd containers are out there and what is a status of those containers.
2. We also need grouping of containers order to choose, prioritize and scale tasks.
3. We need heartbeating of the grid nodes. Hadoop Yarn itself doesn't give enough tools to know if container is "alive".