Method and system for dynamic control of a multi-tier processing system

[0022]In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant teachings. However, it should be apparent to those skilled in the art that the present teachings may be practiced without such details. In other instances, well known methods, procedures, systems, components, and / or circuitry have been described at a relatively high-level, without detail, in order to avoid unnecessarily obscuring aspects of the present teaching.

[0023]The present disclosure describes method, system, and programming aspects of dynamic control of multi-tier systems. Such method and system provide an environment for coordinated scaling and elasticity across multiple tiers. The method and system apply coordinated management of queue lengths, latency and throughput across multiple tiers and scale each tier such that overall throughput and latency objectives are met. The method and system can scale multi-tier, m