Load balancing based upon speech processing specific factors

EXAMPLE 1

Dynamic Factor Computation

[0045] Algorithm 300 computes a speech utilization load based upon a number of sessions, an arrival rate, a duty cycle, and a prediction. A duty cycle percentage equals a number of seconds in a session (ASR or TTS) divided by the number of seconds for a total session. The number of seconds per second and the total seconds per session are statistics that are often maintained by a voice server.

[0046] An ASR utilization equals a number of sessions per second times ASR duty cycle times prediction period, plus the number of ASR engines in use divided by the number of configured ASR engines. The TTS utilization equals a number of sessions per second times TTS duty cycle times prediction period, plus the number of ASR engines in use divided by the number of configured TTS engines.

[0047] An example of an ASR utilization based upon algorithm 300 is presented below: 1)⁢ ⁢Seconds⁢ ⁢ASR⁢ ⁢in⁢ ⁢Session=12⁢ ⁢seconds⁢ ⁢(determined⁢ ⁢by⁢ ⁢system⁢ ⁢stats)⁢⁢2)⁢ ⁢S

EXAMPLE 2

ASR Utilization Computation

[0048]FIG. 4 is a flow chart of a method 400 for implementing speech utilization algorithms in accordance with an embodiment of the inventive arrangements disclosed herein. The method 400 can be performed in the context of a load balancer that selects one of multiple voice servers to handle incoming client speech processing requests. In one embodiment, the method 400 can be performed in the context of system 100. The speech utilization algorithm of method 400 can be implemented as algorithm 200, as algorithm 300, or as any algorithm that determines a speech utilization score or speech utilization level using one or more speech processing specific factors.

[0049] Method 400 can begin in step 405, where one or more speech utilization algorithms can be installed and configured for one or more voice servers In one embodiment, step 405 can be performed using an administration console that deploys a resource adaptor containing the speech utilization algo