System and method for benchmarking ai hardware using synthetic ai model

[0033]The following description is presented to enable any person skilled in the art to make and use the embodiments, and is provided in the context of a particular application and its requirements. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the present disclosure. Thus, the embodiments described herein are not limited to the embodiments shown, but are to be accorded the widest scope consistent with the principles and features disclosed herein.

Overview

[0034]The embodiments described herein solve the problem of efficiently benchmarking AI hardware by generating a synthetic AI model that represents the statistical characteristics of the workloads of a set of AI models corresponding to representative applications and their execution frequencies. The AI hardware can be a piece of hardware