Load Test HTTP-GRPC Proxy and Tensorflow Serving

Open a Terminal through Jupyter Notebook

(Menu Bar -> Terminal -> New Terminal)

Run the Following Command in Terminal to Start HTTP-GRPC Proxy

load_test_predict low

The params are as follows:

  • 1: amount of load low|medium|high

In [ ]: