When talking about the performance of a web service, it is intended to think about 2 metrics. 1. TPS 2. Latency 3. TP50, TP90, TP99 etc.
- single thread test for base line.
One thread tests for a period of time. This tests the ideal response latency. - Find the peak TPS
Test the web service TPS by increasing number of connections. TPS should go up as connections increases, then reach the peak, then goes down. - Test the TP50, TP90, TP99 etc
Around the peak TPS thread connection, monitor the avg latency, TP50, TP90, TP99 etc. Find the number of connection where you can accept the latency metrics.