Performance Comparison Report

It directly reflects the loading time of pages or page components. Each row holds the data of one specific request. Its name is defined within the test case as timer name. The Count section of the table shows the total number of executions (Total), the calculated executions per seconds (1/s) and per minute (1/min), as well as projections or calculations of the executions per hour (1/h) and day (1/d). The Error section shows the total number (Total) of errors that occurred during loading of the page or page component. The error count does not include errors detected during the postvalidation of the data received. Typical error situations are http-response codes such as 404 and 505, timeouts, or connection resets.

The runtime section of the table shows the median, the arithmetic mean, and the minimum and maximum runtime encountered, as well as the standard deviation of all data within that series. The runtime segmentation section shows several runtime segments and the number of requests within the segment's definition.

If the runtime of the test case is shorter than a displayed time period--for example if the test runtime was 30 minutes and the time period is in hours--the numbers are a linear projection. That means they show a possible outcome of a longer test run, assuming load and application behavior remain the same.

*) numbers might be projected

**) Numbers are estimated using HyperLogLog and can be off by up to 0.5%, but only for distinct counts larger than 100,000. A difference of up to 2% can occur for distinct counts larger than 1,000,000.