Overview
A trend report shows the development of performance over time. Multiple measurements are taken into account and evaluated against each other. An XLT trend reports shows you, how your system performs over time, how your tuning effort pays out, and how your live environment acts under changing load situation, if used as monitoring. Two trend report types are available: Difference to Base Run and Difference to Previous Run.
The Difference to Baseline information visualizes the changes compared to your first test run, mostly referred to as baseline. Each table column will show you the difference between your baseline run and the run your are interested in. The quality of your baseline run defines how valuable this report may be. You can also see this as long-term performance trend report. The baseline column lists the initial values for this data group.
The Difference to Previous Run section visualizes the improvements between two adjacent test runs. This shows you, how your last change or tuning effort payed out in comparison to the previous run. It helps you to see whether or not you are on the right track improving the performance of your application. The report also emphasizes sudden improvements or set-backs. This report can also be seen as a short-term performance trend report. The first data column lists the initial measurement values and helps to improve the interpretation of the differences.
When you hover the mouse over the columns of the trend report table, you will see the actual measurement results. This will give you a better impression whether or not the reported percentage change is significant or not.
Please keep in mind, that changes up to 10% can be measurement fluctuations.
Transactions
A transaction is a completed test case. The test case consists of one or more actions. The run time of a transaction contains the runtime of all actions within the test case, thinktimes, and the processing time of the test code itself. If the test path of the test case is heavily randomized, the runtime of transactions might vary significantly. The average runtime shows the development of tests over time and especially helps to evaluate the outcome of long running tests.
#1: compare-01 (Sat Jan 11 20:19:19 CET 2014)
#2: compare-02 (Sat Jan 11 20:41:05 CET 2014)
#3: compare-03 (Sat Jan 11 20:56:26 CET 2014)
#4: compare-04 (Sat Jan 11 21:11:46 CET 2014)
#5: compare-05 (Sat Jan 11 21:27:11 CET 2014)
#6: compare-06 (Sat Jan 11 21:42:32 CET 2014)
#7: compare-07 (Sat Jan 11 21:57:53 CET 2014)
#8: compare-08 (Sat Jan 11 22:13:13 CET 2014)
#9: compare-11 (Sat Jan 11 23:44:05 CET 2014)
#10: compare-12 (Sat Jan 11 23:59:25 CET 2014)
#11: compare-13 (Sun Jan 12 00:14:46 CET 2014)
#12: compare-14 (Sun Jan 12 00:30:11 CET 2014)
| Transaction Name | Baseline | Difference to Baseline | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 26,850 ms | 0.0% | +0.2% | +0.6% | -0.4% | +0.7% | +0.5% | +0.6% | -0.4% | -0.0% | +1.6% | +1.4% |
| TFeed | 2,090 ms | +1.7% | +2.2% | -1.0% | +4.5% | -1.2% | 0.0% | -0.5% | -2.4% | +0.5% | -1.9% | -3.6% |
| TSearchVisitor | 14,270 ms | +2.4% | +1.0% | +3.4% | +4.2% | +4.5% | -0.3% | +0.5% | +5.0% | +4.2% | +2.3% | +6.0% |
| TVisitor | 30,935 ms | -0.0% | -0.0% | +0.2% | +0.2% | +0.2% | +0.1% | -0.2% | +0.4% | -0.5% | +0.3% | +0.4% |
| Totals | 29,000 ms | +0.4% | +0.1% | +0.7% | -0.1% | +0.9% | +1.1% | +0.2% | +0.5% | +0.7% | +0.7% | +0.4% |
| Transaction Name | First | Difference to Previous Run | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 26,850 ms | 0.0% | +0.2% | +0.4% | -1.0% | +1.1% | -0.2% | +0.1% | -1.1% | +0.4% | +1.7% | -0.2% |
| TFeed | 2,090 ms | +1.7% | +0.5% | -3.0% | +5.6% | -5.5% | +1.2% | -0.5% | -1.9% | +2.9% | -2.4% | -1.7% |
| TSearchVisitor | 14,270 ms | +2.4% | -1.4% | +2.4% | +0.7% | +0.3% | -4.6% | +0.8% | +4.5% | -0.7% | -1.9% | +3.6% |
| TVisitor | 30,935 ms | -0.0% | -0.0% | +0.3% | -0.0% | +0.0% | -0.1% | -0.3% | +0.6% | -0.8% | +0.7% | +0.2% |
| Totals | 29,000 ms | +0.4% | -0.3% | +0.6% | -0.7% | +1.0% | +0.2% | -0.9% | +0.2% | +0.2% | -0.0% | -0.2% |
| Transaction Name | Baseline | Difference to Baseline | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 27,028 ms | -0.5% | -0.2% | -0.1% | -0.7% | -0.2% | -0.6% | -0.2% | -0.2% | -0.9% | +0.5% | +0.5% |
| TFeed | 2,186 ms | -2.0% | -3.2% | -4.2% | -1.2% | -3.2% | -4.5% | -4.8% | -3.5% | -3.2% | -4.7% | -5.0% |
| TSearchVisitor | 14,163 ms | +4.0% | +3.0% | +3.6% | +7.2% | +4.7% | +0.2% | +1.2% | +4.4% | +2.6% | +2.7% | +9.0% |
| TVisitor | 30,898 ms | +0.1% | -0.0% | +0.3% | +0.3% | +0.4% | +0.3% | -0.1% | +0.6% | +0.0% | +0.5% | +0.6% |
| Totals | 23,110 ms | +0.8% | +0.6% | +0.9% | +1.4% | +1.1% | +0.3% | +0.2% | +1.1% | +0.4% | +0.9% | +2.0% |
| Transaction Name | First | Difference to Previous Run | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 27,028 ms | -0.5% | +0.3% | +0.0% | -0.6% | +0.5% | -0.4% | +0.4% | +0.0% | -0.7% | +1.4% | +0.0% |
| TFeed | 2,186 ms | -2.0% | -1.2% | -1.1% | +3.1% | -2.0% | -1.3% | -0.3% | +1.3% | +0.3% | -1.5% | -0.3% |
| TSearchVisitor | 14,163 ms | +4.0% | -0.9% | +0.5% | +3.5% | -2.3% | -4.4% | +1.0% | +3.2% | -1.7% | +0.1% | +6.1% |
| TVisitor | 30,898 ms | +0.1% | -0.1% | +0.4% | +0.0% | +0.0% | -0.0% | -0.4% | +0.6% | -0.6% | +0.5% | +0.0% |
| Totals | 23,110 ms | +0.8% | -0.3% | +0.3% | +0.5% | -0.3% | -0.8% | -0.1% | +0.9% | -0.7% | +0.5% | +1.2% |
| Transaction Name | Baseline | Difference to Baseline | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 23,852 ms | +0.5% | +2.9% | +0.2% | 0.0% | +2.2% | -1.5% | +3.7% | +0.7% | +2.0% | +3.7% | +6.7% |
| TFeed | 1,565 ms | +0.8% | +0.1% | +2.0% | -0.8% | -0.3% | -0.4% | -0.1% | +1.7% | -0.4% | +0.8% | +1.2% |
| TSearchVisitor | 6,105 ms | +7.3% | +13.5% | +18.3% | +18.7% | +16.7% | +8.8% | +9.4% | +9.3% | +14.2% | +20.6% | +10.3% |
| TVisitor | 24,328 ms | +12.8% | +12.5% | +15.1% | +13.8% | +8.6% | +15.2% | +15.4% | +15.2% | +15.0% | +12.4% | +13.0% |
| Totals | 1,565 ms | +0.8% | +0.1% | +2.0% | -0.8% | -0.3% | -0.4% | -0.1% | +1.7% | -0.4% | +0.8% | +1.2% |
| Transaction Name | First | Difference to Previous Run | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 23,852 ms | +0.5% | +2.4% | -2.7% | -0.2% | +2.2% | -3.6% | +5.3% | -2.9% | +1.3% | +1.7% | +2.9% |
| TFeed | 1,565 ms | +0.8% | -0.7% | +1.9% | -2.7% | +0.5% | -0.2% | +0.3% | +1.9% | -2.1% | +1.2% | +0.4% |
| TSearchVisitor | 6,105 ms | +7.3% | +5.7% | +4.2% | +0.3% | -1.7% | -6.7% | +0.5% | -0.2% | +4.5% | +5.6% | -8.5% |
| TVisitor | 24,328 ms | +12.8% | -0.3% | +2.4% | -1.1% | -4.6% | +6.1% | +0.2% | -0.2% | -0.2% | -2.3% | +0.6% |
| Totals | 1,565 ms | +0.8% | -0.7% | +1.9% | -2.7% | +0.5% | -0.2% | +0.3% | +1.9% | -2.1% | +1.2% | +0.4% |
| Transaction Name | Baseline | Difference to Baseline | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 34,758 ms | -14.3% | -15.1% | -15.9% | -14.6% | -13.4% | -15.2% | -17.1% | -15.7% | -13.9% | -14.2% | -15.7% |
| TFeed | 8,554 ms | -48.3% | -53.8% | -58.5% | -49.3% | -51.5% | -58.1% | -59.6% | -53.1% | -60.8% | -54.9% | -49.0% |
| TSearchVisitor | 22,836 ms | +1.2% | +2.7% | -2.7% | +8.1% | +2.7% | -2.2% | +1.7% | +3.3% | +1.0% | +1.4% | +3.0% |
| TVisitor | 34,777 ms | -2.5% | +0.1% | -2.8% | +1.0% | -1.5% | -0.7% | -1.4% | -0.0% | -1.6% | +0.8% | -1.1% |
| Totals | 34,777 ms | -2.5% | +0.1% | -2.8% | +1.0% | -1.5% | -0.7% | -1.4% | -0.0% | -1.6% | +0.8% | -1.1% |
| Transaction Name | First | Difference to Previous Run | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 34,758 ms | -14.3% | -0.9% | -0.9% | +1.5% | +1.4% | -2.0% | -2.3% | +1.7% | +2.2% | -0.3% | -1.8% |
| TFeed | 8,554 ms | -48.3% | -10.6% | -10.4% | +22.3% | -4.3% | -13.6% | -3.7% | +16.3% | -16.4% | +14.9% | +13.2% |
| TSearchVisitor | 22,836 ms | +1.2% | +1.5% | -5.3% | +11.2% | -5.1% | -4.8% | +4.0% | +1.6% | -2.3% | +0.5% | +1.5% |
| TVisitor | 34,777 ms | -2.5% | +2.6% | -2.9% | +3.9% | -2.4% | +0.8% | -0.7% | +1.4% | -1.6% | +2.4% | -1.9% |
| Totals | 34,777 ms | -2.5% | +2.6% | -2.9% | +3.9% | -2.4% | +0.8% | -0.7% | +1.4% | -1.6% | +2.4% | -1.9% |
| Transaction Name | Baseline | Difference to Baseline | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TFeed | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TSearchVisitor | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TVisitor | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| Totals | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| Transaction Name | First | Difference to Previous Run | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| TAuthor | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TFeed | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TSearchVisitor | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TVisitor | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| Totals | 0 | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
