From: Ondrej Lichtner <olichtne(a)redhat.com>
In case the Netperf client is run multiple times we reported the
standard deviation as just rate deviation and used it to create a
confidence interval around the mean value. Instead we should report the
standard deviation separately and compute the interval as a multiple of
the standard deviation, for now I set it to 2 times the standard
deviation, based on the 68-95-99.7 rule, because it seems comparable to
the intervals reported when -I99 is set for the Netperf client. But we
should investigate this more...
Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com>
---
test_modules/Netperf.py | 5 ++++-
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git a/test_modules/Netperf.py b/test_modules/Netperf.py
index ecd8b7f..10c993b 100644
--- a/test_modules/Netperf.py
+++ b/test_modules/Netperf.py
@@ -304,7 +304,10 @@ class Netperf(TestGeneric):
rate = 0.0
if len(rates) > 1:
- rate_deviation = std_deviation(rates)
+ # setting deviation to 2xstd_deviation because of the 68-95-99.7
+ # rule this seems comparable to the -I 99 netperf setting
+ res_data["std_deviation"] = std_deviation(rates)
+ rate_deviation = 2*res_data["std_deviation"]
elif len(rates) == 1 and self._confidence is not None:
result = results[0]
rate_deviation = rate * (result["confidence"][1] / 100)
--
2.6.2