Hi…can anyone explain how can we say whether the test is failed/success based on Std Deviation metric and how well can we explain that particular metric to others(in load testing terms).Most of my clients have raised me the question…what exactly does Std Deviation mean in load test.??Any insights are appreciated
Standard deviation doesn’t mean much.
It’s a broken metric we ended up providing because users kept on insisting on having it because they were used to it.
It only makes sense for normal distributions, which your actual distributions are very unlikely to be.
See https://gatling.io/2018/11/20/metrics-analysis-part-1-mean-standard-deviation/