TestEngineering/Performance/FAQ: Difference between revisions

Jump to navigation Jump to search
Line 240: Line 240:
This affects the alerts and results because sometimes we get a series of results that are less modal than the original- of course this generates an alert and a day later you will probably see that we are back to the original x-modal pattern as we see historically.  Some of this is affected by the weekends.
This affects the alerts and results because sometimes we get a series of results that are less modal than the original- of course this generates an alert and a day later you will probably see that we are back to the original x-modal pattern as we see historically.  Some of this is affected by the weekends.


== Random noise ==
== What is random noise? ==
Random noise happens all the time.  In fact our unittests fail 2-3% of the time with a test or two that randomly fails.
Random noise are the data-points that don't fit in the graph trend of the test. They happen because of various uncontrollable factors (and this is assumed) or because the test is unstable.
 
This doesn't affect Talos alerts as much, but keep in mind that if you cannot determine a trend for an alerted regression and have done a lot of retriggers, then it is probably not worth the effort to find the root cause.


= Bugzilla =
= Bugzilla =
342

edits

Navigation menu