QA/Desktop Firefox/Releases: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 1: Line 1:
== Regressions ==
== Regressions ==
* 
{| class="querytable"
{| class="querytable"
  | class="header" | Regression
  | class="header" | Regression
  | class="header" | Versions
  | class="header" | Versions
  | class="header" | in-moztrap
  | class="header" | Manual Coverage
  | class="header" | in-testsuite
  | class="header" | Automation Coverage
  | class="header" | in-qatestsuite
|-
  | {{bug|848663}} Can’t update from FF19.0 to FF19.0.1
| Firefox 19+
| [https://moztrap.mozilla.org/manage/case/6785/ testcase]
|  
  |-
  |-
  | {{bug|787743}}: Private Browsing data does not cache
  | {{bug|787743}}: Private Browsing data does not cache
  | Firefox 15+
  | Firefox 15+
  | [https://moztrap.mozilla.org/manage/case/1529/ testcase]
  | [https://moztrap.mozilla.org/manage/case/1529/ testcase]
| n/a
  | [http://hg.mozilla.org/qa/mozmill-tests/file/tip/tests/functional/testPrivateBrowsing/testAboutCache.js testcase]
  | [http://hg.mozilla.org/qa/mozmill-tests/file/tip/tests/functional/testPrivateBrowsing/testAboutCache.js testcase]
  |-
  |-
Line 16: Line 20:
  | Firefox 15+
  | Firefox 15+
  | [https://moztrap.mozilla.org/manage/case/1372/ testcase]
  | [https://moztrap.mozilla.org/manage/case/1372/ testcase]
| n/a
  | n/a
  | n/a
  |-
  |-
Line 22: Line 25:
  | Firefox 16+
  | Firefox 16+
  | [https://moztrap.mozilla.org/manage/case/1371/ testcase]
  | [https://moztrap.mozilla.org/manage/case/1371/ testcase]
| n/a
  | nominated
  | nominated
  |-
  |-
Line 28: Line 30:
  | Firefox 16+
  | Firefox 16+
  | [https://moztrap.mozilla.org/manage/case/1292/ testcase]
  | [https://moztrap.mozilla.org/manage/case/1292/ testcase]
| n/a
  | nominated
  | nominated
  |-
  |-
Line 34: Line 35:
  | Firefox 17+
  | Firefox 17+
  | [https://moztrap.mozilla.org/manage/case/2524/ testcase]
  | [https://moztrap.mozilla.org/manage/case/2524/ testcase]
| n/a
  | ?
  | ?
  |-
  |-
Line 40: Line 40:
  | Firefox 17+
  | Firefox 17+
  | [https://moztrap.mozilla.org/manage/case/2525/ testcase]
  | [https://moztrap.mozilla.org/manage/case/2525/ testcase]
| n/a
  | ?
  | ?
  |-
  |-
Line 46: Line 45:
  | Firefox 17+
  | Firefox 17+
  | [https://moztrap.mozilla.org/manage/case/2526/ testcase]
  | [https://moztrap.mozilla.org/manage/case/2526/ testcase]
| n/a
  | ?
  | ?
  |-
  |-
Line 52: Line 50:
  | Firefox 17+
  | Firefox 17+
  | [https://moztrap.mozilla.org/manage/case/2527/ testcase]
  | [https://moztrap.mozilla.org/manage/case/2527/ testcase]
| n/a
  | ?
  | ?
  |-
  |-
Line 58: Line 55:
  | Firefox 20+
  | Firefox 20+
  | ?
  | ?
| n/a
  | nominated
  | nominated
  |-
  |-
  | {{bug|834667}} Playing youtube video in html5 starts to leak memory
  | {{bug|834667}} Playing youtube video in html5 starts to leak memory
  | Firefox 19+
  | Firefox 19+
| n/a
  | n/a
  | n/a
  | {{bug|851502}}
  | {{bug|851502}}
Line 69: Line 64:
  | {{bug|839548}} Excessive memory while loading PDF thumbnail view
  | {{bug|839548}} Excessive memory while loading PDF thumbnail view
  | not yet fixed
  | not yet fixed
| n/a
  | n/a
  | n/a
  | {{bug|851507}}
  | {{bug|851507}}

Revision as of 20:39, 20 March 2013

Regressions

Regression Versions Manual Coverage Automation Coverage
bug 848663 Can’t update from FF19.0 to FF19.0.1 Firefox 19+ testcase
bug 787743: Private Browsing data does not cache Firefox 15+ testcase testcase
bug 789958: Verify update applies with root-owned files Firefox 15+ testcase n/a
bug 789422: What's New page on Firefox update Firefox 16+ testcase nominated
bug 650355: Stop accepting md5 hash algorithm Firefox 16+ testcase nominated
Mac OSX 10.8 code-signing Firefox 17+ testcase ?
Breakpad end-to-end functionality Firefox 17+ testcase ?
Mac OSX 32-bit mode compatibility Firefox 17+ testcase ?
Mac OSX 10.5 De-support Firefox 17+ testcase ?
bug 833823 Random, unpredictable behavior with multiple YouTube embeds Firefox 20+ ? nominated
bug 834667 Playing youtube video in html5 starts to leak memory Firefox 19+ n/a bug 851502
bug 839548 Excessive memory while loading PDF thumbnail view not yet fixed n/a bug 851507

Metrics

Visualizations

Metric Interpretations
Qa_release_unconfirmed.png
  • Number of reported bugs is relatively flat over time
  • Number of confirmed bugs is up over time
Qa_release_verified.png
  • Verifying fixes is not keeping pace with patch landings
Qa_release_adi.png
  • Dips in ADIs coincide with spikes in unconfirmed bugs
  • Verifications seem to have little effect on ADIs

Raw Data

Release Updates ADIs Verified Fixed Affected Wontfix Unconfirmed Reported in-testsuite+
Firefox 19 2
Firefox 18 2 106.071 318 694 243 143 340 1385 246
Firefox 17 1 72.758 287 396 173 132 579 1300 178
Firefox 16 2 108.437 137 283 128 176 388 1190 217
Firefox 15 1 102.702 185 261 84 99 415 1357 198
Firefox 14 1 97.377 144 219 85 86 367 1163 146
Firefox 13 1 89.853 177 169 91 74 479 1289 160
Firefox 12 0 97.323 169 176 88 74 450 1336 209
Firefox 11 0 94.203 164 120 88 96 426 1050 218
Firefox 10 2 88.823 80 159 95 84 546 1418 239

Dashboard

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Desktop_Firefox/Releases&oldid=639698"