QA/Desktop Firefox/Releases: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 69: Line 69:
== Metrics ==
== Metrics ==
=== Visualizations ===
=== Visualizations ===
[[Image:QA_Verification_ADIs_20130625.png]]
[[Image:QA_Metric_Bug_Breakdown_20130826.png]]
[[Image:QA_Unconfirmed_ADIs_20130625.png]]
[[Image:QA_Metric_Unconfirmed-vs-ADI_20130826.png]]
[[Image:QA_bug_breakdown_20130625.png]]
[[Image:QA_Metric_Verification_Ratio_20130826.png]]
[[Image:QA_Metric_Verifications-vs-ADI_20130826.png]]


=== Raw Data ===
=== Raw Data ===

Revision as of 23:27, 26 August 2013

Regressions

Regression Versions Manual Coverage Automation Coverage
bug 848663 Can’t update from FF19.0 to FF19.0.1 Firefox 19+ testcase Nominated: bug 853147
bug 834667 Playing youtube video in html5 starts to leak memory Firefox 19+ testcase Nominated: bug 851502
bug 839548 Excessive memory while loading PDF thumbnail view Pending bug fix Pending bug fix Nominated: bug 851507
bug 789958 Verify update applies with root-owned files Firefox 15+ testcase n/a - not automatable
bug 789422 What's New page on Firefox update Firefox 16+ testcase nominated
bug 650355: Stop accepting md5 hash algorithm Firefox 16+ testcase nominated
Mac OSX 10.8 code-signing Firefox 17+ testcase ?
Breakpad end-to-end functionality Firefox 17+ testcase ?
Mac OSX 32-bit mode compatibility Firefox 17+ testcase ?
Mac OSX 10.5 De-support Firefox 17+ testcase ?
bug 833823 Random, unpredictable behavior with multiple YouTube embeds Firefox 20+ ? nominated
bug 787743 Private Browsing data does not cache Firefox 15+ testcase testcase

Metrics

Visualizations

QA Metric Bug Breakdown 20130826.png QA Metric Unconfirmed-vs-ADI 20130826.png QA Metric Verification Ratio 20130826.png QA Metric Verifications-vs-ADI 20130826.png

Raw Data

Release Updates ADIs Verified Fixed Affected Wontfix Unconfirmed Total
Firefox 23 1 349 628 528 338 249 2092
Firefox 22 0 101.335 269 637 509 381 286 2082
Firefox 21 0 106.658 237 608 609 253 299 2006
Firefox 20 1 108.289 312 682 282 354 390 2020
Firefox 19 2 96.789 278 833 166 122 361 1760
Firefox 18 2 106.071 318 694 243 143 340 1738
Firefox 17 1 72.758 287 396 173 132 579 1567
Firefox 16 2 108.437 137 283 128 176 388 1112
Firefox 15 1 102.702 185 261 84 99 415 1044
Firefox 14 1 97.377 144 219 85 86 367 901
Firefox 13 1 89.853 177 169 91 74 479 990
Firefox 12 0 97.323 169 176 88 74 450 957
Firefox 11 0 94.203 164 120 88 96 426 894
Firefox 10 2 88.823 80 159 95 84 546 964

Dashboard, Spreadsheet