QA/Desktop Firefox/Releases

From MozillaWiki
Jump to navigation Jump to search

Regressions

Regression Versions Manual Coverage Automation Coverage
bug 848663 Can’t update from FF19.0 to FF19.0.1 Firefox 19+ testcase Nominated: bug 853147
bug 834667 Playing youtube video in html5 starts to leak memory Firefox 19+ testcase Nominated: bug 851502
bug 839548 Excessive memory while loading PDF thumbnail view Pending bug fix Pending bug fix Nominated: bug 851507
bug 789958 Verify update applies with root-owned files Firefox 15+ testcase n/a - not automatable
bug 789422 What's New page on Firefox update Firefox 16+ testcase nominated
bug 650355: Stop accepting md5 hash algorithm Firefox 16+ testcase nominated
Mac OSX 10.8 code-signing Firefox 17+ testcase ?
Breakpad end-to-end functionality Firefox 17+ testcase ?
Mac OSX 32-bit mode compatibility Firefox 17+ testcase ?
Mac OSX 10.5 De-support Firefox 17+ testcase ?
bug 833823 Random, unpredictable behavior with multiple YouTube embeds Firefox 20+ ? nominated
bug 787743 Private Browsing data does not cache Firefox 15+ testcase testcase

Metrics

Visualizations

QA Metrics Bug Breakdown 20131015.png QA Metrics Unconfirmed-vs-ADI 20131015.png QA Metrics Verification Ratio 20131015.png QA Metrics Verifications-vs-ADI 20131015.png

Raw Data

Release Updates ADIs Verified Fixed Affected Wontfix Unconfirmed Total
Firefox 24 0 379 758 510 273 96 2016
Firefox 23 1 98.479 349 628 528 338 249 2092
Firefox 22 0 101.335 269 637 509 381 286 2082
Firefox 21 0 106.658 237 608 609 253 299 2006
Firefox 20 1 108.289 312 682 282 354 390 2020
Firefox 19 2 96.789 278 833 166 122 361 1760
Firefox 18 2 106.071 318 694 243 143 340 1738
Firefox 17 1 72.758 287 396 173 132 579 1567
Firefox 16 2 108.437 137 283 128 176 388 1112
Firefox 15 1 102.702 185 261 84 99 415 1044
Firefox 14 1 97.377 144 219 85 86 367 901
Firefox 13 1 89.853 177 169 91 74 479 990
Firefox 12 0 97.323 169 176 88 74 450 957
Firefox 11 0 94.203 164 120 88 96 426 894
Firefox 10 2 88.823 80 159 95 84 546 964

Dashboard, Spreadsheet

Effect of Uplifts

Landings per Channel

The following shows when a bug was fixed (based on the state of the status flag during the 6-week period).

Firefox Version Nightly Aurora Beta % Uplifts Point Releases
10 113 170 128 73% 2
11 90 713 283 92% 0
12 356 332 150 58% 0
13 207 316 214 72% 1
14 306 506 279 72% 1
15 340 563 381 74% 1
16 397 460 275 65% 2
17 353 563 420 75% 1
18 532 1069 545 75% 2
19 853 857 332 58% 2
20 783 644 408 57% 1
21 844 514 277 48% 0
22 550 472 247 57% 0
23 683 484 360 55% 1
24 600 494 400 60% 0