Confirmed users
4,072
edits
Releases/Firefox 27/Test Plan: Difference between revisions
m
→Summary
m (→Check List) |
m (→Summary) |
||
| (41 intermediate revisions by 3 users not shown) | |||
| Line 15: | Line 15: | ||
|- | |- | ||
| '''2nd''' | | '''2nd''' | ||
| [mailto: | | [mailto:ashughes@mozilla.com Anthony Hughes] (irc: ashughes) | ||
|- | |- | ||
| '''Builds''' | | '''Builds''' | ||
| Line 37: | Line 37: | ||
* 2014.01.17: {{done|}} Beta 7 | * 2014.01.17: {{done|}} Beta 7 | ||
* 2014.01.21: {{done|}} Beta 8 | * 2014.01.21: {{done|}} Beta 8 | ||
* 2014.01.24: Beta 9 | * 2014.01.24: {{done|}} Beta 9 | ||
* 2014.01.28: Release Candidate | * 2014.01.28: {{done|}} Release Candidate | ||
* 2014.02.04: Final | * 2014.02.04: {{done|}} Final | ||
* 2014.02.13: {{done|}} 27.0.1 | |||
== Features == | == Features == | ||
| Line 154: | Line 155: | ||
|- | |- | ||
| Nvidia 3d vision | | Nvidia 3d vision | ||
| {{ | | {{miss| tracy}} | ||
| {{ | | {{miss| tracy}} | ||
| {{ | | {{miss| tracy}} | ||
| {{ | | {{miss| tracy}} | ||
|- | |- | ||
| Downloads | | Downloads | ||
| Line 228: | Line 229: | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
"id": "791195, 948907, 948935, 948944, 943885, 947079, 856900, 958506, 959553, 959596" | "id": "791195, 948907, 948935, 948944, 943885, 947079, 856900, 958506, 959553, 959596, 972347" | ||
} | } | ||
</bugzilla> | </bugzilla> | ||
== 27.0.1 == | |||
=== Build Info === | |||
* Builds: [https://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/27.0.1-candidates/build1/ build1] | |||
* Build ID: 20140212131424 | |||
* Changes: [https://hg.mozilla.org/releases/mozilla-release/log/168019 Changelog] | |||
* [https://wiki.mozilla.org/QA/Desktop_Firefox/Releases/Configs/Fx27.0.1 Mozmill Configs] | |||
=== Check List === | |||
* {{done|}} Automation Functional tests ([http://mozmill-release.blargon7.com/#/functional/reports?branch=27.0&platform=All&from=2014-02-12&to=2014-02-13 report]) | |||
* {{done|}} Regression testing ([https://moztrap.mozilla.org/results/cases/?filter-run=3392 report]) | |||
* {{done|}} Updates on ''betatest'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=betatest&from=2014-02-13&to=2014-02-13&target=27.0.1 report]) | |||
* {{done|}} Updates on ''releasetest'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=releasetest&from=2014-02-13&to=2014-02-13&target=27.0.1 report]) | |||
* {{done|}} Updates on ''release'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=release&from=2014-02-13&to=2014-02-14&target=27.0.1 report]) | |||
=== Regression Testing === | |||
The following areas have been identified for regression testing and will be covered via Moztrap smoketests. | |||
; Coverage | |||
* Tests: [https://moztrap.mozilla.org/runtests/environment/3392/ Smoketest (Windows 7 64bit, Windows 8.1 64bit, Mac OS X 10.8, Ubuntu 12.04 32bit)] | |||
* Bugs for verification: | |||
** {{done|}} VERIFIED FIXED {{bug|934509}} - crash in nsGlobalWindow::RunTimeout(nsTimeout*) | |||
** {{done|}} VERIFIED FIXED {{bug|945912}} - Crash [@ MOZ_PNG_do_expand_plte] with broken png file | |||
** {{drop|}} [qa-] {{bug|941381}} - IonMonkey: Incorrect fround(asin()) | |||
* If time allows, please check crash reporter. | |||
** Included in the smoke ([https://moztrap.mozilla.org/results/cases/?filter-run=3392 report]). | |||
== Release Candidate / Final == | |||
=== Build Info === | |||
* Builds: [https://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/27.0-candidates/build1/ build1] | |||
* Build ID: 20140127194636 | |||
* Changes: [https://hg.mozilla.org/releases/mozilla-release/log/168007 Changelog] | |||
* [https://wiki.mozilla.org/QA/Desktop_Firefox/Releases/Configs/Fx27 Mozmill Configs] | |||
=== Check List === | |||
* {{done|}} Automation Functional tests ([http://mozmill-release.blargon7.com/#/functional/reports?branch=27.0&platform=All&from=2014-01-27&to=2014-01-28 report]) | |||
* {{done|}} Regression testing ([https://moztrap.mozilla.org/results/cases/?filter-run=3273 report]) | |||
* {{done|}} Updates on ''releasetest'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=releasetest&from=2014-01-28&to=2014-01-29&target=27.0 report]) | |||
* {{done|}} Updates on ''betatest'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=betatest&from=2014-02-03&to=2014-02-03&target=27.0 report]) | |||
* {{done|}} Updates on ''beta'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=beta&from=2014-01-29&to=2014-01-29&target=27.0 report]) | |||
* {{done|}} Updates on ''release'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=release&from=2014-02-04&to=2014-02-04&target=27.0 report]) | |||
=== Regression Testing === | |||
The following areas have been identified for regression testing and will be covered via Moztrap smoketests. | |||
; Coverage | |||
* Tests: Nvidia 3d vision, Breakpad end-to-end functionality | |||
* Platforms: Windows 8.1 64bit, Windows XP 32bit, Mac OSX 10.8, Ubuntu 13.10 32bit | |||
; Instructions | |||
* [https://moztrap.mozilla.org/runtests/environment/3273/ Run these test] | |||
* Select one of the platforms | |||
* Follow the steps in each of the tests and report your results within Moztrap | |||
* Make sure to also do some exploratory testing where permitted | |||
* If you encounter a bug, [http://mzl.la/1eM3osi report it] and add it to the list below using the {{bug|number}} template | |||
== Beta 9 == | == Beta 9 == | ||
| Line 244: | Line 300: | ||
* {{done|}} Updates on ''betatest'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=betatest&from=2014-01-24&to=2014-01-24&target=27.0 report]) | * {{done|}} Updates on ''betatest'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=betatest&from=2014-01-24&to=2014-01-24&target=27.0 report]) | ||
* {{done|}} Updates on ''releasetest'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=releasetest&from=2014-01-24&to=2014-01-24&target=27.0 report]) | * {{done|}} Updates on ''releasetest'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=releasetest&from=2014-01-24&to=2014-01-24&target=27.0 report]) | ||
* {{ | * {{done|}} Updates on ''beta'' channel ([http://mozmill-release.blargon7.com/#/update/detail?&channel=beta&from=2014-01-24&to=2014-01-24&target=27.0 report]) | ||
=== Regression Testing === | === Regression Testing === | ||