canmove, Confirmed users
7,810
edits
Releases/Firefox 4RC/Test Plan: Difference between revisions
Jump to navigation
Jump to search
→Test Plan for RC
| Line 10: | Line 10: | ||
As in previous milestones, we are going to run our automated tests suites, smoketests, basic functional tests, and updates tests on all shipped locales, using Mozmill, and we'll complement those with manual checks on en-US builds. In addition to the regular basic cycle of testing we'll focus on the following activities, some of which we have already done on previous betas, and some of which are specific to the release candidate: | As in previous milestones, we are going to run our automated tests suites, smoketests, basic functional tests, and updates tests on all shipped locales, using Mozmill, and we'll complement those with manual checks on en-US builds. In addition to the regular basic cycle of testing we'll focus on the following activities, some of which we have already done on previous betas, and some of which are specific to the release candidate: | ||
* We are going to verify [https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=d322a1c8537e bug fixes since beta 12] and test around them with exploratory testing- Waverley/Smartware contractors | * We are going to verify [https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=d322a1c8537e bug fixes since beta 12] and test around them with exploratory testing- Waverley/Smartware contractors - '''Done''' | ||
* [https://spreadsheets.google.com/ccc?hl=en&key=t0zrO3mJEMiQNc5YdpbzCxw&hl=en#gid=0 Plugins testing across platforms]: Flash, Silverlight, Quicktime, Adobe Reader (latest versions), Java, RealPlayer, Shockwave, and Windows Media Player (From the [https://addons.mozilla.org/en-US/firefox/browse/type:7 list of most popular plugins] in https://addons.mozilla.org/) - Waverley | * [https://spreadsheets.google.com/ccc?hl=en&key=t0zrO3mJEMiQNc5YdpbzCxw&hl=en#gid=0 Plugins testing across platforms]: Flash, Silverlight, Quicktime, Adobe Reader (latest versions), Java, RealPlayer, Shockwave, and Windows Media Player (From the [https://addons.mozilla.org/en-US/firefox/browse/type:7 list of most popular plugins] in https://addons.mozilla.org/) - Waverley - '''Done''' | ||
** We should spot check Netflix - see marcia for testing account | ** We should spot check Netflix - see marcia for testing account - '''Done''' | ||
* Web Compatibility Testing (Round 3): Popular social, news, games, and entertainment sites (See [https://spreadsheets.google.com/ccc?key=0AvdU4bzekK2qdHk2eWNoZlNCZEstNnY3R0pBWGhEaVE&hl=en#gid=0 testing matrix]) - uTest | * Web Compatibility Testing (Round 3): Popular social, news, games, and entertainment sites (See [https://spreadsheets.google.com/ccc?key=0AvdU4bzekK2qdHk2eWNoZlNCZEstNnY3R0pBWGhEaVE&hl=en#gid=0 testing matrix]) - uTest - '''Done''' | ||
* Hardware compatibility testing including blocklisting: Performed by outside vendor (See [https://wiki.mozilla.org/QA/Firefox_4/Test_Plan/Hardware_Compatibility_FF4_Test_Plan on-going]) - iBeta | * Hardware compatibility testing including blocklisting: Performed by outside vendor (See [https://wiki.mozilla.org/QA/Firefox_4/Test_Plan/Hardware_Compatibility_FF4_Test_Plan on-going]) - iBeta '''Pending results''' | ||
* [https://addons.mozilla.org/en-US/firefox/compatibility/report/4.0 Top 50 add-ons] testing: basic functionality | * [https://addons.mozilla.org/en-US/firefox/compatibility/report/4.0 Top 50 add-ons] testing: basic functionality - '''Done''' | ||
* A round of testing Zynga games through Facebook: Mafia Wars, FarmVille, FrontierVille, using accounts provided by Zynga - marcia | * A round of testing Zynga games through Facebook: Mafia Wars, FarmVille, FrontierVille, using accounts provided by Zynga - marcia, CantinaVille - '''Done''' | ||
* Accessibility - MarcoZ | * Accessibility - MarcoZ - '''Signed off''' | ||
* A cycle of top sites page load testing: top 20k sites - Tomcat | * A cycle of top sites page load testing: top 20k sites - Tomcat - '''Pending results'''' | ||
* Special areas sign-off: Sync (desktop and mobile) - Tracy/Tchung, Test Pilot/Feedback - juanb | * Special areas sign-off: Sync (desktop and mobile) - Tracy/Tchung, Test Pilot/Feedback - juanb '''Pending results'''' | ||
* Crash-stats stability assessment (after 3 full week days) - marcia | * Crash-stats stability assessment (after 3 full week days) - marcia '''Pending results''' | ||
* Major update and downgrade scenario assessment - Waverley/Smartware/juanb | * Major update and downgrade scenario assessment - Waverley/Smartware/juanb - '''Done''' | ||
* Fx4 in-product web pages sign-off - marcia, juanb | * Fx4 in-product web pages sign-off - marcia, juanb | ||
** First Run, What's New, Release Notes, Getting Started, Snippet Server (about:home) | ** First Run, What's New, Release Notes, Getting Started, Snippet Server (about:home) | ||