QA/Firefox3.5/TestPlan/Beta1: Difference between revisions
m (→Test Results) |
m (→Test Results) |
||
| Line 65: | Line 65: | ||
| Tester <BR> '''Betatest - result''' <BR> '''Beta - result''' | | Tester <BR> '''Betatest - result''' <BR> '''Beta - result''' | ||
|- | |- | ||
| Live Spotchecks | | Live Spotchecks & Webpages | ||
| Tester - '''result''' | | Tester - '''result''' | ||
| Tester - '''result''' | | Tester - '''result''' | ||
| Line 84: | Line 84: | ||
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/Updates here]. | Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/Updates here]. | ||
=== L10N | === L10N === | ||
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics. | Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics. | ||
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/L10N here] | Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/L10N here] | ||
=== Live | === Live Spotchecks & Webpages === | ||
Check live site download links on all platforms. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas: | |||
1) Verify the following webpages that gets pushed to staging and then to the live sites. Look for content messaging, spelling mistakes, broken links & imnages, etc.. | |||
* Firstrun page | |||
* Whatsnew Page | |||
* Releasenotes page | |||
2) Check live site download links on all platforms. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas: | |||
* Check for signed installer and applications (windows only) | * Check for signed installer and applications (windows only) | ||
* Firstrun page, whatsnew page, Home page, Search plugin | * Firstrun page, whatsnew page, Home page, Search plugin | ||
Revision as of 16:57, 6 October 2008
Firefox 3.1 Beta1 Test Results
The covered testing for this release will focus on smoketests, bfts, l10n and spotchecks. This will only be on the en-US locale.
Related Pages
Contact Info
PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony / others
Schedule
- Builds hand to QA
- ETA
- QA test signoff
- ETA
- BFTs
- Smoketests
- L10n
- Spotchecks
Build Location and IDs
Test Coverage
- Areas Covered:
- BFTs
- Smoketests
- L10n
- Spotchecks
- Areas Not Covered:
- FFTs
- Updates
Test Results
| Types of Tests | Windows XP | Mac 10.5 | Linux |
|---|---|---|---|
| Smoketests | Tester - result | Tester - result | Tester - result |
| BFTs | Tester - result | Tester - result | Tester - result |
| L10n | Tester - result | Tester - result | Tester - result |
| Updates | Tester Betatest - result Beta - result |
Tester Betatest - result Beta - result |
Tester Betatest - result Beta - result |
| Live Spotchecks & Webpages | Tester - result | Tester - result | Tester - result |
Smoketest Testing
Lite verification tests (or smoketests) will be first ran when the builds are ready. Tests are available on litmus under the Firefox 3.1 test suite. Please record your detailed results in the section [below]. In any case the Smoketests fail, we will raise blockers asap before proceeding with the bfts.
BFT Testing
BFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests pass. Tests are available on litmus under the Firefox 3.1 test suite. Please record your detailed results in the section [below].
Updates Testing
We will be doing updates of all Alpha users to Beta1. We will be checking partial updates, complete updates, and failover scenarios.
Will be available on betatest, releasetest, and beta channels.
Testcases and Results are tracked here.
L10N
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to L10N Requirements for more specifics.
Testcases and Results are tracked here
Live Spotchecks & Webpages
1) Verify the following webpages that gets pushed to staging and then to the live sites. Look for content messaging, spelling mistakes, broken links & imnages, etc..
- Firstrun page
- Whatsnew Page
- Releasenotes page
2) Check live site download links on all platforms. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas:
- Check for signed installer and applications (windows only)
- Firstrun page, whatsnew page, Home page, Search plugin
- Install, uninstall
- General spotchecks and browser functionality
- Confirm Build IDs
Fixed Bugs Verifications
The following bugs are fixed for Beta 1 and need verifications:
- Platform 1.9.1 bugs: http://tinyurl.com/4c4qwb
- Firefox 3.1 bugs: http://tinyurl.com/3tw7zw
Testday
A Beta1 testday will be held and call for the community support to assist with testing. Activities include executing litmus testcases, bug verifications, and focus on the new feature areas that are being implemented. More can be found on QMO.