QA/Firefox3.5/TestPlan/Beta4
Contents
Firefox 3.5 beta4 Test Results
The covered testing for this release will focus on smoketests, bfts, l10n, top plugins, top financial sites, updates, and spotchecks.
Related Pages
Project contacts
PM: Mike Beltzner (beltzner)
Build: Nick Thomas (nthomas)
QA: Tony Chung (tchung)
Schedule
- Code Freeze
- 4/22?
- Builds hand to QA
- 4/23?
- QA test signoff
- 4/27?
- See Test Coverage below
Build Location and IDs
Download:
Builds:
- Mac: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b4) Gecko/20090423 Firefox/3.5b4
- Linux: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b4) Gecko/20090423 Firefox/3.5b4
Test Coverage
- Areas Covered:
- Smoketests
- BFTs
- L10n
- Updates
- Spotchecks & Webpages
- Bug Fixes
- Areas Not Covered:
- FFTs
- Topsites (covered in nightly automation)
- Top Extensions
- Top Themes
- Top Plugins
- Top Financial Sites
- Accessibility
Test Results
Types of Tests | Windows XP | Mac OSX | Linux | ||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Smoketests | Henrik - PASS (unsigned) Timr - PASS (signed) |
Aakash/Timr - PASS
<thead>
</thead>
<tbody>
</tbody>
Smoketest TestingLite verification tests (or smoketests) will be first ran when the builds are ready. Tests are available on litmus under the Firefox 3.1 test suite. In any case the Smoketests result, we will raise blockers asap before proceeding with the bfts. Please record your detailed results in the section below. BFT / FFT TestingBFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests result. Tests are available on litmus under the Firefox 3.1 test suite. FFTs are a full comprehensive set of litmus tests that extend coverage in areas that BFTs dont often get to. These are run at least once during the major milestone timeline. If you are running a BFT or FFT, Please record your detailed results in the section below. Updates TestingWe will be doing updates of all Alpha/Beta users to beta4. We will be checking complete updates, and failover scenarios. Will be available on betatest, releasetest, and beta channels. Testcases and Results are tracked here. L10NVisual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to Fx3.1 L10N Requirements for more specifics. Testcases and Results are tracked here. Top Site Testing
Staging/Live Spotchecks & Webpages1) Verify the following webpages that gets pushed to staging and then to the live sites. Look for content messaging, spelling mistakes, broken links & imnages, etc..
2) Check live site download links on all platforms. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas:
Additional Resource TestingGiven the minimized focus testing around beta 4 due to time constraints, there are a few regression areas that will need some focus testing. This area will call for additional resources to help QA in this effort to ship beta 4 in a timely manner.
Fixed Bugs VerificationsThe following bugs are fixed for beta 4 and need verifications:
TestdayA beta4 testday will be held and call for the community support to assist with testing. Activities include executing litmus testcases, bug verifications, and focus on the new feature areas that are being implemented. More can be found on QMO. Detailed ResultsSmoketests ResultsWindows XP [Henrik/Murali/Timr]
Mac OSX [Aakash]
Linux FC7 [Tracy]
BFT ResultsWindows XP [henrik]
Mac OS X [marcia/aakash/tchung]
Linux [FC7,Tracy/Ubuntu,Aakash]
Focused Testing
Testday Results
|