QA/Firefox3/TestResults/Beta5

« QA/Firefox3/TestResults

Firefox 3 Beta 5 Test Results

Related Pages

Links to separate test results. Some are referenced further below.

Release Tracking Page

• Update snippets Test Results
• L10n Spotchecks Test Results
• Beta 5 Testday Results
• QA Beta 5 Relnotes Tracking
• Windows Respin Tests

Contact Info

PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony (tchung)

Schedule

Code Freeze

3/18

Code Build

ETA 3/25

QA test signoff

ETA 3/24-3/27

• Smoketests (3/24) result (3 testers)
• BFTs (3/24-3/25) result (4 testers)
• Beta 5 and past focused Tests (ongoing)
• Update snippets from Alpha X, Beta 1,2 -> Beta 3 (3/25-3/26) result betatest, result releasetest, result beta (4 testers)
• P1 L10N spotchecks (3/26) result (1 tester)
• B5 bug verifications (ongoing)
• Beta 5 Testday (3/27) result (3 testers)
• Release notes, Websites, live tests (3/27) result (3 testers)

Release Notes

See list of release notes here

Strategy

• Areas Covered:
  • Smoketests
  • BFTs
  • Beta4 and past focused Tests
  • Update snippets from Alpha X, Beta X -> Beta 5
  • Memory Leak Testing (handled by Tomcat on debug builds)
  • P1 L10N spotchecks
  • Bug verifications
  • Beta 5 Testday

• Areas Not Covered:
  • FFTs
  • Top Sites
  • Top Plugins
  • Top Themes
  • Top Extensions
  • localization (String changes) - 3rd party will cover
  • Distribution
  • Major Updates

Test Results

Types of Tests	Win XP	Win Vista	Mac Tiger	Mac Leopard	Linux
Smoketest	Tomcat - result	juanb - result	marcia - result	marcia - result	Tomcat - result
BFT	Tomcat - result	Tomcat (Vista test suite) - result	juanb - result	Marcia (Leopard test suite/PPC and Intel) - result	Tracy - result
Updates Testing (see below)	Tchung - Betatest result, Releasetest result, Beta result	Juanb - Betatest result, Releasetest result, Beta result	Stephend - Betatest result, Releasetest result, Beta result	Marcia - Betatest result, Releasetest result, Beta result	Abillings - Betatest result, Releasetest result, Beta result
l10N Pri 1 locales	Tchung - result	N/A	Tchung - result	N/A	Tchung - result
Bug Verifications	Everyone - result	Everyone - result	Everyone - result	Everyone - result	Everyone - result

Updates Testing

We will be doing updates of all Alpha and Beta users to Beta 5. Tests will include different locales for beta 1, but only en-US for all past versions. We will be checking partial updates, complete updates, and failed status.

Will be available on betatest, releasetest, and beta channels

• Betatest channel - result
• Releasetest channel - result
• Beta channel (live) - result

Testcases and Results are tracked here.

L10N P1 Spotchecks

Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to L10N Requirements for more specifics.

Automation inspection: supported locales will be ran through Minotaur, and results will be reviewed by axel and mic.

Axel's Localization Status Page

P1 Locales to be tested:

• German (de) result
• Japanese (ja) result
• Spanish (es-ES) result
• Netherlands (nl) result
• Italian (it) result
• Finnish (fi) result
• Hindi (pa-IN) result
• Chinese (zh-CN) result
• French (fr) result

Testcases and Results are tracked here - result.

Bug Verifications

Bugs that are marked RESOLVED FIXED that are checked in for beta. Please verify them.

B5 Firefox bugs -
B5 Platform bugs -

Testday

A beta 5 testday will be held and call for the community support to assist with testing. Activities include executing litmus testcases, bug verifications, and focus on the new feature areas that are being implemented. More can be found on QMO.

Testday results are posted here.

Detailed Results

Enter results from testing here.

Live Spot Checks

Live site downloads for Beta4, after bits are pushed out. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas:

• Check for signed installer and applications (windows only)
• Firstrun page, whatsnew page, Home page, Search plugin
• Installer, uninstall
• General spotchecks and browser functionality

Windows XP -> abillings - PASS
Windows Vista -> stephend - PASS
Mac Tiger -> Juan - PASS

Mac Leopard -> Marcia - see results below

• he, Hebrew - fails on Mac with UI problems. Sent screenshots to tchung
• fr, Frisian - PASS
  • bug 417107 has been resolved
• Identifikues montimi: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; sq; rv:1.9b4) Gecko/2008030317 Firefox/3.0b4 - PASS

Linux -> stephend - PASS

Top Issues Reported in Hendrix Against Firefox 3 Beta 5

• Enter here

Top Issues in b4 in Reporter

• Enter here