QA/Fennec/Milestones/2.0/ReleaseTest/4.0.1

Fennec 4.0.1 Test Results

The covered testing for this release will focus on smoketests, verifications and updates. We are focusing on the targeted fixes for Firefox Mobile 4.0.1 such as l10n @font-face, devices with Android 2.3.3, check l10n fixes, etc.

Project contacts

PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Kevin Brosnan (kbrosnan)

Schedule

Code Freeze

-- 4/14

Builds hand to QA

-- 4/15 or 4/18

QA test signoff

-- Aprox. 4/20

Build Location and IDs

1. Go to the candidates folder in our ftp folders
2. Go to the "4.0.1-candidates" folder
3. Download the candidate:
   • For the n900, install the application catalog and update to the candidate build via your device App Manager.
   • For Android, download and install the actual build over any other instance

Test Coverage

Smoketests

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 2.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Please record your detailed results in the "Detailed Test Results" section below.

BFTs for 2.0 Features

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 2.0. Tests are available on litmus under the Fennec 2.0 Test Suite.

Please record your detailed results in the "Detailed Test Results" section below.

OS Integration

The Operating System Integration testsuite is a set of tests that target how Fennec works with the platform (i.e. Android, Maemo, etc.) and features of the device itself (i.e. Orientation, hard keyboard, soft keyboard, etc.). Tests are available on litmus under the Fennec 2.0 Test Suite under the "OS Integration Tests" testgroup.

Please record your detailed results in the "Detailed Test Results" section below.

Fixed Bugs Verifications

The following link contains a list of bugs that are fixed for 4.0.1 and need verifications:

• Fixed Firefox Mobile 4.0.1 blockers even verified bugs should be checked to make sure the fix landed in the Mobile-2.0 tree.

• bug 626051
• bug 643038
• bug 643307
• bug 643836
• bug 644012
• bug 644613
• bug 644735
• bug 649115

L10n Checks

Check l10n switching and that basic functionality does not break.

• German
• Finnish
• French
• Japanese

Updates

Test the update path for the released builds only, not the nightlies. (eg. 1.1->4.0RC (maemo only) and 4.0b5->4.0)

Fennec 4.0 RC can be downloaded from the Mozilla Beta Catalog or the Android Marketplace.

Updates tests to perform for each build

Test Results

Types of Tests	Maemo	Android
Smoketests	Ioana	Andreea
BFTs	Ioana	Andreea & Nicolae
OS Integration	Ioana	Anna - PASS
L10n	mw22 -	kbrosnan -
Fixed Bug Verifications	All	All
Website and Device Stability Checks	--	kbrosnan -
Updates	mw22 -	--

Detailed Test Results

Smoketests Results

Android Device [Waverley]

• Build:
• Results:

• Notes:

n900 [Waverley]

• Build:
• Results:
• Notes:

BFT Results

Android Device [Waverley]

• Build:
• Results:

• Notes:

n900 [Waverley]

• Build:
• Results:
• Notes:

OS Integration Results

HTC Desire Z [Anna]

• Build: Mozilla /5.0 (Android;Linux armv7l;rv:2.1.1) Gecko/20110415 Firefox/4.0.2pre Fennec /4.0.
• Results: PASS
• Notes:
  • Known Bugs:
    • bug 617555: System menu button closes the VKB
  • Observations:
    • When the device is in landscape mode, using the Touch Input keyboard there are no "Next" and "Go" buttons
    • Couldn't install the swype keyboard (is not available on the android market)
    • Landscape full keyboard mode on / off works, using "widget.ime.android.landscape_fullscreen=0, widget.ime.android.fullscreen_threshold=300" is not implemented yet in Firefox 4.0.1

n900 [Waverley]

• Build:
• Results:
• Notes:

L10n Results

G2 [kbrosnan]

• Build:
• Device:
• Results:
• Notes:

n900 [mw22]

• Build:
• Results:
• Notes:

Updates Results

n900 [mw22]

• Build:
• Results:
• Notes: