QA/Fennec/Milestones/2.0/ReleaseTest/Beta3/Build3

Testing for bug 620811

12/21: This bug fixes a critical crash in the restart code. Exploratory testing around the fix:

• Android notifications (download/addons/updates (but no updates),
• app launcher
• restarting after installing an addon
• Fennec installation
• Fennec shut down

Update Testing for bug 620584

12/21: There is a respin of Fennec Beta 3 build 2, that will pick up the changes to bug 620584. This changes the appname for fennec so the Android Market can host the app

• Known Issues (Android Only)
  • There will be two instances of Mobile Firefox if the user has beta 1 or beta 2 previously installed. Both operate on completely different profiles
  • The app launcher may show two instances of Fennec when launching a url. They may be labeled both as Firefox, one being beta 1, the other beta 2.
  • AUS Updates for Fennec beta 1 and beta 2 will be disabled. Going forward, users will only get their updates from Android Market.

• Testing (Android Only)
  1. Single install of Fennec beta 3 on android. Result: one instance of Firefox beta 3. Updates are disabled.
  2. Have an existing Fennec beta 2 on android. Install Fennec beta 3. Result: two instances of Firefox on android, with two different profiles. Both will work as expected. Updates are disabled.
  3. Have an existing Fennec beta 1 on android. Install Fennec beta 3. Result: two instances of Firefox on android, with two different profiles. Both will work as expected. Updates are disabled.
  4. Uninstall the existing instances in steps 2-3. Result: one instance of Firefox beta 3
  5. For steps 2-3, do not select a default browser, and launch a URL. Result: the app launcher appears with 2 instances of Firefox to choose from
  6. Run step 4, then step 5. Result: the app launcher appears with Firefox beta 3 to choose from

Builds

• Build 3 candidates: here
• Fennec 2.0 Litmus tests here

Test Results

Types of Tests	Maemo	Android
Smoketests (see breakdown below)	martijn - FAIL, see bug 620879	Ioana - PASS Ahoza - PASS Anna - PASS
BFTs (see breakdown below)	n/a	Ioana - PASS Ahoza - result Anna - result
Updates	martijn - result	Ioana - PASS - no update offered

Smoketests

N900 (martijn)

• FAIL, see bug 620879

• Run all smoketests
  • result

Android - HTC Desire (Ioana)

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8 Fennec/4.0b3
• Results: PASS

Android - Samsung Galaxy S (ahoza)

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8 Fennec/4.0b3
• Results: PASS

Android - Motorola Droid 2 (Anna)

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
• Result: PASS

BFTs

Android - Samsung Galaxy S (ahoza) Installation -> History

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
• Results: PASS
• Known bugs:
  • bug 617326 - Inconsistencies while searching in google.com

Android - Motorola Droid 2 (Anna) Add-ons -> Sync

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
• Result: PASS
• Known Issues:
  • Add-ons Manager:
    • bug 614547 - Fennec crash [@ GeckoStart ]
  • Assistant bar
    • bug 606466 - Unnecessary ">" button in form autocomplete suggestions list
  • Layout:
    • bug 580920 - Acid 2 test fails in Fennec
  • Password:
    • bug 607504 - HTC Sense keyboard suggestion buffer doesn't commit when you click on a URL
• New Issues:
  • Form Assistant:
    • bug 620929 - VKB flickers when tapping on the search field in the Form

Android - HTC Desire (Ioana) Site Panel -> Screen Navigation

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
• Results:
• Known Issues:
  • Downloads :
    • bug 597953 - Downloads: Dependent behavior on other files
    • bug 619054 - Downloads: Inconsistency at auto-renaming
  • Web Usage
    • bug 610344 - Black filled text fields on Gmail login page.

Updates

Android - HTC Desire (Ioana)

• There are no updates offered for beta 2 or beta 3
• Two instances can be installed (bug 620584)

Exploratory Testing

• Install this crash extension (http://ted.mielczarek.org/mozilla/crashme.html) on fennec and force a crash to get the crash reporter
  • The crash extension can be used only with Android 2.2 (not working with android 2.1 nor Android 2.1 update 1)

Samsung Galaxy S (ahoza)

• Unreproducible issues:
  • when selecting "Restart" after previously installing add-on/changing language browser does not restart, but it does not crash either. I've tried several things after this:
    • reinstalling the application - this didn't solved the problem
    • changed default Home app (used LauncherPro instead TwLauncher) - sometimes I got a dialog "Activity TwLauncher (in progress TwLauncher) is not responding" so I thought there must be something wrong with the app launcher. This didn't fixed the problem either
    • I've used "adb reboot-bootloader" command to reboot my device. After this I could not reproduce the above behavior. The browser restarts after installing add-on/ changing localization.
  • Note: our device (Samsung Captivate I897 for AT&T) is not rooted. We install Fennec using adb tool.