QA/Fennec/Milestones/2.0/ReleaseTest/Beta3/Build3

Testing for bug 620811

12/21: This bug fixes a critical crash in the restart code. Exploratory testing around the fix:

  • Android notifications (download/addons/updates (but no updates),
  • app launcher
  • restarting after installing an addon
  • Fennec installation
  • Fennec shut down

Update Testing for bug 620584

12/21: There is a respin of Fennec Beta 3 build 2, that will pick up the changes to bug 620584. This changes the appname for fennec so the Android Market can host the app

  • Known Issues (Android Only)
    • There will be two instances of Mobile Firefox if the user has beta 1 or beta 2 previously installed. Both operate on completely different profiles
    • The app launcher may show two instances of Fennec when launching a url. They may be labeled both as Firefox, one being beta 1, the other beta 2.
    • AUS Updates for Fennec beta 1 and beta 2 will be disabled. Going forward, users will only get their updates from Android Market.
  • Testing (Android Only)
    1. Single install of Fennec beta 3 on android. Result: one instance of Firefox beta 3. Updates are disabled.
    2. Have an existing Fennec beta 2 on android. Install Fennec beta 3. Result: two instances of Firefox on android, with two different profiles. Both will work as expected. Updates are disabled.
    3. Have an existing Fennec beta 1 on android. Install Fennec beta 3. Result: two instances of Firefox on android, with two different profiles. Both will work as expected. Updates are disabled.
    4. Uninstall the existing instances in steps 2-3. Result: one instance of Firefox beta 3
    5. For steps 2-3, do not select a default browser, and launch a URL. Result: the app launcher appears with 2 instances of Firefox to choose from
    6. Run step 4, then step 5. Result: the app launcher appears with Firefox beta 3 to choose from

Builds

  • Build 3 candidates: here
  • Fennec 2.0 Litmus tests here

Test Results

Types of Tests Maemo Android
Smoketests (see breakdown below) martijn - FAIL, see bug 620879 Ioana - PASS
Ahoza - PASS
Anna - PASS
BFTs (see breakdown below) n/a Ioana - IN PROGRESS
Ahoza - result
Anna - result
Updates martijn - result Ioana - PASS - no update offered

Smoketests

N900 (martijn)

  • Run all smoketests
    • result

Android - HTC Desire (Ioana)

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8 Fennec/4.0b3
  • Results: PASS

Android - Samsung Galaxy S (ahoza)

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8 Fennec/4.0b3
  • Results: PASS

Android - Motorola Droid 2 (Anna)

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
  • Result: PASS

BFTs

Android - Samsung Galaxy S (ahoza)

  • Installation -> History
    • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
    • Results:

Android - Motorola Droid 2 (Anna)

  • Add-ons -> Sync
  • Result: PASS
  • Issues:
    • Add-ons Manager:
    • Form Assistant:
      • bug 620929 - VKB flickers when tapping on the search field in the Form Assistant bar
      • bug 606466 - Unnecessary ">" button in form autocomplete suggestions list
    • Layout:
    • Password:
      • bug 607504 - HTC Sense keyboard suggestion buffer doesn't commit when you click on a URL

Android - HTC Desire (Ioana)

  • Site Panel -> Screen Navigation (skip RTL)

Updates

N900 (martijn)

Android - HTC Desire (Ioana)

  • There are no updates offered for beta 2 or beta 3
  • Two instances can be installed (bug 620584)

Exploratory Testing

Android 1 (waverley)

Android 2 (waverley)

Android 3 (waverley)