Releases/Firefox 3.6.4/Test Plan:OOPP Testing: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 36: Line 36:
** Silverlight 3 and 4
** Silverlight 3 and 4
** Quicktime 7.6.6
** Quicktime 7.6.6
* Add-ons used
** Bing Bar 5.0
** Search Helper Extension 1.0 (part of Bing Bar)
* Ran the plugins section of the BFT.
* Ran the plugins section of the BFT.
* New bugs filed during testing:
* New bugs filed during testing:

Revision as of 18:16, 16 April 2010

OOPP Focused Testing for 3.6.4

We are going to ship OOPP to a wider audience in this branch. By default it will have three specific plugins whitelisted: Flash, Silverlight and Quicktime. These will run out of process in Windows and Linux. Out of process will not be suppported on Mac.

Plugin versions to focus on:

Run the plugins tests in the BFT:

Focus on:

  • Exploratory Testing:
    • End to end crashed-plugin UI
      • Flash 10.x and 10.1rc, Silverlight 3/4, Quicktime 7.6
    • Crashed-plugin UI elements and their properties
    • Quicktime 7.6 testing on Windows (any other version)
    • Bing toolbar (uses Silverlight)
    • Any other popular toolbars (Google, Yahoo)
    • Flashblock or a couple of popular extensions
    • One P1 locale (de, fr, pt-br, it... for example)
    • Popular sites compatibility
    • Top sites automated testing (Tomcat)
  • Performance Testing:
    • Plugin Testing (Quicktime, Flash and Silerlight) in full screen mode
    • Plugin Testing - HD where appropriate or varying the resolution
    • Visual comparison with other browsers in cases where a performance lag is seen

Results

Windows 7 (juanb)

  • Status: Completed (no major issues)
  • Build ID:
  • Plugins Tested
    • Flash 10.0 r45, 10.1 rc
    • Silverlight 3 and 4
    • Quicktime 7.6.6
  • Add-ons used
    • Bing Bar 5.0
    • Search Helper Extension 1.0 (part of Bing Bar)
  • Ran the plugins section of the BFT.
  • New bugs filed during testing:
    • bug 559484 - crash in [@ mozilla::ipc::RPCChannel::..]
  • Issues Noted:
    • Unable to reproduce: crash on http://weblogs.mozillazine.org/marcia/archives/plugin-test.html (with Flash, Quicktime, and Java installed).
    • Unable to reproduce: Under certain conditions, with several pages with different plugins open, killing the plugin-container for Flash, and then reloading the page will kill the whole browser.
    • Investigating: Auto resume while watching a Flash video in full screen doesn't seem to refresh the video, but it will keep going. If you re-size to the original it will pick up where it left as far as video rendering. We noticed this with the network latencies we're experiencing yesterday.

Linux (juanb)

  • Status: Completed (no major issues)
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Plugins tested:
    • Flash 10.0 r45, 10.1 rc
    • Novel Moonlight 2.2 (in process), Silverlight 3.0x
    • QuakeLive Game Launcher 1.0.277
  • Add-ons used:
    • Yahoo Toolbar 2.1.3.20100310105313
  • Ran the plugins section of the BFT
  • New bugs filed during testing:

Windows XP (marcia) spot check

Windows Vista (marcia) spot check

Mac OS X (marcia)

  • Status: result
  • BuildID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Plugin Versions tested
    • Shockwave Flash 10.1 r53
  • Bugs Seen
    • Bug 510846 Flash Player settings/preferences don't receive clicks/mouse events on certain sites
      • Highly annoying since sites that require webcam access such as tokbox require accessing settings.