Releases/Firefox 3.6.4/Test Plan:OOPP Testing 2

OOPP Focused Testing for 3.6.4(build2)

We'll test around the fixes that went in between build1 and build2, verifying as many OOPP bugs as we can. bug 561871#c10 is specially important because it changes the way we do event handling and hang detection on Windows. Bsmedberg suggested we focus on plugin context menus and fullscreening.

Plugin versions to focus on:

• Flash 10.0 r45 (current) and 10.1 (rc2).
• Silverlight 3 / 4
• Quicktime 7.6.3

Run the plugins tests in the BFT:

• Plugins BFT

Focus on:

• Exploratory Testing:
  • End to end crashed-plugin UI
    • Flash 10.x and 10.1rc, Silverlight 3/4, Quicktime 7.6
  • Crashed-plugin UI elements and their properties
  • Quicktime 7.6 testing on Windows (any other version)
  • Bing toolbar (uses Silverlight)
  • Any other popular toolbars (Google, Yahoo)
  • Flashblock or a couple of popular extensions
  • One P1 locale (de, fr, pt-br, it... for example)
  • Popular sites compatibility (examples:)
    • http://www.bing.com/videos/browse/movies?q=browse:movies
    • http://www.silverlight.net/learn/videos/silverlight-4-videos/
  • Top sites automated testing (Tomcat)

• Performance Testing:
  • Plugin Testing (Quicktime, Flash and Silerlight) in full screen mode
  • Plugin Testing - HD where appropriate or varying the resolution
  • Visual comparison with other browsers in cases where a performance lag is seen

Pre-Testing Results Summary (Before receipt of official builds)

Before official builds were received, the following testing was performed:

marcia

• Date: April 30, 2010
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100430 Namoroka/3.6.4 (.NET CLR 3.5.30729)
• Plugin Versions
  • Shockwave Flash 10.0 r45
  • Quicktime Version: 7.6.6.0
  • Silverlight 3.0.50106.0

• Visited http://crash-stats.mozilla.com/topcrasher/byurl/Firefox/3.6.4 - URLs that had been crashing during the build 1

Results Summary

Enter results summary after testing is done. Report bugs found here.

Windows 7 (juanb)

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
• Plugins Tested
  • Flash 10.1 rc (10.1.53.7), 10.0.45.2
  • Silverlight 3 and (4.0.50401.0)
  • Quicktime 7.6.6
  • Adobe Reader
  • Adobe Shockwave
  • Java
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• Issues Noted:
  • Not easy to reproduce: While watching a tv show trailer on fox.com, the app just froze, and it stayed frozen until I killed the plugin-container. No crash report. Only observed once.
  • Filed bug 563811 dealing with a hang bug that exists in non-oopp builds as well.

Linux (juanb)

• Status: Completed (64bit)
• Build ID: Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
• Plugins Tested
  • Flash 10.0 r45
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• Issues Noted: No major issues noticed.

Windows XP (marcia) spot check

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4 (.NET CLR 3.5.30729)
• Plugins Tested
  • Flash 10.0 r45, 10.1 rc
  • Silverlight 3 and (4.0.50401.0)
  • Quicktime 7.6.6
• Add-ons:
• New bugs filed during testing:
  • Bug 563741 Crash in [@ mozilla::plugins::PStreamNotifyParent::Send__delete__(mozilla::plugins::PStreamNotifyParent*, short const&) ]
• Existing bugs seen:
  • Bug 564555 [OOPP] crash [@ nsObjectFrame::GetWindowOriginInPixels(int) ]
• Issues Noted:
• Top Sites Visited: http://www.tubeshared.com/
• Crashes Noted:
  • http://crash-stats.mozilla.com/report/index/bp-2364dac8-f134-4d2f-88c9-4aed72100503 -> [@ @0x0 | CallWindowProcAorW ]
  • http://crash-stats.mozilla.com/report/index/bp-442d1db0-ce7d-4c71-a57f-3e6e32100503 -> [@ RtlEnterCriticalSection ]
  • http://crash-stats.mozilla.com/report/index/da7a9f44-6b58-4c9b-adc6-e754f2100504
  • http://crash-stats.mozilla.com/report/index/bp-a0b29796-cbcf-4488-ae4c-df5b22100507
• Sites visited
  • http://tubeshared.com/

Windows Vista (marcia) spot check

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
• Plugins Tested
  • Flash 10.0 r45, 10.1 rc, 10.1 r53
  • Silverlight 3 and (4.0.50401.0)
  • Quicktime 7.6.6
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• Issues Noted:

Mac OS X 10.6 (marcia)

• Status: Completed
• Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
• Plugins Tested
  • Flash 10.0 r45, 10.1 rc, Shockwave Flash 10.1 d81 (Gala)
  • Silverlight 3 and (4.0.50401.0)
  • Quicktime 7.6.6
• Add-ons:
• New bugs filed during testing:
  • Bug 564506 Crash in [@ JSScope::destroy(JSContext*, JSScope*) ]
• Existing bugs seen:
• Issues Noted:
  • No issues noted during smoketest. Visited a variety of video sites and launched into full screen mode.

Mac OS X 10.5 (marcia)

• Status: Completed
• Build ID:
• Plugins Tested
  • Flash 10.0 r45, 10.1 rc
  • Silverlight 3 and (4.0.50401.0)
  • Quicktime 7.6.6
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• Issues Noted: