Releases/Firefox 3.6.4/Test Plan:OOPP Testing 2: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
Line 1: Line 1:
= OOPP Focused Testing for 3.6.4(build2) =
= OOPP Focused Testing for 3.6.4(build2) =
We'll test around the fixes that went in between build1 and build4, verifying as many OOPP bugs as we can. {{Bug|561871#c10}} is specially important because it changes the way we do event handling and hang detection on Windows. Bsmedberg suggested we focus on plugin context menus and fullscreening.
We'll test around the fixes that went in between build1 and build2, verifying as many OOPP bugs as we can. {{Bug|561871#c10}} is specially important because it changes the way we do event handling and hang detection on Windows. Bsmedberg suggested we focus on plugin context menus and fullscreening.


Plugin versions to focus on:
Plugin versions to focus on:
Line 30: Line 30:
** Visual comparison with other browsers in cases where a performance lag is seen
** Visual comparison with other browsers in cases where a performance lag is seen


== Windows 7 () ==
= Pre-Testing Results Summary (Before receipt of official builds) =
* '''Status:''' ''''
 
* Build ID:  
Before official builds were received, the following testing was performed:
===marcia===
*Date: April 30, 2010
*Build ID:  Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100430 Namoroka/3.6.4 (.NET CLR 3.5.30729)
*Plugin Versions
**Shockwave Flash 10.0 r45
**Quicktime Version: 7.6.6.0
**Silverlight 3.0.50106.0
 
*Visited http://crash-stats.mozilla.com/topcrasher/byurl/Firefox/3.6.4 - URLs that had been crashing during the build 1
 
= Results Summary =
''Enter results summary after testing is done. Report bugs found here.''
 
== Windows 7 (juanb) ==
* '''Status:''' ''Completed''
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Plugins Tested
* Plugins Tested
**  
** Flash 10.1 rc (10.1.53.7), 10.0.45.2
** Silverlight 3 and (4.0.50401.0)
** Quicktime 7.6.6
** Adobe Reader
** Adobe Shockwave
** Java
* Add-ons:
* Add-ons:
* New bugs filed during testing:
* New bugs filed during testing:
* Existing bugs seen:
* Existing bugs seen:
* Issues Noted:
* Issues Noted:
** Not easy to reproduce: While watching a tv show trailer on fox.com, the app just froze, and it stayed frozen until I killed the plugin-container. No crash report. Only observed once.
** Filed {{bug|563811}} dealing with a hang bug that exists in non-oopp builds as well.


== Linux () ==
== Linux (juanb) ==
* '''Status:''' ''''
* '''Status:''' ''Completed (64bit)''
* Build ID:  
* Build ID: Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Plugins Tested
* Plugins Tested
** Flash 10.0 r45
** Flash 10.0 r45
Line 48: Line 71:
* New bugs filed during testing:
* New bugs filed during testing:
* Existing bugs seen:
* Existing bugs seen:
* Issues Noted:  
* Issues Noted: No major issues noticed.


== Windows XP () spot check ==
== Windows XP (marcia) spot check ==
* '''Status:''' ''''''
* '''Status:''' '''Completed'''
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4 (.NET CLR 3.5.30729)
* Plugins Tested
* Plugins Tested
** Flash 10.0 r45, 10.1 rc
** Silverlight 3 and (4.0.50401.0)
** Quicktime 7.6.6
* Add-ons:
* Add-ons:
* New bugs filed during testing:
* New bugs filed during testing:
* Existing Bugs seen:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=563741 Bug 563741]  Crash in [@ mozilla::plugins::PStreamNotifyParent::Send__delete__(mozilla::plugins::PStreamNotifyParent*, short const&) ]
* Existing bugs seen:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=564455 Bug 564555] [OOPP] crash [@ nsObjectFrame::GetWindowOriginInPixels(int) ]
* Issues Noted:
* Issues Noted:
* Top Sites Visited:  
* Top Sites Visited: http://www.tubeshared.com/
* Crashes Noted:
* Crashes Noted:
**http://crash-stats.mozilla.com/report/index/bp-2364dac8-f134-4d2f-88c9-4aed72100503 ->  [@ @0x0 | CallWindowProcAorW ]
**http://crash-stats.mozilla.com/report/index/bp-442d1db0-ce7d-4c71-a57f-3e6e32100503 ->  [@ RtlEnterCriticalSection ]
**http://crash-stats.mozilla.com/report/index/da7a9f44-6b58-4c9b-adc6-e754f2100504
**http://crash-stats.mozilla.com/report/index/bp-a0b29796-cbcf-4488-ae4c-df5b22100507
* Sites visited
**http://tubeshared.com/


== Windows Vista () spot check ==
== Windows Vista (marcia) spot check ==
* '''Status:''' ''''''
* '''Status:''' '''Completed'''
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Plugins Tested
* Plugins Tested
** Flash 10.0 r45, 10.1 rc, 10.1 r53
** Silverlight 3 and (4.0.50401.0)
** Quicktime 7.6.6
* Add-ons:
* Add-ons:
* New bugs filed during testing:
* New bugs filed during testing:
Line 71: Line 108:


== Mac OS X 10.6 (marcia) ==
== Mac OS X 10.6 (marcia) ==
* '''Status:''' ''''''
* '''Status:''' '''Completed'''
* Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100513 Firefox/3.6.4
* Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Plugins Tested
* Plugins Tested
** Flash 10.0 r45, 10.1 rc, Shockwave Flash 10.1 d81 (Gala)
** Silverlight 3 and (4.0.50401.0)
** Quicktime 7.6.6
** Quicktime 7.6.6
* Add-ons:
* Add-ons:
* New bugs filed during testing:
* New bugs filed during testing:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=564506 Bug 564506] Crash in [@ JSScope::destroy(JSContext*, JSScope*) ]
* Existing bugs seen:
* Existing bugs seen:
* Issues Noted:
* Issues Noted:
**No issues noted during smoketest. Visited a variety of video sites and launched into full screen mode.


== Mac OS X 10.5 () ==
== Mac OS X 10.5 (marcia) ==
* '''Status:''' ''''''
* '''Status:''' '''Completed'''
* Build ID:
* Build ID:
* Plugins Tested
* Plugins Tested
** Flash 10.0 r45, 10.1 rc
** Silverlight 3 and (4.0.50401.0)
** Quicktime 7.6.6
* Add-ons:
* Add-ons:
* New bugs filed during testing:
* New bugs filed during testing:
* Existing bugs seen:
* Existing bugs seen:
* Issues Noted:
* Issues Noted:

Latest revision as of 17:32, 14 May 2010

OOPP Focused Testing for 3.6.4(build2)

We'll test around the fixes that went in between build1 and build2, verifying as many OOPP bugs as we can. bug 561871#c10 is specially important because it changes the way we do event handling and hang detection on Windows. Bsmedberg suggested we focus on plugin context menus and fullscreening.

Plugin versions to focus on:

Run the plugins tests in the BFT:

Focus on:

  • Performance Testing:
    • Plugin Testing (Quicktime, Flash and Silerlight) in full screen mode
    • Plugin Testing - HD where appropriate or varying the resolution
    • Visual comparison with other browsers in cases where a performance lag is seen

Pre-Testing Results Summary (Before receipt of official builds)

Before official builds were received, the following testing was performed:

marcia

  • Date: April 30, 2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100430 Namoroka/3.6.4 (.NET CLR 3.5.30729)
  • Plugin Versions
    • Shockwave Flash 10.0 r45
    • Quicktime Version: 7.6.6.0
    • Silverlight 3.0.50106.0

Results Summary

Enter results summary after testing is done. Report bugs found here.

Windows 7 (juanb)

  • Status: Completed
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Plugins Tested
    • Flash 10.1 rc (10.1.53.7), 10.0.45.2
    • Silverlight 3 and (4.0.50401.0)
    • Quicktime 7.6.6
    • Adobe Reader
    • Adobe Shockwave
    • Java
  • Add-ons:
  • New bugs filed during testing:
  • Existing bugs seen:
  • Issues Noted:
    • Not easy to reproduce: While watching a tv show trailer on fox.com, the app just froze, and it stayed frozen until I killed the plugin-container. No crash report. Only observed once.
    • Filed bug 563811 dealing with a hang bug that exists in non-oopp builds as well.

Linux (juanb)

  • Status: Completed (64bit)
  • Build ID: Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Plugins Tested
    • Flash 10.0 r45
  • Add-ons:
  • New bugs filed during testing:
  • Existing bugs seen:
  • Issues Noted: No major issues noticed.

Windows XP (marcia) spot check

Windows Vista (marcia) spot check

  • Status: Completed
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Plugins Tested
    • Flash 10.0 r45, 10.1 rc, 10.1 r53
    • Silverlight 3 and (4.0.50401.0)
    • Quicktime 7.6.6
  • Add-ons:
  • New bugs filed during testing:
  • Existing bugs seen:
  • Issues Noted:

Mac OS X 10.6 (marcia)

  • Status: Completed
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Plugins Tested
    • Flash 10.0 r45, 10.1 rc, Shockwave Flash 10.1 d81 (Gala)
    • Silverlight 3 and (4.0.50401.0)
    • Quicktime 7.6.6
  • Add-ons:
  • New bugs filed during testing:
    • Bug 564506 Crash in [@ JSScope::destroy(JSContext*, JSScope*) ]
  • Existing bugs seen:
  • Issues Noted:
    • No issues noted during smoketest. Visited a variety of video sites and launched into full screen mode.

Mac OS X 10.5 (marcia)

  • Status: Completed
  • Build ID:
  • Plugins Tested
    • Flash 10.0 r45, 10.1 rc
    • Silverlight 3 and (4.0.50401.0)
    • Quicktime 7.6.6
  • Add-ons:
  • New bugs filed during testing:
  • Existing bugs seen:
  • Issues Noted: