QA/mozilla-beta/fx6/Beta 5: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(27 intermediate revisions by 10 users not shown)
Line 11: Line 11:


* {{done|}} Automation (Mozmill BFTs) - ashughes/whimboo: [[QA/mozilla-beta/fx6/Beta_5#Automation|'''Signed Off''']]
* {{done|}} Automation (Mozmill BFTs) - ashughes/whimboo: [[QA/mozilla-beta/fx6/Beta_5#Automation|'''Signed Off''']]
* {{ok|}} [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FIREFOX_6_0b4_RELEASE&tochange=FIREFOX_6_0b5_RELEASE Bug Verifications] - Waverley Team: [http://bit.ly/qr7afL '''result''']
* {{done|}} [http://bit.ly/rfgmc3 Bug Verifications] - Waverley Team: [http://bit.ly/ri5UVK '''Signed Off'''] - One bug reopened.
* {{ok|}} Manual Testing - Waverley Team: [[QA/mozilla-beta/fx6/Beta_5#Manual|'''result''']]
* {{done|}} Manual Testing - Waverley Team: [[QA/mozilla-beta/fx6/Beta_5#Manual|'''Signed-off''']]
* {{ok|}} Feature sign-off - Waverley Team: [[QA/mozilla-beta/fx6/Beta_5#Feature sign-off|'''result''']]
* {{done|}} Feature sign-off - Waverley Team: [[QA/mozilla-beta/fx6/Beta_5#Feature sign-off|'''Signed Off''']]
* {{done|}} Automation (Updates) - geo: [[QA/mozilla-beta/fx6/Beta_5#Updates|'''Signed Off''']] - betatest
* {{done|}} Automation (Updates) - geo: [[QA/mozilla-beta/fx6/Beta_5#Updates|'''Signed Off''']] - betatest


Line 80: Line 80:
=== Manual ===
=== Manual ===
;Smoketests
;Smoketests
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=327
* Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=327
* Litmus Report: https://litmus.mozilla.org/test_run_report.cgi?test_run_id=327


{| class="fullwidth-table"
{| class="fullwidth-table"
Line 90: Line 91:
| Windows 2000  
| Windows 2000  
| Virgil
| Virgil
| RESULT
| PASS
|-
|-
| Windows XP  
| Windows XP  
| Simona
| Simona
| RESULT
| PASS
|-
|-
| Windows Vista  
| Windows Vista  
| Simona
| Simona
| RESULT
| PASS
|-
|-
| Windows 7  
| Windows 7  
| AndreiD
| AndreiD
| RESULT
| PASS
|-
|-
| Windows 7 64-bit  
| Windows 7 64-bit  
Line 110: Line 111:
| Mac OS X 10.6  
| Mac OS X 10.6  
| VladG
| VladG
| RESULT
| PASS
|-
|-
| Ubuntu 11.04
| Ubuntu 11.04
| Alin
| Alin
| RESULT
| PASS
|-
|-
| Ubuntu 11.04 64-bit  
| Ubuntu 11.04 64-bit  
| George
| George
| RESULT
| PASS
|-
|-
| Mac OS X 10.7
| Mac OS X 10.7
Line 130: Line 131:


;Exploratory Testing Around Changes - On Applicable Platforms
;Exploratory Testing Around Changes - On Applicable Platforms
* Change 1 - Signed Off?
* WebGL
* Change 2 - Signed Off?
**[REOPENED] - {{bug|675634}} - Firefox crashes while on a page that uses WebGL [@ gl::VertexDataConverter<float, gl::WidenRule<int, 2>, gl::ConversionRule<int, 0, int>, gl::DefaultVertexValues<float, int> >::convertArray(void const*, unsigned int, unsigned int, void*) ]
* Etc...
* Javascript
 
** PASS
;Issues Found
*Flash
* n/a
** PASS
* QuickTime
** PASS


=== Updates ===
=== Updates ===
Line 183: Line 186:
  | '''PASS'''
  | '''PASS'''
  |-
  |-
  | colspan="4" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=beta&from=2011-07-26&to=2011-07-30&target=6.0 report]
  | colspan="4" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/overview?branch=6.0&channel=beta&from=2011-08-04&to=2011-08-05 report]
  |-
  |-
  | Windows 2000
  | Windows 2000
  | 6.0b4 en-US, zh-TW; 6.0b3 en-US, nl; 4.0b10 en-US
  | 6.0b4 en-US, zh-TW; 6.0b3 en-US, nl; 4.0b10 en-US
  | '''result'''
  | '''PASS'''
  |-
  |-
  | Windows XP
  | Windows XP
  | 6.0b4 en-US, fr; 6.0b3 en-US, it; 4.0b12 en-US, pt-BR
  | 6.0b4 en-US, fr; 6.0b3 en-US, it; 4.0b12 en-US, pt-BR
  | '''result'''
  | '''PASS'''
  |-
  |-
  | Windows Vista
  | Windows Vista
  | 6.0b4 en-US, id; 6.0b3 en-US
  | 6.0b4 en-US, id; 6.0b3 en-US
  | '''result'''
  | '''PASS'''
  |-
  |-
  | Windows 7
  | Windows 7
  | 6.0b4 en-US, de; 6.0b3 en-US, fi; 5.0b6 en-US, es-ES
  | 6.0b4 en-US, de; 6.0b3 en-US, fi; 5.0b6 en-US, es-ES
  | '''result'''
  | '''PASS'''
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | 6.0b4 en-US, de; 6.0b3 en-US, fi; 5.0b6 en-US, es-ES
  | 6.0b4 en-US, de; 6.0b3 en-US, fi; 5.0b6 en-US, es-ES
  | '''result'''
  | '''PASS'''
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | 6.0b4 en-US, de; 6.0b3 en-US, ja-jp-mac; 5.0b7 fr
  | 6.0b4 en-US, de; 6.0b3 en-US, ja-jp-mac; 5.0b7 fr
  | '''result'''
  | '''PASS'''
  |-
  |-
  | Mac OS X 10.7
  | Mac OS X 10.7
Line 215: Line 218:
  | Ubuntu 11.04
  | Ubuntu 11.04
  | 6.0b4 en-US, pl; 6.0b3 en-US, en-GB; 5.0b5 ja
  | 6.0b4 en-US, pl; 6.0b3 en-US, en-GB; 5.0b5 ja
  | '''result'''
  | '''PASS'''
  |-
  |-
  | Ubuntu 11.04 64-bit
  | Ubuntu 11.04 64-bit
  | 6.0b4 en-US, ja; 6.0b3 en-US, it; 5.0b7 zh-CN
  | 6.0b4 en-US, ja; 6.0b3 en-US, it; 5.0b7 zh-CN
  | '''result'''
  | '''PASS'''
  |-
  |-
  |}
  |}
Line 236: Line 239:
| Andrei
| Andrei
| [https://wiki.mozilla.org/Firefox/Features/50ms_ASSERT 50ms Assert]
| [https://wiki.mozilla.org/Firefox/Features/50ms_ASSERT 50ms Assert]
| '''Result'''
| ''Not a user facing feature. The dev team is taking the decision for the sign-off since it is a specific feature for product development''
|-
|-
| Henrik
| Henrik
| [https://wiki.mozilla.org/Features/Firefox/PlugincheckLinkInAOM PlugincheckLinkInAOM]
| [https://wiki.mozilla.org/Features/Firefox/PlugincheckLinkInAOM PlugincheckLinkInAOM]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| Tracy
| Tracy
| [https://wiki.mozilla.org/Firefox/Features/Sync_Discoverability Sync Discoverability]
| [https://wiki.mozilla.org/Firefox/Features/Sync_Discoverability Sync Discoverability]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| George
| George
| [https://wiki.mozilla.org/Firefox/Features/Persist_Panorama_Groups Persist Panorama Groups]
| [https://wiki.mozilla.org/Firefox/Features/Persist_Panorama_Groups Persist Panorama Groups]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| George
| George
| [https://wiki.mozilla.org/Firefox/Features/Panorama_Groups_On_Demand Panorama Groups On Demand]
| [https://wiki.mozilla.org/Firefox/Features/Panorama_Groups_On_Demand Panorama Groups On Demand]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| George
| George
| [https://wiki.mozilla.org/Privacy/Features/Site-based_data_management_UI Site-based data management UI]
| [https://wiki.mozilla.org/Privacy/Features/Site-based_data_management_UI Site-based data management UI]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| George
| George
| [https://wiki.mozilla.org/Firefox/Features/windows-scrolling windows-scrolling]
| [https://wiki.mozilla.org/Firefox/Features/windows-scrolling windows-scrolling]
| '''Result'''
| '''SIGNED-OFF''' See limitations in wiki-page
|-
|-
| Simona
| Simona
| [https://wiki.mozilla.org/Firefox/Features/Locationbar_Domain_Highlight Locationbar Domain Highlight]
| [https://wiki.mozilla.org/Firefox/Features/Locationbar_Domain_Highlight Locationbar Domain Highlight]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| Simona
| Simona
| [https://wiki.mozilla.org/DevTools/Features/WebDeveloperMenu WebDeveloper Menu]
| [https://wiki.mozilla.org/DevTools/Features/WebDeveloperMenu WebDeveloper Menu]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| VladG
| VladG
| [https://wiki.mozilla.org/Platform/Features/RevampAboutMemory RevampAboutMemory]
| [https://wiki.mozilla.org/Platform/Features/RevampAboutMemory RevampAboutMemory]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| VladG
| VladG
| [https://wiki.mozilla.org/Platform/Features/Progress_Element Progress Element]
| [https://wiki.mozilla.org/Platform/Features/Progress_Element Progress Element]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-
| Vlad
| Vlad
| [https://wiki.mozilla.org/DevTools/Features/AutocompletionPopup Autocomplete Popup]
| [https://wiki.mozilla.org/DevTools/Features/AutocompletionPopup Autocomplete Popup]
| '''Result'''
| '''SIGN-OFF'''
|-
|-
| Vlad
| Vlad
| [https://wiki.mozilla.org/DevTools/Features/WebConsoleUpgrade WebConsoleUpgrade]
| [https://wiki.mozilla.org/DevTools/Features/WebConsoleUpgrade WebConsoleUpgrade]
| '''Result'''
| '''SIGN-OFF'''
|-
|-
| Alex
| Alex
| [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad]
| [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad]
| '''Result'''
| '''SIGNED-OFF'''
|-
|-

Latest revision as of 18:44, 5 August 2011

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 4 | mozilla-beta:fx6:Beta 5 | mozilla-beta:fx6:Beta 6 »

Beta 5 Test Plan and Results

Tasks

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7:

  • Windows XP
  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Mac OSX 10.6
  • Ubuntu 10.10 (32-bit and 64-bit)
  • Windows 2000
  • Mac OSX 10.7

Results

Problems Found

List any found issues or bugs here. Use [6b5] whiteboard entry to keep track.

Automation

Run automated BFTs and link reports from dashboard

Platform General Tests Restart Tests
Windows 2000 PASS PASS
Windows XP PASS PASS
Windows Vista PASS PASS
Windows 7 PASS PASS
Windows 7 64-bit PASS PASS
Mac OS X 10.6 PASS PASS
Mac OS X 10.7 PASS PASS
Ubuntu 10.10 PASS PASS
Ubuntu 10.10 64-bit PASS (i686)
PASS (x86_64) 		PASS (i686)
PASS (x86_64)
Issues Found
  • Any major issues?

PASS

Manual

Smoketests
Platform Name of tester Results
Windows 2000 Virgil PASS
Windows XP Simona PASS
Windows Vista Simona PASS
Windows 7 AndreiD PASS
Windows 7 64-bit AndreiD PASS
Mac OS X 10.6 VladG PASS
Ubuntu 11.04 Alin PASS
Ubuntu 11.04 64-bit George PASS
Mac OS X 10.7 VladG PASS
Issues Found
  • Any major issues?
    • n/a
Exploratory Testing Around Changes - On Applicable Platforms
  • WebGL
    • [REOPENED] - bug 675634 - Firefox crashes while on a page that uses WebGL [@ gl::VertexDataConverter<float, gl::WidenRule<int, 2>, gl::ConversionRule<int, 0, int>, gl::DefaultVertexValues<float, int> >::convertArray(void const*, unsigned int, unsigned int, void*) ]
  • Javascript
    • PASS
  • Flash
    • PASS
  • QuickTime
    • PASS

Updates

Target Build ID: Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0 (20110804xxxx)

Platform Builds Result
Betatest: report
Windows 2000 6.0b4 en-US, zh-TW; 6.0b3 en-US, nl; 4.0b10 en-US PASS
Windows XP 6.0b4 en-US, fr; 6.0b3 en-US, it; 4.0b12 en-US, pt-BR PASS
Windows Vista 6.0b4 en-US, id; 6.0b3 en-US PASS
Windows 7 6.0b4 en-US, de; 6.0b3 en-US, fi; 5.0b6 en-US, es-ES PASS
Windows 7 64-bit 6.0b4 en-US, de; 6.0b3 en-US, fi; 5.0b6 en-US, es-ES PASS
Mac OS X 10.6 6.0b4 en-US, de; 6.0b3 en-US, ja-jp-mac; 5.0b7 fr PASS
Mac OS X 10.7
Ubuntu 11.04 6.0b4 en-US, pl; 6.0b3 en-US, en-GB; 5.0b5 ja PASS
Ubuntu 11.04 64-bit 6.0b4 en-US, ja; 6.0b3 en-US, it; 5.0b7 zh-CN PASS
Beta: report
Windows 2000 6.0b4 en-US, zh-TW; 6.0b3 en-US, nl; 4.0b10 en-US PASS
Windows XP 6.0b4 en-US, fr; 6.0b3 en-US, it; 4.0b12 en-US, pt-BR PASS
Windows Vista 6.0b4 en-US, id; 6.0b3 en-US PASS
Windows 7 6.0b4 en-US, de; 6.0b3 en-US, fi; 5.0b6 en-US, es-ES PASS
Windows 7 64-bit 6.0b4 en-US, de; 6.0b3 en-US, fi; 5.0b6 en-US, es-ES PASS
Mac OS X 10.6 6.0b4 en-US, de; 6.0b3 en-US, ja-jp-mac; 5.0b7 fr PASS
Mac OS X 10.7
Ubuntu 11.04 6.0b4 en-US, pl; 6.0b3 en-US, en-GB; 5.0b5 ja PASS
Ubuntu 11.04 64-bit 6.0b4 en-US, ja; 6.0b3 en-US, it; 5.0b7 zh-CN PASS
Issues Found
  • Any major issues?

Feature sign-off

Feature Owner Results
Andrei 50ms Assert Not a user facing feature. The dev team is taking the decision for the sign-off since it is a specific feature for product development
Henrik PlugincheckLinkInAOM SIGNED-OFF
Tracy Sync Discoverability SIGNED-OFF
George Persist Panorama Groups SIGNED-OFF
George Panorama Groups On Demand SIGNED-OFF
George Site-based data management UI SIGNED-OFF
George windows-scrolling SIGNED-OFF See limitations in wiki-page
Simona Locationbar Domain Highlight SIGNED-OFF
Simona WebDeveloper Menu SIGNED-OFF
VladG RevampAboutMemory SIGNED-OFF
VladG Progress Element SIGNED-OFF
Vlad Autocomplete Popup SIGN-OFF
Vlad WebConsoleUpgrade SIGN-OFF
Alex Scratchpad SIGNED-OFF
Retrieved from "https://wiki.allizom.org/index.php?title=QA/mozilla-beta/fx6/Beta_5&oldid=336730"