Releases/Firefox 49/Test Plan/Beta/3: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(-)
 
m (-)
 
(8 intermediate revisions by one other user not shown)
Line 1: Line 1:
<small> « [[Releases/Firefox_48/Test_Plan/Beta/RC2 | Firefox 48 RC2]] | [[Releases/Firefox 49/Test Plan/Beta/1 | Firefox 49 Beta 1]]  | [[Releases/Firefox 49/Test Plan/Beta/2 | Firefox 49 Beta 2]] » </small>
<small> « [[Releases/Firefox 49/Test Plan/Beta/2 | Firefox 49 Beta 2]] | [[Releases/Firefox 49/Test Plan/Beta/3 | Firefox 49 Beta 3]]  | [[Releases/Firefox 49/Test Plan/Beta/4 | Firefox 49 Beta 4]] » </small>


= Firefox 49.0 Beta 3 Test Plan =
= Firefox 49.0 Beta 3 Test Plan =
Line 12: Line 12:
{| class="wikitable" width=50%
{| class="wikitable" width=50%
  ! Build 1
  ! Build 1
  | style="background:green; color:white; text-align:center;" | '''---'''
  | style="background:green; color:white; text-align:center;" | '''SHIP IT'''
|}
|}


== Manual Testing summary - Platform Coverage and Areas Tested ==
== Manual Testing summary - Platform Coverage and Areas Tested ==
* Testing performed around the crash reporter, printing and video compatibility.
* Testing performed around the crash reporter, printing and video compatibility.
* Test Cases executed and results: [https://testrail.stage.mozaws.net/index.php?/reports/view/29 report]
* Test Cases executed and results: [https://testrail.stage.mozaws.net/index.php?/reports/view/30 report]


=== Build 1 ===
=== Build 1 ===
Line 25: Line 25:
  ! Build  architecture
  ! Build  architecture
  ! Assignee
  ! Assignee
  ! Results: [https://testrail.stage.mozaws.net/index.php?/reports/view/29 report]
  ! Results: [https://testrail.stage.mozaws.net/index.php?/reports/view/30 report]
  |-
  |-
  | Windows 7 x86 (Intel HD 530)
  | Windows 7 x86 (Intel HD 530)
  | 32-bit
  | 32-bit
  | Cristian Comorasu
  | Cristian Comorasu
  | style="text-align:center;" | {{mok|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Windows 10 x64 (Intel HD 530)
  | Windows 10 x64 (Intel HD 530)
  | 64-bit
  | 64-bit
  | Alexandru Simonca
  | Alexandru Simonca
  | style="text-align:center;" | {{mok|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Mac OS X 10.11 (Intel Iris Pro (1536 MB))
  | Mac OS X 10.11 (Intel Iris Pro (1536 MB))
  | 64-bit
  | 64-bit
  | Camelia Badau
  | Camelia Badau
  | style="text-align:center;" | {{mok|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Ubuntu 12.04 LTS x86 (AMD Radeon HD 6450)
  | Ubuntu 12.04 LTS x86 (AMD Radeon HD 6450)
  | 32-bit
  | 32-bit
  | Mihai Boldan
  | Mihai Boldan
  | style="text-align:center;" | {{mok|}}
  | style="text-align:center;" | {{mdone|}}
  |}
  |}


Line 52: Line 52:
  ! Tested Area
  ! Tested Area
  ! Testing Type
  ! Testing Type
  ! [https://testrail.stage.mozaws.net/index.php?/reports/view/29 Results]
  ! [https://testrail.stage.mozaws.net/index.php?/reports/view/30 Results]
  |-
  |-
  | Audio compatibility
  | Audio compatibility
  | Smoke Testing
  | Smoke Testing
  | style="background:green; color: white; text-align:center;" | '''---'''
  | style="background:green; color: white; text-align:center;" | '''PASS'''
  |-
  |-
  | Customization
  | Customization
  | Smoke Testing
  | Smoke Testing
  | style="background:green; color: white; text-align:center;" | '''---'''
  | style="background:green; color: white; text-align:center;" | '''PASS'''
  |-
  |-
  |}
  |}
Line 96: Line 96:


= Results =
= Results =
* [https://testrail.stage.mozaws.net/index.php?/reports/view/29 Found bugs - new and known]
* [https://testrail.stage.mozaws.net/index.php?/reports/view/30 Found bugs - new and known]


== New bugs ==  
== New bugs ==  
Line 118: Line 118:
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"972658, 1043280, 1176218, 1192204, 1194214, 1194241, 1202654, 1223391, 1230678, 1280642, 1282075, 1284830",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}

Latest revision as of 14:24, 16 August 2016

«  Firefox 49 Beta 2 | Firefox 49 Beta 3 | Firefox 49 Beta 4 »

Firefox 49.0 Beta 3 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around the crash reporter, printing and video compatibility.
  • Test Cases executed and results: report

Build 1

Platform Build architecture Assignee Results: report
Windows 7 x86 (Intel HD 530) 32-bit Cristian Comorasu [DONE]
Windows 10 x64 (Intel HD 530) 64-bit Alexandru Simonca [DONE]
Mac OS X 10.11 (Intel Iris Pro (1536 MB)) 64-bit Camelia Badau [DONE]
Ubuntu 12.04 LTS x86 (AMD Radeon HD 6450) 32-bit Mihai Boldan [DONE]
Tested Area Testing Type Results
Audio compatibility Smoke Testing PASS
Customization Smoke Testing PASS

Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech on Desktop Camelia Badau [ON TRACK] Feature set to release with Firefox 49. Test Plan
Text to Speech in Reader View Camelia Badau [ON TRACK] Feature set to release with Firefox 49. Test Plan
Mac elevated updates Bogdan Maris [ON TRACK] Feature set to release with Firefox 49. Test Plan

Results

New bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
972658 Undo 'restore defaults' does not restore toolbar visibility (bookmarks / menu toolbar ) NEW
1043280 Bookmark animation not displayed when page is bookmarked from the Context Menu RESOLVED WORKSFORME
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1194241 [Ubuntu] Pause option is not displayed in context menu while the audio sample is played RESOLVED WORKSFORME
1202654 “Restart now” and “Undo” buttons should not appear for Default theme in about:addons RESOLVED INACTIVE
1223391 [Linux] Audio jumps when I'm right clicking in different places on the time bar RESOLVED WORKSFORME
1230678 youtube shows black line 720p & 1080p videos in normal view mode VERIFIED FIXED
1280642 Name of 'Subscribe' and 'Share This Page' tools are greyed out if moved to panel and still in customization mode VERIFIED FIXED
1282075 Selecting the "Hide Controls" option causes the container area to disappear (for audio files played inline) NEW
1284830 Tab sound indicator flickers while on www.zurichopenair.ch VERIFIED FIXED

12 Total; 3 Open (25%); 5 Resolved (41.67%); 4 Verified (33.33%);


Branch Bug Fix Verifications

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.allizom.org/index.php?title=Releases/Firefox_49/Test_Plan/Beta/3&oldid=1144138"