Releases/Firefox 50/Test Plan/Beta/10
« Firefox 50 Beta 9 | Firefox 50 Beta 10 | Firefox 50 Beta 11 »
Firefox 50.0 Beta 10 Test Plan
- Release Week: Oct 24th, 2016. Plan is to ship this build on Tuesday, Oct 25th 2016 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida
- Build 1: 50.0b10-build1 | 38cfded170521 | (ID: 20161024172922)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | SHIP IT |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around: Download Protection, Sync & FxA (including the newly introduced features: Sign-in Unblock, Device Manager and Service/Apps Manager).
- [DONE] ⚠ Please note that we're currently waiting for test results on a specific Download Protection test case that requires a 12hrs wait time. We'll make sure to follow up on that, first thing tomorrow.
- Test Cases executed and results: report
Build 1
| Platform | Graphics | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 7 x86 | AMD Radeon HD 6450 | 32-bit | Camelia Badau | [DONE] |
| Windows 8.1 x64 | Intel HD Graphics | 64-bit | Ciprian Georgiu | [DONE] |
| Mac OS X 10.11 | NVIDIA GeForce GT 640M | 64-bit | Alexandru Simonca | [DONE] |
| Ubuntu 14.04 x86 | tbd | 32-bit | Iulia Cristescu | [DONE] |
| Tested Area | Testing Type | [testrail_link Results] |
|---|---|---|
| DOWNLOAD PROTECTION | Smoke Testing | PASS |
| SYNC & FXA | Smoke and Exploratory Testing | PASS |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Windows Child Mode | Iulia Cristescu | [ON TRACK] | scheduled to release with Firefox 50; pre-release sign off is underway | Test Plan |
| Pointer Lock API | Alexandru Simonca | [ON TRACK] | scheduled to release with Firefox 50; pre-release sign off is underway | Test Plan |
| WebM EME support for Widevine | Ciprian Georgiu | [INVESTIGATION NEEDED] | scheduled to release with Firefox 50; at this point, our concerns revolve around the still unresolved bugs: 1298027, 1298030, 1301423 and the recent issue we noticed on the shaka player demo, under Ubuntu (the latter being currently investigated by Bryce Van Dyk); pre-release sign off is underway | Test Plan |
| Simplify page | Bogdan Maris | [AT RISK] | target milestone changed to Fx51, due to 1306294, 1306299, 1306295. | Test Plan |
Results
New bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1
Known Issues - also seen in previous builds
Major issues also seen in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1
Low impact issues also seen in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1
Branch Bug Fix Verifications
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed