Confirmed users
1,595
edits
QA/Feature Testing: Difference between revisions
m
→Useful references: -
Andrei.vaida (talk | contribs) (→Quality statuses: -) |
Andrei.vaida (talk | contribs) m (→Useful references: -) |
||
| (One intermediate revision by one other user not shown) | |||
| Line 276: | Line 276: | ||
Kanchan Kumari<br/> | Kanchan Kumari<br/> | ||
Engineering QA | Engineering QA | ||
</blockquote> | |||
==== Bugwork ==== | |||
===== Description ===== | |||
Minor changes (or low impact) to Firefox, mainly consisting of a meta-bug and a few dependencies are usually decided together with the Eng Teams to be treated as bugworks instead of features. This also applies to low impact features coming as a testing request late in the cycle, which don't allow the QA teams to apply the full testing process usually needed for a feature (Test Plan creation, sign-off emails..). | |||
Bugworks will not be receiving a standard sign-off report from QA, but only a test report (without a Quality Status - sign-off color, Quality Trend..) describing what was considered in scope/covered. | |||
<br/><br/> | |||
===== Example ===== | |||
This is an email report example of a regular bugwork test report. | |||
* <u>Subject</u>: | |||
<blockquote style="background: #F3F3F3; border-left: 4px solid #ccc; padding-left: 15px;">[62][desktop][bugwork] Widevine CDM 1.4.9.1088 - Beta 62 test report (2018-08-16)</blockquote> | |||
* <u>Body</u>: | |||
<blockquote style="background: #F3F3F3; border-left: 4px solid #ccc; padding-left: 15px;">Hello,<br/> | |||
We have completed the testing for Widevine CDM 1.4.9.1088 feature. Please see below the details. | |||
Testing covered the following: | |||
* Firefox builds: Fx 62.0b16 | |||
* Platforms: Windows 7 x86, Windows 10 x64, Ubuntu 16.04 x64, Mac OS X 10.13, Windows 8 x86 | |||
Testing summary: | |||
* Test Plan: N/A | |||
* Test report: https://testrail.stage.mozaws.net/index.php?/reports/view/1073 | |||
* Bugs: https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1482918%2C%20653826%2C%201482161&list_id=14433425 | |||
Please note that this email stands as a test report for “Widevine CDM 1.4.9.1088” feature on Beta 62. Testing was performed as requested on different sites to ensure their functionality and stability while Widevine CDM 1.4.9.1088 is enabled. The feature functionality and stability are looking good, since we did not encounter any crashes and the functionality issues we found are not major. | |||
Thanks, | |||
</blockquote> | </blockquote> | ||
| Line 284: | Line 316: | ||
* All QA documentation available for features, structured per Firefox version: [https://drive.google.com/open?id=0B-n79IWvmJYYQngxVjhiRUJ1bTA here]. | * All QA documentation available for features, structured per Firefox version: [https://drive.google.com/open?id=0B-n79IWvmJYYQngxVjhiRUJ1bTA here]. | ||
* Feature QA status per Firefox version: | * Feature QA status per Firefox version: | ||
** Firefox 66: [https://docs.google.com/spreadsheets/d/1vPyFxPmnQt5YZThJlFaeyriLkeXU6sE6jgEHgAryUbo/edit#gid=0 here] | |||
** Firefox 65: [https://docs.google.com/spreadsheets/d/1-zxhm8GJf9fZ0kFbrfB5tzpfCcTqUNHVhDJaCfIr89o/edit here] | |||
** Firefox 64: [https://docs.google.com/spreadsheets/d/1z4_GjF-OHKihIeqfJGzH3NUC0hK3Ct8chyHOm8Nguo4/edit here] | ** Firefox 64: [https://docs.google.com/spreadsheets/d/1z4_GjF-OHKihIeqfJGzH3NUC0hK3Ct8chyHOm8Nguo4/edit here] | ||
** Firefox 63: [https://docs.google.com/spreadsheets/u/2/d/1IdIMWOrYymTVKgCPiPoxWQ3xlYBNbGX_UC2rAX1YRYY/edit here] | ** Firefox 63: [https://docs.google.com/spreadsheets/u/2/d/1IdIMWOrYymTVKgCPiPoxWQ3xlYBNbGX_UC2rAX1YRYY/edit here] | ||