Confirmed users
9,511
edits
QA/Goals/2015q1: Difference between revisions
no edit summary
No edit summary |
|||
| Line 43: | Line 43: | ||
| | | | ||
|- | |- | ||
| Marionette Training and | | Marionette Training and Test Conversion | ||
| Feb 1 2015 | | Feb 1 2015 | ||
| | | | ||
| Line 61: | Line 61: | ||
== Firefox == | == Firefox == | ||
=== E10s === | === E10s === | ||
* {{ok|<small>[lizzard, juanb]</small> - Establish baselines for automated test coverage, crash-stats, add-on compatibility, and memory footprint for e10s Nightly and track them throughout Q1.}} | * {{ok|<small>[lizzard, juanb]</small> - Establish baselines for automated-test coverage, crash-stats, add-on compatibility, and memory footprint for e10s Nightly and track them throughout Q1.}} | ||
* {{ok|<small>[lizzard, juanb]</small> - Improve the automated test coverage for E10s enabled builds by turning on tests for a new platform and ensuring bugs filed for perma-fails.}} | * {{ok|<small>[lizzard, juanb]</small> - Improve the automated-test coverage for E10s-enabled builds by turning on tests for a new platform and ensuring bugs filed for perma-fails.}} | ||
* {{ok|<small>[lizzard, juanb]</small> - Engage community to help improve | * {{ok|<small>[lizzard, juanb]</small> - Engage community to help improve add-on compatibility testing for e10s}} | ||
** milestones/deliverables: https://etherpad.mozilla.org/e10s-strategy-qa | ** milestones/deliverables: https://etherpad.mozilla.org/e10s-strategy-qa | ||
| Line 69: | Line 69: | ||
* {{ok|<small>[tracy]</small> - Document best practices for triage and test writing for DOM issues to pave the way for community involvement}} | * {{ok|<small>[tracy]</small> - Document best practices for triage and test writing for DOM issues to pave the way for community involvement}} | ||
* {{ok|<small>[ashughes]</small> - Establish baseline metrics for specification coverage, test stability, and other DOM quality metrics and track them throughout Q1}} | * {{ok|<small>[ashughes]</small> - Establish baseline metrics for specification coverage, test stability, and other DOM quality metrics and track them throughout Q1}} | ||
* {{ok|<small>[tracy, ashughes]</small> - Create several new automated tests/get existing | * {{ok|<small>[tracy, ashughes]</small> - Create several new automated tests/get existing Web-platform tests working to support the Picture tag and ServiceWorkers specifications}} | ||
** milestones/deliverables: https://etherpad.mozilla.org/qa-dom-strategy | ** milestones/deliverables: https://etherpad.mozilla.org/qa-dom-strategy | ||
=== Security/Privacy === | === Security/Privacy === | ||
* {{ok|<small>[mwobensmith]</small> - Set up AWS instance to run large TLS regression test}} | * {{ok|<small>[mwobensmith]</small> - Set up AWS instance to run large TLS regression test}} | ||
* {{ok|<small>[mwobensmith]</small> - Create a fast running subset of the larger TLS test and automate to run per-release (i.e. pre-beta)}} | * {{ok|<small>[mwobensmith]</small> - Create a fast-running subset of the larger TLS test and automate to run per-release (i.e. pre-beta)}} | ||
* {{ok|<small>[kjoziwak]</small> - Monitor and create telemetry probes to gather data to help serve as an early warning system for risky changes}} | * {{ok|<small>[kjoziwak]</small> - Monitor and create telemetry probes to gather data to help serve as an early warning system for risky changes}} | ||
=== Fennec === | === Fennec === | ||
* {{ok|<small>[aaronmt, kbrosnan]</small> - Slim down the per release smoketest by at least 25%}} | * {{ok|<small>[aaronmt, kbrosnan]</small> - Slim down the per-release smoketest by at least 25%}} | ||
* {{ok|<small>[kbrosnan]</small> - Investigate using | * {{ok|<small>[kbrosnan]</small> - Investigate using Marionette/Firefox Green-light on Fennec, create a plan and prioritized set of targets for the Marionette team}} | ||
* {{ok|<small>[aaronmt]</small> - Fix or discontinue appthwak automation}} | * {{ok|<small>[aaronmt]</small> - Fix or discontinue appthwak automation}} | ||
| Line 90: | Line 90: | ||
* {{prev|<small>[krupa]</small> - Have automation coverage for Payments including in-app payments}} | * {{prev|<small>[krupa]</small> - Have automation coverage for Payments including in-app payments}} | ||
** total scope of work (done vs. remaining) here: [https://bugzilla.mozilla.org/showdependencytree.cgi?id=1015251&hide_resolved=0 bug 1015251] | ** total scope of work (done vs. remaining) here: [https://bugzilla.mozilla.org/showdependencytree.cgi?id=1015251&hide_resolved=0 bug 1015251] | ||
* {{ok|<small>[krupa]</small> - Coordinate and drive quality efforts to prepare for AMO to require | * {{ok|<small>[krupa]</small> - Coordinate and drive quality efforts to prepare for AMO to require add-on signing}} | ||
== Platform QA == | == Platform QA == | ||
* {{ok|<small>[Marcia, Syd]</small> Eliminate Flash issues on | * {{ok|<small>[Marcia, Syd]</small> Eliminate Flash issues on YouTube by supporting the media team in shipping MSE on YouTube for Windows Vista and higher through manual and automated testing}} | ||
== Community == | == Community == | ||
* [marcia] Build community effort to support the Buddy Up project | * [marcia] Build community effort to support the Buddy Up project | ||
* [ashughes] Help create at least three small, focused test-day events that focus on helping contributors be more effective | * [ashughes] Help create at least three small, focused test-day events that focus on helping contributors be more effective | ||