Add-ons/QA/Testplan/Add-ons Post Reviews Process: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "'''Revision History''' {| class="wikitable" style="width:65%" |- ! Date !! Version !! Author !! Description |- | 20/06/2017 || 1.0 || Valentina Virlics || Created first draf...")
 
No edit summary
Line 10: Line 10:


= Overview =
= Overview =
*


== Purpose ==
== Purpose ==
 
*


=== Entry Criteria ===
=== Entry Criteria ===
Line 30: Line 30:
== Scope ==
== Scope ==
===what's in scope?===
===what's in scope?===
* Inform add-on developers of the submission restrictions in advance
*  
* Support submission of new versions for all existing add-ons
* Block new submissions of (after the release of Firefox 53):
** non-WebExtensions extensions 
** add-ons targeting only Firefox, Firefox for Android, or both
*** listed and unlisted distribution are both affected
* Only accept legacy extensions with strict compatibility and a maxVersion lower than 53.0
    
    
'''In discussions:'''   
'''In discussions:'''   
* Support submission of add-ons targeting Thunderbird and SeaMonkey
*  
* Block multipackage .xpis


===what's out of scope?===
===what's out of scope?===
Line 90: Line 83:
|}   
|}   
    
    
Created a doc with more detailed scenarios - [https://docs.google.com/spreadsheets/d/1g-eVqSUiqGx0nzltgkbg4XtiUppwDfKUjpWbYOtkBy8/edit#gid=0 Restrict Legacy Add-ons Submission]


== Testing Tools ==
== Testing Tools ==
Line 99: Line 91:
| Test plan creation || Mozilla wiki
| Test plan creation || Mozilla wiki
|-
|-
| Test case creation || [https://testrail.stage.mozaws.net/index.php?/suites/view/506 TestRail] / [https://docs.google.com/document/d/1BdiJSYD4aOMClasGxx5wVShHEk8VbxefE3Gf_6jpgkQ/edit# Google docs]  
| Test case creation || [TestRail] / [Google docs]  
|-
|-
| Test case execution || [https://testrail.stage.mozaws.net/index.php?/suites/view/506 TestRail]
| Test case execution || [TestRail]
|-
|-
| Bugs management || Github
| Bugs management || Github
Line 107: Line 99:


= References =
= References =
* PRD - https://docs.google.com/document/d/1BdiJSYD4aOMClasGxx5wVShHEk8VbxefE3Gf_6jpgkQ/edit#
* PRD - https://docs.google.com/document/d/1BdiJSYD4aOMClasGxx5wVShHEk8VbxefE3Gf_6jpgkQ/edit#
  * Tracker: not available yet
* Tracker: https://github.com/mozilla/addons-server/issues/5211 
* Implementation plan with what we care about for Q2: https://docs.google.com/document/d/1rZvM2QGk8WtkNUDRvLEvrbqZ190hvHfOle4zVRllQmw/edit  
* Post-review weights for prioritization https://docs.google.com/spreadsheets/d/1CZEECHHqEmK87fNiWNslAsFQBL7zxYF-c63-zZVZuqw/edit#gid=0 


= Testcases =  
= Testcases =  
== Test Areas ==
== Test Areas ==
* Submission of add-ons vs. submission of webextensions
* Review of add-ons  


== Test suite ==
== Test suite ==
  Full Test Suite: [https://testrail.stage.mozaws.net/index.php?/suites/view/506 here]
  Full Test Suite: [here]


= Bug Work =
= Bug Work =
* Feature implementation bug - [https://github.com/mozilla/addons-server/issues/4234 4234]     
* Feature implementation bug - [https://github.com/mozilla/addons-server/issues/5211 5210]     
* All Feature bugs:
* All Feature bugs:
** [https://github.com/mozilla/addons-server/labels/Legacy%20switch%20off Open]   
** [ Open]   
** [https://github.com/mozilla/addons-server/issues?q=label%3A%22Legacy+switch+off%22+is%3Aclosed Closed]
** [ Closed]


<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">

Revision as of 09:31, 20 June 2017

Revision History

Date Version Author Description
20/06/2017 1.0 Valentina Virlics Created first draft

Overview

Purpose

Entry Criteria

  • QA has access to PRD and some mocks (found in bugs)
  • The feature has landed in -dev

Current Status

  • The feature is under continuous development

Exit Criteria

  • All related bugs triaged
  • All blockers fixed
  • All resolved bugs verified by QA
  • Found-fixed bugs rate going down in time

Scope

what's in scope?

In discussions:

what's out of scope?

  • Add-ons/Webextensions functionality

Ownership

Product Manager: Jorge Villalobos; irc nick :jorgev
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Add-ons QA: Valentina Virlics; irc nick :ValentinaV

Requirements for testing

Environments

  • Windows
  • Mac OS

Servers

Channels

  • Release

Test Strategy

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 15.12.2016
Study PRD/mocks received 06.01.2017
QA - Test plan creation 03.02.2017
QA - Test cases preparation 06.03.2017
QA - Test cases execution
Release Date 17.04.2017 (Firefox Release 53)


Testing Tools

Process Tool
Test plan creation Mozilla wiki
Test case creation [TestRail] / [Google docs]
Test case execution [TestRail]
Bugs management Github

References

Testcases

Test Areas

  • Review of add-ons

Test suite

Full Test Suite: [here]

Bug Work

  • Feature implementation bug - 5210
  • All Feature bugs:
    • [ Open]
    • [ Closed]
Bug fix verification
Logged bugs

Sign off

Criteria

Check list

  • All test cases should be executed
  • All blockers must be fixed and verified or have an agreed-upon timeline for being fixed
Retrieved from "https://wiki.allizom.org/index.php?title=Add-ons/QA/Testplan/Add-ons_Post_Reviews_Process&oldid=1174158"