Add-ons/QA/Testplan/NewAMOMobile: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(12 intermediate revisions by 2 users not shown)
Line 1: Line 1:
= Overview =
= Overview =
The completely new AMO Mobile page design with a modern and simplified look, oriented to users and ease of utilization.  
New AMO Mobile design(applied for Desktop Mobile view too) with a modern and simplified look, oriented to users and ease of utilization.  


== Purpose ==
== Purpose ==
A more attractive mobile AMO page with a more easy and intuitive way to install and search for Add-ons and Themes
A more attractive AMO page with a more easy and intuitive way to install and search for Add-ons and Themes


=== Entry Criteria ===
=== Entry Criteria ===
* QA has access to mocks :  https://mozilla.invisionapp.com/share/GY8O3Z4ZE#/screens . Any other info were found in bugs logged in GitHub
* QA has access to [https://mozilla.invisionapp.com/share/GY8O3Z4ZE#/screens mocks] . Any other info were found in bugs logged in GitHub
* The feature has landed in -dev : https://addons-dev.allizom.org/en-US/firefox/ and will land in prod in mid February. Aiming for Feature complete End of Jan
* The feature has landed in -dev : https://addons-dev.allizom.org/en-US/firefox/.
Mobile release is set for March 9th.
 
=== Current status ===
* The feature is partially in -dev . Still under development


=== Exit Criteria ===
=== Exit Criteria ===
Line 17: Line 21:
== Scope ==
== Scope ==
===what's in scope?===
===what's in scope?===
* AMO mobile appearance.
* AMO mobile appearance
* Behavior of AMO mobile in logged in \ logged out states
* Behavior of AMO mobile in logged in \ logged out states
* Inatall\Uninstall of Add-ons and Themes on Mobile
* Install\Uninstall of Add-ons and Themes
* Search for Add-ons and Themes on Mobile. Sorting the search results. Search suggestions
* Search for Add-ons and Themes. Sorting the search results. Search suggestions.
* Add-on and Themes reviews and rating on Mobile
* Add-on and Themes reviews and ratings
* Add-ons and Themes categories  
* Add-ons and Themes categories  
* AMO mobile in different languages and RTL view
* AMO mobile pages in different languages and RTL view
* Collections in AMO mobile - not sure if this will be implemented but this is present on mocks
* Collections - not sure if this will be implemented but is present on mocks
* Versions availability in AMO mobile public pages
* Versions availability in AMO mobile public pages
* Themes preview on Mobile
* Themes preview
* User settings on Mobile
* User settings
* Page errors  
* Page errors


===what's out of scope?===
===what's out of scope?===
Line 51: Line 55:


== Channels ==
== Channels ==
* Release
* [http://archive.mozilla.org/pub/mobile/releases/51.0/android-api-15/en-US/fennec-51.0.en-US.android-arm.apk Release]
* Nightly
* [http://archive.mozilla.org/pub/mobile/nightly/2017/01/2017-01-30-11-03-29-mozilla-central-android-api-15/fennec-54.0a1.multi.android-arm.apk Nightly]
* Unbranded builds
* [http://archive.mozilla.org/pub/mobile/tinderbox-builds/mozilla-release-android-api-15/1485542540/fennec-51.0.1.en-US.android-arm.apk Unbranded builds]


= Test Strategy =  
= Test Strategy =  
Line 75: Line 79:
|-
|-
| QA - Test cases execution   
| QA - Test cases execution   
|style="text-align:center;" | 01.02.2017 || 15.02.2017  
|style="text-align:center;" | 01.02.2017 || 08.03.2017  
|-
|-
| Release Date  
| Release Date  
|style="text-align:center;" | 16.02.2017 ||  
|style="text-align:center;" | 09.03.2017 ||  
|}
|}


Line 97: Line 101:
= References =
= References =
  * PRD - https://mozilla.invisionapp.com/share/GY8O3Z4ZE#/screens
  * PRD - https://mozilla.invisionapp.com/share/GY8O3Z4ZE#/screens
* Tracker: [https://github.com/mozilla/addons-server/issues/3465 3465]


= Testcases =  
= Testcases =  
Line 118: Line 121:
====== Bug fix verification ======
====== Bug fix verification ======
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
* https://github.com/mozilla/addons-frontend/issues?q=label%3A%22mobile+pages+v1%22+label%3A%22verified+fixed%22+is%3Aclosed  
* [https://github.com/mozilla/addons-frontend/issues?q=label%3A%22mobile+pages+v1%22+label%3A%22verified+fixed%22+is%3Aclosed Verified Fixed V1]


</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
====== Logged bugs ======
<div class="mw-collapsible-content">
* [https://github.com/mozilla/addons-server/issues/4217 4217] - Beta-channel tooltip from beta-version submission step is not aligned
* [https://github.com/mozilla/addons-server/issues/4220 4220] - Different format for beta versions used in Add-ons and WebExtensions
* [https://github.com/mozilla/addons-server/issues/4226 4226] - "Review History" links for beta versions are useless
* [https://github.com/mozilla/addons-server/issues/4269 4269] - "Incomplete" status for unlisted add-ons in Dev Hub homepage
* [https://github.com/mozilla/addons-server/issues/4282 4282] - Click on incomplete status redirects to final step of submission
* [https://github.com/mozilla/addons-server/issues/4488 4488] - Handle duplicate version better
* [https://github.com/mozilla/addons-server/issues/4491 4491] - No source-code file available anywhere if added during new file submission
* [https://github.com/mozilla/addons-server/issues/4394 4394] - "Completed" add-on is displayed as incomplete 
* [https://github.com/mozilla/addons-server/issues/4302 4302] - Misleading info while adding a second beta-listed version for an unlisted add-on 
* [https://github.com/mozilla/addons-server/issues/4420 4420] - Blocking submission for second listed version in 6 steps 
* [https://github.com/mozilla/addons-server/issues/4427 4427] - Beta add-on asking for resume after deleting first listed version 
* [https://github.com/mozilla/addons-server/issues/4479 4479] - 500 error page is loaded while unlisted version number is clicked from Admin Manage page 
* [https://github.com/mozilla/addons-server/issues/4484 4484] - Search in "All Unlisted Add-ons" is not working for add-on with mixed versions if first version is unlisted 
</div></div>
</div></div>


Latest revision as of 13:26, 6 July 2017

Overview

New AMO Mobile design(applied for Desktop Mobile view too) with a modern and simplified look, oriented to users and ease of utilization.

Purpose

A more attractive AMO page with a more easy and intuitive way to install and search for Add-ons and Themes

Entry Criteria

Mobile release is set for March 9th.

Current status

  • The feature is partially in -dev . Still under development

Exit Criteria

  • All related bugs triaged
  • All blockers fixed
  • All resolved bugs verified by QA
  • Found-fixed bugs rate going down in time

Scope

what's in scope?

  • AMO mobile appearance
  • Behavior of AMO mobile in logged in \ logged out states
  • Install\Uninstall of Add-ons and Themes
  • Search for Add-ons and Themes. Sorting the search results. Search suggestions.
  • Add-on and Themes reviews and ratings
  • Add-ons and Themes categories
  • AMO mobile pages in different languages and RTL view
  • Collections - not sure if this will be implemented but is present on mocks
  • Versions availability in AMO mobile public pages
  • Themes preview
  • User settings
  • Page errors

what's out of scope?

  • Add-ons functionality
  • Translations in different languages . This will not exclude testing on another languages for UI issues related to different length of strings

Ownership

Product Manager: Matthew Riley MacPherson; irc nick :tofumatt
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Add-ons QA: Rares Macarie; irc nick :RaresM
Add-ons QA: Cosmin Badescu; irc nick :CosminB

Requirements for testing

Environments

  • Android phone, tablets

Servers

Channels

Test Strategy

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 11.01.2016
Study PRD/mocks received 11.01.2017
QA - Test plan creation 30.01.2017 31.01.2017
QA - Test cases preparation 30.01.2017 01.02.2017
QA - Test cases execution 01.02.2017 08.03.2017
Release Date 09.03.2017

Testing Tools

Process Tool
Test plan creation Mozilla wiki
Test case creation [TBD TestRail] / Google docs
Test case execution [TBD TestRail]
Bugs management Github

References

* PRD - https://mozilla.invisionapp.com/share/GY8O3Z4ZE#/screens

Testcases

Test Areas

  • AMO Mobile

Test suite

Gdoc Test suite - Link
TestRail - TBD

Bug Work

Bug fix verification

Sign off

Criteria

Check list

  • All test cases should be executed
  • All blockers must be fixed and verified or have an agreed-upon timeline for being fixed
Retrieved from "https://wiki.allizom.org/index.php?title=Add-ons/QA/Testplan/NewAMOMobile&oldid=1175147"