MozillaWiki

B2G/QA/Gaia Test Plan/Template: Difference between revisions

Page Discussion

B2G/QA/Gaia Test Plan/Template (view source)

Revision as of 22:31, 29 January 2016

224 bytes added ,  29 January 2016
port naoki's test plan template
(Created page with "1. Introduction 1.1 Purpose: See https://wiki.mozilla.org/Gaia/Clock � 2. Resource Plan 2.1 People on Project Role Owner Dev refer to : https://wiki.mozilla.org/Modules/F...")
 
(port naoki's test plan template)
 
Line 1: Line 1:
1. Introduction
== Introduction ==
1.1 Purpose:
=== Purpose ===
See https://wiki.mozilla.org/Gaia/Clock
See https://wiki.mozilla.org/Gaia/<app name, i.e. Clock>


�
== Resource Plan ==
=== People on Project ===


2. Resource Plan
{| class="wikitable"
2.1 People on Project
|-
 
! Role !! Owner
Role
|-
Owner
| Dev || https://wiki.mozilla.org/Modules/FirefoxOS
Dev
|-
refer to : https://wiki.mozilla.org/Modules/FirefoxOS
| QA || https://wiki.mozilla.org/B2G/QA_Overview#Team_Members
QA
|-
refer to :
| UX || https://wiki.mozilla.org/Gaia/UXTeam
https://wiki.mozilla.org/B2G/QA_Overview#Team_Members
|}
UX
see https://wiki.mozilla.org/Gaia/UXTeam


=== HW/SW Specification/Requirements ===
HW:
* Testing will be conducted on the Aries (Sony Compact Z3C) and the Flame device.
* Headphones; 2 and 3 prong types : see https://en.wikipedia.org/wiki/Phone_connector_%28audio%29#TRRS_standards
* Headphones; bluetooth w/ AVRCP : https://en.wikipedia.org/wiki/List_of_Bluetooth_profiles#Audio.2FVideo_Remote_Control_Profile_.28AVRCP.29


2.2 HW/SW Specification/Requirements:
== Test Strategy ==
HW:
=== Major Test Area Strategy ===
Testing will be conducted on the Aries (Sony Compact Z3C) and the Flame device.
* Unit test
Headphones; 2 and 3 prong types : see https://en.wikipedia.org/wiki/Phone_connector_%28audio%29#TRRS_standards
** Dev driven : https://github.com/mozilla-b2g/gaia/tree/master/apps/<clock>/test/unit
Headphones; bluetooth w/ AVRCP : https://en.wikipedia.org/wiki/List_of_Bluetooth_profiles#Audio.2FVideo_Remote_Control_Profile_.28AVRCP.29
* Smoke test
** https://moztrap.mozilla.org/manage/cases/?filter-suite=241 ( Done daily)
** Specific smoke tests : https://moztrap.mozilla.org/manage/case/1772/
* Manual Functionality test
** https://moztrap.mozilla.org/manage/cases/<suite id>
** Exploratory testing : <mapping link>
** Test cases based on ACC
* Automation Integration test
** https://github.com/mozilla-b2g/gaia/tree/master/apps/<clock>/test/marionette
* Automation End-to-end tests
** https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests/gaiatest/tests/functional/<clock>
* Security test :
** security team does the testing : https://wiki.mozilla.org/Security/Reviews/Gaia/clock
* Stress test :  
** No current stress test
** Possible to add to MTBF :
*** https://wiki.mozilla.org/QA/Automation/Projects/MTBF
*** https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Automated_testing/MTBF_tests
* Performance test
** Raptor testing
*** https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Automated_testing/Raptor
*** dashboard : https://raptor.mozilla.org/
* l10n test
** RTL : https://moztrap.mozilla.org/manage/cases/?filter-suite=974


=== Test Deliverables ===
* Test Cases
** Outcome of test case runs:
*** Maybe wiki the test run and have a link in the email and paste in here?


=== Dependencies/Risk ===
* Dependencies on SNTP (default settings) : http://mxr.mozilla.org/mozilla-central/source/b2g/app/b2g.js#928
* Possibly with QC’s XPCOM for some QC hardware; May need to configure QC file
* Dependencies on settings app
* Dependencies on system clock


=== Scope ===
* In scope:
** <app> application and interactions with the system.
* Out of scope :
** underwater testing


=== Signoff/Exit Criteria ===
* zero blocker bugs for 2.6
* ui-review +


�
== References ==
3. Test Strategy
=== Repositories ===
3.1 Major Test Area Strategy:
Unit test
Dev driven : https://github.com/mozilla-b2g/gaia/tree/master/apps/clock/test/unit
Smoke test
https://moztrap.mozilla.org/manage/cases/?filter-suite=241 ( Done daily)
Specific smoke tests : https://moztrap.mozilla.org/manage/case/1772/
Manual Functionality test
https://moztrap.mozilla.org/manage/cases/?filter-suite=684
Exploratory testing : <mapping link>
Test cases based on ACC
Automation Integration test
https://github.com/mozilla-b2g/gaia/tree/master/apps/clock/test/marionette
Automation End-to-end tests
https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests/gaiatest/tests/functional/clock
Security test :
security team does the testing : https://wiki.mozilla.org/Security/Reviews/Gaia/clock
Stress test :
No current stress test
Possible to add to MTBF :
https://wiki.mozilla.org/QA/Automation/Projects/MTBF
https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Automated_testing/MTBF_tests
Performance test
Raptor testing
https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Automated_testing/Raptor
dashboard : https://raptor.mozilla.org/
l10n test
RTL : https://moztrap.mozilla.org/manage/cases/?filter-suite=974
3.2 Test Deliverables:
Test Cases
Outcome of test case runs:
Maybe wiki the test run and have a link in the email and paste in here?
3.3 Dependencies/Risk:
dependencies on SNTP (default settings) : http://mxr.mozilla.org/mozilla-central/source/b2g/app/b2g.js#928
possibly with QC’s XPCOM for some QC hardware; May need to configure QC file
dependencies on settings app
dependencies on system clock
3.5 Scope:
In scope:
clock application and interactions with the system.
Out of scope :
underwater testing
3.4 Signoff/Exit Criteria:
zero blocker bugs for 2.6
ui-review +
4. References
4.1 Repositories:
Gaia : https://github.com/mozilla-b2g/gaia/tree/master/apps/clock
Gaia : https://github.com/mozilla-b2g/gaia/tree/master/apps/clock
4.2 Bugs tracking features:
=== Bugs tracking features ===
No new features in 2.6
No new features in 2.6
4.3 Specs/Design Diagrams:
=== Specs/Design Diagrams ===
https://mozilla.app.box.com/applications/1/864504610
https://mozilla.app.box.com/applications/1/864504610
4.4 Scrum :
=== Scrum ===
No scrum for Clock
No scrum for Clock
4.5 Meeting Notes:
=== Meeting Notes ===
No meetings for Clock
No meetings for Clock
4.6 Supplemental Documentation
=== Supplemental Documentation ===
4.6.1 Terminology
==== Terminology ====
4.7 Project Schedule
=== Project Schedule ===
https://wiki.mozilla.org/Firefox_OS/Releases/2.6
https://wiki.mozilla.org/Firefox_OS/Releases/2.6
4.8 Test Outline
=== Test Outline ===
https://public.etherpad-mozilla.org/p/test-outline-clock
https://public.etherpad-mozilla.org/p/test-outline-clock
4.9 Test Cases
=== Test Cases ===
4.9.1 Clock ACC Matrix  
==== Clock ACC Matrix ====
https://docs.google.com/spreadsheets/d/1Tk8xW2oT9qvs5cFXf5XMGnEnWDAmgKINtWJU_USpRNo/edit#gid=0
https://docs.google.com/spreadsheets/d/1Tk8xW2oT9qvs5cFXf5XMGnEnWDAmgKINtWJU_USpRNo/edit#gid=0


4.9.2 Moztrap Test Cases
==== Moztrap Test Cases ====
https://moztrap.mozilla.org/manage/cases/?filter-suite=684
https://moztrap.mozilla.org/manage/cases/?filter-suite=684


5. Glossary:
== Glossary ==
Npark
352

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/1115002"