B2G/QA/WebAPI Test Plan/Simple Push: Difference between revisions

← Older edit

B2G/QA/WebAPI Test Plan/Simple Push (view source)

Revision as of 16:58, 11 July 2013

1,744 bytes added , 11 July 2013

→‎Test Case Management

Jsmith

Confirmed users

2,959

edits

@@ Line 6: / Line 6: @@
 === In Scope ===
-==== Functionality ====
 * Simple Push DOM API testing with reference push server on target release devices (e.g. leo)
 * Sanity testing around Simple Push API integrating with a target push server for a Firefox OS release
-==== Software Qualities ====
-*
 === Out of Scope ===
@@ Line 22: / Line 16: @@
 == Testing Lifecycle ==
+=== Overview ===
+This section provides an overview of the lifecycle of testing of the Simple Push API on Firefox OS.
+=== DOM API and Reference Push Server Testing ===
+==== Summary ====
+End to end testing of the Simple Push API against the reference push server.
+==== Signoff Criteria ====
+* Full test pass of planned test cases executed against target release device
+* All blocker bugs fixed and verified
+=== Reference App End to End Automation ===
+==== Summary ====
+Create a reference app that run through a bunch of Simple Push API tests on device in an automated manner and report pass/fail results. This app should be able to run any device Firefox OS is supported on.
+==== Signoff Criteria ====
+* Completion of development of a reference app that can through a suite of Simple Push tests in an automated manner
+* All tests passing in the reference app on target release devices
+=== DOM API Mochitests ===
+==== Summary ====
+Development of mochitests to cover basic Simple Push API scenarios on Firefox OS.
+==== Signoff Criteria ====
+Smoke tests for the Simple Push API have been built as mochitests and checked into mozilla central.
 == Infrastructure ==
+* Mochitest development will require a local server to be built to run the mochitests against in buildbot
 == Test Case Management ==
-== Open Questions ==
+* End to end test cases are defined [https://docs.google.com/a/mozilla.com/spreadsheet/ccc?key=0AnuFvnBOJD0CdG8zQXNsQ0ZNSm9jb203QklCeDl1dWc#gid=0 here]
+* MozTrap test cases will be written for regression tests using the reference app automation
+* Other test cases not covered in MozTrap will be maintained here and ran as needed
 == Resources ==
+* [https://etherpad.mozilla.org/simplePush-questions Open Questions]
+* [https://wiki.mozilla.org/WebAPI/SimplePush Simple Push API Information]
+* [https://wiki.mozilla.org/WebAPI/SimplePush/Protocol Simple Push Protocol Information]