QA/Fennec/draft mihai 2: Difference between revisions
Jump to navigation
Jump to search
Full Query
| Line 56: | Line 56: | ||
* bugs to track the Presentation API feature | * bugs to track the Presentation API feature | ||
* https://bugzilla.mozilla.org/showdependencytree.cgi?id=1184036&hide_resolved=0 | * https://bugzilla.mozilla.org/showdependencytree.cgi?id=1184036&hide_resolved=0 | ||
* meta bug: {{Bug|1184036}} - (1-UA_Presentation_API) [meta] 1-UA support for Presentation API | |||
ex: | ex: | ||
<onlyinclude> | <onlyinclude> | ||
Revision as of 15:56, 14 November 2016
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that Presentation API is correctly implemented.
Ownership
Developer contact: Shih-Chiang Chien (:schien)
Overall Status
[pending] Nightly 53: it's going to be prefed on, on 15-11-2016
Testing Summary
Scope of testing
The testing will be focusing on:
- Verify that the manual tests made by W3C for presentation API pass
- Monitor crash rate, stability, and power consumption
- Check that no important issues are regressing from the feature work
Environments
Testing will be performed on following devices:
- Nexus Player
- Chromecast
- Phones and Tablets
- Android 4.4+
Specifications
User stories
- Use cases and requirements for Presentation API
Acceptance Criteria
- The feature does not introduce new regressions that affect performance and stability
- All w3c tests pass
==KPIs / Measurements Used:
- Qualitative:
- No negative feedback from users
Testing details
- Environment:
- Receiver (Presentation Display): "Nexus Player + TV" or "Chromecast +TV" - Sender: Android device with Android 4.4 or higher - Fennec Build: https://people-mozilla.org/~schien/presentation-api/fennec-52.0a1.en-US.android-arm.apk
- Test cases(Latest test result: 14.11.2016):
- https://docs.google.com/spreadsheets/d/1uub8yabL0-_7TUaBPZ7sbhqYNcn936IYQSU6vNhMULY/edit#gid=1378915478 - All tests passed except a known w3c issue, and 2 tests are Not Applicable - https://docs.google.com/spreadsheets/d/1xfbFJw2nfSAL3Bd4LIXMkdUseI1Cq3aZW8ZrDmU5Hc4/edit#gid=284504573 - 11/12 tests PASSED
Bug Work
Tracking bugs
- bugs to track the Presentation API feature
- https://bugzilla.mozilla.org/showdependencytree.cgi?id=1184036&hide_resolved=0
- meta bug: bug 1184036 - (1-UA_Presentation_API) [meta] 1-UA support for Presentation API
ex:
84 Total; 1 Open (1.19%); 78 Resolved (92.86%); 5 Verified (5.95%);
Signoff
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- Not landed yet
Aurora testing
- Not landed yet
Beta testing
- Not landed yet