Template
- To be edited as necessary
Introduction
- Brief description of the area/feature(s) covered by this document.
The primary purpose here is provide enough information about this functional area to a new person that they will be able to achieve a basic understanding of the feature and provide links to the any documentation or engineering docs for further reading is needed. If this is a new feature include which release it is targeted at.
Testing Approach
- High level overview of the testing methodologies used in each type of testing done for this project (Manual and Automated)
The purpose of this section is provide guidance on how this area can be tested and what methodologies are most likely to be productive. For example when testing WebRTC the approach for manual testing would be to initiate calls connections between to clients and verify audio and video quality. The automated approach would be to use predictable data sources for audio and video steams allowing you to preform data analysis on the call statistics. Additionally you will want to provide some guidance on what can and can not be tested.
Include:
- Examples of things to watch for.
- What are some of common errors and issues that this testing is targeted at finding
- Filing Bugs
- How are bugs reported.
- What component(s) should they be filed under
- Define keywords, whiteboard tags and other flags or verbage that is expected to be used when reporting bugs
Get Involved
- How can volunteers and community members become involved in this project.
- Links to One and Done tasks
- Links to Moztrap tests
- Good First Verify in bugzilla
- Links to any tutorials and other QA introductory material
- Contact information and Meetings schedules and information on how to join
Requirements
- What are the minimum requirements for becoming involved (Hardware, Software, Skills)
- Describe the required test environment and provide instructions on how to create it.
- If special skills are required, provide links to any tutorials that may be available on the subject.
- If special hardware is required, provide steps on how to verify that the testers systems meet the minimum requirements.
Related Prefs
- Define any preferences or about:config options that are related to the behavior of this area
Describe what pref or option does and what values should be used and how they will change the behavior of the browser. Be sure to include what the default value should be.
Related Features
- What other features are either directly related too or can be affected by changes made to this feature.
For instance, changes to the javascript engine can have effects on emscipten and asm.js. WebRTC has dependencies on graphics (Open H.264) and Networking.
Test Cases
- Define the test cases required to test this feature/area.
Include which tests can and should be automated, which framework used and how often the should be executed. * Provide link to repository(ies) for automated tests.
- Smoke
- Describe basic smoke tests required to prove minimum acceptance
- Functional
- List each major functional area to be tested and basic concepts for testing
- End-to-end User Stories
- Describe primary use cases
- Exploratory
- Describe some related areas and user stories that may be useful to explore
Bug Triage
Document any bug triage meetings and/or processes, including priorities:
- unconfirmed bugs
- development bugs
- fixed bugs
- regressions
- tracking bugs
- blocking bugs
Risks
- What are the primary areas of risk involved in this area.
For example Graphics has the risk of not being to have a broad enough test bed to provide coverage for edge case testing and may result in unexpected behavior when released to a wider audience.
Reporting and Status
- Describe how are test results reported and provide links to any automated test reports or dashboards.
- List milestones and current progress
- Include bug queries for tracked bugs
- Sign-off status for each release tested.