QA/Fennec/Milestones/5.0a1
Fennec 5.0 Nightly Test Plan
Overview
The goal of this Overall Test Plan is to lay out our testing strategy, determine who will own certain test areas and when they will do it and, finally, track the status. All of our releases are tested off of the "Fennec 5.0 Nightly Catch-All Test Run" on the Litmus TCM. For more information about Fennec 5.0, take a look at the mobile team's Feature Planning page.
Project contacts
PM: Thomas Arend (tarend)
Dev Lead: Stuart Parmenter (stuart)
Build: John Oduinn (oduinn)
QA: Aakash Desai (aakashd)
Schedule
- Start Date: 4/04/2011
- End Date: 4/11/2011
Bugs in Release
Build Location and IDs
- Go to the nightly builds folder in our ftp directory
- Go to the "latest-mozilla-central" folder
- Download and install the candidate onto your Android phone/device
Test Areas
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Waverley | Daily |
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 5.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
Results details can be found in Waverley's results wiki.
BFTs for 5.0 Features
| QA Task | Person/Group | How Often? |
| BFTs | Waverley | Daily |
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 2.0. Tests are available on litmus under the Fennec 2.0 Test Suite.
Results details can be found in ...
OS Integration
| QA Task | Person/Group | How Often? |
| OS Integration | Waverley | Weekly |
The OS Integration testsuite is a set of tests that encompass device-level and operating-system-level tests for the Android platform. In terms of criteria, they will determine a quality criteria for pass or failure of the system level characteristics of the application. Results can be found in the waverley results wiki.
Fixed Bugs Verifications
| QA Task | Person/Group | How Often? |
| Bug Verification | Waverley | Daily |
The following link contains a list of bugs that are fixed for 6.0 and need verifications:
- Fixed Firefox Mobile 5.0a2 bugs (even verified bugs) should be checked to make sure the fix landed in the Mobile-5.0 Aurora tree.
Crasher Triage
| QA Task | Person/Group | How Often? |
| Crasher Triage | mw22 | Daily |
Bug Triage
| QA Task | Person/Group | How Often? |
| Bug Triage | MoCo Team | Weekly |
Testday
| QA Task | Person/Group | How Often? |
| Testday | kbrosnan | Once |