QA/Fennec/iOS/1.0: Difference between revisions
(Created page with "<small>QA/Fennec/iOS</small> = QA Test Strategy & Test Plan - Fennec (Firefox) for iOS 1.0 = == Overview == This is a tracking document that outlines the...") |
mNo edit summary |
||
| Line 16: | Line 16: | ||
We will need core expertise and unique community involvement needed which will be applicable for iOS testing. There will be core issues to tackle that are not specific to devices and can be done by anybody on the team or by anyone who has expressed interest in the community. | We will need core expertise and unique community involvement needed which will be applicable for iOS testing. There will be core issues to tackle that are not specific to devices and can be done by anybody on the team or by anyone who has expressed interest in the community. | ||
== Areas Covered == | |||
* [[QA/Fennec/iOS/1.0#Feature_Tests| Featured Areas Tests]] | |||
* [[QA/Fennec/iOS/1.0#Web_Compatibility_Tests| Web Compatibility Tests ]] | |||
* [[QA/Fennec/iOS/1.0#User_Performance_Tests| User Performance Tests ]] | |||
* [[QA/Fennec/iOS/1.0#Configurations_Tests| Configurations Tests ]] | |||
* [[QA/Fennec/iOS/1.0#Security_Tests| Security Tests ]] | |||
* [[QA/Fennec/iOS/1.0#Accessibility_Tests| Accessibility Tests ]] | |||
* [[QA/Fennec/iOS/1.0#Bug_Verifications| Bug Verifications ]] | |||
* [[QA/Fennec/iOS/1.0#Distribution_Tests| Distribution Tests]] | |||
* [[QA/Fennec/iOS/1.0#L10N_Tests| L10N Test Deliverables]] | |||
* [[QA/Fennec/iOS/1.0#Install.2FUpdates_Tests| Updates Test ]] | |||
* [[QA/Fennec/iOS/1.0#Regression_Tests| Regression Tests]] | |||
== Areas not Covered == | |||
* Feature Unit Tests | |||
** These are normally covered by feature developers, not QA. We are open to discussion about what we could do in QA to increase Unit Tests other than what automation currently exists. Need more definition here on what QA/Dev should own. | |||
* String Localization Tests | |||
** See more in the L10n Test Deliverable section. | |||
== Schedule == | |||
The release schedule is broken up by milestones, determined by the Fennec team. Each milestone will contain feature enhancements, bug fixes, and updates. Most testing of focused areas and regression areas will come in the latter half of the schedule, during the latter parts of alpha up until the final release candidate. | |||
NOTE: We are going to branch from GitHub to create a follow-up 1.0.x and 2.x branch which we will ship future releases from. | |||
Revision as of 18:18, 10 August 2015
QA Test Strategy & Test Plan - Fennec (Firefox) for iOS 1.0
Overview
This is a tracking document that outlines the test strategy that Mozilla QA will follow regarding a thorough test pass of Fennec for iOS releases. It will follow the general plan on steps and process that QA will take to accomplish a "sign off" to the release strategy. Mozilla QA strives to uphold quality software, and a successful pass corresponds to no blocking issues, 'Green'-colored test pass on test cases in both execution and automation, and a thorough bug verification window of all Blocking bugs and Critical bugs.
NOTE: Updates to this document continue to change as Mozilla continues to refine development process.
Fennec Testing
As Fennec for iOS is a new project with Mozilla a lot of the test effort early on is to set up infrastructure, define basic processes, build up a QA team and community, and participate in early on decisions that shape the future of the project.
One big issue with Fennec for iOS is our limitations with build and device availability (re: Apple) that is unlike that of Android.
We will need core expertise and unique community involvement needed which will be applicable for iOS testing. There will be core issues to tackle that are not specific to devices and can be done by anybody on the team or by anyone who has expressed interest in the community.
Areas Covered
- Featured Areas Tests
- Web Compatibility Tests
- User Performance Tests
- Configurations Tests
- Security Tests
- Accessibility Tests
- Bug Verifications
- Distribution Tests
- L10N Test Deliverables
- Updates Test
- Regression Tests
Areas not Covered
- Feature Unit Tests
- These are normally covered by feature developers, not QA. We are open to discussion about what we could do in QA to increase Unit Tests other than what automation currently exists. Need more definition here on what QA/Dev should own.
- String Localization Tests
- See more in the L10n Test Deliverable section.
Schedule
The release schedule is broken up by milestones, determined by the Fennec team. Each milestone will contain feature enhancements, bug fixes, and updates. Most testing of focused areas and regression areas will come in the latter half of the schedule, during the latter parts of alpha up until the final release candidate.
NOTE: We are going to branch from GitHub to create a follow-up 1.0.x and 2.x branch which we will ship future releases from.