Releases/Firefox 17/Test Plan

« Firefox 16 | Firefox 17 | Firefox 18 »

Firefox 17 Test Plan

Summary

Milestone	Firefox 17
Status	Currently in ' -- merging to Aurora on August 27, 2012
Lead	Anthony Hughes (irc: ashughes)
2nd	Juan Becerra (irc: juanb)
Builds	[ftp] [http] [web]

The following is the test plan for Firefox 17 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 17. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Details

The following is a description of the tasks which need to be completed throughout this release.

• 2012-07-16: {{|}} Nightly Merge
• 2012-08-27: {{|}} Aurora Merge
• 2012-10-08: {{|}} Pre-Beta feature sign-offs
• 2012-10-11: {{|}} Beta 1
• 2012-10-18: {{|}} Beta 2
• 2012-10-25: {{|}} Beta 3
• 2012-11-01: {{|}} Beta 4
• 2012-11-08: {{|}} Beta 5
• 2012-11-15: {{|}} Beta 6
• 2012-11-19: {{|}} Release Candidate
• 2012-11-20: {{|}} Final

Nightly

Merge

Functional Automation - result

Update Spotchecks - result

Features

See the Feature Release Tracking wiki for a general overview

Features

See the Feature Release Tracking wiki for a general overview

Feature	Owner	Status	Tests
Silent Update: Updated workflow for users with incompatible add-ons	Ioana Budnar	Risk, might be delayed.

Endurance Automation

The purpose of this section is to track any potential memory regressions via spikes reported in the dashboard.

What to Do

1. Check the Charts
2. If you see an anomalous event (ie. spike or dip), get the report for the specific event
3. If the event happens twice in a row, file a bug under Mozmill Tests
4. Notify Anthony Hughes of the issue
5. Record the event in this wiki below

Current Status (Mihaela Velimiroviciu) - Last Updated

Bugzilla query error

Query options must be valid JSON.1

Functional Automation

The purpose of this section is to track any potential functional regressions via results reported in the dashboard.

What to Do

1. Check the testrun reports
2. If you see any failing tests, check that there are not any bugs on file for it already
3. If not, file a bug under Mozmill Tests
4. Notify Anthony Hughes of the issue
5. Record the event in this wiki below

Current Status (Vlad Maniac / Alex Lakatos) - Last Updated

Bug Triage

The purpose of this section is to triage UNCONFIRMED incoming bugs.

What to Do

1. Check the UNCONFIRMED bugs
2. Test the bugs in the latest Firefox Nightly
3. If you can't reproduce the bug, ask for the reporter to provide more information
4. If you reproduce the bug, add your testing information and mark the bug NEW
5. Notify Anthony Hughes of the NEW issue

Current Status (Vlad Ghetiu / Virgil Dicu) - Last Updated

Result Spreadsheet

Aurora Merge

The following are the detailed results of the automated BFT test runs.

Platform	Result: report
Windows 2000	Result
Windows XP	Result
Windows Vista	Result
Windows 7 32-bit	Result
Windows 7 64-bit	Result
Mac OS X 10.6	Result
Mac OS X 10.7	Result
Ubuntu 11.04 32-bit	Result
Ubuntu 11.04 64-bit	Result

Issues Found

Updates

The following are details of update verifications for Firefox 15 merge to Aurora

Auroratest

• {{|}} [tester] Windows XP:
• {{|}} [tester] Windows 7:
• {{|}} [tester] Mac OS X 10.6:
• {{|}} [tester] Ubuntu 11.04:

Aurora

• {{|}} [tester] Windows XP:
• {{|}} [tester] Windows 7:
• {{|}} [tester] Mac OS X 10.6:
• {{|}} [tester] Ubuntu 11.04:

Issues Found

Manual Spot Checks and Feature Sign-Off

Are all features implemented at this point working?

Manual spot Checks [spreadsheet]

• Platforms: Windows XP, Windows 7 x64, Ubuntu 11.10, Mac 10.6
• Found known issues:
• New issues:
• Status: