QA/Firefox:8

From MozillaWiki
< QA
Jump to: navigation, search

« mozilla-beta:fx6 | Firefox 7 | Firefox 8 | Firefox 9 »

Firefox 8 Test Plan

Summary

Milestone <thead> </thead> <tbody> </tbody>
Firefox 8
Status
Currently in Nightly -- merging to Aurora on August 16th, 2011
-
Lead
Anthony Hughes (irc: ashughes)
-
2nd
Juan Becerra (irc: juanb)
}

Latest Build: ftp, http, web

The following is the test plan for Firefox 8 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 8. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Details

Task Owner Status <thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:10%" Frequency
[[QA/Firefox:8#Automation Automation]]
Check dashboards for new failures
Softvision
{{ok 2011-08-xx}}
DAILY
-
[[QA/Firefox:8#Bug_Triage Bug Triage]]
Check Bugzilla for regressions
Softvision
{{ok 2011-08-xx}}
DAILY
-
[[QA/Firefox:8#Features Feature Sign-off]]
Final sign-off of features
various
{{ok 2011-08-xx}}
ONCE
-
[[QA/Firefox:8#Aurora_Merge_Sign-off Merge Sign-off]]
Merge From Nightly to Aurora
ashughes
Due 2011-08-16
ONCE
}

Automation

Summary <thead> </thead> <tbody> </tbody>
Triage the Mozmill dashboard for test failures and debug for potential Firefox regressions.
Status
NEW (8), ASSIGNED (6), FIXED (3), REGRESSIONS (0) -- last updated 2011-08-01
-
Lead
Vlad Maniac (Softvision)
-
2nd
Alex Lakatos (Softvision)
}
Tasks
  • Check the Mozmill dashboard for failing tests for the day
  • Cross reference any failure to the list of NEW and ASSIGNED bugs
    • If the bug is NEW, assign it to yourself and try to fix it
    • If the bug is ASSIGNED and there has been no activity on the bug in over a week, offer your assistance to fix the bug
    • If there is NO bug on file, file it using this template
  • If you need assistance, ask ashughes in the #mozmill channel

Bug Triage

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
-
Status
Triage on-going, (2011-xx-xx)
-
Owner
Softvision
-
Bugs (As of 2011-08-03: Please update links)
UNCONFIRMED, FIXED, TRACKING/STATUS, Waverley UNCONFIRMED Spreadsheet, Waverley FIXED Spreadsheet
}
Important Bugs Not Captured Elsewhere
Notes

Features

Track features which have landed in Firefox 7 and are ready to be tested. Check the Flight Tracking page for more information on feature readiness.

Sharing textures cross-process for Electrolysis

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
-
Status
-
Owners
DEV: Chris Jones, QA: George Carstoiu
-
Links
Feature Page, Tracking Bug
-
}

Console Object Completion

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
-
Status
-
Owners
DEV: Kevin Dangoor, QA:
-
Links
Feature Page, Status page
-
}

Confirm on Upgrade

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
-
Status
???
-
Owners
DEV: Mossop, QA:
-
Links
[testplan], Project Page
}

Console Queued Message Display

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
-
Status
-
Owners
DEV: Kevin Dangoor, QA:
-
Links
Feature Page, Status page
-
}

Expose Add-On Performance Information in Firefox

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
-
Status
-
Owners
DEV: Justin Scott, QA:
-
Links
Feature Page
-
}

Code Editor

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
-
Status
Patches in review
-
Owners
DEV: Kevin Dangoor, QA:
-
Links
Feature Page, Status page
-
}

In-content UI Visual Unification

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
-
Status
Initial work landed; getting reviews and converting additional pages
-
Owners
DEV: Blair McBride, QA:
-
Links
Feature Page
-
}

Ensure User Accepts Add-Ons Installed by Third-Party Apps

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
-
Status
-
Owners
DEV: Dave Townsend, QA:
-
Links
Feature Page
-
}

Tab Move/Detach Animations

<thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:90%"
Summary
Tab animations when user moves or detaches a tab
-
Status
Landed
-
Owners
DEV: Alex Limi QA:
-
Links
Feature Page
-
}
Notes

Aurora Merge Sign-off

Task Owner <thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:20%" Status
Automated BFTs
TBD
-
Smoketests
Softvision
TBD
-
Feature Spotchecks
Softvision
TBD
-
Bug Verifications
Softvision
TBD
-
Updates
TBD
}

Builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/ (Firefox 8.0a2)
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=315

Automated BFTs

Platform Functional Restartresult <thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:20%" Result
Windows 2000
report
report
result
-
Windows XP
report
report
result
-
Windows Vista
report
report
result
-
Windows 7
report
report
result
-
Windows 7 64-bit
report
report
result
-
Mac OS X 10.6
report
report
result
-
Mac OS X 10.7
report
report
result
-
Ubuntu 11.04
report
report
result
-
Ubuntu 11.04
report
report
result
}
Issues Found

Smoketests

Platform Tester <thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:20%" Result
Windows 2000
Simona
result
-
Windows XP
AndreiD
result
-
Windows Vista
Simona
result
-
Windows 7
VladG
result
-
Windows 7 64-bit
AndreiD
result
-
Mac OS X 10.6
VladG
result
-
Ubuntu 10.10
George
result
-
Ubuntu 10.10 64-bit
George
result
}

Litmus: testrun, report, builds

Issues Found

Feature Spotchecks

Feature Tester <thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:30%" Result
Sharing textures cross-process for Electrolysis
-
Console Object Completion
-
Confirm Add-Ons on Upgrade
-
Console Queued Message Display
-
Expose Add-On Performance Information in Firefox
-
Code Editor
-
In-content UI Visual Unification
-
Ensure User Accepts Add-Ons Installed by Third-Party Apps
-
Tab Move/Detach Animations
-
}
Issues Found

Bug Verifications

Issues Found

Updates

Platform Builds Auroratest <thead> </thead> <tbody> </tbody>
style="background:#EFEFEF; width:10%" Aurora
Windows XP
Firefox/7.0a2 -> Firefox/8.0a2
result
result
-
Windows 7
result
result
-
Mac OS X 10.6
result
result
-
Mac OS X 10.7
result
result
-
Ubuntu 11.04
result
result
}
Issues Found