QA/Firefox3.5/TestPlan: Difference between revisions
< QA | Firefox3.5
Jump to navigation
Jump to search
| Line 10: | Line 10: | ||
=== Blocking Beta 2 Issues === | === Blocking Beta 2 Issues === | ||
* (tchung) {{Bug|407875}} - Unprivileged users are not notified of security updates | |||
** Flagged for beta 2, but no patch in sight yet. | |||
* (bc) {{Bug|458857}} - TM: "Assertion failure: ngslots == tm->globalTypeMap->length()" with gc and generator as getters | * (bc) {{Bug|458857}} - TM: "Assertion failure: ngslots == tm->globalTypeMap->length()" with gc and generator as getters | ||
** blocking flag, needs a patch | ** blocking flag, needs a patch | ||
Revision as of 00:42, 8 November 2008
Top Critical issues for QA
This is a working list that QA is using to request be fixed or completed for the Upcoming Fx3 Milestones.
If you have untracked issues in these areas, please enter them here:
- Design still incomplete?
- Major bugs blocking your feature that should be addressed?
- Major bugs blocking overall regression of the trunk that should be fixed before shipping?
Blocking Beta 2 Issues
- (tchung) bug 407875 - Unprivileged users are not notified of security updates
- Flagged for beta 2, but no patch in sight yet.
- (bc) bug 458857 - TM: "Assertion failure: ngslots == tm->globalTypeMap->length()" with gc and generator as getters
- blocking flag, needs a patch
- (bc) bug 451843 - Running Dijit Tree Test with Content JIT enabled causes the TreeView not to appear.
- TM is b2, but no one assigned to it yet. Might need to be punted to next milestone
- (bc) bug 457660 - js1_8/genexps/regress-380237-01.js: InternalError: too much recursion (64bit)
- TM is b2, but no one assigned to it yet. Might need to be punted to next milestone
- (Marcia)
bug 411929 - Private Browsing UI- Resolved Fixed, in testing now
- (Marcia)
bug 248970 - (PrivateBrowsing) Private Browsing mode (global toggle for saving/caching everything).- Resolved Fixed, in testing now
- (Marcia)
bug 436304 - Implement "All Tabs" panel with previews- Resolved Fixed, in testing now
- (Marcia)
bug 456088 - Ctrl+Tab / All Tabs revision- Resolved Fixed, in testing now
Blocking Next Milestone and Beyond
- (bc) bug 445178 - (decimal) Implement ES 3.1 Decimal Support
- Blocking flag set
- (ctalbert) bug 459148 - SVG curves are drawn differently than curves drawn by the CSS system
- Testcase development blocked by pixel rounding issues. No blocking flag requested yet
- (ctalbert) bug 458169 - implement downloadable font support on Linux
- Blocking flag set, Assigned, but no work yet
- (juanb) bug 459878 - Tracking bug: do major update from FF3.0.x to FF3.1 to make sure it all works
- Would like to get a MU testrun for beta 2. When can we have this? Target the last week of november
- See Topcrashes from Beta 1. Particularly needing blocking beta 2 attention:
- #1, #2, #4, #8, (#6 & #7 need more external investigation)
- (hskupin) bug 451267 - Master password dialog is shown on each website with at least one text field due to sqlite import
- Requested blocking flag. Awaiting feedback from dolske.
- (hskupin) bug 463285 - After closing the search fields context menu the ctrl-tab panel cannot be closed anymore and results in crash
- Needs input from dev side. Blocking flag requested.
(Marcia) bug 347930 - Tab strip should be a toolbar instead- Pushed out of 3.1. flag has been minused.
(Stephend) bug 450314 - use a special tag to block results from the awesomebarresolved wontfixed
Overview
The goal of this Overall Test Plan is to lay out our testing strategy, communicate it to others, and track the status.
Major QA Activities:
- New feature testing - see below
- L10n testing
- Milestone testing
Requirements and Scheduling
Test Results
Test Areas
Feature Focused Areas
Key: L = Large (3-6 weeks) M = Medium (2-4 weeks) S = Small (1-2 weeks)
| Feature Area and Spec | Test Plan Location | QA Contact | Dev Contact | Size | FF or Platform? | Description |
| Downloadable Fonts (@font-face rule) | here | Akira, ctalbert | jdaggett/zack | L | Pf |
|
| moz-transform (CSS Transform) | here | martijn, ctalbert | Keith Schwarz | L | Pf |
|
| ? | L | Pf |
| |||
| Places | here | Tracy | dietrich | L | Ff |
|
| Private Browsing Mode | Test Plan | Marcia | Ehsan Akhgari [:ehsan] | L | Ff |
|
| ? | L | Pf |
| |||
| SVG CSS | here | Martijn | roc | L | Pf |
|
| WHATWG <canvas> text API | here | Tchung | ebutler | L | Pf |
|
| Border Image | ? | martijn, ctalbert | robarnold, dbaron | M | Pf | |
| Cross Site XHR | here | bc, ctalbert | sicking@mozilla.com | M | Pf |
|
| Drag and Drop of Tabs (to new Windows) | here | juanb | Bz | M | Ff |
|
| Color Management | here | Ezadkiel Villarico Marbella (seneca community) | bholley | M | Pf |
|
| HTML 5 Drag and Drop API | here | Joelm | Ndeakin | M | Pf |
|
| Media Queries | here | Joelm, (formerly Hasham) | dbaron | M | Pf |
|
| Native JSON | here | Mikeal | rsayre@mozilla.com | M | Pf |
|
| Worker Threads | here | Adam or bc | bent@mozilla.com | M | Pf |
|
| AwesomeBar | here | stephend | dietrich/mardak | S | Ff |
|
| Ctrl-Tab | Ctrl Tab Test Plan | marcia | Dao | S | Ff |
|
| Session Restore | Session Restore Test Plan | marcia | Dietrich | S | Ff |
|
| ? | Tomcat | ? | S | Ff | ?
| |
| Search Text Widget | Search Widget Testplan | whimboo | Dao | S | Ff |
|
| S | Pf |
| ||||
| Element Traversal | here | Joelm | Jonas Sicking | S | Pf |
|
| Script Defer | here | Joelm | Jonas Sicking | S | Pf |
|
| ACID 3 | Testplan | Tomcat | Roc or dbaron | M | Pf | |
| Add-on Update | Addons Testplan | Tchung/Tomcat | ? | M | Ff |
|
| Memory Leaks | Memory Leaks Test Plan | Tomcat | Tomcat | L | Pf/Ff |
|
| Offline/Local Storage | here | juanb | dcamp | Pf |
| |
| Password Manager to mozStorage | here | harthur | zpao | ? | Pf |
|
| Video Decoders | here | Tchung, ctalbert, mikeal | roc/cdouble? | Pf |
| |
| JavaScript 1.8.1 | bc | brendan | Pf |
| ||
| Pf |
|
Unowned Features
| Feature Area and Spec | Test Plan Location | QA Contact | Dev Contact | Size | FF or Platform? | Description |
| Improved CMS performance | ? | ? | Bobby Holly | S | Pf |
|
| Aero Glass support in chrome on Vista | ? | ? | Bobby Holly | S | Pf |
|
Regression Areas
- Top Web accessibility Tests
- Plugins (eg. Flash, java, AJAX)
- Extensions (eg. Firebug, NoScript, Fotofox)
- Themes (eg. Vista, Joga, Simpsons)
- Top Site Tests (eg. Alexa top 50)
- Financial Sites (eg. banks, online trading)
- Accessibility Tests
- User Performance Testing
- Major / Minor Update Testing
- L10N Testing (may coincide with Feature area)
- Distribution Testing (may coincide with Feature area)
Tiger Team Testing
Daily smoketests are ran against nightly trunk builds. Please see marcia for more information.
Link to Schedule and Assignments
Extensions
The following extensions in the list below will be ran through regression tests during selected milestone releases.
See examples here.
Top Crash reports
The main report is the easiest to view.
Banking and Financial Sites
For these types of sites, we’re asking community members and MoCo QA to state which banks and financial institutions they're willing to test. Please add your name to the list.
L10n Testing with Third Parties
For additional string testing, Mozilla will work with the l10n Team for localization and string testing.
Results link to be posted later.
Review Feedback
In this section, we will roll up all common feedback pulled from external sources that appears common and should be tracked by QA. Feedback sources can include:
- Hendrix Feedback system (mozilla.feedback newsgroups)
- Bugzilla
- Breakpad Crash Reporter
- Mozillazine Forums
QA / Support Team Issues
Add any common issues you are finding during your nightly /release testing that you feel would be good for Mozilla support to be aware of.
- See Topcrashers in beta 1
- Private Browsing has landed, but bugs are being found as we speak
- Ctrl-Tab preview pane has landed, but bugs are being found as we speak
Additional References
This section is left to add any additional references relevant to the Firefox 3.1 project