Firefox/Projects/Doorhanger notifications/Test Plan: Difference between revisions
< Firefox | Projects | Doorhanger notifications
Jump to navigation
Jump to search
(37 intermediate revisions by the same user not shown) | |||
Line 142: | Line 142: | ||
| [[#Mozmill_Tests]] | | [[#Mozmill_Tests]] | ||
| Links to automated mozmill feature test cases | | Links to automated mozmill feature test cases | ||
| | | 1 test exists | ||
|} | |} | ||
Line 154: | Line 154: | ||
| [[#Smoke_Tests]] | | [[#Smoke_Tests]] | ||
| link to smoke tests | | link to smoke tests | ||
| | | {{ok|}} | ||
|- | |- | ||
| [[#Regression_Tests]] | | [[#Regression_Tests]] | ||
| link to BFT and/or regression tests | | link to BFT and/or regression tests | ||
| | | {{ok|}} | ||
|- | |- | ||
| [[#Functional_Tests]] | | [[#Functional_Tests]] | ||
| link to FFT and/or complete functional tests | | link to FFT and/or complete functional tests | ||
| | | {{ok|}} | ||
|} | |} | ||
Line 250: | Line 250: | ||
{| class="fullwidth-table" | {| class="fullwidth-table" | ||
|- | |- | ||
! Query | ! Query | ||
! Description | ! Description | ||
|- | |- | ||
| {{bug|398776}} | |||
| Top-level tracking bug | | Top-level tracking bug | ||
|- | |- | ||
| | | [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=509642+572967+565187+573187+572972 Dependencies] | ||
| Bugs blocking the release of this feature | |||
|- | |- | ||
| Incoming | | [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=popupnotification&bug_status=UNCONFIRMED Incoming] | ||
| | | Unconfirmed bugs pending triage | ||
|- | |- | ||
| Resolved | | [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=popupnotification&bug_status=RESOLVED Resolved] | ||
| | | Resolved bugs pending verification | ||
|} | |} | ||
Line 274: | Line 269: | ||
== Bug Verification == | == Bug Verification == | ||
* | * Dependencies | ||
** [FIXED] {{bug|509642}} - Menu-button styling improvements | |||
** [NEW] {{bug|572967}} - Notifications reactivation via icon | |||
** [FIXED] {{bug|565187}} - Geolocation notification icons | |||
** [FIXED] {{bug|573187}} - Test pilot downloads same JAR | |||
** [NEW] {{bug|572972}} - Show Geolocation icon, Permissions prefs | |||
* Resolved Fixed to Verify | |||
** Query: [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=popupnotification&bug_status=RESOLVED] | |||
[[#Feature_Bug_Management|top]] | [[#Feature_Bug_Management|top]] | ||
== Bug Triage == | == Bug Triage == | ||
* | * [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=XUL%20Widgets&product=Toolkit Unconfirmed Toolkit:XUL Widgets] | ||
[[#Feature_Bug_Management|top]] | [[#Feature_Bug_Management|top]] | ||
Line 335: | Line 336: | ||
If a particular feature needs manual tests which should also be covered by Mozmill tests please add the "''[mozmill-test-needed]''" whiteboard entry to the feature implementation or regression bug. | If a particular feature needs manual tests which should also be covered by Mozmill tests please add the "''[mozmill-test-needed]''" whiteboard entry to the feature implementation or regression bug. | ||
'''Pre-existing Tests''' | |||
{| class="fullwidth-table" | |||
| style="background:#EFEFEF; width:20%" | '''Function''' | |||
| style="background:#EFEFEF; width:60%" | '''Tests''' | |||
| style="background:#EFEFEF; width:20%" | '''Status''' | |||
|- | |||
| Geolocation | |||
| [http://hg.mozilla.org/qa/mozmill-tests/file/default/firefox/testPrivateBrowsing/testGeolocation.js Verify geolocation token is cleared when exiting private browsing] | |||
| No revisions necessary | |||
|} | |||
[[#Feature_Tests|top]] | [[#Feature_Tests|top]] | ||
Line 343: | Line 352: | ||
=== Smoke_Tests === | === Smoke_Tests === | ||
'''Pre-existing Tests''' | |||
{| class="fullwidth-table" | |||
| style="background:#EFEFEF; width:20%" | '''Function''' | |||
| style="background:#EFEFEF; width:60%" | '''Tests''' | |||
| style="background:#EFEFEF; width:20%" | '''Status''' | |||
|- | |||
|} | |||
'''New Tests''' | |||
{| class="fullwidth-table" | |||
| style="background:#EFEFEF; width:20%" | '''Function''' | |||
| style="background:#EFEFEF; width:60%" | '''Tests''' | |||
| style="background:#EFEFEF; width:20%" | '''Status''' | |||
|- | |||
| Geolocation | |||
| [https://litmus.mozilla.org/show_test.cgi?id=12056 Share location] | |||
| Added 06/29/2010 | |||
|} | |||
[[#Feature_Tests|top]] | [[#Feature_Tests|top]] | ||
=== Regression_Tests === | === Regression_Tests === | ||
'''Pre-existing Tests''' | |||
{| class="fullwidth-table" | |||
| style="background:#EFEFEF; width:20%" | '''Function''' | |||
| style="background:#EFEFEF; width:60%" | '''Tests''' | |||
| style="background:#EFEFEF; width:20%" | '''Status''' | |||
|- | |||
|} | |||
'''New Tests''' | |||
{| class="fullwidth-table" | |||
| style="background:#EFEFEF; width:20%" | '''Function''' | |||
| style="background:#EFEFEF; width:60%" | '''Tests''' | |||
| style="background:#EFEFEF; width:20%" | '''Status''' | |||
|- | |||
| rowspan="3" | Geolocation | |||
| [https://litmus.mozilla.org/show_test.cgi?id=12055 Geolocation popup notification] | |||
| Added 06/29/2010 | |||
|- | |||
| [https://litmus.mozilla.org/show_test.cgi?id=12058 Always Allow Sharing Location] | |||
| Added 06/30/2010 | |||
|- | |||
| [https://litmus.mozilla.org/show_test.cgi?id=12059 Never Share Location] | |||
| Added 06/30/2010 | |||
|} | |||
[[#Feature_Tests|top]] | [[#Feature_Tests|top]] | ||
=== Functional_Tests === | === Functional_Tests === | ||
'''Pre-existing Tests''' | |||
{| class="fullwidth-table" | |||
| style="background:#EFEFEF; width:20%" | '''Function''' | |||
| style="background:#EFEFEF; width:60%" | '''Tests''' | |||
| style="background:#EFEFEF; width:20%" | '''Status''' | |||
|- | |||
| rowspan="3" | Geolocation | |||
| [https://litmus.mozilla.org/show_test.cgi?id=11291 Verify Share Location "Block" pref in Page Info] | |||
| revised | |||
|- | |||
| [https://litmus.mozilla.org/show_test.cgi?id=11415 Verify geolocation token is cleared after allowing permissions via Page Info] | |||
| revised | |||
|- | |||
| [https://litmus.mozilla.org/show_test.cgi?id=11306 Verify geolocation token is cleared when exiting private browsing] | |||
| revised | |||
|} | |||
[[#Feature_Tests|top]] | [[#Feature_Tests|top]] |
Latest revision as of 16:04, 1 July 2010
Doorhanger Notifications
- Development Status: - In progress (6/24/2010)
- Feature Testing: - In progress (6/28/2010)
- Team: gavin (dev), faaborg (ux), ashughes (qa)
- Tracking Bugs: bug 398776
Feature Description
Provide a unified action and notification area.
Feature Release Readiness Assessment
The table below provides a top level go/no go assessment of whether the feature is release ready for the given milestone.
Milestone | Assessment |
---|---|
#Beta1 | Partial: Only Geolocation landed (testing) |
#Beta2 | N/A |
#Beta3 | N/A |
Feature Documentation
Item | Description | Status |
---|---|---|
#Project_Wiki | Wiki Links to all feature related entries | wiki |
#Developer_Links (blogs) | Developer links to feature related sites | [DONE] |
#Other_Docs | Web links to feature related sites | [DONE] |
#Developer_QA_Review | Details from developer and qa discussions regarding feature test strategies and issues. | [DONE] |
Feature Bug Management
Item | Description | Status |
---|---|---|
#Bug_Tracking | Top level bugs tracking feature | bug 398776 |
#Bug_Verification | Feature bugs that need verification | pending-feedback |
#Bug_Triage | Links triage bug tasks | pending-feedback |
Feature Test Items
The table below provides a breakdown of all feature items that should be covered and how they will be tested. Not all items will be covered by internal QA team members.
Test Item | Description | Covered By | Status |
---|---|---|---|
#Actions | UI and function of actions | Developer Tests, QA Tests, Beta tester exposure | investigating |
#Notifications | UI and function of notifications | Developer Tests, QA Tests, Beta tester exposure | investigating |
#Localization | Feature localization | QA tests, Beta tester exposure | investigating |
#Accessibility | Feature accessibility | Unknown at this time | pending-feedback |
#Plugins | Plugins compatibility | N/A | N/A |
#Addons | Addons compatibility | N/A | N/A |
#Topsites | Top internet sites compatibilities | N/A | N/A |
Feature Tests
Automated Tests
Item | Description | Status |
---|---|---|
#Developer_Tests | Links to automated developer tests | [DONE] |
#Mozmill_Tests | Links to automated mozmill feature test cases | 1 test exists |
Manual Tests
Item | Description | Status |
---|---|---|
#Smoke_Tests | link to smoke tests | [ON TRACK] |
#Regression_Tests | link to BFT and/or regression tests | [ON TRACK] |
#Functional_Tests | link to FFT and/or complete functional tests | [ON TRACK] |
Community Test Events
Item | Description | Status |
---|---|---|
#Testdays | Links to test day event results for feature | nothing planned |
#Bugdays | Links to bug day event results for feature | nothing planned |
#Meetups | Links to Meetup events for feature | nothing planned |
Feature Documentation Details
Project Wiki
Developer Links
- Design documentation
- Issues with old mechanism
- Current limitations
Other Docs
- Site Identity out of scope for this feature -- being done in a separate project
- Faaborg's initial blog post
- moz-dev-apps-firefox discussion
Developer QA Review
- Do we have automated tests for the feature?
- Yes
- What do they cover?
- browser-chrome
- basic functionality of JS-module
- geolocation
- What do they not cover?
- interaction between different notifications
- doorhanger and bar at the same time
- multiple doorhangers
- interaction between different notifications
- How well do they cover the feature?
- core functionality nearly completely covered
- What are the important areas we should focus on?
- Preferences for "allow"
- What are the dependencies?
- [NEW] bug 572967 - Allow notifications to be reactivated via icon
- [NEW] bug 565187 - Geolocation notification icons
- [FIXED] bug 573187 - Test pilot downloads multiple copies of same JAR
- [NEW] bug 572972 - Show Geolocation icon, Permissions prefs
- What is our comfort level with this feature in its current state?
- Once dependencies fixed, ship
- What feedback would you like from QA?
- Investigate UX/UI issues
Feature Release Readiness Assessment Details
Beta1
- Targetting Beta1
- Geolocation patch landed
- Development feels this will be B1 ready
Beta2
Beta3
Feature Bug Management Details
Bug Tracking
Query | Description |
---|---|
bug 398776 | Top-level tracking bug |
Dependencies | Bugs blocking the release of this feature |
Incoming | Unconfirmed bugs pending triage |
Resolved | Resolved bugs pending verification |
Bug Verification
- Dependencies
- [FIXED] bug 509642 - Menu-button styling improvements
- [NEW] bug 572967 - Notifications reactivation via icon
- [FIXED] bug 565187 - Geolocation notification icons
- [FIXED] bug 573187 - Test pilot downloads same JAR
- [NEW] bug 572972 - Show Geolocation icon, Permissions prefs
- Resolved Fixed to Verify
- Query: [1]
Bug Triage
Feature Test Items Details
Actions
- Details of action test requirements
Notifications
- Details of notification test requirements
Localization
- Styling rules similar to Larry
- API similar to NotificationBox
- Long message wrapping (no max-width)
Accessibility
- Development needs to sync with Accessibility once bug 572967 lands
Plugins
- Not relevant to this feature
Addons
- Entirely additive (very little risk)
- Adds another notification method to Firefox, does not alter existing methods
Topsites
- Not relevant to this feature
Feature Tests Details
Automated Tests Details
Developer Tests
Mozmill Tests
If a particular feature needs manual tests which should also be covered by Mozmill tests please add the "[mozmill-test-needed]" whiteboard entry to the feature implementation or regression bug.
Pre-existing Tests
Function | Tests | Status |
Geolocation | Verify geolocation token is cleared when exiting private browsing | No revisions necessary |
Manual Tests Details
Smoke_Tests
Pre-existing Tests
Function | Tests | Status |
New Tests
Function | Tests | Status |
Geolocation | Share location | Added 06/29/2010 |
Regression_Tests
Pre-existing Tests
Function | Tests | Status |
New Tests
Function | Tests | Status |
Geolocation | Geolocation popup notification | Added 06/29/2010 |
Always Allow Sharing Location | Added 06/30/2010 | |
Never Share Location | Added 06/30/2010 |
Functional_Tests
Pre-existing Tests
Function | Tests | Status |
Geolocation | Verify Share Location "Block" pref in Page Info | revised |
Verify geolocation token is cleared after allowing permissions via Page Info | revised | |
Verify geolocation token is cleared when exiting private browsing | revised |
Community Test Events Details
Testdays
- Links to test day event results for feature
Bugdays
- Links to bug day event results for feature
Meetups
- Links to Meetup events for feature