Firefox/Projects/Network Error Pages/Test Plan: Difference between revisions

← Older edit

Firefox/Projects/Network Error Pages/Test Plan (view source)

Revision as of 01:59, 25 June 2010

2,580 bytes added , 25 June 2010

→‎Community Test Events

Ashughes

Confirmed users

14,525

edits

@@ Line 37: / Line 37: @@
 | [[#Project_Wiki]]
 | Wiki Links to all feature related entries
-|
+| [https://wiki.mozilla.org/Firefox/Projects/Network_Error_Pages#References wiki]
 |-
 | [[#Developer_Links|#Developer_Links (blogs)]]
 | Developer links to feature related sites
-|
+| {{done|}}
 |-
 | [[#Other_Docs]]
 | Web links to feature related sites
-|
+| {{done|}}
 |-
 | [[#Developer_QA_Review]]
 | Details from developer and qa discussions regarding feature test strategies and issues.
-|
+| pending-feedback
 |}
@@ Line 64: / Line 64: @@
 | [[#Bug_Tracking]]
 | Top level bugs tracking feature
-|
+| {{bug|482874}}
 |-
 | [[#Bug_Verification]]
 | Feature bugs that need verification
-|
+| pending-feedback
 |-
 | [[#Bug_Triage]]
 | Links triage bug tasks
-|
+| pending-feedback
 |}
@@ Line 91: / Line 91: @@
 | Page not found error page
 | Developer Tests, QA Tests, Beta tester coverage
-|
+| pending-feedback
 |-
 | [[#Suggestions|Suggestions]]
 | Alternate site suggestions
 | Developer Tests, QA Tests, Beta tester coverage
-|
+| pending-feedback
 |-
 | [[#Search|Search]]
 | Pre-populate site-search box & button, primarily used on 404 error pages, terms derived from URL
 | Developer Tests, QA Tests, Beta tester coverage
-|
+| pending-feedback
 |-
 | [[#Localization]]
 | Feature localization
 |
-|
+| pending-feedback
 |-
 | [[#Accessibility]]
 | Feature accessibility
 |
-|
+| pending-feedback
 |-
 | [[#Plugins]]
 | Plugins compatibility
 |
-|
+| pending-feedback
 |-
 | [[#Addons]]
 | Addons compatibility
 |
-|
+| pending-feedback
 |-
 | [[#Topsites]]
 | Top internet sites compatibilities
 |
-|
+| pending-feedback
 |}
 [[#Feature_Description|top]]
 = [[#Feature_Tests_Details|Feature Tests]] =
@@ Line 142: / Line 141: @@
 | [[#Developer_Tests]]
 | Links to automated developer tests
-|
+| pending-feedback
 |-
 | [[#Mozmill_Tests]]
 | Links to automated mozmill feature test cases
-|
+|  pending-feedback
 |}
@@ Line 158: / Line 157: @@
 | [[#Smoke_Tests]]
 | link to smoke tests
-|
+| pending-feedback
 |-
 | [[#Regression_Tests]]
 | link to BFT and/or regression tests
-|
+| pending-feedback
 |-
 | [[#Functional_Tests]]
 | link to FFT and/or complete functional tests
-|
+| pending-feedback
 |}
@@ Line 180: / Line 179: @@
 | [[#Testdays]]
 | Links to test day event results for feature
-|
+| pending-feedback
 |-
 | [[#Bugdays]]
 | Links to bug day event results for feature
-|
+| pending-feedback
 |-
 | [[#Meetups]]
 | Links to Meetup events for feature
-|
+| pending-feedback
 |}
 [[#Feature_Description|top]]
@@ Line 267: / Line 266: @@
 * Is the spelling/grammar correct for localizations?
 * Does the layout look decent?
+* 404 Pages
+** < 512 bytes:
+*** http://www.almostinfinite.com/qwertyuiop (283 bytes)
+** > 512 bytes:
+*** http://www.mozilla.org/qwertyuiop (2168 bytes)
+** Top Sites:
+*** http://www.digg.com/qwertyuiop
+*** http://www.amazon.com/qwertyuiop
+*** http://www.wikipedia.org/qwertyuiop
+*** http://www.yahoo.com/qwertyuiop
+*** http://www.facebook.com/qwertyuiop
 [[#Feature_Test_Items|top]]
@@ Line 320: / Line 331: @@
 = [[#Feature_Tests|Feature Tests Details]] =
 == [[#Automated_Tests|Automated Tests Details]] ==
+'''NOTE: Most of these may be best served as an automated and manual test'''
+* If a 404 error page meets the constraint it should be overridden.
+* If a 404 error page does not meet the constraint, it should *not* be overridden.
+* Make sure Suggestion appears when there is a very close match.
+* Make sure Suggestion does not appear when there is not remotely close match.
+* Verify that the URL is well-formed, and that the anchor element displaying it works.
+* Make sure Search appears for 404 error overrides.
+* Make sure Search does *not* appear for DNS Not Found errors.
+* Verify that the search box is pre-populated when it appears, and verify that the button actually triggers the search.
+* Verify that the search uses the user's preferred search engine when it makes sense (e.g. Google or Yahoo, but not Wikipedia).
+* Verify that the search is actually constrained to the site.
+* Make sure that Global Websearch appears both for 404 error overrides and DNS Not Found errors.
+* Make sure that the Global Websearch search box is pre-populated with search terms, and verify that the button actually triggers the search.
+* Make sure the Global Websearch search uses the user's preferred search engine when it makes sense (e.g. Google or Yahoo, but not Wikipedia).
+* Verify that the UI control (button, link, etc.) appears in the original error page, and verify that it works.
+* [Manual Error Page] Trigger a conventional 404 page that will not be overridden (just too large, etc.).  Verify that the UI control (button, link, etc.) is visible in the browser chrome, and verify that it will show the 404-override page.
+* Do the error pages validate? (I don't know if this is critical, but if we can automate it, it won't hurt to test.)
 === Developer Tests ===
@@ Line 327: / Line 355: @@
 === Mozmill Tests ===
-If a particular feature needs manual tests which should also be covered by Mozmill tests please add the "''[mozmill-test-needed]''" whiteboard entry to the feature implementation or regression bug.
-List of Mozmill Tests:
 * Links to automated mozmill feature test cases
@@ Line 335: / Line 360: @@
 == [[#Manual_Tests|Manual Tests Details]] ==
+'''Potentially all of the above plus...'''
+* Is the spelling and grammar correct? (Obviously localization dependent).
+* Does the layout look decent? (Keep in mind that error pages may vary in layout from error to error since only some features will apply to each error page).
 === Smoke_Tests ===