AwesomebarSearchProviderReset/TestPlan

Awesomebar Search Provider Reset

Feature	Status	Release Target	Lead engineer	QA Lead	QA Status
Awesomebar Search Provider Reset	In Development	Firefox 20	Gavin Sharp	Manuela Muntean	In Progress

Summary

Users falling victim to "search hijacking" (keyword.URL being taken over by an unwanted search engine) is a common problem.

There are two cases we can detect:

• pref is changed, and the hostname is different (e.g. switched from the default of Google to SuperAwesomeWebDealsSearch.com)
• pref is changed, and only parameters are different (e.g. user customized to a specific type of Google search, or referral codes where added)

In either case, we could prompt the user and offer to reset the keyword.URL value to the default after they trigger a search from the location bar.

• Screenshot of notification

Reference

• bug 718088 - offer to re-set keyword.URL if it has a non-default value - RESOLVED FIXED

Use Cases to Test

Test that the notification which prompts the user is displayed when

• manually changing keyword.URL pref from "about:config", and then actually performing a keyword search
• installing an add-on that automatically changes the keyword.URL pref, and then actually performing a keyword search

Test Cases

• Test cases and test results can be seen in the Google Spreadsheet
• They are also present in MozTrap, in the Awesomebar Search Provider Reset test suite.

Bugs

• bug 732671 - Prevent third party apps to change default search engine - RESOLVED DUPLICATE
• bug 784189 - Offer to re-set keyword.URL if it has a non-default value until a better solution can be found - RESOLVED DUPLICATE
• bug 736878 - keyword.URL reset prompt doesn't properly re-set prefs if default engine is modified - RESOLVED FIXED
• bug 744957 - Enhancements to help mitigate search hijacking - RESOLVED INCOMPLETE
• bug 838864 - keyword.URL reset interferes poorly with some partner add-ons - ASSIGNED
• bug 839410 - Notification appearing after setting keyword.URL to "http://www.google.com" or "http://www.search.google.com" - NEW
• bug 839416 - keyword.URL reset notification doesn't appear after setting keyword.URL to an invalid URL - NEW
• bug 839629 - Fix partner add-ons so that search pref changes comply with add-on guidelines - NEW

Sign off

Criteria

• All the test cases were executed.
• All the blocker, critical, major bugs have been fixed.

Firefox 19 beta 5 - 2013-02-07

• bug 839410 - Notification appearing after setting keyword.URL to "http://www.google.com" or "http://www.search.google.com"
• bug 839416 - Notification doesn't appear after setting keyword.URL to something without "http://" or with an invalid URL
• Regarding the following add-ons installation:
  • a) Ask.com
  • b) Snap.do
  • c) Babylon
  • d) ScumBag 2000
  • e) Claro Search
  • f) MyStart Incredibar
• The results, grouped by OSs, are next:
  • Windows 7 64-bit:
    • a) couldn't install
    • b) changes the pref; the notification appears and works as expected
    • c) doesn't change the pref
    • d) couldn't find it
    • e) couldn't find it
    • f) Incredibar EN 10.14.40.128 installed; doesn't change the pref after installation
  • Windows 8 32-bit:
    • a) couldn't install
    • b) changes the pref; the notification appears and works as expected
    • c) doesn't change the pref
    • d) couldn't find it
    • e) couldn't find it
    • f) Incredibar EN 10.14.40.128 installed; doesn't change the pref after installation
  • Ubuntu 12.04 32-bit:
    • a) couldn't install
    • b) couldn't find a source for Ubuntu
    • c) not available for Ubuntu
    • d) couldn't find a source for Ubuntu
    • e) couldn't find a source for Ubuntu
    • f) couldn't find a source for Ubuntu
  • Mac OSX 10.8.2:
    • a) couldn't find a source for Mac
    • b) couldn't find a source for Mac
    • c) couldn't find a source for Mac
    • d) couldn't find a source for Mac
    • e) couldn't find a source for Mac
    • f) Incredibar EN 3.16.0.3 installed; it doesn't change the pref after installation
  • Windows Vista 32-bit:
    • Ask.com add-on:
      • i) changes the pref; the notification appears and works as expected (see attached photo)
      • ii) when choosing "Yes, use Google", the pref resets to its default value
  • Windows XP 32-bit:
    • Ask.com add-on:
      • couldn't install