Firefox/Projects/browser ballot mechanical turk

Background

To compliment the testing and research done by Critical in Europe, a series of Mechanical Turk tests will be conducted to test various aspects of the EC's Ballot design. The goal is to determine both how to design the ballot in the most neutral way possible, and for Mozilla to determine the most successful summary and image for the Firefox section of the ballot.

Series One: Comparing Slogans and Designs

Test 1: Comparing Firefox Banners

This simple 6-question test asked about people's reactions to the top Firefox logos. 40 people participated.

Questions asked

1. Which of the following five versions drew your attention first?

   

2. Why did that version draw your attention first? (freeform)
3. Which of the following five versions do you prefer?

   

4. Why do you prefer this version? (freeform)
5. Which browser do you use most often?
   • Internet Explorer
   • Firefox
   • Safari
   • Opera
   • Other
6. Why do you use this browser? (freeform)

Results

(results of first test)

Series Two: Comparing Slogans Individually

In five separate tests, a complete ballot was presented similar to the one that Microsoft proposed. On each, a different Firefox slogan was displayed. Each test contained the following four items, presented to each of 40 users:

Imagine you just bought a new computer running Microsoft Windows 7. You turn it on, and you see the following screen. Please read the description of each browser carefully, and then answer the following questions.

Test 1: Ballot reading "Your online security is Firefox's top priority. It's built by the Mozilla Foundation to make browsing better."
Test 2: Ballot reading "Firefox adapts to how you use the Web. Find out why more people have downloaded it than any other browser."
Test 3: Firefox is free and made to help you get the most out of the Web. Find out why more people have downloaded it than any other browser."
Test 4: More people have downloaded Firefox than any other browser. Find out why!"
Test 5: Ballot reading "Built by the Mozilla Foundation to make the Web better, Firefox won't take over your computer or compromise your privacy."

1. Which item on this screen would you choose?
   • Install Safari
   • Install Google Chrome
   • Install Microsoft Internet Explorer
   • Install Firefox
   • Install Opera
   • Select Later
2. Why would you choose this item? (freeform)
3. Which browser do you currently use most often?
   • Safari
   • Google Chrome
   • Microsoft Internet Explorer
   • Firefox
   • Opera
   • Other
4. Why do you use this browser? (freeform)

Results

here

Test 2: Comparing Firefox Slogans

This simple 7-question test asked about people's reactions to the top Firefox slogans. 40 people participated.

Questions asked

1. Which slogan below do you find most convincing?
   • Your online security is Firefox's top priority. It's built by the Mozilla Foundation to make browsing better.
   • Firefox adapts to how you use the Web. Find out why more people have downloaded it than any other browser.
   • Firefox is free and made to help you get the most out of the Web. Find out why more people have downloaded it than any other browser.
   • More people have downloaded Firefox than any other browser. Find out why!
   • Built by the Mozilla Foundation to make the Web better, Firefox won't take over your computer or compromise your privacy.
2. Why did you find that version most convincing? (freeform)
3. Which browser do you use most often?
   • Internet Explorer
   • Firefox
   • Safari
   • Opera
   • Other
4. Why do you use this browser? (freeform)
5. Which of the the following five items do you consider most important in a browser?
   • Speed
   • Security
   • Customizability
   • Ease of Use
   • Other
6. Why do you consider this to be the most important? (freeform)

Results

gdsasgadsgasgd

Phase Two

1. Actual ballot with branded browsers, three tests each with three winning logo designs. Ask users

• Which item drew your attention first?
• If you saw this dialog when you bought a new computer, which item would you have selected?
  • Why?

2. De-branded ("fruit") browser, three tests each with three winning logo designs. Ask users

• Which item drew your attention first?
  • Why?