Pancake/French Toast/Prototyping/2012-08 General User Testing

Script

Preparation

• Animated wireframe for Scenario 1 File:French-toast-ur-search.key.tar.gz. Plan to start with scenario 1. This gives users a chance to understand the layer concepts before exploring paper prototypes.
• Print a copies of wireframes to use as paper prototypes
• Print a copy of the video release form: https://intranet.mozilla.org/images/a/ac/Mozilla_User_Studies_Release_Form_-_1-18-12_update.pdf
• Sharpie marker

Tip: You can use Photo Booth or iMovie to record video/audio from your Mac.

What is the job-to-be-done for this script?

• Make user comfortable
• Capture unbiased reactions

Avoid correcting the user, but keep things moving if they get stuck.

Intro

• My name is _______. I'm a designer at Mozilla. I'm currently doing research and development on a new product, and would love your feedback.
• I'll ask a few background questions. Then, I'll show you a prototype and give you a scenario. Afterwards, I'll ask you a few follow-up questions. It will take about 30 to 45 minutes.
• If something doesn't make sense, let me know. This is exactly the kind of feedback I'm looking for.
• If it's ok with you, I'll video the exercise. This helps us remember your actual impression of the app. We won't share it outside of Mozilla.

Warm-up

• Survey: Name, Age
• What are some of the ways you save things for later?
• What kinds of things do you save from the web?
• What are some of the ways you organize things you save?
• What do you share?
  • How? What services do you use?

• What do you like about those services?
• Is there anything you wish you could do with them that you can't?

Exercise

• Imagine you just installed a new iPad app from Mozilla. It says you can use it "collect and share the web". This is what it looks like.
• Please point out the things you see on screen and tell me what you think they are. Point out anything that seems unusual or confusing.
• Ok, let's explore a scenario. While we do it, try to "think aloud" about what is happening.
• Scenario 1:
  • You want to learn more about a band you recently discovered.
  • When you find what you're interested in, you'll probably want to save it.

• Scenario 2:
  • Maybe there are others out there that have similar musical tastes?
  • If you find them, you'll want to follow them and be updated.

• What do you expect when I _______?
  • How is it different from what you expected?
  • What do you expect to be able to do with it?
  • Please point out what you see on screen. What do you think it does?

• (After transitions, changes) What do you think just happened?
  • How is it different from what you expected?
  • Please point out what you see on screen. What do you think it does?

• Show me how you would _______. Go ahead -- try it.

Follow-up

• Is there anything you would like to see on this page that isn't here?
• Is there anything on this page that you would never use?
  • Why?

• (Handing user paper prototypes, sharpie) Are there any other customizations you would make?
  • Show me (encourage sketching onto paper prototype)

Win

• "I'm not a technical person".
• Loves her android phone. "I hate iOS, it doesn't have widgets".
• "I use Pinterest, but I don't share"

File:2012-08-win-sketches.pdf.tar.gz

Notes:

• Confused about the role of the back button in the viewer (thought it should go back to search)
• Wanted a close button for layers, or some kind of tab system
• Likes "Recent searches" area
• Identified all icons on Lv 1 without a problem, except "Explore"
• Wanted a personal space to save things for later, or some kind of default board