Optimization Test plan template: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
Line 1: Line 1:
'''Insert Test Name'''
Firefox Growth Team: Identifying Optimization Opportunities


== Background ==
Please fill out the following information so that we can prioritize the opportunity associated with this idea. Thanks!


Qualifying the Opportunity: State why we are conducting this test and use any data / research that help informed the opportunity.
== Qualifying the Opportunity==
'''
What's the Optimization Opportunity?'''
Please use any supporting data or information that can help identify what the problem / opporutnity is


== Hypothesis ==
'''Page to be Tested'''
What page do you want to optimize?


Insert Hypothesis here
'''Hypothesis'''
State your hypothesis for how you are going to increase conversion


== Experiment Information ==
'''Page element you would like to isolate and test'''
CTA's, copy, layout, etc.
'''
Test Audience Segment'''
What segment of traffic will we be testing against? (Eg. Browser, OS, Country, etc)


Please fill out the following information.
'''Current Conversion Rates'''
What is the current conversion rate associated with the page goal that you want to test?


* Team Conducting Test
'''Target Conversion Rate'''
* Page / Experience that was tested: insert link here
What is the target Conversion Rate that we would like to hit?
* Date of the Test: insert date range here
* Sample Size
* Testing Platform Used: Optimizely or Google Content Experiments
* Link to Test: insert link here
 
== Variations Tested ==
 
Insert Screencaps or Link to the Tested Variations
 
== Summary of Results ==
 
Hypothesis is TRUE or FALSE.
 
Summarize the findings within 2-4 sentences. 
 
Experiment Data
 
{| border="1" class="wikitable" style="border-collapse:collapse; width:100%;border-style:solid;border-color:grey;"
! style="background: #EEEEEE; width:10%"|Variations
! style="background: #EEEEEE; width:15%; align:left;"|Visitors
! style="background: #EEEEEE; width:15%; align:left;"|Conversions
! style="background: #EEEEEE; width:15%;"|Conversion Rate
! style="background: #EEEEEE; width:15%; align:left;"|% Improvement
! ! style="background: #EEEEEE; width:15%; align:left;"|Confidence
! ! style="background: #EEEEEE; width:15%; align:left;"|Winner
|-
! Original
|
|
|
|
|
|
|-
! Variation 1
|
|
|
|
|
|
|-
! ...
|
|
|
|
|
|
|-
! Variation X
|
|
|
|
|
|
|-
|}
 
== Key Learnings ==
 
What did we learn as a result of taking this test. Insert at least 3 things.
 
== Action Taken as a Result of the Experiment ==
 
Now that you have completed the test, what were the next steps taken?

Revision as of 19:00, 22 September 2014

Firefox Growth Team: Identifying Optimization Opportunities

Please fill out the following information so that we can prioritize the opportunity associated with this idea. Thanks!

Qualifying the Opportunity

What's the Optimization Opportunity? Please use any supporting data or information that can help identify what the problem / opporutnity is

Page to be Tested What page do you want to optimize?

Hypothesis State your hypothesis for how you are going to increase conversion

Page element you would like to isolate and test CTA's, copy, layout, etc. Test Audience Segment What segment of traffic will we be testing against? (Eg. Browser, OS, Country, etc)

Current Conversion Rates What is the current conversion rate associated with the page goal that you want to test?

Target Conversion Rate What is the target Conversion Rate that we would like to hit?