Optimization Test plan template: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(5 intermediate revisions by the same user not shown)
Line 1: Line 1:
'''Insert Test Name'''
'''Firefox Growth Team: Identifying Optimization Opportunities'''


== Background ==
Please fill out the following information so that we can prioritize the opportunity associated with this idea. Thanks!


Qualifying the Opportunity: State why we are conducting this test and use any data / research that help informed the opportunity.
== Qualifying the Opportunity==
'''What's the Optimization Opportunity?'''<br/>
Please use any supporting data or information that can help identify what the problem / opporutnity is


== Hypothesis ==
'''Page to be Tested'''<br/>
What page do you want to optimize?


Insert Hypothesis here
'''Hypothesis'''<br/>
State your hypothesis for how you are going to increase conversion


== Experiment Information ==
'''Page element you would like to isolate and test'''<br/>
CTA's, copy, layout, etc.
'''
Test Audience Segment'''<br/>
What segment of traffic will we be testing against? (Eg. Browser, OS, Country, etc)


    Team Conducting Test
'''Current Conversion Rates'''<br/>
    Page / Experience that was tested: insert link here
What is the current conversion rate associated with the page goal that you want to test?
    Date of the Test: insert date range here
    Sample Size
    Testing Platform Used: Optimizely or Google Content Experiments
    Link to Test: insert link here


== Variations Tested ==
'''Target Conversion Rate'''<br/>
 
What is the target Conversion Rate that we would like to hit?
Insert Screencaps or Link to the Tested Variations
 
== Summary of Results ==
 
Hypothesis is TRUE or FALSE.
 
Summarize the findings within 2-4 sentences. 
 
Experiment Data
 
{| border="1" class="wikitable" style="border-collapse:collapse; width:100%;border-style:solid;border-color:grey;"
! style="background: #EEEEEE; width:10%"|Variations
! style="background: #EEEEEE; width:20%; align:left;"|Visitors
! style="background: #EEEEEE; width:20%; align:left;"|Conversions
! style="background: #EEEEEE; width:10%;"|Conversion Rate
! style="background: #EEEEEE; width:40%; align:left;"|% Improvement
! ! style="background: #EEEEEE; width:40%; align:left;"|Confidence
! ! style="background: #EEEEEE; width:40%; align:left;"|Winner
|-
! Original
|
|
|
|
|
|
|-
! Variation 1
|
|
|
|
|
|
|-
! ...
|
|
|
|
|
|
|-
! Variation X
|
|
|
|
|
|
|-
|}
 
== Key Learnings ==
 
What did we learn as a result of taking this test. Insert at least 3 things.
 
== Action Taken as a Result of the Experiment ==
 
Now that you have completed the test, what were the next steps taken?

Latest revision as of 19:02, 22 September 2014

Firefox Growth Team: Identifying Optimization Opportunities

Please fill out the following information so that we can prioritize the opportunity associated with this idea. Thanks!

Qualifying the Opportunity

What's the Optimization Opportunity?
Please use any supporting data or information that can help identify what the problem / opporutnity is

Page to be Tested
What page do you want to optimize?

Hypothesis
State your hypothesis for how you are going to increase conversion

Page element you would like to isolate and test
CTA's, copy, layout, etc. Test Audience Segment
What segment of traffic will we be testing against? (Eg. Browser, OS, Country, etc)

Current Conversion Rates
What is the current conversion rate associated with the page goal that you want to test?

Target Conversion Rate
What is the target Conversion Rate that we would like to hit?