QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(29 intermediate revisions by 12 users not shown)
Line 1: Line 1:
== Read Me First! ==
== '''Read Me First!''' ==
* If you are an advanced user, download the [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-1.9.1/ latest Shiretoko nightly], create a new profile, and check out an area from the guide below.
* If you're not an advanced user but you just can't wait: [http://www.mozilla.com/en-US/firefox/all-beta.html Download the Firefox 3.5b4]
** If you are like most in Moco, you have a Mac, so create a temporary folder on your desktop, and name it something like: ''beta99test''
** Open your Terminal application. At the prompt type:
** <pre>./Desktop/beta99test/Firefox.app/Contents/MacOS/firefox -P -no-remote</pre>
** Create a new profile. Give it a name such as "preview", and start the browser.
** After it starts. Check for updates. You should be offered the new Preview version. Go through the installation and run with it!!! (Contact juanb on irc, or x262 if you have questions, or if you are using Windows XP/Vista:) )
 
* What are we doing?
* What are we doing?
*# Run a [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Daily_Browsing_Testing quick testsuite] of daily browsed sites
*# Run a [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Daily_Browsing_Testing quick testsuite] of daily browsed sites
*# Next, sign up to test [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Fx3.5_Feature_Testing new Fx3.5 Features] under the "Testers" list
*# Next, sign up to test [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Fx3.5_Feature_Testing new Fx3.5 Features] under the "Testers" list
*#* Try to make a concerted effort to sign up for something you're not comfortable with
*#* Try to make a concerted effort to sign up for something you're not comfortable with
*#* Example: "aakashd" signed up for Tab testing is shown [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Fx3.5_Feature_Testing here]
*#* Signing up for a feature is just to show which features are getting a lot of attention and which ones aren't
*#* Signing up for a feature is just to show which features are getting a lot of attention and which ones aren't
*#* People are free to "sign up" for more than one feature if they like
*#* People are free to "sign up" for more than one feature if they like
*#* The onus is on learning new features for those that haven't tried them out <b>as well as</b> using these features together to find deeper critical/blocker bugs
*#* The onus is on learning new features for those that haven't tried them out <b>as well as</b> using these features together to find deeper critical/blocker bugs
*#* Example: "aakashd" signed up for Tab testing is shown [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Fx3.5_Feature_Testing here]
*# To do some additional testing, take a look at: [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Addtl._Resource_Testing Addtl. Resource Testing]
*# To do some additional testing, take a look at: [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Addtl._Resource_Testing Addtl. Resource Testing]
* For any bugs found, add "[MoCoTestday]" to their whiteboard
* For any bugs found, add "[MoCoTestday]" to their whiteboard
Line 29: Line 37:


== Testing ==
== Testing ==
<Center><font color=red><b>NOT FINISHED! DON'T JUDGE ME :(</b></font></center>


=== Daily Browsing Testing ===
=== Daily Browsing Testing ===
Line 36: Line 43:


=== Fx3.5 Feature Testing ===
=== Fx3.5 Feature Testing ===
* Tear away and Drag-and-drop Tabs, Bookmarks and Folders [ {{bug|496103}}, {{bug|475066}} ]  
 
** []
* Tear away of Tabs [ {{bug|475066}} ]  
** Contacts: tracy, juanb, marcia
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/TearAwayTab Tear Away Tab Test Guide]
** Contacts: tracy, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** aakashd
*** aakashd
*** bpung
* Private Browsing [ {{bug|248970}} ]
* Private Browsing [ {{bug|248970}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/PrivateBrowsing Private Browsing Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/PrivateBrowsing Private Browsing Test Guide]
** Contacts: marcia, aaronmt
** Contacts: aaronmt, whimboo, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** armenzg
* Clear Recent History [ {{bug|480169}} ]
* Clear Recent History [ {{bug|480169}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/DailyBrowsing CRH Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/ClearRecentHistory CRH Test Guide]
** Contacts: tracy
** Contacts: tracy, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** jdicarlo (Done - found [http://crash-stats.mozilla.com/report/index/2e9ac49e-7f31-4119-a1af-86abc2090611 a crash])
* Video [ {{bug|382267}}, {{bug|422538}} ]
* Video [ {{bug|382267}}, {{bug|422538}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Video Video Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Video Video Test Guide]
** Contacts: aaronmt, tchung
** Contacts: aaronmt, tchung, whimboo
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** mak
*** myk
* Geolocation [ {{bug|488497}} ]
* Geolocation [ {{bug|488497}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Geolocation Geolocation Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Geolocation Geolocation Test Guide]
** Contacts: jmaher
** Contacts: jmaher
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** mak
*** dalmaer
* Session Restore/Restore Closed Windows [ {{bug|339445}}, {{bug|346337}}, {{bug|448976}} ]
* Session Restore/Restore Closed Windows [ {{bug|339445}}, {{bug|346337}}, {{bug|448976}} ]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/SessionRestore|Session Restore Test Guide]]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/SessionRestore|Session Restore Test Guide]]
** Contacts: ctalbert
** Contacts: ctalbert, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
* LocalStore [ {{bug|422526}}, {{bug|485396}}, {{bug|484180}} ]
*** ashughes
** [ Test Guide]
 
** Contacts: juanb
* JS/Java [ {{bug|488015}}, {{bug|452498}}, ]
** <font color=green><b>Sign Up Here:</b></font>
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Javascript|JS/Java Test Guide]]
* JS Enhancements [ {{bug|488015}}, {{bug|452498}}, ]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Javascript|JS Test Guide]]
** Contacts: ctalbert
** Contacts: ctalbert
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** bgalbraith


===  Addtl. Resource Testing ===
===  Addtl. Resource Testing ===
Line 74: Line 93:
** Contacts: tchung
** Contacts: tchung
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
* Test banking sites via the [http://quality.mozilla.org/website-testing Website Testing Project] to log all results
* Test banking sites via the [http://quality.mozilla.org/website-testing Website Testing Project] to log all results
** <font color=red>DISCLAIMER:</FONT> it requires another login for the time being, so please register in order to make result reports!
** <font color=red><b>DISCLAIMER:</b></FONT> it requires another login for the time being, so please register in order to make result reports!
** Contacts: whimboo
** Contacts: whimboo
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** jdicarlo  (Done)
== Results Summary ==
* Fx 3.5 Preview
** Had a max of 64 in the testday channel at its peak
** Major contributors outside mozQA: Labs team! (jono, myk, Mardak), mak, kbrosnan, tmyoung, asadotzler, ozten, Lucas, TheUni, limi, zpao, dao, dria, mitchell, dveditz,
** [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=mocotestday 23 Bugs found]
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Tabbed+Browser&component=Tabbed+Browsing&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 6 Tabbed/Browsing] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Video%2FAudio&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 5 Video/Audio] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Session+Restore&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 4 Session Store] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Geolocation&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 2 Geolocation] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Private+Browsing&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Private Browsing] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Drag+%26+Drop&component=Drag+and+Drop&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Drag and Drop] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Layout&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Layout] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Microsummaries&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Microsummaries] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=JavaScript+Debugging+APIs&component=JavaScript+Engine&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Javascript] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=General&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 General] Bug
** Special thanks to tmyoung and jono for finding [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Other&product=Mozilla+Labs&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&emailreporter1=1&emailtype1=substring&email1=&emailreporter2=1&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=2009-06-10&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=reporter&type0-0-0=substring&value0-0-0=jdicarlo%40mozilla.com&field0-0-1=reporter&type0-0-1=substring&value0-0-1=mozilla.bugs%40alyoung.com&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3= 4 more Labs] bugs on the day

Latest revision as of 17:00, 12 June 2009

Read Me First!

  • If you are an advanced user, download the latest Shiretoko nightly, create a new profile, and check out an area from the guide below.
  • If you're not an advanced user but you just can't wait: Download the Firefox 3.5b4
    • If you are like most in Moco, you have a Mac, so create a temporary folder on your desktop, and name it something like: beta99test
    • Open your Terminal application. At the prompt type:
    • ./Desktop/beta99test/Firefox.app/Contents/MacOS/firefox -P -no-remote
    • Create a new profile. Give it a name such as "preview", and start the browser.
    • After it starts. Check for updates. You should be offered the new Preview version. Go through the installation and run with it!!! (Contact juanb on irc, or x262 if you have questions, or if you are using Windows XP/Vista:) )
  • What are we doing?
    1. Run a quick testsuite of daily browsed sites
    2. Next, sign up to test new Fx3.5 Features under the "Testers" list
      • Try to make a concerted effort to sign up for something you're not comfortable with
      • Example: "aakashd" signed up for Tab testing is shown here
      • Signing up for a feature is just to show which features are getting a lot of attention and which ones aren't
      • People are free to "sign up" for more than one feature if they like
      • The onus is on learning new features for those that haven't tried them out as well as using these features together to find deeper critical/blocker bugs
    3. To do some additional testing, take a look at: Addtl. Resource Testing
  • For any bugs found, add "[MoCoTestday]" to their whiteboard
    • If you're unsure it's a bug, go to the #testday channel (check out Communication for more info)

Supplementary Information

When and Where?

  • Date: Thursday, June 11
  • Time: 7 AM - 5 PM PDT
  • Location: on the #testday channel (via irc.mozilla.org) and/or in-house @ Mountain View

Communication

  • For general questions: irc: #testday channel
    • primary contacts: timr, tchung, juanb, aakashd
  • When testing on Fx3.5 features, go to their corresponding

Reference Guides

Testing

Daily Browsing Testing

Fx3.5 Feature Testing

Addtl. Resource Testing

  • Test banking sites via the Website Testing Project to log all results
    • DISCLAIMER: it requires another login for the time being, so please register in order to make result reports!
    • Contacts: whimboo
    • Sign Up Here:
      • jdicarlo (Done)

Results Summary