QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(25 intermediate revisions by 12 users not shown)
Line 1: Line 1:
== Read Me First! ==
== '''Read Me First!''' ==
* If you are an advanced user, download the [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-1.9.1/ latest Shiretoko nightly], create a new profile, and check out an area from the guide below.
* If you're not an advanced user but you just can't wait: [http://www.mozilla.com/en-US/firefox/all-beta.html Download the Firefox 3.5b4]
** If you are like most in Moco, you have a Mac, so create a temporary folder on your desktop, and name it something like: ''beta99test''
** Open your Terminal application. At the prompt type:
** <pre>./Desktop/beta99test/Firefox.app/Contents/MacOS/firefox -P -no-remote</pre>
** Create a new profile. Give it a name such as "preview", and start the browser.
** After it starts. Check for updates. You should be offered the new Preview version. Go through the installation and run with it!!! (Contact juanb on irc, or x262 if you have questions, or if you are using Windows XP/Vista:) )
 
* What are we doing?
* What are we doing?
*# Run a [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Daily_Browsing_Testing quick testsuite] of daily browsed sites
*# Run a [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Daily_Browsing_Testing quick testsuite] of daily browsed sites
Line 29: Line 37:


== Testing ==
== Testing ==
<Center><font color=red><b>NOT FINISHED! DON'T JUDGE ME :(</b></font></center>


=== Daily Browsing Testing ===
=== Daily Browsing Testing ===
Line 37: Line 44:
=== Fx3.5 Feature Testing ===
=== Fx3.5 Feature Testing ===


* Tear away of Tabs, [ {{bug|475066}} ]  
* Tear away of Tabs  [ {{bug|475066}} ]  
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/TearAwayTab Tear Away Tab Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/TearAwayTab Tear Away Tab Test Guide]
** Contacts: tracy, juanb, marcia
** Contacts: tracy, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** aakashd
*** aakashd
*** bpung


* Private Browsing [ {{bug|248970}} ]
* Private Browsing [ {{bug|248970}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/PrivateBrowsing Private Browsing Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/PrivateBrowsing Private Browsing Test Guide]
** Contacts: marcia, aaronmt
** Contacts: aaronmt, whimboo, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** armenzg


* Clear Recent History [ {{bug|480169}} ]
* Clear Recent History [ {{bug|480169}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/ClearRecentHistory CRH Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/ClearRecentHistory CRH Test Guide]
** Contacts: tracy
** Contacts: tracy, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** jdicarlo (Done - found [http://crash-stats.mozilla.com/report/index/2e9ac49e-7f31-4119-a1af-86abc2090611 a crash])


* Video [ {{bug|382267}}, {{bug|422538}} ]
* Video [ {{bug|382267}}, {{bug|422538}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Video Video Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Video Video Test Guide]
** Contacts: aaronmt, tchung
** Contacts: aaronmt, tchung, whimboo
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** mak
*** myk


* Geolocation [ {{bug|488497}} ]
* Geolocation [ {{bug|488497}} ]
Line 62: Line 74:
** Contacts: jmaher
** Contacts: jmaher
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** mak
*** dalmaer


* Session Restore/Restore Closed Windows [ {{bug|339445}}, {{bug|346337}}, {{bug|448976}} ]
* Session Restore/Restore Closed Windows [ {{bug|339445}}, {{bug|346337}}, {{bug|448976}} ]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/SessionRestore|Session Restore Test Guide]]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/SessionRestore|Session Restore Test Guide]]
** Contacts: ctalbert
** Contacts: ctalbert, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** ashughes


* LocalStore [ {{bug|422526}}, {{bug|485396}}, {{bug|484180}} ]
* JS/Java [ {{bug|488015}}, {{bug|452498}}, ]
** [ Test Guide]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Javascript|JS/Java Test Guide]]
** Contacts: juanb
** <font color=green><b>Sign Up Here:</b></font>
 
* JS Enhancements [ {{bug|488015}}, {{bug|452498}}, ]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Javascript|JS Test Guide]]
** Contacts: ctalbert
** Contacts: ctalbert
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** bgalbraith


===  Addtl. Resource Testing ===
===  Addtl. Resource Testing ===
Line 84: Line 95:


* Test banking sites via the [http://quality.mozilla.org/website-testing Website Testing Project] to log all results
* Test banking sites via the [http://quality.mozilla.org/website-testing Website Testing Project] to log all results
** <font color=red>DISCLAIMER:</FONT> it requires another login for the time being, so please register in order to make result reports!
** <font color=red><b>DISCLAIMER:</b></FONT> it requires another login for the time being, so please register in order to make result reports!
** Contacts: whimboo
** Contacts: whimboo
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** jdicarlo  (Done)
== Results Summary ==
* Fx 3.5 Preview
** Had a max of 64 in the testday channel at its peak
** Major contributors outside mozQA: Labs team! (jono, myk, Mardak), mak, kbrosnan, tmyoung, asadotzler, ozten, Lucas, TheUni, limi, zpao, dao, dria, mitchell, dveditz,
** [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=mocotestday 23 Bugs found]
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Tabbed+Browser&component=Tabbed+Browsing&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 6 Tabbed/Browsing] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Video%2FAudio&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 5 Video/Audio] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Session+Restore&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 4 Session Store] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Geolocation&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 2 Geolocation] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Private+Browsing&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Private Browsing] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Drag+%26+Drop&component=Drag+and+Drop&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Drag and Drop] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Layout&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Layout] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Microsummaries&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Microsummaries] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=JavaScript+Debugging+APIs&component=JavaScript+Engine&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Javascript] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=General&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 General] Bug
** Special thanks to tmyoung and jono for finding [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Other&product=Mozilla+Labs&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&emailreporter1=1&emailtype1=substring&email1=&emailreporter2=1&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=2009-06-10&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=reporter&type0-0-0=substring&value0-0-0=jdicarlo%40mozilla.com&field0-0-1=reporter&type0-0-1=substring&value0-0-1=mozilla.bugs%40alyoung.com&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3= 4 more Labs] bugs on the day

Latest revision as of 17:00, 12 June 2009

Read Me First!

  • If you are an advanced user, download the latest Shiretoko nightly, create a new profile, and check out an area from the guide below.
  • If you're not an advanced user but you just can't wait: Download the Firefox 3.5b4
    • If you are like most in Moco, you have a Mac, so create a temporary folder on your desktop, and name it something like: beta99test
    • Open your Terminal application. At the prompt type:
    • ./Desktop/beta99test/Firefox.app/Contents/MacOS/firefox -P -no-remote
    • Create a new profile. Give it a name such as "preview", and start the browser.
    • After it starts. Check for updates. You should be offered the new Preview version. Go through the installation and run with it!!! (Contact juanb on irc, or x262 if you have questions, or if you are using Windows XP/Vista:) )
  • What are we doing?
    1. Run a quick testsuite of daily browsed sites
    2. Next, sign up to test new Fx3.5 Features under the "Testers" list
      • Try to make a concerted effort to sign up for something you're not comfortable with
      • Example: "aakashd" signed up for Tab testing is shown here
      • Signing up for a feature is just to show which features are getting a lot of attention and which ones aren't
      • People are free to "sign up" for more than one feature if they like
      • The onus is on learning new features for those that haven't tried them out as well as using these features together to find deeper critical/blocker bugs
    3. To do some additional testing, take a look at: Addtl. Resource Testing
  • For any bugs found, add "[MoCoTestday]" to their whiteboard
    • If you're unsure it's a bug, go to the #testday channel (check out Communication for more info)

Supplementary Information

When and Where?

  • Date: Thursday, June 11
  • Time: 7 AM - 5 PM PDT
  • Location: on the #testday channel (via irc.mozilla.org) and/or in-house @ Mountain View

Communication

  • For general questions: irc: #testday channel
    • primary contacts: timr, tchung, juanb, aakashd
  • When testing on Fx3.5 features, go to their corresponding

Reference Guides

Testing

Daily Browsing Testing

Fx3.5 Feature Testing

Addtl. Resource Testing

  • Test banking sites via the Website Testing Project to log all results
    • DISCLAIMER: it requires another login for the time being, so please register in order to make result reports!
    • Contacts: whimboo
    • Sign Up Here:
      • jdicarlo (Done)

Results Summary