QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(15 intermediate revisions by 7 users not shown)
Line 1: Line 1:
== '''Read Me First!''' ==
== '''Read Me First!''' ==
* If you are an advanced user, download the [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-1.9.1/ latest Shiretoko nightly], create a new profile, and check out an area from the guide below.
* If you're not an advanced user but you just can't wait: [http://www.mozilla.com/en-US/firefox/all-beta.html Download the Firefox 3.5b4]
** If you are like most in Moco, you have a Mac, so create a temporary folder on your desktop, and name it something like: ''beta99test''
** Open your Terminal application. At the prompt type:
** <pre>./Desktop/beta99test/Firefox.app/Contents/MacOS/firefox -P -no-remote</pre>
** Create a new profile. Give it a name such as "preview", and start the browser.
** After it starts. Check for updates. You should be offered the new Preview version. Go through the installation and run with it!!! (Contact juanb on irc, or x262 if you have questions, or if you are using Windows XP/Vista:) )
* What are we doing?
* What are we doing?
*# Run a [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Daily_Browsing_Testing quick testsuite] of daily browsed sites
*# Run a [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Daily_Browsing_Testing quick testsuite] of daily browsed sites
Line 38: Line 46:
* Tear away of Tabs  [ {{bug|475066}} ]  
* Tear away of Tabs  [ {{bug|475066}} ]  
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/TearAwayTab Tear Away Tab Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/TearAwayTab Tear Away Tab Test Guide]
** Contacts: tracy
** Contacts: tracy, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** aakashd
*** aakashd
*** bpung


* Private Browsing [ {{bug|248970}} ]
* Private Browsing [ {{bug|248970}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/PrivateBrowsing Private Browsing Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/PrivateBrowsing Private Browsing Test Guide]
** Contacts: aaronmt, whimboo
** Contacts: aaronmt, whimboo, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** armenzg
*** armenzg
Line 50: Line 59:
* Clear Recent History [ {{bug|480169}} ]
* Clear Recent History [ {{bug|480169}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/ClearRecentHistory CRH Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/ClearRecentHistory CRH Test Guide]
** Contacts: tracy
** Contacts: tracy, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** jdicarlo (Done - found [http://crash-stats.mozilla.com/report/index/2e9ac49e-7f31-4119-a1af-86abc2090611 a crash])


* Video [ {{bug|382267}}, {{bug|422538}} ]
* Video [ {{bug|382267}}, {{bug|422538}} ]
Line 58: Line 68:
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** mak
*** mak
*** myk


* Geolocation [ {{bug|488497}} ]
* Geolocation [ {{bug|488497}} ]
Line 64: Line 75:
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** mak
*** mak
*** dalmaer


* Session Restore/Restore Closed Windows [ {{bug|339445}}, {{bug|346337}}, {{bug|448976}} ]
* Session Restore/Restore Closed Windows [ {{bug|339445}}, {{bug|346337}}, {{bug|448976}} ]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/SessionRestore|Session Restore Test Guide]]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/SessionRestore|Session Restore Test Guide]]
** Contacts: ctalbert
** Contacts: ctalbert, juanb
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** ashughes


* JS/Java [ {{bug|488015}}, {{bug|452498}}, ]
* JS/Java [ {{bug|488015}}, {{bug|452498}}, ]
Line 74: Line 87:
** Contacts: ctalbert
** Contacts: ctalbert
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** bgalbraith


===  Addtl. Resource Testing ===
===  Addtl. Resource Testing ===
Line 84: Line 98:
** Contacts: whimboo
** Contacts: whimboo
** <font color=green><b>Sign Up Here:</b></font>
** <font color=green><b>Sign Up Here:</b></font>
*** jdicarlo  (Done)
== Results Summary ==
* Fx 3.5 Preview
** Had a max of 64 in the testday channel at its peak
** Major contributors outside mozQA: Labs team! (jono, myk, Mardak), mak, kbrosnan, tmyoung, asadotzler, ozten, Lucas, TheUni, limi, zpao, dao, dria, mitchell, dveditz,
** [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=mocotestday 23 Bugs found]
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Tabbed+Browser&component=Tabbed+Browsing&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 6 Tabbed/Browsing] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Video%2FAudio&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 5 Video/Audio] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Session+Restore&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 4 Session Store] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Geolocation&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 2 Geolocation] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Private+Browsing&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Private Browsing] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Drag+%26+Drop&component=Drag+and+Drop&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Drag and Drop] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Layout&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Layout] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Microsummaries&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Microsummaries] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=JavaScript+Debugging+APIs&component=JavaScript+Engine&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Javascript] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=General&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 General] Bug
** Special thanks to tmyoung and jono for finding [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Other&product=Mozilla+Labs&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&emailreporter1=1&emailtype1=substring&email1=&emailreporter2=1&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=2009-06-10&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=reporter&type0-0-0=substring&value0-0-0=jdicarlo%40mozilla.com&field0-0-1=reporter&type0-0-1=substring&value0-0-1=mozilla.bugs%40alyoung.com&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3= 4 more Labs] bugs on the day

Latest revision as of 17:00, 12 June 2009

Read Me First!

  • If you are an advanced user, download the latest Shiretoko nightly, create a new profile, and check out an area from the guide below.
  • If you're not an advanced user but you just can't wait: Download the Firefox 3.5b4
    • If you are like most in Moco, you have a Mac, so create a temporary folder on your desktop, and name it something like: beta99test
    • Open your Terminal application. At the prompt type:
    • ./Desktop/beta99test/Firefox.app/Contents/MacOS/firefox -P -no-remote
    • Create a new profile. Give it a name such as "preview", and start the browser.
    • After it starts. Check for updates. You should be offered the new Preview version. Go through the installation and run with it!!! (Contact juanb on irc, or x262 if you have questions, or if you are using Windows XP/Vista:) )
  • What are we doing?
    1. Run a quick testsuite of daily browsed sites
    2. Next, sign up to test new Fx3.5 Features under the "Testers" list
      • Try to make a concerted effort to sign up for something you're not comfortable with
      • Example: "aakashd" signed up for Tab testing is shown here
      • Signing up for a feature is just to show which features are getting a lot of attention and which ones aren't
      • People are free to "sign up" for more than one feature if they like
      • The onus is on learning new features for those that haven't tried them out as well as using these features together to find deeper critical/blocker bugs
    3. To do some additional testing, take a look at: Addtl. Resource Testing
  • For any bugs found, add "[MoCoTestday]" to their whiteboard
    • If you're unsure it's a bug, go to the #testday channel (check out Communication for more info)

Supplementary Information

When and Where?

  • Date: Thursday, June 11
  • Time: 7 AM - 5 PM PDT
  • Location: on the #testday channel (via irc.mozilla.org) and/or in-house @ Mountain View

Communication

  • For general questions: irc: #testday channel
    • primary contacts: timr, tchung, juanb, aakashd
  • When testing on Fx3.5 features, go to their corresponding

Reference Guides

Testing

Daily Browsing Testing

Fx3.5 Feature Testing

Addtl. Resource Testing

  • Test banking sites via the Website Testing Project to log all results
    • DISCLAIMER: it requires another login for the time being, so please register in order to make result reports!
    • Contacts: whimboo
    • Sign Up Here:
      • jdicarlo (Done)

Results Summary