QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday: Difference between revisions

no edit summary
No edit summary
 
(36 intermediate revisions by 12 users not shown)
Line 1: Line 1:
== Read Me First! ==
== '''Read Me First!''' ==
* Run a quick testsuite of daily browsed sites
* If you are an advanced user, download the [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-1.9.1/ latest Shiretoko nightly], create a new profile, and check out an area from the guide below.
* Next, sign up to test [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Fx3.5_Feature_Testing new Fx3.5 Features] under the "Testers" list
* If you're not an advanced user but you just can't wait: [http://www.mozilla.com/en-US/firefox/all-beta.html Download the Firefox 3.5b4]
** Try to make a concerted effort to sign up for something you're not comfortable with
** If you are like most in Moco, you have a Mac, so create a temporary folder on your desktop, and name it something like: ''beta99test''
** People are free to "sign up" for <b>more than one feature</b> if they like
** Open your Terminal application. At the prompt type:
** The onus is on learning new features for those that haven't tried them out <b>as well as</b> using these features together to find deeper critical/blocker bugs
** <pre>./Desktop/beta99test/Firefox.app/Contents/MacOS/firefox -P -no-remote</pre>
** Example: "aakashd" signed up for Tab testing is shown [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Fx3.5_Feature_Testing here]
** Create a new profile. Give it a name such as "preview", and start the browser.
** After it starts. Check for updates. You should be offered the new Preview version. Go through the installation and run with it!!! (Contact juanb on irc, or x262 if you have questions, or if you are using Windows XP/Vista:) )
 
* What are we doing?
*# Run a [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Daily_Browsing_Testing quick testsuite] of daily browsed sites
*# Next, sign up to test [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Fx3.5_Feature_Testing new Fx3.5 Features] under the "Testers" list
*#* Try to make a concerted effort to sign up for something you're not comfortable with
*#* Example: "aakashd" signed up for Tab testing is shown [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Fx3.5_Feature_Testing here]
*#* Signing up for a feature is just to show which features are getting a lot of attention and which ones aren't
*#* People are free to "sign up" for more than one feature if they like
*#* The onus is on learning new features for those that haven't tried them out <b>as well as</b> using these features together to find deeper critical/blocker bugs
*# To do some additional testing, take a look at: [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Addtl._Resource_Testing Addtl. Resource Testing]
* For any bugs found, add "[MoCoTestday]" to their whiteboard
* For any bugs found, add "[MoCoTestday]" to their whiteboard
** If you're unsure it's a bug, go to the #testday channel (check out [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Communication Communication] for more info)
** If you're unsure it's a bug, go to the #testday channel (check out [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Communication Communication] for more info)
* To do more testing, take a look at: [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday#Addtl._Resource_Testing Addtl. Resource Testing]


== Supplementary Information ==
== Supplementary Information ==
Line 27: Line 37:


== Testing ==
== Testing ==
<Center><font color=red><b>NOT FINISHED! DON'T JUDGE ME :(</b></font></center>


=== Daily Browsing Testing ===
=== Daily Browsing Testing ===
Line 34: Line 43:


=== Fx3.5 Feature Testing ===
=== Fx3.5 Feature Testing ===
* Tear away and Drag-and-drop Tabs, Bookmarks and Folders [ {{bug|496103}}, {{bug|475066}} ]  
 
** []
* Tear away of Tabs [ {{bug|475066}} ]  
** Contacts: tracy, juanb, marcia
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/TearAwayTab Tear Away Tab Test Guide]
** Testers
** Contacts: tracy, juanb
** <font color=green><b>Sign Up Here:</b></font>
*** aakashd
*** aakashd
*** bpung
* Private Browsing [ {{bug|248970}} ]
* Private Browsing [ {{bug|248970}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/PrivateBrowsing Private Browsing Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/PrivateBrowsing Private Browsing Test Guide]
** Contacts: marcia, aaronmt
** Contacts: aaronmt, whimboo, juanb
** Testers
** <font color=green><b>Sign Up Here:</b></font>
*** armenzg
 
* Clear Recent History [ {{bug|480169}} ]
* Clear Recent History [ {{bug|480169}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/DailyBrowsing CRH Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/ClearRecentHistory CRH Test Guide]
** Contacts: tracy
** Contacts: tracy, juanb
** Testers
** <font color=green><b>Sign Up Here:</b></font>
*** jdicarlo (Done - found [http://crash-stats.mozilla.com/report/index/2e9ac49e-7f31-4119-a1af-86abc2090611 a crash])
 
* Video [ {{bug|382267}}, {{bug|422538}} ]
* Video [ {{bug|382267}}, {{bug|422538}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Video Video Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Video Video Test Guide]
** Contacts: aaronmt, tchung
** Contacts: aaronmt, tchung, whimboo
** Testers
** <font color=green><b>Sign Up Here:</b></font>
*** mak
*** myk
 
* Geolocation [ {{bug|488497}} ]
* Geolocation [ {{bug|488497}} ]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Geolocation Geolocation Test Guide]
** [https://wiki.mozilla.org/QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Geolocation Geolocation Test Guide]
** Contacts: jmaher
** Contacts: jmaher
** Testers
** <font color=green><b>Sign Up Here:</b></font>
*** mak
*** dalmaer
 
* Session Restore/Restore Closed Windows [ {{bug|339445}}, {{bug|346337}}, {{bug|448976}} ]
* Session Restore/Restore Closed Windows [ {{bug|339445}}, {{bug|346337}}, {{bug|448976}} ]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/SessionRestore|Session Restore Test Guide]]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/SessionRestore|Session Restore Test Guide]]
** Contacts: ctalbert, juanb
** <font color=green><b>Sign Up Here:</b></font>
*** ashughes
* JS/Java [ {{bug|488015}}, {{bug|452498}}, ]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Javascript|JS/Java Test Guide]]
** Contacts: ctalbert
** Contacts: ctalbert
** Testers
** <font color=green><b>Sign Up Here:</b></font>
* LocalStore [ {{bug|422526}}, {{bug|485396}}, {{bug|484180}} ]
*** bgalbraith
** [ Test Guide]
** Contacts: juanb
** Testers
* JS Enhancements [ {{bug|488015}}, {{bug|452498}}, ]
** [[QA/Firefox3.5/TestPlan/BetaPreview/MocoTestday/Javascript|JS Test Guide]]
** Contacts: ctalbert
** Testers


===  Addtl. Resource Testing ===
===  Addtl. Resource Testing ===
* Verification of [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Core&product=Firefox&product=Toolkit&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.9.1&bug_status=RESOLVED&bug_status=VERIFIED&resolution=FIXED&bug_severity=blocker&bug_severity=critical&emailassigned_to1=1&emailtype1=substring&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&known_name=1.9.1+FIXED&query_based_on=1.9.1+FIXED&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=&field0-0-1=flagtypes.name&type0-0-1=equals&value0-0-1= critical and blocker resolved bugs]  
* Verification of [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Core&product=Firefox&product=Toolkit&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.9.1&bug_status=RESOLVED&bug_status=VERIFIED&resolution=FIXED&bug_severity=blocker&bug_severity=critical&emailassigned_to1=1&emailtype1=substring&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&known_name=1.9.1+FIXED&query_based_on=1.9.1+FIXED&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=&field0-0-1=flagtypes.name&type0-0-1=equals&value0-0-1= critical and blocker resolved bugs]  
** Contacts: tchung
** Contacts: tchung
** Testers
** <font color=green><b>Sign Up Here:</b></font>
 
* Test banking sites via the [http://quality.mozilla.org/website-testing Website Testing Project] to log all results
* Test banking sites via the [http://quality.mozilla.org/website-testing Website Testing Project] to log all results
** <font color=red>DISCLAIMER:</FONT> it requires another login for the time being, so please register in order to make result reports!
** <font color=red><b>DISCLAIMER:</b></FONT> it requires another login for the time being, so please register in order to make result reports!
** Contacts: whimboo
** Contacts: whimboo
** Testers
** <font color=green><b>Sign Up Here:</b></font>
*** jdicarlo  (Done)
 
== Results Summary ==
* Fx 3.5 Preview
** Had a max of 64 in the testday channel at its peak
** Major contributors outside mozQA: Labs team! (jono, myk, Mardak), mak, kbrosnan, tmyoung, asadotzler, ozten, Lucas, TheUni, limi, zpao, dao, dria, mitchell, dveditz,
** [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=mocotestday 23 Bugs found]
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Tabbed+Browser&component=Tabbed+Browsing&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 6 Tabbed/Browsing] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Video%2FAudio&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 5 Video/Audio] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Session+Restore&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 4 Session Store] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Geolocation&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 2 Geolocation] Bugs
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Private+Browsing&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Private Browsing] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Drag+%26+Drop&component=Drag+and+Drop&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Drag and Drop] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Layout&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Layout] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=Microsummaries&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Microsummaries] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=JavaScript+Debugging+APIs&component=JavaScript+Engine&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 Javascript] Bug
*** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&component=General&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=product&type0-0-0=substring&value0-0-0=mocotestday&field0-0-1=component&type0-0-1=substring&value0-0-1=mocotestday&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=mocotestday&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=mocotestday 1 General] Bug
** Special thanks to tmyoung and jono for finding [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Other&product=Mozilla+Labs&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&emailreporter1=1&emailtype1=substring&email1=&emailreporter2=1&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=2009-06-10&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=reporter&type0-0-0=substring&value0-0-0=jdicarlo%40mozilla.com&field0-0-1=reporter&type0-0-1=substring&value0-0-1=mozilla.bugs%40alyoung.com&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3= 4 more Labs] bugs on the day
Confirmed users
6,300

edits