QA/Fennec/Waverley: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
 
(30 intermediate revisions by 5 users not shown)
Line 213: Line 213:
| '''TC added'''
| '''TC added'''
|-
|-
| 10/08/12
| 10/18/12
| Firefox Mobile 16 RC
| Firefox for Android 17.0b2 build2 2012-10-18
Samsung Galaxy Tab (Android 3.1)
*Samsung Galaxy R (Android 2.3.4)
*Acer A500 (Android 3.2.1)
|
|
* Smoke and Exploratory on Firefox Mobile 16 RC (adrian.tamas)
* Smoketests, Bug verification and Exploratory on Firefox for Android 17.0b2 build2 (2012-10-18) (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=237 Smoke test results]
**[https://moztrap.mozilla.org/results/cases/?filter-run=272 MozTrap smoketest results for ARMv7]
**[https://moztrap.mozilla.org/results/cases/?filter-run=271 MozTrap smoketests results for Tablet]
|
|
|{{bug|799116}}, {{bug|799087}}, {{bug|799094}}, {{bug|799110}}, {{bug|799119}}
|
|
|{{bug|798942}}, {{bug|787188}}
|
|
|-
|-
| 10/08/12
| 10/18/12
| Firefox Mobile 16 RC
| Firefox for Android 17.0b2 build2 Samsung Galaxy Nexus (Android 4.1.1)
Asus Eee Transformers  (Android 4.1)
|
*  Smoke, Permissions and Exploratory on Firefox Mobile 16 RC (ioana.chiorean)
** [https://moztrap.mozilla.org/results/cases/?filter-run=237 Smoke test results]
|
|
* Smoketests and exploratory on Firefox for Android 17.0b2 build2 - Android 4.1.1, Android 3.1, Android 2.3.4, ARMv6 (andreea.pod)
* [https://moztrap.mozilla.org/results/cases/?filter-run=272 Smoke on phone]
* [https://moztrap.mozilla.org/results/cases/?filter-run=271 Smoke on tablet]
|
|
|{{bug|803024}}
|
|
|
|
|-
|-
| 10/08/12
| 10/23/12
| Firefox for Android 16 RC
| Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)
Samsung Galaxy Note (Android 4.0.4)
Acer A500 (Android 3.2.1)
|
|
* Smoketest (nicolae.cristian)
* Smoketests and Exploratory on Firefox for Android 17.0b3 build1 - Android 2.3.4,Android 3.2.1 ARMv7 (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=238 phone results]
* [https://moztrap.mozilla.org/results/cases/?filter-run=281 MozTrap smoketest results for ARMv7]
* Exploratory testing
* [https://moztrap.mozilla.org/results/cases/?filter-run=279 MozTrap smoketests results for Tablet]
** [https://goo.gl/PsCT4 exploratory results]
|
|
|{{bug|804964}}
|
|
|{{bug|786029}}
|
|
|-
|-
| 10/08/12
| 11/01/12
| Firefox Mobile 16 RC
| Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)
Asus Eee Transformers Galaxu Tab 2 (Android 4.1,4.0)  
Acer A500 (Android 3.2.1)
|
|
* Smoke and Exploratory on Firefox Mobile 16 RC (ioana.chiorean)
* Smoketests and Permissions on Firefox for Android 17.0b4 build1 - Android 2.3.4,Android 3.2.1 ARMv7 (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=237 Smoke test results]
* [https://moztrap.mozilla.org/results/cases/?filter-run=301 MozTrap smoketest results for ARMv7]
|
|
|
|
Line 259: Line 260:
|
|
|-
|-
| 10/09/12
| 11/01/12
| Firefox for Android 19.0a1
| Firefox for Android 17.0b3 build1 Samsung Galaxy S2 (Android 4.0.4)
Samsung Galaxy Note (Android 4.0.4)
|
* Smoketests and Exploratory on Firefox for Android 17.0b4 build1 - Android 4.0.4 ARMv7 (adrian.tamas)
* [https://moztrap.mozilla.org/results/cases/?filter-run=301 MozTrap smoketest results for ARMv7]
|
|
* Bug verification (nicolae.cristian)
* Exploratory testing (verify new features)
** [https://goo.gl/PsCT4 exploratory results]
|
|
|
|
|{{bug|769145}}, {{bug|790448}}, {{bug|776499}}, {{bug|776613}}, {{bug|770817}}, {{bug|743173}}, {{bug|710298}}, {{bug|795932}}, {{bug|793276}}, {{bug|778811}}
|
|
|-
|-
| 10/09/12
| 11/07/12
| Mozilla Central
| Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
Samsung Galaxy Tab (Android 3.1)
Samsung Galaxy R (Android 2.3.4)
|
*  Creating automation tests (adrian.tamas)
** [https://bugzilla.mozilla.org/show_bug.cgi?id=732212 Added patch in bug Bug 732212]
|
|
|
|
|
|-
* Smoketests and BFT's on Firefox for Android 17.0b5 build1 - Android 3.2.1 ARMv7 (paul.feher)
| 10/09/12
* [https://moztrap.mozilla.org/results/cases/?filter-run=319 MozTrap smoketest results for Tablets]
| Mozilla Central
* [https://moztrap.mozilla.org/results/cases/?filter-run=320 MozTrap BFT's results for Tablets]
HTC Desire Z (Android 2.3.4)
|
|
*  QA Wanted, Regression-window, Exploratory and Smoke tests on Nightly 19.0a1 2012-10-09  (paul.feher)
|
|
|{{bug|769145}}
|
|
|
|
|-
|-
| 10/09/12
| 11/08/12
| Firefox Mobile 19 Nightly
| Bug verification & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
Galaxy Nexus (Android 4.1)  
|
* Exploratory on Firefox Mobile 19 Nightly  (ioana.chiorean)
* Testing updates from Google Play - 16.0
* Bug triage
|
|
* Smoketests and BFT's on Firefox for Android 17.0b5 build1 - Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=319 MozTrap smoketest results for Tablets]
* [https://moztrap.mozilla.org/results/cases/?filter-run=320 MozTrap BFT's results for Tablets]
|
|
|
|
|{{bug|801627}}
|
|
|-
|-
| 10/10/12
| 11/09/12
| Mozilla Central
| Virtual Keyboard and IME  verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
Samsung Galaxy Tab (Android 3.1)
Samsung Galaxy R (Android 2.3.4)
|
*  Creating automation tests for forward, back and reload page (adrian.tamas)
** [https://bugzilla.mozilla.org/show_bug.cgi?id=747835 Working on a patch for 747835]
|
|
* QA-wanted bug investigation and Virtual Keyboard and IME  verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
|
|
|{{bug|810291}}, {{bug|810284}}, {{bug|810236}}, {{bug|810266}}
|
|
|
|
|-
|-
| 10/10/12
| 11/12/12
| Mozilla Central
| Virtual Keyboard and IME  verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
Samsung Galaxy R (Android 2.3.4)
HTC Desire Z (Android 2.3.4)
|
* Regression-window and Exploratory on Nightly 19.0a1 2012-10-10 (paul.feher)
|
|{{bug|799932}}
|
|
|
|-
* QA-wanted bug investigation and Virtual Keyboard and IME  verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
| 10/10/12
| Firefox for Android 19.0a1
Samsung Galaxy Note (Android 4.0.4)
|
|
* Bug verification (nicolae.cristian)
|{{bug|810792}}, {{bug|810816}}
* Exploratory testing (verify new features)
** [https://goo.gl/PsCT4 exploratory results]
* Add TCs to MozTrap
** [https://moztrap.mozilla.org/manage/cases/?filter-id=2738 Reflow-On-Zoom]
** [https://moztrap.mozilla.org/manage/cases/?filter-id=2739 Search suggestions prompt]
** [https://moztrap.mozilla.org/manage/cases/?filter-id=2740 Search suggestions prompt]
|
|
|{{bug|799865}}, {{bug|799924}}
|{{bug|779096}}, {{bug|781542}}
|
|
|-
|-
| 10/10/12
| 11/13/12
| Firefox Mobile 19 Nightly
| QA-wanted bug investigation, Regression-window and Exploratory on Samsung Galaxy R (Android 2.3.4)
Galaxy Nexus (Android 4.1,4.0)  
|
|
* Bug Verification - all branches  (ioana.chiorean)
* QA-wanted bug investigation, Regression-window and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
|
|
|{{bug|811238}}, {{bug|811231}}, {{bug|811304}}
|
|
|{{Bug|799206}}, {{Bug|799053}}, {{Bug|798920}}, {{Bug|795656}}, {{Bug|795705,792060}}, {{Bug|776950,775770}}, {{Bug|776064}}, {{Bug|689687}}, {{Bug|775766}}, {{Bug|769886}}, {{Bug|657744}}, {{Bug|672004}}, {{Bug|687717}}, {{Bug|757856}}, {{Bug|701137}},
|
|
|-
|-
| 10/09/12
| 11/14/12
| Mozilla Central
| Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 6 build 1 Samsung Galaxy Tab (Android 3.1.1)
Samsung Galaxy Tab (Android 3.1)
|
* BFT's on Firefox Beta 17.0b1 build 2 2012-10-11 (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=251 BFT's Results]
|
|
|
|
* Smoketests and BFT's on Firefox for Android 17.0b6 build1 - Android 3.1.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=328 MozTrap smoketest results for Phones]
* [https://moztrap.mozilla.org/results/cases/?filter-run=330 MozTrap smoketest results for Tablets]
|
|
|-
|{{bug|811707}}
| 10/11/12
| Firefox Mobile 17.0b1 build 2
Samsung Galaxy Tab 2 7.0 (Android 4.0.4)
|
*  Smoke, Permissions and BFTs on tablet (adrian.tamas)
** [https://moztrap.mozilla.org/results/cases/?filter-run=248 Smoke]
** [https://moztrap.mozilla.org/results/cases/?filter-run=251 BFTs]
|
|
|{{bug|800286}}, {{bug|800305}}, {{bug|800356}}
|{{bug|793480}}, {{bug|786623}}
|
|
|-
|-
| 10/11/12
| 11/15/12
| Firefox Mobile 17.0b1  Beta Build 2
| Bug triage and Exploratory on Samsung Galaxy R (Android 2.3.4)
Galaxy Nexus (Android 4.1), LG Slider (2.3 ARMv6)
|
* Smoke, Permission and BFTs (ioana.chiorean)
* [https://moztrap.mozilla.org/results/cases/?filter-run=252 BFT]
* [https://moztrap.mozilla.org/results/cases/?filter-run=249 Smoke ARMv7]
* [https://moztrap.mozilla.org/results/cases/?filter-run=250 Smoke ARMv6]
* [https://wiki.mozilla.org/QA/Fennec/17/Beta/1/Build_2/permissions-results Permission]
* [https://wiki.mozilla.org/QA/Fennec/17/Beta/1/Build_2/ Testplan for Fennec (Firefox for Android) 17.0 Beta 1 Build 2]
|
|
* Bug triage and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
|
|
|{{bug|812118}}
|
|
|
|
|-
|-
| 10/12/12
| 11/16/12
| Aurora 18.0a2 2012-10-11
| Bug triage and Smoke tests on Mobile Firefox for Android 17 Beta 7 build 1 Samsung Galaxy Tab (Android 3.1.1)
Samsung Galaxy Tab 2 7.0 (Android 4.0.4)
|
*  BFTs on tablet (adrian.tamas)
** [https://moztrap.mozilla.org/results/cases/?filter-run=262 BFTs]
|
|{{bug|800805}}, {{bug|800831}}, {{bug|800849}}, {{bug|800869}}, {{bug|800879}}
|
|
|
|-
* Bug triage and Smoketests on Firefox for Android 17.0b7 build1 - Android 3.1.1 ARMv7 (paul.feher)
| 10/12/12
* [https://moztrap.mozilla.org/results/cases/?filter-run=390 MozTrap smoketest results for Tablets]
| Aurora 18.0a2 2012-10-11
Samsung Galaxy Tab (Android 3.1)
|
|
* BFTs & Smoke Test on tablet Firefox Beta 17.0b1 build 2 2012-10-11 (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=258 Smoke Test Results]
** [https://moztrap.mozilla.org/results/cases/?filter-run=262 BFTs Results]
|
|
|{{bug|800886}}, {{bug|800899}}
|
|
|
|
|-
|-
| 10/12/12
| 11/19/12
| Firefox Mobile 18.0a2 Aurora Sign Off
| Bug triage and Smoke tests on Mobile Firefox 17.0 RC Samsung Galaxy R (Android 2.3.4)
Galaxy Nexus (Android 4.1), LG Slider (2.3 ARMv6)
|
* Smoke and BFTs 18.0 Aurora Sign Off(ioana.chiorean)
* [https://moztrap.mozilla.org/results/cases/?filter-run=262 BFT]
* [https://moztrap.mozilla.org/results/cases/?filter-run=259 Smoke ARMv6]
* [https://wiki.mozilla.org/QA/Fennec/18/Aurora/SignOff/ Fennec (Firefox for Android) 18.0 Aurora Sign Off]
|
|
* Bug triage and Smoketests on Mobile Firefox 17.0 RC Samsung Galaxy R - Android 2.3.4 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=396 MozTrap smoketest results for Phones]
|
|
|
|
|{{bug|802549}}
|
|
|}
|}

Latest revision as of 15:48, 19 November 2012

Weekly Meetings

Conference room details will vary team, but they will be held at 8am on Tuesdays.

Tuesdays, 8am PT / 4pm GMT
All-Team Meeting
Dial in: 800-707-2533
Password 369, conference #245
Tuesdays, 8am PT / 4pm GMT
Firefox (Desktop Firefox): Juan Becerra
Dial in: 650-903-0800 (US), x92 then 9 and extension number 262
Or: 800-707-2533, pin 369, then 9 and extension number 262
Tuesdays, 8am PT / 4pm GMT
Automation WebQA
Dial in: 800-707-2533
Password 369, conference #
Mondays, 8am PT / 4pm GMT
Desktop Automation
Dial in: 800-707-2533
Password 369, conference #654
Tuesdays, 8am PT / 4pm GMT
Fennec
Dial in: 800-707-2533
Password 369, conference #

Every two weeks we will hold meetings to go over highlights with all the teams. The time for this meeting has not yet been decided.

All-Team Meetings

  • Bi-weekly Team Agenda
    • We will hold bi-weekly meetings to catch up on work from all teams. Time and format to be decided.


Individual Team Meetings


Desktop

Mobile

WebQA Manual

  • (Park your URL accordingly and use the template above)


Desktop Automation
Date Summary
2011-11-14 Release automation execution, Failing Test policy, Pivotal Tracker usefulness
2011-10-04 Q3 Goals Review, Q4 Goals Proposal, Discovery Pane and Places tests

Mozilla Stand-Up Rotation

Mozilla Mobile team will participate in a rolling standup that Waverley Mobile holds every week

  • URL: https://mozqa.sync.in/mozbtech-standup-<Friday Date>
  • Dial in: 800-707-2533, password 369, conference #245
  • When: Every Thursday, 5:30pm - 5:45pm Romanian Time (7:30am PST, 10:30am EST)
  • Rotation:
    • Tony - Jan 5, 2012
    • Kevin - Jan 12
    • Aaron - Jan 19
    • Naoki - Jan 26
    • Martijn - Feb 2
    • Tony - Feb 9
    • Kevin - Feb 16
    • Aaron - Feb 23
    • Naoki - Mar 1
    • Martijn - Mar 8
    • Tony...Kevin... Aaron... Etc..

Team Members

Name Contact IRC Nickname Availability Project Assignments
Ioana Chiorean ioana.chiorean@softvision.ro ioanachiorean Contractor
Andreea Pod andreea.pod@softvision.ro AndreeaPod Contractor
Nicolae Cristian nicolae.cristian@softvision.ro xti Contractor
Catalin Suciu catalin.suciu@softvision.ro CataSuciu Contractor
Adrian Tămaș adrian.tamas@softvision.ro AdrianT Contractor
Paul Feher paul.feher@softvision.ro PaulFeher Contractor

Top issues

Bugs blocking Fennec 2.0b2

Get Setup

Register Accounts

  • Guide on how to install/update Mobile Firefox nightly builds, Clear your Profile and Uninstall can be found here
  • Go to Litmus, register an account.
  • Go to Bugzilla, register an account. In the future, to file a bug you can fill out this form: File a Bug.
  • Register for edit privileges for wiki.mozilla.org. See Account Creation

Communication

Run Testcases

From here, there's a number of testgroups available to run testcases on:

Run Smoketests

  1. Click on the Smoketest Testgroup
  2. Run the testcases in "Install and Startup"
  3. Run the testcases in "Functionality"
  4. Run the testcases in "Uninstall"

Run BFTs (Basic Functional Tests)

  1. Click on the Basic Functional Test Testgroup
  2. Run the testcases in each subgroup

Results

Date Build Identifier Testcases Run Non-Reproducible Issues Found Bugs Filed Verified bugs TC added
10/18/12 Firefox for Android 17.0b2 build2 2012-10-18
  • Samsung Galaxy R (Android 2.3.4)
  • Acer A500 (Android 3.2.1)
bug 798942, bug 787188
10/18/12 Firefox for Android 17.0b2 build2 Samsung Galaxy Nexus (Android 4.1.1)
  • Smoketests and exploratory on Firefox for Android 17.0b2 build2 - Android 4.1.1, Android 3.1, Android 2.3.4, ARMv6 (andreea.pod)
  • Smoke on phone
  • Smoke on tablet
bug 803024
10/23/12 Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)

Acer A500 (Android 3.2.1)

bug 804964
11/01/12 Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)

Acer A500 (Android 3.2.1)

11/01/12 Firefox for Android 17.0b3 build1 Samsung Galaxy S2 (Android 4.0.4)
11/07/12 Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
11/08/12 Bug verification & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1) bug 801627
11/09/12 Virtual Keyboard and IME verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
  • QA-wanted bug investigation and Virtual Keyboard and IME verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
bug 810291, bug 810284, bug 810236, bug 810266
11/12/12 Virtual Keyboard and IME verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
  • QA-wanted bug investigation and Virtual Keyboard and IME verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
bug 810792, bug 810816
11/13/12 QA-wanted bug investigation, Regression-window and Exploratory on Samsung Galaxy R (Android 2.3.4)
  • QA-wanted bug investigation, Regression-window and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
bug 811238, bug 811231, bug 811304
11/14/12 Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 6 build 1 Samsung Galaxy Tab (Android 3.1.1) bug 811707
11/15/12 Bug triage and Exploratory on Samsung Galaxy R (Android 2.3.4)
  • Bug triage and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
bug 812118
11/16/12 Bug triage and Smoke tests on Mobile Firefox for Android 17 Beta 7 build 1 Samsung Galaxy Tab (Android 3.1.1)
11/19/12 Bug triage and Smoke tests on Mobile Firefox 17.0 RC Samsung Galaxy R (Android 2.3.4) bug 802549


Other useful stuff

Testplan for the next release

Meetings

Waverley/Mozilla Office Hours

There will be a short meeting daily on IRC/gTalk/Phone explaining status and mentioning any issues.

Details:

  • Daily @ 8AM
  • +1.641.715.3200 x120740
  • IRC: #mobile

Waverley/Mozilla Status Meetings

There will be a meeting weekly to discuss the general status of Tests Run over the past week and goals for the upcoming week.

Details:

  • Tuesdays @ 8am, 6:00pm Romania
  • 650-903-0800 or 650-215-1282 x92 Conf# 245 (US/INTL)
  • 1-800-707-2533 (pin 369) Conf# 245 (US)
  • Backchannel: #mobile

Mozilla Mobile Engineering Meeting

There will be a meeting each week to discuss the general status of Mobile. Please use #mobile, dev-platforms-mobile@mozilla.org or mozilla.dev.platforms.mobile for communication

Meeting Details:

  • Wednesdays @ 9:30AM PST
  • +1 650-903-0800 (US/Intl) x92 conference number 8605#
  • +1 800 707 2533 (US) pin 369 conference number 8605#
  • #mobile for backchannel

Resources

Contacts

  • Aakash Desai: email, [irc: aakashd]
  • Patti Gosselin: email, [irc: PattiG]
  • Matt Evans: email, [irc: mevans]