QA/Fennec/Waverley: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
 
(40 intermediate revisions by 5 users not shown)
Line 213: Line 213:
| '''TC added'''
| '''TC added'''
|-
|-
| 10/08/12
| 10/18/12
| Firefox Mobile 16 RC
| Firefox for Android 17.0b2 build2 2012-10-18
Samsung Galaxy Tab (Android 3.1)
*Samsung Galaxy R (Android 2.3.4)
*Acer A500 (Android 3.2.1)
|
|
* Smoke and Exploratory on Firefox Mobile 16 RC (adrian.tamas)
* Smoketests, Bug verification and Exploratory on Firefox for Android 17.0b2 build2 (2012-10-18) (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=237 Smoke test results]
**[https://moztrap.mozilla.org/results/cases/?filter-run=272 MozTrap smoketest results for ARMv7]
**[https://moztrap.mozilla.org/results/cases/?filter-run=271 MozTrap smoketests results for Tablet]
|
|
|{{bug|799116}}, {{bug|799087}}, {{bug|799094}}, {{bug|799110}}, {{bug|799119}}
|
|
|{{bug|798942}}, {{bug|787188}}
|
|
|-
|-
| 10/08/12
| 10/18/12
| Firefox Mobile 16 RC
| Firefox for Android 17.0b2 build2 Samsung Galaxy Nexus (Android 4.1.1)
Asus Eee Transformers  (Android 4.1)
|
|
* Smoke, Permissions and Exploratory on Firefox Mobile 16 RC (ioana.chiorean)
* Smoketests and exploratory on Firefox for Android 17.0b2 build2 - Android 4.1.1, Android 3.1, Android 2.3.4, ARMv6 (andreea.pod)
** [https://moztrap.mozilla.org/results/cases/?filter-run=237 Smoke test results]
* [https://moztrap.mozilla.org/results/cases/?filter-run=272 Smoke on phone]
* [https://moztrap.mozilla.org/results/cases/?filter-run=271 Smoke on tablet]
|
|{{bug|803024}}
|
|
|-
| 10/23/12
| Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)
Acer A500 (Android 3.2.1)
|
* Smoketests and Exploratory on Firefox for Android 17.0b3 build1 - Android 2.3.4,Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=281 MozTrap smoketest results for ARMv7]
* [https://moztrap.mozilla.org/results/cases/?filter-run=279 MozTrap smoketests results for Tablet]
|
|{{bug|804964}}
|
|
|-
| 11/01/12
| Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)
Acer A500 (Android 3.2.1)
|
* Smoketests and Permissions on Firefox for Android 17.0b4 build1 - Android 2.3.4,Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=301 MozTrap smoketest results for ARMv7]
|
|
|
|
Line 235: Line 260:
|
|
|-
|-
| 10/08/12
| 11/01/12
| Firefox for Android 16 RC
| Firefox for Android 17.0b3 build1 Samsung Galaxy S2 (Android 4.0.4)
Samsung Galaxy Note (Android 4.0.4)
|
* Smoketests and Exploratory on Firefox for Android 17.0b4 build1 - Android 4.0.4 ARMv7 (adrian.tamas)
* [https://moztrap.mozilla.org/results/cases/?filter-run=301 MozTrap smoketest results for ARMv7]
|
|
* Smoketest (nicolae.cristian)
** [https://moztrap.mozilla.org/results/cases/?filter-run=238 phone results]
* Exploratory testing
** [https://goo.gl/PsCT4 exploratory results]
|
|
|
|
|{{bug|786029}}
|
|
|-
|-
| 10/09/12
| 11/07/12
| Firefox for Android 19.0a1
| Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
Samsung Galaxy Note (Android 4.0.4)
|
* Smoketests and BFT's on Firefox for Android 17.0b5 build1 - Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=319 MozTrap smoketest results for Tablets]
* [https://moztrap.mozilla.org/results/cases/?filter-run=320 MozTrap BFT's results for Tablets]
|
|
* Bug verification (nicolae.cristian)
* Exploratory testing (verify new features)
** [https://goo.gl/PsCT4 exploratory results]
|
|
|
|
|{{bug|769145}}, {{bug|790448}}, {{bug|776499}}, {{bug|776613}}, {{bug|770817}}, {{bug|743173}}, {{bug|710298}}, {{bug|795932}}, {{bug|793276}}, {{bug|778811}}
|
|
|-
|-
| 10/09/12
| 11/08/12
| Mozilla Central
| Bug verification & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
Samsung Galaxy Tab (Android 3.1)
|
Samsung Galaxy R (Android 2.3.4)
* Smoketests and BFT's on Firefox for Android 17.0b5 build1 - Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=319 MozTrap smoketest results for Tablets]
* [https://moztrap.mozilla.org/results/cases/?filter-run=320 MozTrap BFT's results for Tablets]
|
|
|{{bug|801627}}
|
|
Creating automation tests (adrian.tamas)
|-
** [https://bugzilla.mozilla.org/show_bug.cgi?id=732212 Added patch in bug Bug 732212]
| 11/09/12
| Virtual Keyboard and IME  verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
|
* QA-wanted bug investigation and Virtual Keyboard and IME  verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
|
|{{bug|810291}}, {{bug|810284}}, {{bug|810236}}, {{bug|810266}}
|
|
|-
| 11/12/12
| Virtual Keyboard and IME verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
|
* QA-wanted bug investigation and Virtual Keyboard and IME  verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
|
|{{bug|810792}}, {{bug|810816}}
|
|
|-
| 11/13/12
| QA-wanted bug investigation, Regression-window and Exploratory on Samsung Galaxy R (Android 2.3.4)
|
* QA-wanted bug investigation, Regression-window and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
|
|{{bug|811238}}, {{bug|811231}}, {{bug|811304}}
|
|
|-
| 11/14/12
| Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 6 build 1 Samsung Galaxy Tab (Android 3.1.1)
|
|
* Smoketests and BFT's on Firefox for Android 17.0b6 build1 - Android 3.1.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=328 MozTrap smoketest results for Phones]
* [https://moztrap.mozilla.org/results/cases/?filter-run=330 MozTrap smoketest results for Tablets]
|
|
|{{bug|811707}}
|
|
|
|
|-
|-
| 10/09/12
| 11/15/12
| Mozilla Central
| Bug triage and Exploratory on Samsung Galaxy R (Android 2.3.4)
HTC Desire Z (Android 2.3.4)
|
|
* QA Wanted, Regression-window, Exploratory and Smoke tests on Nightly 19.0a1 2012-10-09  (paul.feher)
* Bug triage and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
|
|
|{{bug|769145}}
|{{bug|812118}}
|
|
|
|
|-
|-
| 10/10/12
| 11/16/12
| Mozilla Central
| Bug triage and Smoke tests on Mobile Firefox for Android 17 Beta 7 build 1 Samsung Galaxy Tab (Android 3.1.1)
Samsung Galaxy Tab (Android 3.1)
Samsung Galaxy R (Android 2.3.4)
|
|
* Creating automation tests for forward, back and reload page (adrian.tamas)
* Bug triage and Smoketests on Firefox for Android 17.0b7 build1 - Android 3.1.1 ARMv7 (paul.feher)
** [https://bugzilla.mozilla.org/show_bug.cgi?id=747835 Working on a patch for 747835]
* [https://moztrap.mozilla.org/results/cases/?filter-run=390 MozTrap smoketest results for Tablets]
|
|
|
|
Line 294: Line 349:
|
|
|-
|-
| 10/10/12
| 11/19/12
| Mozilla Central
| Bug triage and Smoke tests on Mobile Firefox 17.0 RC Samsung Galaxy R (Android 2.3.4)
Samsung Galaxy R (Android 2.3.4)
HTC Desire Z (Android 2.3.4)
|
|
* Regression-window and Exploratory on Nightly 19.0a1 2012-10-10 (paul.feher)
* Bug triage and Smoketests on Mobile Firefox 17.0 RC Samsung Galaxy R - Android 2.3.4 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=396 MozTrap smoketest results for Phones]
|
|
|{{bug|799932}}
|
|
|{{bug|802549}}
|
|
|}
|}

Latest revision as of 15:48, 19 November 2012

Weekly Meetings

Conference room details will vary team, but they will be held at 8am on Tuesdays.

Tuesdays, 8am PT / 4pm GMT
All-Team Meeting
Dial in: 800-707-2533
Password 369, conference #245
Tuesdays, 8am PT / 4pm GMT
Firefox (Desktop Firefox): Juan Becerra
Dial in: 650-903-0800 (US), x92 then 9 and extension number 262
Or: 800-707-2533, pin 369, then 9 and extension number 262
Tuesdays, 8am PT / 4pm GMT
Automation WebQA
Dial in: 800-707-2533
Password 369, conference #
Mondays, 8am PT / 4pm GMT
Desktop Automation
Dial in: 800-707-2533
Password 369, conference #654
Tuesdays, 8am PT / 4pm GMT
Fennec
Dial in: 800-707-2533
Password 369, conference #

Every two weeks we will hold meetings to go over highlights with all the teams. The time for this meeting has not yet been decided.

All-Team Meetings

  • Bi-weekly Team Agenda
    • We will hold bi-weekly meetings to catch up on work from all teams. Time and format to be decided.


Individual Team Meetings


Desktop

Mobile

WebQA Manual

  • (Park your URL accordingly and use the template above)


Desktop Automation
Date Summary
2011-11-14 Release automation execution, Failing Test policy, Pivotal Tracker usefulness
2011-10-04 Q3 Goals Review, Q4 Goals Proposal, Discovery Pane and Places tests

Mozilla Stand-Up Rotation

Mozilla Mobile team will participate in a rolling standup that Waverley Mobile holds every week

  • URL: https://mozqa.sync.in/mozbtech-standup-<Friday Date>
  • Dial in: 800-707-2533, password 369, conference #245
  • When: Every Thursday, 5:30pm - 5:45pm Romanian Time (7:30am PST, 10:30am EST)
  • Rotation:
    • Tony - Jan 5, 2012
    • Kevin - Jan 12
    • Aaron - Jan 19
    • Naoki - Jan 26
    • Martijn - Feb 2
    • Tony - Feb 9
    • Kevin - Feb 16
    • Aaron - Feb 23
    • Naoki - Mar 1
    • Martijn - Mar 8
    • Tony...Kevin... Aaron... Etc..

Team Members

Name Contact IRC Nickname Availability Project Assignments
Ioana Chiorean ioana.chiorean@softvision.ro ioanachiorean Contractor
Andreea Pod andreea.pod@softvision.ro AndreeaPod Contractor
Nicolae Cristian nicolae.cristian@softvision.ro xti Contractor
Catalin Suciu catalin.suciu@softvision.ro CataSuciu Contractor
Adrian Tămaș adrian.tamas@softvision.ro AdrianT Contractor
Paul Feher paul.feher@softvision.ro PaulFeher Contractor

Top issues

Bugs blocking Fennec 2.0b2

Get Setup

Register Accounts

  • Guide on how to install/update Mobile Firefox nightly builds, Clear your Profile and Uninstall can be found here
  • Go to Litmus, register an account.
  • Go to Bugzilla, register an account. In the future, to file a bug you can fill out this form: File a Bug.
  • Register for edit privileges for wiki.mozilla.org. See Account Creation

Communication

Run Testcases

From here, there's a number of testgroups available to run testcases on:

Run Smoketests

  1. Click on the Smoketest Testgroup
  2. Run the testcases in "Install and Startup"
  3. Run the testcases in "Functionality"
  4. Run the testcases in "Uninstall"

Run BFTs (Basic Functional Tests)

  1. Click on the Basic Functional Test Testgroup
  2. Run the testcases in each subgroup

Results

Date Build Identifier Testcases Run Non-Reproducible Issues Found Bugs Filed Verified bugs TC added
10/18/12 Firefox for Android 17.0b2 build2 2012-10-18
  • Samsung Galaxy R (Android 2.3.4)
  • Acer A500 (Android 3.2.1)
bug 798942, bug 787188
10/18/12 Firefox for Android 17.0b2 build2 Samsung Galaxy Nexus (Android 4.1.1)
  • Smoketests and exploratory on Firefox for Android 17.0b2 build2 - Android 4.1.1, Android 3.1, Android 2.3.4, ARMv6 (andreea.pod)
  • Smoke on phone
  • Smoke on tablet
bug 803024
10/23/12 Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)

Acer A500 (Android 3.2.1)

bug 804964
11/01/12 Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)

Acer A500 (Android 3.2.1)

11/01/12 Firefox for Android 17.0b3 build1 Samsung Galaxy S2 (Android 4.0.4)
11/07/12 Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
11/08/12 Bug verification & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1) bug 801627
11/09/12 Virtual Keyboard and IME verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
  • QA-wanted bug investigation and Virtual Keyboard and IME verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
bug 810291, bug 810284, bug 810236, bug 810266
11/12/12 Virtual Keyboard and IME verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
  • QA-wanted bug investigation and Virtual Keyboard and IME verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
bug 810792, bug 810816
11/13/12 QA-wanted bug investigation, Regression-window and Exploratory on Samsung Galaxy R (Android 2.3.4)
  • QA-wanted bug investigation, Regression-window and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
bug 811238, bug 811231, bug 811304
11/14/12 Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 6 build 1 Samsung Galaxy Tab (Android 3.1.1) bug 811707
11/15/12 Bug triage and Exploratory on Samsung Galaxy R (Android 2.3.4)
  • Bug triage and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
bug 812118
11/16/12 Bug triage and Smoke tests on Mobile Firefox for Android 17 Beta 7 build 1 Samsung Galaxy Tab (Android 3.1.1)
11/19/12 Bug triage and Smoke tests on Mobile Firefox 17.0 RC Samsung Galaxy R (Android 2.3.4) bug 802549


Other useful stuff

Testplan for the next release

Meetings

Waverley/Mozilla Office Hours

There will be a short meeting daily on IRC/gTalk/Phone explaining status and mentioning any issues.

Details:

  • Daily @ 8AM
  • +1.641.715.3200 x120740
  • IRC: #mobile

Waverley/Mozilla Status Meetings

There will be a meeting weekly to discuss the general status of Tests Run over the past week and goals for the upcoming week.

Details:

  • Tuesdays @ 8am, 6:00pm Romania
  • 650-903-0800 or 650-215-1282 x92 Conf# 245 (US/INTL)
  • 1-800-707-2533 (pin 369) Conf# 245 (US)
  • Backchannel: #mobile

Mozilla Mobile Engineering Meeting

There will be a meeting each week to discuss the general status of Mobile. Please use #mobile, dev-platforms-mobile@mozilla.org or mozilla.dev.platforms.mobile for communication

Meeting Details:

  • Wednesdays @ 9:30AM PST
  • +1 650-903-0800 (US/Intl) x92 conference number 8605#
  • +1 800 707 2533 (US) pin 369 conference number 8605#
  • #mobile for backchannel

Resources

Contacts

  • Aakash Desai: email, [irc: aakashd]
  • Patti Gosselin: email, [irc: PattiG]
  • Matt Evans: email, [irc: mevans]