QA/Fennec/Waverley/2011-05-17

Meeting Notes for 2011-05-17

Welcome

(eg. headcount, updates with staffing, vacation/away time)

Firefox Updates

(eg. Status, top issues)

• Mozilla (juanb)
  • We are a "go" for merging aurora to beta sometime on Tuesday
  • Extent of testing will be automated testing and verbal sign-off of major features
  • May 24: nightly to aurora merge
• ETA: end of the week or early next week
• Waverley (Andrei, George, Simona, Vlad G)
  • Test plan
    • Review and update of Litmus tests Link
    • Triage of recent unconfirmed bugs across platforms - Link
    • Fixed bug verification across platforms - Link
    • Logged issues - Link
    • Exploratory testing around specific areas (highlighted important issues) - Link
  • Team plan
    • Set up top 3 goals for future work (Meeting notes as reference) - Link
    • Assign QA contacts for Firefox Features - Link

Automation Updates

(eg. Status, top issues)

WebQA (Selenium)

• General
• Waverly (Teodosia, Florin)
  • modifying tests according to the received code review
  • adapting the tests to the recent input test framework changes
  • Teodosia is in PTO
• Mozilla

Desktop (Mozmill)

• General
• Waverley (Alex, Vlad)
  • Separate multiple tests in one file into own their test modules Tracking Bug
  • Working on bugs (all have patches up for review): Query
• Mozilla (Anthony, Henrik)
  • First set of tests for the Discovery Pane are available for automation (Link)
  • Activity of the test creation will be tracked in the PivotalTracker

Fennec Updates

(eg. Status, top issues)

• Mozilla (test lead)
  • Fennec 5 beta testplan to be finalized today
  • Fennec 5 beta has hacky building See blog
    • Pay close attention to unusual behavior when running smoketests, bfts (installs, languages, addons, profiles)
    • Verify Fennec 5 fixed bugs (tracking-fennec=5+)
      • Still open blockers (bug 655852, bug 655864)
  • Fennec 6 Feature testing update?
    • Feedback to the zoom and sync issues have been sent
• Waverley (Ioana, Anna, Andreea, Nicolae)
  • Weekly Status:
    • run BFTs, OS integration tests and daily smoke tests on all new devices (LG Optimus 2X P990, HTC Desire Z, Google Nexus S) daily results ; archive . Builds tested as follows:
      • Smoketests on Aurora (weekly) on Central (daily)
      • BFTs and OS Integration Tests on Central
    • Bug triage and validation on both channels: nightly and aurora
      • bug validation daily results ; archive ;
      • bug Triage Comments and status
    • run performance tests and more against daily builds with the add-on (daily on aurora and central)(result are on server)
    • updating the Litmus TC Updated tests in Litmus
    • Logged issues
  • Issues:
    • Regarding the testcases in Litmus, how could we distinguish aurora from nightly builds? Will there be a separation after channels or maybe after versions (Firefox 5, Firefox 6) made ? And when they will be separated?
    • Is the test plan for Firefox 5 (mobile) already available  ?
    • Regarding the testday from this Friday, do you want us to start it earlier and get involve during our work schedule (this meaning the testday will also have an European timeline)
    • Sync Bugs:
      • bug 647220 [cri|P1] Sync data not cleared and added each sync time
      • bug 656594 [nor|P2] Sync Now button is active even if the Sync is in progress
      • bug 651048 [nor|P2] Connect to Sync popup is still displayed even if the app is already connected to Sync
      • bug 656622 [enh|P3] Undo removal of the sync account after the clear data unnecessary
      • bug 656605 [nor|--] Bookmarks are not synced to mobile

Round Table

(eg. Other items to discuss)

• Feature assignments in Fx6
  • Bug verification comments detail.
• Updates for the process of revising Litmus subgroup ownership? (Henrik)
• Why do we have a nightly branch in Litmus? This has aurora test-runs in it. It is a bit confusing. What is the plan with it? (Vlad)
• Are you guys seeing Daily litmus test results emails yet? (tchung)

Take Aways

(eg. Action items)