Web Testing/Automation/automation-13-05-2011: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
Line 12: Line 12:
* Would like dev/trunk, next/stage, prod test runs
* Would like dev/trunk, next/stage, prod test runs
* Where are we with marking tests for specific environments, etc?
* Where are we with marking tests for specific environments, etc?
* Wishlist from Stephen: BFT/smoketest-style suite for new Engagement projects
** Think: David's security suite + server status, basic tests, etc.
*** Really lightweight, but useful -- goal is to increase awareness of staging-server/project suck


==Status Update==
==Status Update==

Revision as of 16:25, 13 May 2011

<< Last meeting | WebQA Automation | Next meeting >>

Discussion topics

  • Waverly working with WebQA now. Currently plowing through code reviews
  • Selenium Grid 2.0 progress
  • Renaming Selenium environments - proposal is here: https://github.com/davehunt/moz-grid-config/blob/new-environment-names/grid_configuration.yml
  • Py.Test doesn't give us a testrun duration in the results XML so we're missing out on some reporting. See http://qa-selenium.mv.mozilla.com:8080/job/input.stage/478/testReport/history/?
  • Conftest.py -- everyone know it?
  • Unless you have a specific need, we shouldn't be using Firefox4b;en-us;MacOSX6 in tests
    • Related -- Raymond and I talked yesterday about auto-updating an Aurora build on Mac in our env.
      • wget the build, rm -rf the old build/dir, mv the new build to the Applications folder?
  • Would like dev/trunk, next/stage, prod test runs
  • Where are we with marking tests for specific environments, etc?
  • Wishlist from Stephen: BFT/smoketest-style suite for new Engagement projects
    • Think: David's security suite + server status, basic tests, etc.
      • Really lightweight, but useful -- goal is to increase awareness of staging-server/project suck

Status Update

AMO | CI

SUMO CI

  • SUMO tests migrated to GitHub
  • 'Ask A Question' test is up [1]
  • 'KB articles' test is coming up

Input CI

  • Dave H. is currently fixing the broken build. Have brought in command-line stuff to simplify things.
    • This impacts all open pull requests
    • Removed vars.py completely - we should apply this to other test repos using conftest.py

Socorro CI

  • 8 failures are a combo of missing data/tests which need updating

MDN CI

Mozilla.com CI

Action Items

  • Make sure each team member has merge ability
  • Change to the new Grid naming for Browser-Environments
  • Py.Test test run times
    • Have a look at Py.Test and AMO.Rewrite