Web Testing/Automation/automation-13-05-2011: Difference between revisions
| (12 intermediate revisions by 4 users not shown) | |||
| Line 11: | Line 11: | ||
*** wget the build, rm -rf the old build/dir, mv the new build to the Applications folder? | *** wget the build, rm -rf the old build/dir, mv the new build to the Applications folder? | ||
* Would like dev/trunk, next/stage, prod test runs | * Would like dev/trunk, next/stage, prod test runs | ||
* Where are we with marking tests for specific environments, etc? | |||
* Wishlist from Stephen: BFT/smoketest-style suite for new Engagement projects | |||
** Think: [https://wiki.mozilla.org/WebAppSec/garmr David's security suite] (Garmr) + server status, basic tests, etc. | |||
*** Really lightweight, but useful -- goal is to increase awareness of staging-server/project suck | |||
**** I offer https://webifyme-dev.allizom.org/ as an example | |||
==Status Update== | ==Status Update== | ||
| Line 22: | Line 27: | ||
===[https://wiki.mozilla.org/Sumo SUMO] [http://qa-selenium.mv.mozilla.com:8080/view/SUMO%20Tests/ CI]=== | ===[https://wiki.mozilla.org/Sumo SUMO] [http://qa-selenium.mv.mozilla.com:8080/view/SUMO%20Tests/ CI]=== | ||
* | * SUMO tests migrated to [https://github.com/mozilla/sumo-tests GitHub] | ||
* 'Ask A Question' test is up [https://github.com/vish-moz/sumo-tests/blob/master/test_loggedin_ask_a_new_question.py] | |||
* 'KB articles' test is coming up | |||
=== [https://wiki.mozilla.org/Firefox/Input Input] [http://qa-selenium.mv.mozilla.com:8080/job/input%20stage/ CI] === | === [https://wiki.mozilla.org/Firefox/Input Input] [http://qa-selenium.mv.mozilla.com:8080/job/input%20stage/ CI] === | ||
| Line 28: | Line 35: | ||
* Dave H. is currently fixing the broken build. Have brought in command-line stuff to simplify things. | * Dave H. is currently fixing the broken build. Have brought in command-line stuff to simplify things. | ||
**This impacts all open pull requests | **This impacts all open pull requests | ||
**Removed vars.py completely - we should apply this to other test repos using conftest.py | |||
===[https://wiki.mozilla.org/Breakpad Socorro] [http://qa-selenium.mv.mozilla.com:8080/job/socorro/ CI]=== | ===[https://wiki.mozilla.org/Breakpad Socorro] [http://qa-selenium.mv.mozilla.com:8080/job/socorro/ CI]=== | ||
| Line 38: | Line 46: | ||
==Action Items== | ==Action Items== | ||
* | * Make sure each team member has merge ability | ||
* Change to the new Grid naming for Browser-Environments | |||
* Py.Test test run times | |||
** Have a look at Py.Test and AMO.Rewrite | |||
* Project owners to update their vars.py to [https://github.com/mozilla/input-tests/pull/56 Dave's new conftest.py changes] | |||
* Speak to Py.Test about decorators for tests and perhaps fix the bug | |||
Latest revision as of 16:37, 13 May 2011
Discussion topics
- Waverly working with WebQA now. Currently plowing through code reviews
- Selenium Grid 2.0 progress
- Renaming Selenium environments - proposal is here: https://github.com/davehunt/moz-grid-config/blob/new-environment-names/grid_configuration.yml
- Py.Test doesn't give us a testrun duration in the results XML so we're missing out on some reporting. See http://qa-selenium.mv.mozilla.com:8080/job/input.stage/478/testReport/history/?
- Conftest.py -- everyone know it?
- Unless you have a specific need, we shouldn't be using Firefox4b;en-us;MacOSX6 in tests
- Related -- Raymond and I talked yesterday about auto-updating an Aurora build on Mac in our env.
- wget the build, rm -rf the old build/dir, mv the new build to the Applications folder?
- Related -- Raymond and I talked yesterday about auto-updating an Aurora build on Mac in our env.
- Would like dev/trunk, next/stage, prod test runs
- Where are we with marking tests for specific environments, etc?
- Wishlist from Stephen: BFT/smoketest-style suite for new Engagement projects
- Think: David's security suite (Garmr) + server status, basic tests, etc.
- Really lightweight, but useful -- goal is to increase awareness of staging-server/project suck
- I offer https://webifyme-dev.allizom.org/ as an example
- Really lightweight, but useful -- goal is to increase awareness of staging-server/project suck
- Think: David's security suite (Garmr) + server status, basic tests, etc.
Status Update
AMO | CI
- David has taken over Ayan's tests for AMO Builder Tasks
- Test Day organised for 24-05-11 Blog Post
- Can we fix http://viewvc.svn.mozilla.org/vc?view=revision&sortby=date&revision=88309?
SUMO CI
Input CI
- Dave H. is currently fixing the broken build. Have brought in command-line stuff to simplify things.
- This impacts all open pull requests
- Removed vars.py completely - we should apply this to other test repos using conftest.py
Socorro CI
- 8 failures are a combo of missing data/tests which need updating
MDN CI
Mozilla.com CI
Action Items
- Make sure each team member has merge ability
- Change to the new Grid naming for Browser-Environments
- Py.Test test run times
- Have a look at Py.Test and AMO.Rewrite
- Project owners to update their vars.py to Dave's new conftest.py changes
- Speak to Py.Test about decorators for tests and perhaps fix the bug