Web Testing/Automation/automation-13-05-2011: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(23 intermediate revisions by 4 users not shown)
Line 3: Line 3:


* Waverly working with WebQA now. Currently plowing through code reviews
* Waverly working with WebQA now. Currently plowing through code reviews
* Selenium Grid 2.0 progress
* Renaming Selenium environments - proposal is here: https://github.com/davehunt/moz-grid-config/blob/new-environment-names/grid_configuration.yml
* Py.Test doesn't give us a testrun duration in the results XML so we're missing out on some reporting. See http://qa-selenium.mv.mozilla.com:8080/job/input.stage/478/testReport/history/?
* [http://viewvc.svn.mozilla.org/vc/projects/socorro_qa/conftest.py?view=markup Conftest.py] -- everyone know it?
* Unless you have a specific need, we shouldn't be using Firefox4b;en-us;MacOSX6 in tests
** Related -- Raymond and I talked yesterday about auto-updating an Aurora build on Mac in our env.
*** wget the build, rm -rf the old build/dir, mv the new build to the Applications folder?
* Would like dev/trunk, next/stage, prod test runs
* Where are we with marking tests for specific environments, etc?
* Wishlist from Stephen: BFT/smoketest-style suite for new Engagement projects
** Think: [https://wiki.mozilla.org/WebAppSec/garmr David's security suite] (Garmr) + server status, basic tests, etc.
*** Really lightweight, but useful -- goal is to increase awareness of staging-server/project suck
**** I offer https://webifyme-dev.allizom.org/ as an example


==Status Update==
==Status Update==
Line 8: Line 21:


===[http://addons.mozilla.org AMO] | [http://qa-selenium.mv.mozilla.com:8080/view/AMO%20Tests/ CI]===
===[http://addons.mozilla.org AMO] | [http://qa-selenium.mv.mozilla.com:8080/view/AMO%20Tests/ CI]===
* David has taken over Ayan's tests for AMO Builder [[https://www.pivotaltracker.com/projects/291071 Tasks]]
* David has taken over Ayan's tests for AMO Builder [https://www.pivotaltracker.com/projects/291071 Tasks]
* Test Day organised for 24-05-11 [http://www.theautomatedtester.co.uk/blog/2011/selenium-test-day-amo-240511.html Blog Post]
* Can we fix http://viewvc.svn.mozilla.org/vc?view=revision&sortby=date&revision=88309?
** Commit that broke it: https://github.com/jbalogh/zamboni/commit/5dc1cfe79ff99fe7c93d01041eb61757137d737b#diff-11


===[https://wiki.mozilla.org/Sumo SUMO] [http://qa-selenium.mv.mozilla.com:8080/view/SUMO%20Tests/ CI]===
===[https://wiki.mozilla.org/Sumo SUMO] [http://qa-selenium.mv.mozilla.com:8080/view/SUMO%20Tests/ CI]===
*  
* SUMO tests migrated to [https://github.com/mozilla/sumo-tests GitHub]
* 'Ask A Question' test is up [https://github.com/vish-moz/sumo-tests/blob/master/test_loggedin_ask_a_new_question.py]
* 'KB articles' test is coming up


=== [https://wiki.mozilla.org/Firefox/Input Input] [http://qa-selenium.mv.mozilla.com:8080/job/input%20stage/ CI] ===
=== [https://wiki.mozilla.org/Firefox/Input Input] [http://qa-selenium.mv.mozilla.com:8080/job/input%20stage/ CI] ===


*  
* Dave H. is currently fixing the broken build. Have brought in command-line stuff to simplify things.
**This impacts all open pull requests
**Removed vars.py completely - we should apply this to other test repos using conftest.py


===[https://wiki.mozilla.org/Breakpad Socorro] [http://qa-selenium.mv.mozilla.com:8080/job/socorro/ CI]===
===[https://wiki.mozilla.org/Breakpad Socorro] [http://qa-selenium.mv.mozilla.com:8080/job/socorro/ CI]===
*[http://qa-selenium.mv.mozilla.com:8080/view/Socorro/job/socorro/lastCompletedBuild/testReport/ 8 failures] are a combo of missing data/tests which need updating


===MDN [http://qa-selenium.mv.mozilla.com:8080/view/MDN/ CI]===
*
===Mozilla.com [http://qa-selenium.mv.mozilla.com:8080/job/mozilla.com/ CI]===
===Mozilla.com [http://qa-selenium.mv.mozilla.com:8080/job/mozilla.com/ CI]===
*  
*


==Action Items==
==Action Items==
*
* Make sure each team member has merge ability
* Change to the new Grid naming for Browser-Environments
* Py.Test test run times
** Have a look at Py.Test and AMO.Rewrite
* Project owners to update their vars.py to [https://github.com/mozilla/input-tests/pull/56 Dave's new conftest.py changes]
* Speak to Py.Test about decorators for tests and perhaps fix the bug

Latest revision as of 16:37, 13 May 2011

<< Last meeting | WebQA Automation | Next meeting >>

Discussion topics

Status Update

AMO | CI

SUMO CI

  • SUMO tests migrated to GitHub
  • 'Ask A Question' test is up [1]
  • 'KB articles' test is coming up

Input CI

  • Dave H. is currently fixing the broken build. Have brought in command-line stuff to simplify things.
    • This impacts all open pull requests
    • Removed vars.py completely - we should apply this to other test repos using conftest.py

Socorro CI

  • 8 failures are a combo of missing data/tests which need updating

MDN CI

Mozilla.com CI

Action Items

  • Make sure each team member has merge ability
  • Change to the new Grid naming for Browser-Environments
  • Py.Test test run times
    • Have a look at Py.Test and AMO.Rewrite
  • Project owners to update their vars.py to Dave's new conftest.py changes
  • Speak to Py.Test about decorators for tests and perhaps fix the bug
Retrieved from "https://wiki.allizom.org/index.php?title=Web_Testing/Automation/automation-13-05-2011&oldid=308359"