Web Testing/Automation/automation-08-07-2011: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with " << Last meeting | [https://wiki.mozilla.org/QA/Execution/Web_Testing/Automation WebQA Automation] | [[Web_Testing/Automation/aut...")
 
 
(9 intermediate revisions by 4 users not shown)
Line 4: Line 4:
* Edgecast appears to have been sorted for AMO.
* Edgecast appears to have been sorted for AMO.
* Pull requests are going a lot smoother
* Pull requests are going a lot smoother
* Selenium 2 released with Grid 2 and rolled out through our grid. Tests a running a lot faster!
* Selenium 2 released with Grid 2 and rolled out through our grid.
** So far tests are running well, if you see problems please raise them.
** Tests seem to be a bit faster (probably due to proper load balancing).
** Many more environments available now. See http://qa-selenium.mv.mozilla.com:4444/grid/console
** Builds running in parallel can be increased to run more threads.
*** input.stage has been increased from 4 to 8.
*** amo.rewrite has been increased from 5 to 8.
** Selenium 2 will work with Firefox 5, so we should start running tests on this by default.
* FlightDeck Tests are being cleaned up, taking more time than expected, will be done next week!
* FlightDeck Tests are being cleaned up, taking more time than expected, will be done next week!
 
* Pivotal Track Attack
* New Details page to be released soon.
* Selenium 2 - Marlena will circulate info


==Status Update==
==Status Update==
Line 12: Line 21:


===[http://addons.mozilla.org AMO] | [http://qa-selenium.mv.mozilla.com:8080/view/AMO%20Tests/ CI]===
===[http://addons.mozilla.org AMO] | [http://qa-selenium.mv.mozilla.com:8080/view/AMO%20Tests/ CI]===
 
* Pivotal Track Attack!!
** Today for Team Mountain View and Monday for Team Cluj
** Moving all tracking of automating tests from the spreadsheet into Pivotal Tracker
** tags map to spreadsheet pages (Great idea, Bebe!)
** Team Mountain view will "pass the baton" to Team Cluj with an email to update anything of which they should be aware.
* AMO Automation page needs to be updated by Weds.  Will make sure it fits in with what Rebecca is doing.(Marlena)
* Test for Mission statement which was causing timeouts has a [https://github.com/mozilla/Addon-Tests/pull/47 patch in the pull request queue] (Thanks to Vish for isolating the problem!)


===[https://wiki.mozilla.org/Sumo SUMO] [http://qa-selenium.mv.mozilla.com:8080/view/SUMO%20Tests/ CI]===
===[https://wiki.mozilla.org/Sumo SUMO] [http://qa-selenium.mv.mozilla.com:8080/view/SUMO%20Tests/ CI]===
*  
* Two new [https://github.com/mozilla/sumo-tests/blob/master/test_questions_sort.py tests]


=== [https://wiki.mozilla.org/Firefox/Input Input] [http://qa-selenium.mv.mozilla.com:8080/job/input%20stage/ CI] ===
=== [https://wiki.mozilla.org/Firefox/Input Input] [http://qa-selenium.mv.mozilla.com:8080/job/input%20stage/ CI] ===


*  
*Working with IT to improve the stability of Stage.
 


===[https://wiki.mozilla.org/Breakpad Socorro] [http://qa-selenium.mv.mozilla.com:8080/job/socorro/ CI]===
===[https://wiki.mozilla.org/Breakpad Socorro] [http://qa-selenium.mv.mozilla.com:8080/job/socorro/ CI]===
Line 31: Line 45:
===Mozilla.com [http://qa-selenium.mv.mozilla.com:8080/job/mozilla.com/ CI]===
===Mozilla.com [http://qa-selenium.mv.mozilla.com:8080/job/mozilla.com/ CI]===
*  
*  
===QMO [http://qa-selenium.mv.mozilla.com:8080/job/qmo.stage/ CI]===
* Now running on Firefox 4 & 5 on Mac & Windows
* Intermittent failures require further investigation


== Action Items ==
== Action Items ==
* Add Case Conductor to CI
* Update Beta environments today
* Add Firefox 5 environments
** Install Firefox 5 to all Selenium nodes
*** Mac: /Applications/Firefox 5.app
*** Windows: C:\Program Files\Mozilla Firefox 5
** Update moz-grid-config
*** Should just be a case of git pull
** Change test builds to use Firefox 5 by default

Latest revision as of 16:31, 8 July 2011

<< Last meeting | WebQA Automation | Next meeting >>

Discussion topics

  • Edgecast appears to have been sorted for AMO.
  • Pull requests are going a lot smoother
  • Selenium 2 released with Grid 2 and rolled out through our grid.
    • So far tests are running well, if you see problems please raise them.
    • Tests seem to be a bit faster (probably due to proper load balancing).
    • Many more environments available now. See http://qa-selenium.mv.mozilla.com:4444/grid/console
    • Builds running in parallel can be increased to run more threads.
      • input.stage has been increased from 4 to 8.
      • amo.rewrite has been increased from 5 to 8.
    • Selenium 2 will work with Firefox 5, so we should start running tests on this by default.
  • FlightDeck Tests are being cleaned up, taking more time than expected, will be done next week!
  • Pivotal Track Attack
  • New Details page to be released soon.
  • Selenium 2 - Marlena will circulate info

Status Update

AMO | CI

  • Pivotal Track Attack!!
    • Today for Team Mountain View and Monday for Team Cluj
    • Moving all tracking of automating tests from the spreadsheet into Pivotal Tracker
    • tags map to spreadsheet pages (Great idea, Bebe!)
    • Team Mountain view will "pass the baton" to Team Cluj with an email to update anything of which they should be aware.
  • AMO Automation page needs to be updated by Weds. Will make sure it fits in with what Rebecca is doing.(Marlena)
  • Test for Mission statement which was causing timeouts has a patch in the pull request queue (Thanks to Vish for isolating the problem!)

SUMO CI

Input CI

  • Working with IT to improve the stability of Stage.

Socorro CI


MDN CI

Mozilla.com CI

QMO CI

  • Now running on Firefox 4 & 5 on Mac & Windows
  • Intermittent failures require further investigation

Action Items

  • Add Case Conductor to CI
  • Update Beta environments today
  • Add Firefox 5 environments
    • Install Firefox 5 to all Selenium nodes
      • Mac: /Applications/Firefox 5.app
      • Windows: C:\Program Files\Mozilla Firefox 5
    • Update moz-grid-config
      • Should just be a case of git pull
    • Change test builds to use Firefox 5 by default
Retrieved from "https://wiki.allizom.org/index.php?title=Web_Testing/Automation/automation-08-07-2011&oldid=326769"