Web Testing/Automation/automation-08-23-2010: Difference between revisions
Jump to navigation
Jump to search
(Created page with "==Status Update== ===AMO=== ===SUMO=== ===Mozilla.com=== ==Discussion topics== ==Action Items==") |
|||
| (14 intermediate revisions by 4 users not shown) | |||
| Line 1: | Line 1: | ||
==Status Update== | ==Status Update== | ||
===AMO=== | ===AMO=== | ||
* Selectively added exceptions-to-exceptions so that suites don't finish red because of failures we don't care about. Result: FFT finishes green. The issues causing BFT and Search suites to finish red might be handled the same way. (Truman) | |||
* Working on a test case for [https://bugzilla.mozilla.org/show_bug.cgi?id=568386 bug 568386]. Planning to get it done by End-of-week(post AMO release) | |||
===SUMO=== | ===SUMO=== | ||
=== | * Converted & tested 14 test cases to page object model | ||
* Ready to check-in today | |||
===Page Object Model=== | |||
* A prototype for AMO is finished. Another is in-progress. (Truman) | |||
==Discussion topics== | ==Discussion topics== | ||
* Evaluation of Sauce Labs | |||
** Pros: | |||
*** Latest versions of *most* browsers, very little on-going maintenance/configuration needed | |||
*** Support (both their service and Selenium) | |||
*** No need to upgrade RCs, Hudson, etc. | |||
*** They have a Hudson plugin | |||
*** Video (live/archived) support | |||
** Cons: | |||
*** Initial setup: | |||
**** SSH tunneling from VM -> Sauce OnDemand | |||
**** Code replacing to get tests to run on their service (key/host, etc.) | |||
*** Potential cost? | |||
** No Mac support | |||
* Propose AMO daily suites are scheduled to before mid-morning. | |||
* Revisit tests cases printing to console | |||
==Action Items== | ==Action Items== | ||
* Vishal to commit all his page model testcases for SUMO - [done] | |||
* More greens; less reds - Truman/Vishal - [done] | |||
* Set up a job to run on the latest beta and minefield - Truman/Vishal/Stephen [blocked by Selenium bug] | |||
* Make the browser/OS compatibility stuff more obvious - Truman to take this | |||
Latest revision as of 23:07, 14 September 2010
Status Update
AMO
- Selectively added exceptions-to-exceptions so that suites don't finish red because of failures we don't care about. Result: FFT finishes green. The issues causing BFT and Search suites to finish red might be handled the same way. (Truman)
- Working on a test case for bug 568386. Planning to get it done by End-of-week(post AMO release)
SUMO
- Converted & tested 14 test cases to page object model
- Ready to check-in today
Page Object Model
- A prototype for AMO is finished. Another is in-progress. (Truman)
Discussion topics
- Evaluation of Sauce Labs
- Pros:
- Latest versions of *most* browsers, very little on-going maintenance/configuration needed
- Support (both their service and Selenium)
- No need to upgrade RCs, Hudson, etc.
- They have a Hudson plugin
- Video (live/archived) support
- Cons:
- Initial setup:
- SSH tunneling from VM -> Sauce OnDemand
- Code replacing to get tests to run on their service (key/host, etc.)
- Potential cost?
- Initial setup:
- No Mac support
- Pros:
- Propose AMO daily suites are scheduled to before mid-morning.
- Revisit tests cases printing to console
Action Items
- Vishal to commit all his page model testcases for SUMO - [done]
- More greens; less reds - Truman/Vishal - [done]
- Set up a job to run on the latest beta and minefield - Truman/Vishal/Stephen [blocked by Selenium bug]
- Make the browser/OS compatibility stuff more obvious - Truman to take this