Confirmed users
2,177
edits
QA/Execution/Web Testing/Meetings/2016-01-07: Difference between revisions
QA/Execution/Web Testing/Meetings/2016-01-07 (view source)
Revision as of 08:56, 8 January 2016
, 8 January 2016→Action items
No edit summary |
|||
| (9 intermediate revisions by 3 users not shown) | |||
| Line 14: | Line 14: | ||
= Last week's action items = | = Last week's action items = | ||
* {{prev|}}[matt][stephen] - The participation team are looking for someone to review their pull request for mozillians-tests - meeting with them during Orlando work week | * {{prev|}}[matt][stephen] - The participation team are looking for someone to review their pull request for mozillians-tests - meeting with them during Orlando work week | ||
** [stephend] - I merged https://github.com/mozilla/mozillians-tests/pull/205 and re-enabled the mozillians.dev.* tests after the pull was r+'d | |||
*** still trying to get a much-clearer sense (have reached out to Pierros) and blog post of the timeline and changes made/test-areas needed, so we can work with the team to invite community via a testday | |||
== Read-only == | == Read-only == | ||
| Line 19: | Line 21: | ||
= Discussion items = | = Discussion items = | ||
* | * [davehunt] Changes to AMO dev caused expected failures, but due to high timeouts and reruns the amo.dev job took over 8 hours! | ||
** I've removed reruns from amo.dev.* and set the timeout to 60 seconds | |||
** I'd like to do this for all jobs, but it will cause noise due to intermittent failures | |||
** Thoughts/opinions? Can we handle the noise and tackle the intermittent failures? | |||
** Note that it is possible to mark individual tests as flaky and to indicate a maximum number of reruns. | |||
* [davehunt] [https://github.com/mozilla/marketplace-tests/commit/62295a50902a41cfd90f506368bc9bcff5e9580b Until recently], marketplace-tests waiting for an element to be visible would wait 600 seconds instead of 60 | |||
** This is a good example of why it's a bad idea to mix implicit and explicit waits | |||
* [davehunt] Sauce Labs has announced they're dropping support for Appium 1.3.4 and older | |||
** We're using 1.4.13 as our default version (latest recommended version is 1.4.16) | |||
** For AMO we're using 1.3.7 due to issues experienced with 1.4.x, so we may want to look into this before support is dropped for 1.3.x entirely | |||
* [stephend] - Just FYI (shouldn't affect our test infra); Web Ops is [https://bugzilla.mozilla.org/show_bug.cgi?id=1233489 upgrading Zeus to 10.3] during the [https://bugzilla.mozilla.org/show_bug.cgi?id=1230205 Tree-Closing Window] this weekend | |||
= [https://wiki.mozilla.org/QA/Execution/Web_Testing/Goals/ | = [https://wiki.mozilla.org/QA/Execution/Web_Testing/Goals/2016/Q1 Goals Check-in] - 1st and 3rd meetings, monthly = | ||
* https://wiki.mozilla.org/QA/Execution/Web_Testing/Goals/ | * https://wiki.mozilla.org/QA/Execution/Web_Testing/Goals/2016/Q1 | ||
= Upcoming Events = | = Upcoming Events = | ||
| Line 64: | Line 76: | ||
= Action items = | = Action items = | ||
* | * {{done|}}[davehunt] Create an issue on addons-tests to update the version of Appium we are using to 1.4 | ||
** https://github.com/mozilla/Addon-Tests/issues/806 | |||
* [kthiessen] Try to update the default version of Appium we use to 1.4.16 | |||
* [stephend] Create an etherpad and send out a note about brainstorming ideas for Q1 goals | |||
* [stephend] Finalize the "year in review" blog post | |||
** team members: please populate the etherpad at https://public.etherpad-mozilla.org/p/webqa-year-in-review-2015 | |||
= Next Meeting = | = Next Meeting = | ||
* Next owner / scribe: | * Next owner / scribe: Valentina | ||
* Next week's meeting notes: | * Next week's meeting notes: Dave | ||