QA/Execution/Web Testing/Meetings/2016-01-07: Difference between revisions

No edit summary
 
(9 intermediate revisions by 3 users not shown)
Line 14: Line 14:
= Last week's action items =
= Last week's action items =
* {{prev|}}[matt][stephen] - The participation team are looking for someone to review their pull request for mozillians-tests - meeting with them during Orlando work week
* {{prev|}}[matt][stephen] - The participation team are looking for someone to review their pull request for mozillians-tests - meeting with them during Orlando work week
** [stephend] - I merged https://github.com/mozilla/mozillians-tests/pull/205 and re-enabled the mozillians.dev.* tests after the pull was r+'d
*** still trying to get a much-clearer sense (have reached out to Pierros) and blog post of the timeline and changes made/test-areas needed, so we can work with the team to invite community via a testday


== Read-only ==
== Read-only ==
Line 19: Line 21:


= Discussion items =
= Discussion items =
*
* [davehunt] Changes to AMO dev caused expected failures, but due to high timeouts and reruns the amo.dev job took over 8 hours!
** I've removed reruns from amo.dev.* and set the timeout to 60 seconds
** I'd like to do this for all jobs, but it will cause noise due to intermittent failures
** Thoughts/opinions? Can we handle the noise and tackle the intermittent failures?
** Note that it is possible to mark individual tests as flaky and to indicate a maximum number of reruns.
* [davehunt] [https://github.com/mozilla/marketplace-tests/commit/62295a50902a41cfd90f506368bc9bcff5e9580b Until recently], marketplace-tests waiting for an element to be visible would wait 600 seconds instead of 60
** This is a good example of why it's a bad idea to mix implicit and explicit waits
* [davehunt] Sauce Labs has announced they're dropping support for Appium 1.3.4 and older
** We're using 1.4.13 as our default version (latest recommended version is 1.4.16)
** For AMO we're using 1.3.7 due to issues experienced with 1.4.x, so we may want to look into this before support is dropped for 1.3.x entirely
* [stephend] - Just FYI (shouldn't affect our test infra); Web Ops is [https://bugzilla.mozilla.org/show_bug.cgi?id=1233489 upgrading Zeus to 10.3] during the [https://bugzilla.mozilla.org/show_bug.cgi?id=1230205 Tree-Closing Window] this weekend


= [https://wiki.mozilla.org/QA/Execution/Web_Testing/Goals/2015/Q4 Goals Check-in] - 1st and 3rd meetings, monthly =
= [https://wiki.mozilla.org/QA/Execution/Web_Testing/Goals/2016/Q1 Goals Check-in] - 1st and 3rd meetings, monthly =
* https://wiki.mozilla.org/QA/Execution/Web_Testing/Goals/2015/Q4
* https://wiki.mozilla.org/QA/Execution/Web_Testing/Goals/2016/Q1


= Upcoming Events =
= Upcoming Events =
Line 64: Line 76:


= Action items =
= Action items =
*
* {{done|}}[davehunt] Create an issue on addons-tests to update the version of Appium we are using to 1.4
** https://github.com/mozilla/Addon-Tests/issues/806
* [kthiessen] Try to update the default version of Appium we use to 1.4.16
* [stephend] Create an etherpad and send out a note about brainstorming ideas for Q1 goals
* [stephend] Finalize the "year in review" blog post
** team members: please populate the etherpad at https://public.etherpad-mozilla.org/p/webqa-year-in-review-2015


= Next Meeting =
= Next Meeting =
* Next owner / scribe:
* Next owner / scribe: Valentina
* Next week's meeting notes:
* Next week's meeting notes: Dave
Confirmed users
2,177

edits