Confirmed users
3,990
edits
Auto-tools/Meetings/2015-01-12: Difference between revisions
Auto-tools/Meetings/2015-01-12 (view source)
Revision as of 17:05, 13 January 2015
, 13 January 2015Add bug
(update jmaher progress) |
(Add bug) |
||
| (17 intermediate revisions by 11 users not shown) | |||
| Line 4: | Line 4: | ||
* jgriffin: re-introductions - Henrik | * jgriffin: re-introductions - Henrik | ||
* jgriffin: Q1 goal updates | * jgriffin: Q1 goal updates | ||
* jgriffin: Q4 goal debrief | |||
* A-Team Community Day - January 27th! | |||
= Newsgroup and Blog Posts = | = Newsgroup and Blog Posts = | ||
| Line 22: | Line 24: | ||
* '''progress since last update''': | * '''progress since last update''': | ||
** alert/confirm/prompt implementation ({{bug|906712}}) f? | ** alert/confirm/prompt implementation ({{bug|906712}}) f? | ||
** {{bug|1107336}} dependent up for review. See {{bug|1118201}}. Work on {{bug|1107336}} complete and will put up for review if there are no changes required to dependent. | |||
=== Support the conversion of targeted P1 mozmill tests to Marionette and get them running in CI [hskupin] === | === Support the conversion of targeted P1 mozmill tests to Marionette and get them running in CI [hskupin] === | ||
| Line 28: | Line 31: | ||
* stretch goal: support the conversion of Search tests | * stretch goal: support the conversion of Search tests | ||
* '''progress since last update''': | * '''progress since last update''': | ||
** Waiting for next marionette-client release ({{bug|1120364}}) to continue with window and tab handling support | |||
** Finished [https://github.com/mozilla/firefox-greenlight-tests/pull/40 prefs module] and added [https://github.com/mozilla/firefox-greenlight-tests/pull/42/ Travis support] | |||
** [https://github.com/mozilla/firefox-greenlight-tests/issues/44 Discussion] about how to name the repository - my proposal would be 'Firefox UI Tests" | |||
=== Resolve P1 bugs blocking the release of Marionette 1.0 [AutomatedTester, ato, jgraham] === | === Resolve P1 bugs blocking the release of Marionette 1.0 [AutomatedTester, ato, jgraham] === | ||
| Line 33: | Line 39: | ||
* stretch goal: release Marionette 1.0 | * stretch goal: release Marionette 1.0 | ||
* '''progress since last update''': | * '''progress since last update''': | ||
** {{bug|1090925}} has been for Feedback | |||
** Very-rough version of WebDriver <-> Marionette proxy working based on a guess of what the spec might look like. | |||
*** Next step: work out how to launch Firefox for a session when required. | |||
===''Supporting Tasks''=== | ===''Supporting Tasks''=== | ||
| Line 47: | Line 56: | ||
=== Better Bugzilla integration with MozReview [dkl] === | === Better Bugzilla integration with MozReview [dkl] === | ||
* details: Make MozReview data in Bugzilla more useful by creating a Bugzilla field that contains dynamic information about a MozReview review request | * details: Make MozReview data in Bugzilla more useful by creating a Bugzilla field that contains dynamic information about a MozReview review request | ||
* '''progress since last update''': | * '''progress since last update''': None, finishing up on 5.0 upstream Bugzilla release. | ||
===''Supporting Tasks''=== | ===''Supporting Tasks''=== | ||
* continue improvements to the multi-commit UI | * continue improvements to the multi-commit UI | ||
** '''progress since last update''': | |||
*** mconley posted a new [https://reviewboard.mozilla.org/r/661/ review request] for {{bug|1064111}} ('Move contents of "Commits" tab in rbmozui to the main review request page') | |||
== Perfherder == | == Perfherder == | ||
| Line 56: | Line 67: | ||
=== Ingest all Talos data with Treeherder and develop a UI that can be used to view current and historical data [wlach] === | === Ingest all Talos data with Treeherder and develop a UI that can be used to view current and historical data [wlach] === | ||
* details: We want to use Treeherder to store and display Talos performance data, because Datazilla is being deprecated and Graphserver doesn't support the kind of performance analysis we'd like to perform on the data. | * details: We want to use Treeherder to store and display Talos performance data, because Datazilla is being deprecated and Graphserver doesn't support the kind of performance analysis we'd like to perform on the data. | ||
* '''progress since last update''': | * '''progress since last update''': | ||
** Data: All data seems to be in treeherder. Waiting for ekyle to stand up a new instance of dzAlerts using treeherder data so we can validate that the same alerts are generated. Likely no progress this week as he's on vacation. | |||
** UI: Tracking progress on Trello here: https://trello.com/b/PQSxEIZf/perfherder-ui-tasks | |||
*** New since last time: Fixed some nits from mdoglio and jfrench, allowed deleting series, style tweaks. | |||
== Treeherder == | == Treeherder == | ||
| Line 97: | Line 111: | ||
=== Implement versioning framework for REST API [dkl] === | === Implement versioning framework for REST API [dkl] === | ||
* '''progress since last update''': | * '''progress since last update''': Design work completed. Will work on implementation soon right after finishing with upstream 5.0 Bugzilla release. | ||
=== GitHub authentication [dylan] === | === GitHub authentication [dylan] === | ||
* '''progress since last update''': | * '''progress since last update''': Plan/design ready, implementation delayed by previous quarter's goals (guided bug entry). | ||
== DevTools Harness == | == DevTools Harness == | ||
| Line 106: | Line 120: | ||
=== Get the DevTools harness running in continuous integration [ted] === | === Get the DevTools harness running in continuous integration [ted] === | ||
* details: Take the prototype that was developed in 2014 Q4 (https://github.com/luser/luciddream) and get it running in continuous integration and visible in Treeherder. It's TBD whether this will be run in buildbot or TaskCluster, but we should get it running somewhere per-commit this quarter against linux desktop Firefox and a B2G emulator. | * details: Take the prototype that was developed in 2014 Q4 (https://github.com/luser/luciddream) and get it running in continuous integration and visible in Treeherder. It's TBD whether this will be run in buildbot or TaskCluster, but we should get it running somewhere per-commit this quarter against linux desktop Firefox and a B2G emulator. | ||
* '''progress since last update''': | * '''progress since last update''': Nothing to report, working on other tasks and catching up from holiday backlog. Planning to chat about status of Taskcluster this week to decide on feasibility of using it. | ||
== CloudServices Automation == | == CloudServices Automation == | ||
| Line 116: | Line 130: | ||
=== Prototype a retrigger-based bisection tool [armenzg, jmaher] === | === Prototype a retrigger-based bisection tool [armenzg, jmaher] === | ||
* details: Create a prototype of a command-line tool that can be used by sheriffs and others to automate retrigger-based bisection. This could be used to help bisect new intermittent oranges, and to backfill jobs that have been skipped due to coalescing. Integration with Treeherder or other service will be done later. | * details: {{bug|1120990}} - Create a prototype of a command-line tool that can be used by sheriffs and others to automate retrigger-based bisection. This could be used to help bisect new intermittent oranges, and to backfill jobs that have been skipped due to coalescing. Integration with Treeherder or other service will be done later. | ||
* '''progress since last update''': Nothing new; a lot of catch up after the holiday break | * '''progress since last update''': Nothing new; a lot of catch up after the holiday break | ||
| Line 122: | Line 136: | ||
* details: Create a Proof of Concept “big data” project which will store information about every test file we run: test status, error details, test machine and test duration to begin with. We will use this project to develop schemas and queries that work with data this large, and we will use this data to normalize chunk sizes and provide details about which tests never fail. | * details: Create a Proof of Concept “big data” project which will store information about every test file we run: test status, error details, test machine and test duration to begin with. We will use this project to develop schemas and queries that work with data this large, and we will use this data to normalize chunk sizes and provide details about which tests never fail. | ||
* '''progress since last update''': | * '''progress since last update''': | ||
** [ahal] Set up aws instance that listens to pulse and both sends jobs over rq to be processed by workers and stores them in mongodb for historical reprocessing | |||
** [ahal] Set up supervisord dashboard for managing various processes | |||
=== Implement the ability to normalize chunk durations in mochitest [ahal] === | === Implement the ability to normalize chunk durations in mochitest [ahal] === | ||
| Line 128: | Line 144: | ||
* bug: {{bug|1054247}} | * bug: {{bug|1054247}} | ||
* '''progress since last update''': | * '''progress since last update''': | ||
** [ahal] None besides initial brainstorming/planning, working on ActiveData project | |||
=== Create Android 4.4 emulator image for automated tests [gbrown] === | === Create Android 4.4 emulator image for automated tests [gbrown] === | ||
| Line 137: | Line 154: | ||
** "greening" of tests | ** "greening" of tests | ||
* '''progress since last update''': | * '''progress since last update''': | ||
** created an avd from the Android 4.4 sdk | |||
** built custom images from AOSP | |||
** testing both locally | |||
=== Help Releng reduce test load [jmaher] === | === Help Releng reduce test load [jmaher] === | ||