Auto-tools/Goals/2013Q2: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "Our Goal in Q2 is mostly ergonomics and stability. In other words: * '''Goal:''' Improve Developer/QA ergonomics around running and debugging automation by: ** Applying mach...")
 
No edit summary
Line 2: Line 2:


* '''Goal:''' Improve Developer/QA ergonomics around running and debugging automation by:
* '''Goal:''' Improve Developer/QA ergonomics around running and debugging automation by:
** Applying mach across B2G and Desktop as a developer interface
** Make running any B2G test and landing at a breakpoint in a debugger require 3 commands or less.
** Making the review process on Bugzilla more streamlined and user friendly
** Improve patch review experience on bugzilla/Make bugzilla more user-centric TODO: Measurement? Buglist?
** Providing actionable performance data
** Replace graph server with Datazilla for all desktop Talos tests
** Implementing time saving regression hunting solutions.
** Release a v1 "bisect in the cloud" for linux tests
** Drive ability to run B2G tests from any repo commit in a trial fashion (joint with releng)
** Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng
** Create ability for monitoring the effect of any change to any B2G repo on test stability per target branch (joint with releng)


* '''Goal:''' Improve stability, reliability, and scalability of automation platforms by:
* '''Goal:''' Improve stability, reliability, and scalability of automation platforms by:
** Completing native REST interface on Bugzilla
** Addressing all P1 B2G automation stability issues TODO: buglist?
** Completing Mochitest to Mozbase port
** Complete native REST interface for Bugzilla (improves scalability, performance)
** Complete Mochitest to Mozbase port P1 bugs TODO: buglist
** Create Microbenchmark suite
** Create Microbenchmark suite
** Drive developer investigation into the top 20 intermittent failures in automation and drive solutions where possible.
** Drive developer investigation into the top 20 intermittent failures in automation and drive solutions where possible.
** Update pulse so that its dependent (client side) libraries are current
** Update pulse so that its dependent (client side) libraries are current TODO: buglist
** Create a specification and a pricing model for power cycling of real phones
** Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.


* '''Goal:''' Build toward our future by:
* '''Goal:''' Build toward our future by:
** Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
** Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
** Release a mozmill 2 and work with partners to drive toward a 2.1
** Release a mozmill 2 and work with contributor community to drive toward a 2.1
** Automate a scrolling fps test using camera Eideticker measurements
** Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps
** Continue work on W3C specs already underway
** Create and Deploy BMO user profile data for community building and education
** Create BMO profile data for both ease of use and community building
** Deploy tracking flags fix to BMO.
** Revamp Testday/Bugday efforts to drive community growth in our QA/Dev/Triage teams
** Revamp Testday/Bugday efforts to drive community growth in our QA/Dev/Triage teams
** Address low hanging fruit of releng infrastructure load issues (joint with releng)
** Address P1 low hanging fruit of releng infrastructure load issues (joint with releng) TODO: List
** Add x86 devices to Autophone
** Add x86 Android devices to Autophone

Revision as of 02:20, 29 March 2013

Our Goal in Q2 is mostly ergonomics and stability. In other words:

  • Goal: Improve Developer/QA ergonomics around running and debugging automation by:
    • Make running any B2G test and landing at a breakpoint in a debugger require 3 commands or less.
    • Improve patch review experience on bugzilla/Make bugzilla more user-centric TODO: Measurement? Buglist?
    • Replace graph server with Datazilla for all desktop Talos tests
    • Release a v1 "bisect in the cloud" for linux tests
    • Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng
  • Goal: Improve stability, reliability, and scalability of automation platforms by:
    • Addressing all P1 B2G automation stability issues TODO: buglist?
    • Complete native REST interface for Bugzilla (improves scalability, performance)
    • Complete Mochitest to Mozbase port P1 bugs TODO: buglist
    • Create Microbenchmark suite
    • Drive developer investigation into the top 20 intermittent failures in automation and drive solutions where possible.
    • Update pulse so that its dependent (client side) libraries are current TODO: buglist
    • Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.
  • Goal: Build toward our future by:
    • Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
    • Release a mozmill 2 and work with contributor community to drive toward a 2.1
    • Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps
    • Create and Deploy BMO user profile data for community building and education
    • Revamp Testday/Bugday efforts to drive community growth in our QA/Dev/Triage teams
    • Address P1 low hanging fruit of releng infrastructure load issues (joint with releng) TODO: List
    • Add x86 Android devices to Autophone
Retrieved from "https://wiki.allizom.org/index.php?title=Auto-tools/Goals/2013Q2&oldid=642350"