Confirmed users
3,816
edits
Auto-tools/Goals/2012Q4: Difference between revisions
no edit summary
(Update sheriffing goals) |
No edit summary |
||
| Line 1: | Line 1: | ||
* '''Ensure B2G has all test automation available to prepare for launch''' | * '''Ensure B2G has all test automation available to prepare for launch''' | ||
** {{ok|Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms. Specifically we are turning on:}} | ** {{ok|Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms. Specifically we are turning on:}} | ||
*** {{done|Mochitest-plain (emulator first | *** {{done|Mochitest-plain (emulator first)}} | ||
*** {{skip|Mochitest-chome (emulator first | *** {{skip|Mochitest-chome (emulator first)}} | ||
*** {{done|Reftest (emulator first | *** {{done|Reftest (emulator first}} | ||
*** {{ | *** {{done|xpcshell (emulator)}} | ||
*** {{done|webAPI (emulator only}} | *** {{done|webAPI (emulator only}} | ||
*** {{ok|webQA - gaia front end tests emulator and panda}} | *** {{ok|webQA - gaia front end tests emulator and panda}} | ||
*** {{ok|gaia dev integration/unit tests emulator and panda}} | *** {{ok|gaia dev integration/unit tests emulator and panda}} | ||
** {{ | ** {{done|Maintain B2G dog food update server as well as builds for development and QA while working to hand them off to releng}} | ||
** {{ | ** {{done|Ensure all webAPIs testable through the emulator have comprehensive automated tests}} | ||
** {{ | ** {{done|Continue to aid QA in creating automated tests for B2G}} | ||
* '''Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support.''' | * '''Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support.''' | ||
** {{ | ** {{done|Have APC.io (ARMv6)boards smoketest ready - rooted, working, plugged into Autophone}} | ||
** {{ | ** {{done|Monitor deployment of large scale android and B2G panda board testing, aid with bug investigations}} | ||
** {{done|Implement a new pool-based approach for device management in automation to increase stability on all mobile device testing}} | ** {{done|Implement a new pool-based approach for device management in automation to increase stability on all mobile device testing}} | ||
*** Version 1.1 released and deployed. | *** Version 1.1 released and deployed. | ||
** {{ | ** {{done|Deploy Autophone (Noah's Ark) mochitest and robocop test abilities.}} | ||
* '''Create and deploy performance automation for desktop, fennec, and B2G product benchmarks''' | * '''Create and deploy performance automation for desktop, fennec, and B2G product benchmarks''' | ||
** {{ok|Create Eideticker tests for B2G on panda boards and run them once a day}} | ** {{ok|Create Eideticker tests for B2G on panda boards and run them once a day}} | ||
** {{ | ** {{done|Monitor Datazilla webservices and ensure our accuracy in detecting performance regressions on a per-push basis}} | ||
** {{ | ** {{done|Deploy Datazilla per-push UI to make it easier for developers to dig into the causes of performance regressions}} | ||
* '''Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla.''' | * '''Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla.''' | ||
** {{defer|Deploy 4.2 version of Bugzilla}} | ** {{defer|Deploy 4.2 version of Bugzilla}} | ||
*** Deferred because of risk of deployment during critical b2g week. Rescheduled for early 2013. | *** Deferred because of risk of deployment during critical b2g week. Rescheduled for early 2013. | ||
** {{ | ** {{done|Ensure that bug migration tools are in place for B2G so that we can share bugs with outside services and partners.}} | ||
** {{ | ** {{done|Complete the 'Sandstone' CSS update}} | ||
*** This should be done on time but won't be deployed until next year, with 4.2. | *** This should be done on time but won't be deployed until next year, with 4.2. | ||
** {{defer|Rework browserID <--> BMO integration}} | ** {{defer|Rework browserID <--> BMO integration}} | ||
*** Deferred in favour of some optimizations and github-migration scripts. | *** Deferred in favour of some optimizations and github-migration scripts. | ||
** {{ | ** {{defer|Deliver user and product dashboards}} | ||
*** As with the Sandstone skin, deployment delayed with 4.2 until next year. | *** As with the Sandstone skin, deployment delayed with 4.2 until next year. | ||
** {{defer|Deploy tracking flags extension database optimization}} | ** {{defer|Deploy tracking flags extension database optimization}} | ||
| Line 61: | Line 61: | ||
** {{done|Increase the SnR of dev.tree-management regression emails by suppressing small percentage changes & cleaning up the subject lines}} | ** {{done|Increase the SnR of dev.tree-management regression emails by suppressing small percentage changes & cleaning up the subject lines}} | ||
* '''Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA.''' | * '''Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA.''' | ||
** {{ | ** {{defer|Re-organize and improve the automated testing documentation at MDN}} | ||
** {{ | ** {{done|Develop first round of unit tests for WebRTC}} | ||
** {{ | ** {{done|Ensure all B2G device WebAPIs testable through emulators have comprehensive low level test coverage}} | ||
* ''' Projects Defered due to pivoting hard toward B2G''' | * ''' Projects Defered due to pivoting hard toward B2G''' | ||