Confirmed users
3,816
edits
Auto-tools/Goals/2012Q4: Difference between revisions
no edit summary
(Created page with "* Ensure B2G has all test automation available to prepare for launch ** {{ok|Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms.}} ** {{ok|Maintain B2G ...") |
No edit summary |
||
| Line 1: | Line 1: | ||
* Ensure B2G has all test automation available to prepare for launch | * '''Ensure B2G has all test automation available to prepare for launch''' | ||
** {{ok|Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms.}} | ** {{ok|Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms.}} | ||
** {{ok|Maintain B2G dog food update server as well as builds for development and QA while working to hand them off to releng}} | ** {{ok|Maintain B2G dog food update server as well as builds for development and QA while working to hand them off to releng}} | ||
** {{ok|Ensure all webAPIs testable through the emulator have comprehensive automated tests}} | ** {{ok|Ensure all webAPIs testable through the emulator have comprehensive automated tests}} | ||
** {{ok|Continue to aid QA in creating automated tests for B2G}} | ** {{ok|Continue to aid QA in creating automated tests for B2G}} | ||
* Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support. | * '''Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support.''' | ||
** {{ok|Have APC.io boards chassis-ready -- rooted, smoketested, and working for ARMv6 testing}} | ** {{ok|Have APC.io boards chassis-ready -- rooted, smoketested, and working for ARMv6 testing}} | ||
** {{ok|Monitor deployment of large scale android and B2G panda board testing, aid with bug investigations}} | ** {{ok|Monitor deployment of large scale android and B2G panda board testing, aid with bug investigations}} | ||
** {{ok|Deploy Autophone with 40 phones and 70% up time}} | ** {{ok|Deploy Autophone with 40 phones and 70% up time}} | ||
* Create and deploy performance automation for desktop, fennec, and B2G product benchmarks | * '''Create and deploy performance automation for desktop, fennec, and B2G product benchmarks''' | ||
** {{ok|Create Eideticker tests for B2G on panda boards and run them once a day}} | ** {{ok|Create Eideticker tests for B2G on panda boards and run them once a day}} | ||
** {{ok|Port Eideticker to win32 and run tests there once a day to measure win32 snappiness for desktop}} | ** {{ok|Port Eideticker to win32 and run tests there once a day to measure win32 snappiness for desktop}} | ||
| Line 14: | Line 14: | ||
** {{ok|Monitor Datazilla webservices and ensure our accuracy in detecting performance regressions on a per-push basis}} | ** {{ok|Monitor Datazilla webservices and ensure our accuracy in detecting performance regressions on a per-push basis}} | ||
** {{ok|Deploy Datazilla per-push UI to make it easier for developers to dig into the causes of performance regressions}} | ** {{ok|Deploy Datazilla per-push UI to make it easier for developers to dig into the causes of performance regressions}} | ||
* Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla. | * '''Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla.''' | ||
** {{ok|Complete the 'Sandstone' CSS update}} | ** {{ok|Complete the 'Sandstone' CSS update}} | ||
** {{ok|Complete the REST API integration}} | ** {{ok|Complete the REST API integration}} | ||
| Line 20: | Line 20: | ||
** {{ok|Deliver user and product dashboards}} | ** {{ok|Deliver user and product dashboards}} | ||
** {{ok|Deploy tracking flags extension database optimization}} | ** {{ok|Deploy tracking flags extension database optimization}} | ||
* Make the process of sheriffing easier by updating TBPL and helping make it easier to handle the intermittent test problem | * '''Make the process of sheriffing easier by updating TBPL and helping make it easier to handle the intermittent test problem''' | ||
** TBD | ** TBD | ||
** TBD | ** TBD | ||
* Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA. | * '''Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA.''' | ||
** {{ok|Finish and deploy mozmill 2.0 changes to frameworks and existing QA tests}} | ** {{ok|Finish and deploy mozmill 2.0 changes to frameworks and existing QA tests}} | ||
** {{ok|Update selenium grid to use ESX on-demand to improve web QA capacity}} | ** {{ok|Update selenium grid to use ESX on-demand to improve web QA capacity}} | ||
** {{ok|Re-organize and improve the automated testing documentation at MDN}} | ** {{ok|Re-organize and improve the automated testing documentation at MDN}} | ||
** {{ok|Develop tests for WebRTC, B2G and other high profile projects}} | ** {{ok|Develop tests for WebRTC, B2G and other high profile projects}} | ||