Auto-tools/Goals/2012Q4: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "* Ensure B2G has all test automation available to prepare for launch ** {{ok|Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms.}} ** {{ok|Maintain B2G ...")
 
No edit summary
Line 1: Line 1:
* Ensure B2G has all test automation available to prepare for launch
* '''Ensure B2G has all test automation available to prepare for launch'''
** {{ok|Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms.}}
** {{ok|Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms.}}
** {{ok|Maintain B2G dog food update server as well as builds for development and QA while working to hand them off to releng}}
** {{ok|Maintain B2G dog food update server as well as builds for development and QA while working to hand them off to releng}}
** {{ok|Ensure all webAPIs testable through the emulator have comprehensive automated tests}}
** {{ok|Ensure all webAPIs testable through the emulator have comprehensive automated tests}}
** {{ok|Continue to aid QA in creating automated tests for B2G}}
** {{ok|Continue to aid QA in creating automated tests for B2G}}
* Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support.
* '''Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support.'''
** {{ok|Have APC.io boards chassis-ready -- rooted, smoketested, and working for ARMv6 testing}}
** {{ok|Have APC.io boards chassis-ready -- rooted, smoketested, and working for ARMv6 testing}}
** {{ok|Monitor deployment of large scale android and B2G panda board testing, aid with bug investigations}}
** {{ok|Monitor deployment of large scale android and B2G panda board testing, aid with bug investigations}}
** {{ok|Deploy Autophone with 40 phones and 70% up time}}
** {{ok|Deploy Autophone with 40 phones and 70% up time}}
* Create and deploy performance automation for desktop, fennec, and B2G product benchmarks
* '''Create and deploy performance automation for desktop, fennec, and B2G product benchmarks'''
** {{ok|Create Eideticker tests for B2G on panda boards and run them once a day}}
** {{ok|Create Eideticker tests for B2G on panda boards and run them once a day}}
** {{ok|Port Eideticker to win32 and run tests there once a day to measure win32 snappiness for desktop}}
** {{ok|Port Eideticker to win32 and run tests there once a day to measure win32 snappiness for desktop}}
Line 14: Line 14:
** {{ok|Monitor Datazilla webservices and ensure our accuracy in detecting performance regressions on a per-push basis}}
** {{ok|Monitor Datazilla webservices and ensure our accuracy in detecting performance regressions on a per-push basis}}
** {{ok|Deploy Datazilla per-push UI to make it easier for developers to dig into the causes of performance regressions}}
** {{ok|Deploy Datazilla per-push UI to make it easier for developers to dig into the causes of performance regressions}}
* Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla.
* '''Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla.'''
** {{ok|Complete the 'Sandstone' CSS update}}
** {{ok|Complete the 'Sandstone' CSS update}}
** {{ok|Complete the REST API integration}}
** {{ok|Complete the REST API integration}}
Line 20: Line 20:
** {{ok|Deliver user and product dashboards}}
** {{ok|Deliver user and product dashboards}}
** {{ok|Deploy tracking flags extension database optimization}}
** {{ok|Deploy tracking flags extension database optimization}}
* Make the process of sheriffing easier by updating TBPL and helping make it easier to handle the intermittent test problem
* '''Make the process of sheriffing easier by updating TBPL and helping make it easier to handle the intermittent test problem'''
** TBD
** TBD
** TBD
** TBD
* Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA.
* '''Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA.'''
** {{ok|Finish and deploy mozmill 2.0 changes to frameworks and existing QA tests}}
** {{ok|Finish and deploy mozmill 2.0 changes to frameworks and existing QA tests}}
** {{ok|Update selenium grid to use ESX on-demand to improve web QA capacity}}
** {{ok|Update selenium grid to use ESX on-demand to improve web QA capacity}}
** {{ok|Re-organize and improve the automated testing documentation at MDN}}
** {{ok|Re-organize and improve the automated testing documentation at MDN}}
** {{ok|Develop tests for WebRTC, B2G and other high profile projects}}
** {{ok|Develop tests for WebRTC, B2G and other high profile projects}}

Revision as of 02:31, 27 September 2012

  • Ensure B2G has all test automation available to prepare for launch
    • [ON TRACK] Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms.
    • [ON TRACK] Maintain B2G dog food update server as well as builds for development and QA while working to hand them off to releng
    • [ON TRACK] Ensure all webAPIs testable through the emulator have comprehensive automated tests
    • [ON TRACK] Continue to aid QA in creating automated tests for B2G
  • Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support.
    • [ON TRACK] Have APC.io boards chassis-ready -- rooted, smoketested, and working for ARMv6 testing
    • [ON TRACK] Monitor deployment of large scale android and B2G panda board testing, aid with bug investigations
    • [ON TRACK] Deploy Autophone with 40 phones and 70% up time
  • Create and deploy performance automation for desktop, fennec, and B2G product benchmarks
    • [ON TRACK] Create Eideticker tests for B2G on panda boards and run them once a day
    • [ON TRACK] Port Eideticker to win32 and run tests there once a day to measure win32 snappiness for desktop
    • [ON TRACK] Create pageload benchmark with networking shaper tests so that we can adequately track user-perceived performance across all devices and network types
    • [ON TRACK] Monitor Datazilla webservices and ensure our accuracy in detecting performance regressions on a per-push basis
    • [ON TRACK] Deploy Datazilla per-push UI to make it easier for developers to dig into the causes of performance regressions
  • Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla.
    • [ON TRACK] Complete the 'Sandstone' CSS update
    • [ON TRACK] Complete the REST API integration
    • [ON TRACK] Rework browserID <--> BMO integration
    • [ON TRACK] Deliver user and product dashboards
    • [ON TRACK] Deploy tracking flags extension database optimization
  • Make the process of sheriffing easier by updating TBPL and helping make it easier to handle the intermittent test problem
    • TBD
    • TBD
  • Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA.
    • [ON TRACK] Finish and deploy mozmill 2.0 changes to frameworks and existing QA tests
    • [ON TRACK] Update selenium grid to use ESX on-demand to improve web QA capacity
    • [ON TRACK] Re-organize and improve the automated testing documentation at MDN
    • [ON TRACK] Develop tests for WebRTC, B2G and other high profile projects
Retrieved from "https://wiki.allizom.org/index.php?title=Auto-tools/Goals/2012Q4&oldid=474309"