QA/Mozmill Test Automation/Endurance Tests/Meetings/06-28-2011: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "<small> « previous mtg Endurance Tests Home | [[QA/Mozmill Test...")
 
 
(5 intermediate revisions by 2 users not shown)
Line 5: Line 5:


= Previous Action Items =
= Previous Action Items =
* {{prev|Investigate next steps for Flash content tests ({{bug|635310}}). (Anthony)}}
* {{done|Investigate next steps for Flash content tests ({{bug|635310}}). (Anthony)}}
* {{prev|Implement a 'max memory' view to expose testruns consuming large amounts of memory. (Dave)}}
* {{prev|Implement a 'max memory' view to expose testruns consuming large amounts of memory. (Dave)}}
* {{prev|Schedule endurance test involvement for next Mozmill testday. (Dave/Henrik)}}
* {{prev|Schedule endurance test involvement for next Mozmill testday. (Dave/Henrik)}}
Line 19: Line 19:


= Current Work =
= Current Work =
* [ASSIGNED] {{bug|635310}} - Mozmill Endurance test for flash video performance - ashughes
* {{bug|635310}} - Mozmill Endurance test for flash video performance - ashughes
** Currently reaching out to Benoit Girard and Chris Jones to get more detailed information about Flash rendering
** FLV and SWF video checked into litmus-data and cloned to mozqa.com
** Prelim: video, ads, and games each use different rendering methods -- will likely mean 3 separate tests
** Next step is to create some HTML pages which host the videos
* Running an endurance test with restarts enabled and a large number of iterations causes Disconnect Error {{bug|658395}} - patches in review.
* Running an endurance test with restarts enabled and a large number of iterations causes Disconnect Error {{bug|658395}} - patches in review.


Line 34: Line 34:


= Meeting Notes =
= Meeting Notes =
http://etherpad.mozilla.com:9000/endurance-20110628


= Action Items =
= Action Items =
* Create test pages embedding the Flash videos and write endurance tests. (Anthony)
* Investigate report performance issue and raise bug. (Dave)
* {{done|Raise bug for adding the addons and endurance testruns to the daily testrun ({{bug|668072}}). (Dave)}}
* {{done|Comment on the bug for specifying a user comment on testruns with details of potential uses ({{bug|626711}}, {{bug|668063}}, {{bug|668064}}). (Dave)}}
* Investigate potential collaboration with the Telemetry project in Nightly. (Dave)
* All action items carried over from previous meeting.
* All action items carried over from previous meeting.

Latest revision as of 08:46, 5 July 2011

« previous mtg Endurance Tests Home | next mtg »

Previous Action Items

  • [DONE] Investigate next steps for Flash content tests (bug 635310). (Anthony)
  • [CARRY OVER] Implement a 'max memory' view to expose testruns consuming large amounts of memory. (Dave)
  • [CARRY OVER] Schedule endurance test involvement for next Mozmill testday. (Dave/Henrik)
  • [CARRY OVER] Investigate if we can gather all details from about:support in the same way that we currently gather metrics from about:memory. (Dave)
  • [CARRY OVER] [UNASSIGNED] Investigate diagnostic interfaces to all systems.
    • What can we gather?
    • How can we sync this data up?
  • [CARRY OVER] Investigate extra resources for endurance tests. (Matt)
  • [CARRY OVER] Investigate caching results to disk during testrun to reduce any impact on memory metrics (bug 634580). (Dave)
  • [DONE] Cancel next meeting due to PTO. (Dave)
  • [DONE] Fix the failing test. (Dave)
  • [DONE] Raise a new bug for dealing with issues encountered when gathering metrics (bug 661245). (Dave)

Current Work

  • bug 635310 - Mozmill Endurance test for flash video performance - ashughes
    • FLV and SWF video checked into litmus-data and cloned to mozqa.com
    • Next step is to create some HTML pages which host the videos
  • Running an endurance test with restarts enabled and a large number of iterations causes Disconnect Error bug 658395 - patches in review.

Failing Tests

Discussion Items / Updates

  • Limitation in reporting large sets of results
  • Infrastructure requirements for continuous daily testruns
  • Ability to filter results by machine identifier or additional label
  • Micro-iterations
  • Waverly contributing to endurance tests

Meeting Notes

http://etherpad.mozilla.com:9000/endurance-20110628

Action Items

  • Create test pages embedding the Flash videos and write endurance tests. (Anthony)
  • Investigate report performance issue and raise bug. (Dave)
  • [DONE] Raise bug for adding the addons and endurance testruns to the daily testrun (bug 668072). (Dave)
  • [DONE] Comment on the bug for specifying a user comment on testruns with details of potential uses (bug 626711, bug 668063, bug 668064). (Dave)
  • Investigate potential collaboration with the Telemetry project in Nightly. (Dave)
  • All action items carried over from previous meeting.
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Mozmill_Test_Automation/Endurance_Tests/Meetings/06-28-2011&oldid=324833"