QA/Platform/DOM: Difference between revisions

From MozillaWiki
< QA‎ | Platform
Jump to navigation Jump to search
Line 110: Line 110:
; [[Platform/Roadmap#DOM|Roadmap]] / [https://trello.com/b/HFf1xGCC/platform-status-board Trello] / [[QA/Platform/DOM/Feature_Testplan_Template|Template]]
; [[Platform/Roadmap#DOM|Roadmap]] / [https://trello.com/b/HFf1xGCC/platform-status-board Trello] / [[QA/Platform/DOM/Feature_Testplan_Template|Template]]


== Nightly ==
Firefox 40 (Nightly):
* {{ok|}} Screen Orientation API (Bugzilla, [https://trello.com/c/bqNlSEiO/444-screen-orientation-api Trello], Wiki)
* [https://trello.com/c/bqNlSEiO/444-screen-orientation-api Screen Orientation API]


== Aurora ==
Firefox 39 (Aurora):
* {{ok|}} Service Workers: [https://bugzil.la/903441 Bugzilla], [https://trello.com/c/VxM3osuE/19-service-workers Trello], [[QA/Platform/DOM/Service_Workers|Wiki]] (''unassigned'')
* [https://trello.com/c/VxM3osuE/19-service-workers Service Workers]
* {{ok|}} IndexedDB/SQLite Performance: Bugzilla, [https://trello.com/c/OaQ85bvs/406-indexeddb-sqlite-performance-improvements Trello], [[QA/Platform/DOM/IndexedDB_SQLite_Performance_Improvements|Wiki]] (''unassigned'')
* [https://trello.com/c/OaQ85bvs/406-indexeddb-sqlite-performance-improvements IndexedDB & SQLite performance improvements]
 
== Beta ==
* {{ok|}} Picture Tag: [https://bugzil.la/1017875 Bugzilla], [https://trello.com/c/16ShYTsh/13-picture-tag Trello], [[QA/Platform/DOM/Picture_Tag|Wiki]] (''unassigned'')
* {{ok|}} RequestSync API: [https://bugzil.la/1018320 Bugzilla], [https://trello.com/c/MtwzxobL/181-requestsync-api-2-2 Trello], [[QA/Platform/DOM/RequestSync_API|Wiki]] (''unassigned'')
* {{ok|}} BroadcastChannel API: [https://bugzil.la/966439 Bugzilla], [https://trello.com/c/qlwsobbB/407-broadcast-channel-api Trello], [[QA/Platform/DOM/BroadcastChannel_API|Wiki]] (''unassigned'')


Firefox 38 (Beta):
* [https://trello.com/c/16ShYTsh/13-picture-tag Picture Tag]
* [https://trello.com/c/MtwzxobL/181-requestsync-api-2-2 RequestSync API]
* [https://trello.com/c/qlwsobbB/407-broadcast-channel-api BroadcastChannel API]


Firefox 37 (released March 31, 2015):
Firefox 37 (released March 31, 2015):
* [https://trello.com/c/rdHssqZr/20-indexeddb-in-workers IndexedDB in Workers]
* [https://trello.com/c/rdHssqZr/20-indexeddb-in-workers IndexedDB in Workers]
* [https://trello.com/c/7EJdOwmn/78-websockets-in-workers Web Sockets in Workers]
* [https://trello.com/c/7EJdOwmn/78-websockets-in-workers Web Sockets in Workers]

Revision as of 19:35, 4 May 2015

About the Team

People

  • Manager: Andrew Overholt (overholt)
  • Engineers: Ehsan Akhgari (ehsan), Anne van Kesteren (annevk), Josh Matthews (jdm), Boris Zbarsky (bz)
  • QA: Anthony Hughes (ashughes)

How to Contact Us

Meetings

Meetings are pending approval of bug triage processes. Once this is approved we will go ahead and set up a recurring meeting.

Strategy

This page documents the QA strategy for testing Mozilla's DOM implementation. Our primary objective is the continuous improvement of DOM quality through two-week sprints of open, transparent, and data-driven qualification processes.

Documentation

Guides:

Reference:

Current Initiatives

Develop documentation to enable greater transparency of DOM testing standards and practices.

  • [DONE] Document how bugs are logged and triaged, including different types of bugs and how they're prioritized
  • [DONE] Develop a feature testplan template and begin documenting in-flight features
  • Develop a map of the dependencies DOM has on other components

Develop a suite of metrics to measure the overall health of Gecko's DOM implementation and the QA impact.

  • [DONE] Create an initial set of rudimentary metrics based on Bugzilla data to measure bug workflow effectiveness (wiki)
  • Review the metrics and automate them if they are deemed informative, investigate new metrics if not

Improve flow and resolution of bugs

  • Set up processes for bug triage including documentation and meetings
  • Create a backlog of bug-work for QA and begin working through that backlog
  • Improve coverage of the web-platform-tests

Sprints

Sprint Deadline Status Deliverables
5 March 20, 2015 IN PROGRESS
  • [DONE] make sure all DOM crashes >1% are reported
  • [ON TRACK] set up triage meeting once MDN documentation is reviewed
  • [ON TRACK] create patch for web-platform-tests#1506
  • [ON TRACK] review Betabreakers Firefox 38 testing (testplan)
  • Late Additions:
4 March 13, 2015 DONE
  • [CARRY OVER] set up a recurring triage meeting that is open to the public
    • delayed pending feedback on MDN documentation
  • [DONE] review and revise existing bug workflow documentation (migrate to MDN)
  • [DONE] review and revise the strategy and make sure all ramp up items are accounted for
  • [CARRY OVER] create an initial patch for web-platform-tests#1506
    • delayed due to Betabreakers Firefox 38 testing being moved up to Aurora
3 February 27, 2015 DONE
  • [DONE] Anthony to mock up something with unconfirmed bugs
  • [DONE] Get DOM team (Andrew and whoever else) to review benchmarks and metrics from bugzilla
  • [DROPPED] If benchmarks pass muster Anthony to look at automating them/metrics.js etc
    • delayed to Q2 due to competing priorities
  • [CARRY OVER] Tracy to set up bug triage
    • handed off to Anthony due to re-org
  • [CARRY OVER] Tracy to document the bug workflow w.r.t. verification (ie. when do we verify a bug)
    • handed off to Anthony due to re-org
  • [DONE] Revise the big to-do list above into a strategy of what will be done and when
  • [DROPPED] Look into what "developer preview" actually means w.r.t. service workers.
    • not sure what this was in regards to
  • [CARRY OVER] Review ramp up to make sure everything is completed or tracked
    • handed off to Anthony due to re-org

Triage

The team will meet once per week to go through the following reports in an effort to make sure bugs are moving forward toward resolution.

Read our guide to learn more about triage.

Backlog

Features

Roadmap / Trello / Template

Firefox 40 (Nightly):

Firefox 39 (Aurora):

Firefox 38 (Beta):

Firefox 37 (released March 31, 2015):