QA/Loop: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
m (Canonical name for the category is "Test Plans," not "Test Paan.")
 
(64 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[Category: Test Plans]]
== Summary ==
== Summary ==
'''Loop''' is a project to deliver rich real-time communication to the web. This page details the strategy to ensure this project delivers on time and to a high-level of quality.
Loop (aka ''Firefox Hello'') is a project to deliver rich real-time communication to the web. This page details the strategy to ensure this project delivers on time and to a high-level of quality. '''What to help? [https://oneanddone.mozilla.org/en-US/tasks/64/ Run some tests!]'''
 
; More Information
* [[Loop|Project wiki]]
* [[Loop|Project wiki]]
* [https://docs.google.com/a/mozilla.com/document/d/18UUZMXLmB0qJDi2OZHSvDEE9GkvEQSj8Z07ts0wzU28/edit Requirements document]
* [https://docs.google.com/a/mozilla.com/document/d/18UUZMXLmB0qJDi2OZHSvDEE9GkvEQSj8Z07ts0wzU28/edit Requirements document]
* [https://people.mozilla.org/~dhenein/labs/loop-mvp-spec/ Interactive UX Mockups]
* [https://useradvocacy.mozilla.org/dashboards/hello-v1/ Feedback Dashboard]
* [https://docs.google.com/a/mozilla.com/presentation/d/1TVWCia5G2fRzdIV754QwKRbm44wdmFMe7v3opPi-8QM/edit?pli=1#slide=id.g547d72bf6_01035 2015 Roadmap]


=== People Involved ===
== People Involved ==
{|  
{|  
  |- valign="top"
  |- valign="top"
Line 11: Line 17:
  |- valign="top"
  |- valign="top"
  | '''Product'''
  | '''Product'''
  | Anthony Hughes <br> Jason Smith
  | Anthony Hughes <br> Tony Chung
  | QA contact for the Desktop client <br> QA contact for the Mobile client
  | QA contact for the Desktop client <br> QA contact for the [[QA/Loop/Firefox_OS|Mobile client]]
  |- valign="top"
  |- valign="top"
  | '''Platform'''
  | '''Platform'''
  | Geo Mealer <br> Nils Ohlmeier <br> Syd Polk <br> Jason Smith <br> Martijn Wargers <br> Paul Yang
  | Geo Mealer <br> Nils Ohlmeier <br> Syd Polk <br> Jason Smith <br> Martijn Wargers <br> Paul Yang
  | Automation support for mobile performance <br> QA contact for WebRTC, Screensharing, and Tokbox SDK support <br> Automation support for WebRTC <br> QA contact for Privileged API support <br> QA contact for MSISDN support <br> QA contact for H264 decoding support
  | Automation support for mobile performance <br> QA contact for WebRTC, Screensharing, and Tokbox SDK support <br> Automation support for WebRTC <br> QA contact for Privileged API support <br> QA contact for [[QA/Loop/MSISDN|MSISDN support]] <br> QA contact for H264 decoding support
  |- valign="top"
  |- valign="top"
  | '''Services'''
  | '''Services'''
Line 23: Line 29:
  |}
  |}


=== Meetings ===
== Test Plans ==
* [[QA/Loop/E2E|End-to-End Testing]] (Anthony Hughes)
* [[QA/Loop/Firefox_OS|Firefox OS Client]] (Tony Chung)
* [[QA/Loop/MSISDN|MSISDN Support]] (Martijn Wargers)
 
== Meetings ==
{| class="querytable"
{| class="querytable"
  | class="header" | Meeting
  | class="header" | Meeting
Line 50: Line 61:
  | Anthony Hughes' Vidyo room
  | Anthony Hughes' Vidyo room
  | [https://mozqa.etherpad.mozilla.org/loop-status-meeting Agenda]
  | [https://mozqa.etherpad.mozilla.org/loop-status-meeting Agenda]
  | [[Loop/QA/Meetings:2014-07-24|2014-07-24]]
  | [[Loop/QA/Meetings:2014-08-21|2014-08-21]]
  |-
  |-
  |}
  |}


=== Tracking Bugs ===
== Dashboards ==
<bugzilla>
* [https://metrics.services.mozilla.com/loop-server-dashboard/ Loop Server Dashboard]
{
* [http://pf-jenkins.qa.mtv2.mozilla.com:8080/ WebRTC Automation Dashboard]
"include_fields":"id,summary,qa_contact,status",
* [https://trello.com/b/rnC9Fyor/functional-testing End-to-End Automation Dashboard]
"f1":"blocked",
"o1":"equals",
"v1":"998329"
}
</bugzilla>


=== Milestones ===
== Deliverables ==
By Firefox Version
Client
* Firefox 32: Ship OpenH264
* {{ok|}} [[QA/Loop/Firefox_35|Firefox 35 Desktop Client]] (Anthony Hughes)
* Firefox 33: Ship Screensharing and Loop MLP
* {{done|}} [[QA/Loop/Firefox_34|Firefox 34 Desktop Client]] (Anthony Hughes)
* Firefox 34: Ship Loop MVP
* {{ok|}} [[QA/Loop/Firefox_OS|Firefox OS Mobile Client]] (Tony Chung)


By Product Feature
Automation
* [[QA/WebRTC/Screensharing|Screensharing via OpenH264]]: Begin testing in Firefox 32, ship in Firefox 33
* {{ok|}} [[QA/Loop/E2E|End-to-End Testing]] (Nils Ohlmeier)
* [[QA/WebRTC/Loop/MLP|Loop MLP]]: 0 Open; 11 Resolved; 46 Verified; (target: Firefox 33)
* {{ok|}} [https://www.pivotaltracker.com/s/projects/1139894 WebRTC] (Syd Polk)
* [[QA/WebRTC/Loop/MVP|Loop MVP]]: 23 Open; 14 Resolved; 24 Verified; (target: Firefox 34)
* {{ok|}} [https://bugzilla.mozilla.org/show_bug.cgi?id=1092239 Standalone Page] (Stephen Donner)
* Server/Services:
* Firefox OS:
* Platform:


=== Dashboards ===
Platform
* [https://trello.com/b/dJrDc6QT/webrtc-overview-in-progress WebRTC Progress Overview]
* {{ok|}} [[QA/Loop/OpenH264|OpenH264]] (Nils Ohlmeier)
* [http://charts.paas.allizom.org/fxos/burndown-milestone.html#milestone=Milestone.Firefox33&team=WebRTC_Loop Firefox 33 Product Changes]
* {{done|}} [[QA/Loop/MSISDN|MSISDN Support]] (Martijn Wargers)
* [http://charts.paas.allizom.org/fxos/burndown-milestone.html#milestone=Milestone.Firefox33&team=WebRTC_Platform Firefox 33 Platform Changes]
* {{done|}} [[QA/Loop/PrivilegedAPI|Privileged API]] (Tony Chung)
* {{done|}} [https://docs.google.com/a/mozilla.com/spreadsheets/d/1y3ByW96g2F_nrtbfF-lQZ1Yvm1VM666q7jfuyWhMeXA/edit#gid=2101170456 Tokbox Back-end] (Nils Ohlmeier)


== Testing ==
Server
* [[QA/Loop/Desktop_Client|Desktop Client]] (Anthony Hughes)
* {{ok|}} [[Loop/Load_Handling|Server Scalability]] (James Bonacci)
* {{ok|}} [[CloudServices/Loop|Services]] (Richard Pappalardo)

Latest revision as of 19:00, 6 January 2016

Summary

Loop (aka Firefox Hello) is a project to deliver rich real-time communication to the web. This page details the strategy to ensure this project delivers on time and to a high-level of quality. What to help? Run some tests!

More Information

People Involved

QA Lead Anthony Hughes
Product Anthony Hughes
Tony Chung
QA contact for the Desktop client
QA contact for the Mobile client
Platform Geo Mealer
Nils Ohlmeier
Syd Polk
Jason Smith
Martijn Wargers
Paul Yang
Automation support for mobile performance
QA contact for WebRTC, Screensharing, and Tokbox SDK support
Automation support for WebRTC
QA contact for Privileged API support
QA contact for MSISDN support
QA contact for H264 decoding support
Services James Bonacci
Peter DeHaan
Richard Pappalardo
Edwin Wong
QA contact for server scalability
QA contact for server APIs
QA contact for Firefox Accounts integration
QA Lead for Services support

Test Plans

Meetings

Meeting When Where Notes Last Meeting
Project Status 11:30h Pacific on Tuesday Shell Escalante's Vidyo room Agenda
Partner Testing Coordination 09:30h Pacific on Wednesday Shell Escalante's Vidyo Room
Tokbox Testing Coordination 14:00h Pacific on Wednesday Opentok Agenda
QA Status 13:00h Pacific on Thursday Anthony Hughes' Vidyo room Agenda 2014-08-21

Dashboards

Deliverables

Client

Automation

Platform

Server