QA/Loop: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
m (Canonical name for the category is "Test Plans," not "Test Paan.")
 
(97 intermediate revisions by 2 users not shown)
Line 1: Line 1:
= People =
[[Category: Test Plans]]
* Lead - Anthony Hughes
== Summary ==
* Desktop - Anthony Hughes
Loop (aka ''Firefox Hello'') is a project to deliver rich real-time communication to the web. This page details the strategy to ensure this project delivers on time and to a high-level of quality. '''What to help? [https://oneanddone.mozilla.org/en-US/tasks/64/ Run some tests!]'''
* Mobile - TEF, ?
* Platform - Nils Ohlmeier
** H264 - Paul Yang, Martijn Wargers
** MSIIDN - Martijn Wargers
** Performance - Geo Mealer, Syd Polk
** Privileged API - Jason Smith
* Server - ?
* Services - Peter deHaan, Edwin Wong


= Meetings =
; More Information
* [[Loop|Project wiki]]
* [https://docs.google.com/a/mozilla.com/document/d/18UUZMXLmB0qJDi2OZHSvDEE9GkvEQSj8Z07ts0wzU28/edit Requirements document]
* [https://people.mozilla.org/~dhenein/labs/loop-mvp-spec/ Interactive UX Mockups]
* [https://useradvocacy.mozilla.org/dashboards/hello-v1/ Feedback Dashboard]
* [https://docs.google.com/a/mozilla.com/presentation/d/1TVWCia5G2fRzdIV754QwKRbm44wdmFMe7v3opPi-8QM/edit?pli=1#slide=id.g547d72bf6_01035 2015 Roadmap]
 
== People Involved ==
{|
|- valign="top"
| '''QA Lead'''
| Anthony Hughes
|- valign="top"
| '''Product'''
| Anthony Hughes <br> Tony Chung
| QA contact for the Desktop client <br> QA contact for the [[QA/Loop/Firefox_OS|Mobile client]]
|- valign="top"
| '''Platform'''
| Geo Mealer <br> Nils Ohlmeier <br> Syd Polk <br> Jason Smith <br> Martijn Wargers <br> Paul Yang
| Automation support for mobile performance <br> QA contact for WebRTC, Screensharing, and Tokbox SDK support <br> Automation support for WebRTC <br> QA contact for Privileged API support <br> QA contact for [[QA/Loop/MSISDN|MSISDN support]] <br> QA contact for H264 decoding support
|- valign="top"
| '''Services'''
| James Bonacci <br> Peter DeHaan <br> Richard Pappalardo <br> Edwin Wong
| QA contact for server scalability <br> QA contact for server APIs <br> QA contact for Firefox Accounts integration <br> QA Lead for Services support
|}
 
== Test Plans ==
* [[QA/Loop/E2E|End-to-End Testing]] (Anthony Hughes)
* [[QA/Loop/Firefox_OS|Firefox OS Client]] (Tony Chung)
* [[QA/Loop/MSISDN|MSISDN Support]] (Martijn Wargers)
 
== Meetings ==
{| class="querytable"
{| class="querytable"
  | class="header" | Meeting
  | class="header" | Meeting
Line 17: Line 40:
  | class="header" | Where
  | class="header" | Where
  | class="header" | Notes
  | class="header" | Notes
| class="header" | Last Meeting
  |-
  |-
  | Project Status
  | Project Status
Line 36: Line 60:
  | 13:00h Pacific on Thursday
  | 13:00h Pacific on Thursday
  | Anthony Hughes' Vidyo room
  | Anthony Hughes' Vidyo room
  |
  | [https://mozqa.etherpad.mozilla.org/loop-status-meeting Agenda]
| [[Loop/QA/Meetings:2014-08-21|2014-08-21]]
  |-
  |-
  |}
  |}


= Tracking Bugs =
== Dashboards ==
<bugzilla>
* [https://metrics.services.mozilla.com/loop-server-dashboard/ Loop Server Dashboard]
{
* [http://pf-jenkins.qa.mtv2.mozilla.com:8080/ WebRTC Automation Dashboard]
"include_fields":"id,summary,qa_contact,resolution",
* [https://trello.com/b/rnC9Fyor/functional-testing End-to-End Automation Dashboard]
"f1":"blocked",
"o1":"equals",
"v1":"998329"
}
</bugzilla>
 
= Desktop Client =
''Owner: Anthony Hughes''
* [https://docs.google.com/a/mozilla.com/document/d/1xYZijHnJ1JeJhONm2AYvxSnD2tWztC16WGFyD5U_d6g/edit?disco=AAAAAJhWOZw draft testplan]
 
==== User Stories ====
 
==== Blockers ====
<bugzilla>
{
"include_fields":"id,summary,qa_contact,resolution",
"f1":"blocked",
"o1":"equals",
"v1":"971986"
}
</bugzilla>
 
= Gaia Client =
''Owner: ''
 
==== User Stories ====
* Caller attempts a WebRTC call, Callee ends the call after 60 seconds
* Caller attempts a WebRTC call, Callee ends the call after 10 minutes
* Caller attempts a WebRTC call, Callee ends the call after 30 minutes
* Caller attempts a WebRTC call, Caller ends the call after 1 hour
* Caller attempts a WebRTC call, Caller/Callee rotates the phone every 15 seconds for one minute, Callee ends the call after 4 minutes
* Caller attempts a WebRTC call, Callee ends the call after 60 seconds, repeat 100x
* Caller attempts a WebRTC call, Caller/Calle perform zoom gestures during call, Caller ends the call after 2 minutes
* Caller attempts a WebRTC call, Caller/Callee covers sensor after 15 seconds and removes cover after 30 seconds, Callee ends call after 2 minutes
* Caller attempts a WebRTC call, Caller/Callee mute the call after 1 minute, unmute the call after 2 minutes, Callee ends the call after 3 minutes
* Caller attempts a WebRTC call to a Callee who only accepts VOIP calls
* Caller attempts a voice-only call and switches to video call after 30 seconds
* Caller attempts a WebRTC call, Callee gets thrown off network after 1 minute
 
==== Blockers ====
<bugzilla>
{
"include_fields":"id,summary,status,resolution",
"f1":"blocked",
"o1":"equals",
"v1":"988276"
}
</bugzilla>
 
==== Bugs ====
<bugzilla>
{
"include_fields":"id,summary,status,resolution",
"f1":"component",
"o1":"equals",
"v1":"Gaia::Loop"
}
</bugzilla>
 
= Platform =
== Performance ==
''Owner: Geo Mealer''
* [https://docs.google.com/a/mozilla.com/document/d/1UaieWV3jIQEthuo_d8_GZIyQmFSMijxSgudlzhK_3sA/edit#heading=h.hdklkwzcmnvd FxOS performance roadmap]
 
==== User Stories ====
* AV Sync performance over a 15 minute WebRTC call
* CPU performance over a 1 minute WebRTC call
* Power usage over a 1 minute WebRTC call
* E2E latency over a 1 minute WebRTC call
 
==== Testing ====
 
==== Blockers ====
 
==== Bugs ====
 
== Privileged API ==
''Owner: Jason Smith''
 
==== User Stories ====
 
==== Blockers ====
<bugzilla>
{
"include_fields":"id,summary,qa_contact,resolution",
"f1":"blocked",
"o1":"equals",
"v1":"988285"
}
</bugzilla>
 
==== Bugs ====
 
== Tokbox ==
''Owner: Nils Ohlmeier''
* [https://webrtc.etherpad.mozilla.org/tokbox-meeting Meetings]: Tuesday @ 2pm Pacific
 
==== Testing ====
 
==== Blockers ====
 
==== Bugs ====
 
= Server =
== Scalability ==
''Owner: James Bonacci''
 
==== Goals ====
 
==== Testing ====
 
==== Blockers ====
<bugzilla>
{
"include_fields":"id,summary,qa_contact,resolution",
"f1":"blocked",
"o1":"equals",
"v1":"998332"
}
</bugzilla>
 
==== Bugs ====
 
= Services =
''Owner: Edwin Wong''


==== Goals ====
== Deliverables ==
Client
* {{ok|}} [[QA/Loop/Firefox_35|Firefox 35 Desktop Client]] (Anthony Hughes)
* {{done|}} [[QA/Loop/Firefox_34|Firefox 34 Desktop Client]] (Anthony Hughes)
* {{ok|}} [[QA/Loop/Firefox_OS|Firefox OS Mobile Client]] (Tony Chung)


==== Testing ====
Automation
* [https://wiki.mozilla.org/Services/Loop/Try_Loop Steps to pre-trial Loop]
* {{ok|}} [[QA/Loop/E2E|End-to-End Testing]] (Nils Ohlmeier)
* {{ok|}} [https://www.pivotaltracker.com/s/projects/1139894 WebRTC] (Syd Polk)
* {{ok|}} [https://bugzilla.mozilla.org/show_bug.cgi?id=1092239 Standalone Page] (Stephen Donner)


==== Blockers ====
Platform
<bugzilla>
* {{ok|}} [[QA/Loop/OpenH264|OpenH264]] (Nils Ohlmeier)
{
* {{done|}} [[QA/Loop/MSISDN|MSISDN Support]] (Martijn Wargers)
"include_fields":"id,summary,qa_contact,resolution",
* {{done|}} [[QA/Loop/PrivilegedAPI|Privileged API]] (Tony Chung)
"f1":"blocked",
* {{done|}} [https://docs.google.com/a/mozilla.com/spreadsheets/d/1y3ByW96g2F_nrtbfF-lQZ1Yvm1VM666q7jfuyWhMeXA/edit#gid=2101170456 Tokbox Back-end] (Nils Ohlmeier)
"o1":"equals",
"v1":"998748"
}
</bugzilla>


==== Bugs ====
Server
* {{ok|}} [[Loop/Load_Handling|Server Scalability]] (James Bonacci)
* {{ok|}} [[CloudServices/Loop|Services]] (Richard Pappalardo)

Latest revision as of 19:00, 6 January 2016

Summary

Loop (aka Firefox Hello) is a project to deliver rich real-time communication to the web. This page details the strategy to ensure this project delivers on time and to a high-level of quality. What to help? Run some tests!

More Information

People Involved

QA Lead Anthony Hughes
Product Anthony Hughes
Tony Chung 		QA contact for the Desktop client
QA contact for the Mobile client
Platform Geo Mealer
Nils Ohlmeier
Syd Polk
Jason Smith
Martijn Wargers
Paul Yang 		Automation support for mobile performance
QA contact for WebRTC, Screensharing, and Tokbox SDK support
Automation support for WebRTC
QA contact for Privileged API support
QA contact for MSISDN support
QA contact for H264 decoding support
Services James Bonacci
Peter DeHaan
Richard Pappalardo
Edwin Wong 		QA contact for server scalability
QA contact for server APIs
QA contact for Firefox Accounts integration
QA Lead for Services support

Test Plans

Meetings

Meeting When Where Notes Last Meeting
Project Status 11:30h Pacific on Tuesday Shell Escalante's Vidyo room Agenda
Partner Testing Coordination 09:30h Pacific on Wednesday Shell Escalante's Vidyo Room
Tokbox Testing Coordination 14:00h Pacific on Wednesday Opentok Agenda
QA Status 13:00h Pacific on Thursday Anthony Hughes' Vidyo room Agenda 2014-08-21

Dashboards

Deliverables

Client

Automation

Platform

Server

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Loop&oldid=1111634"