QA/Loop: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
m (Canonical name for the category is "Test Plans," not "Test Paan.")
 
(30 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[Category: Test Plans]]
== Summary ==
== Summary ==
'''Loop''' is a project to deliver rich real-time communication to the web. This page details the strategy to ensure this project delivers on time and to a high-level of quality.
Loop (aka ''Firefox Hello'') is a project to deliver rich real-time communication to the web. This page details the strategy to ensure this project delivers on time and to a high-level of quality. '''What to help? [https://oneanddone.mozilla.org/en-US/tasks/64/ Run some tests!]'''
 
; More Information
* [[Loop|Project wiki]]
* [[Loop|Project wiki]]
* [https://docs.google.com/a/mozilla.com/document/d/18UUZMXLmB0qJDi2OZHSvDEE9GkvEQSj8Z07ts0wzU28/edit Requirements document]
* [https://docs.google.com/a/mozilla.com/document/d/18UUZMXLmB0qJDi2OZHSvDEE9GkvEQSj8Z07ts0wzU28/edit Requirements document]
* [https://people.mozilla.org/~dhenein/labs/loop-mvp-spec/ Interactive UX Mockups]
* [https://useradvocacy.mozilla.org/dashboards/hello-v1/ Feedback Dashboard]
* [https://docs.google.com/a/mozilla.com/presentation/d/1TVWCia5G2fRzdIV754QwKRbm44wdmFMe7v3opPi-8QM/edit?pli=1#slide=id.g547d72bf6_01035 2015 Roadmap]


== People Involved ==
== People Involved ==
Line 12: Line 18:
  | '''Product'''
  | '''Product'''
  | Anthony Hughes <br> Tony Chung
  | Anthony Hughes <br> Tony Chung
  | QA contact for the Desktop client <br> QA contact for the Mobile client
  | QA contact for the Desktop client <br> QA contact for the [[QA/Loop/Firefox_OS|Mobile client]]
  |- valign="top"
  |- valign="top"
  | '''Platform'''
  | '''Platform'''
Line 22: Line 28:
  | QA contact for server scalability <br> QA contact for server APIs <br> QA contact for Firefox Accounts integration <br> QA Lead for Services support
  | QA contact for server scalability <br> QA contact for server APIs <br> QA contact for Firefox Accounts integration <br> QA Lead for Services support
  |}
  |}
== Test Plans ==
* [[QA/Loop/E2E|End-to-End Testing]] (Anthony Hughes)
* [[QA/Loop/Firefox_OS|Firefox OS Client]] (Tony Chung)
* [[QA/Loop/MSISDN|MSISDN Support]] (Martijn Wargers)


== Meetings ==
== Meetings ==
Line 54: Line 65:
  |}
  |}


== Top-level Status ==
== Dashboards ==
=== Milestone: Firefox 34 Beta Readiness ===
* [https://metrics.services.mozilla.com/loop-server-dashboard/ Loop Server Dashboard]
{| class="wikitable" style="width:100%"
* [http://pf-jenkins.qa.mtv2.mozilla.com:8080/ WebRTC Automation Dashboard]
! style="text-align:left" | Component
* [https://trello.com/b/rnC9Fyor/functional-testing End-to-End Automation Dashboard]
! style="text-align:left" | Tracking Bug
! style="text-align:left" | QA Contact
! style="text-align:left" | Health
! style="text-align:left; width:40%" | Details
|-
! colspan="5" style="text-align:left" | Client
|-
| Desktop
| {{bug|971986}}
| Anthony Hughes
| {{ok|}}
| Tracking uplifts to Aurora for pre-Beta sign-off
|-
| Mobile
| {{bug|988276}}
| <strike>Jason Smith</strike> Tony Chung
| {{ok|}}
| ''detailed status/blockers''
|-
! colspan="5" style="text-align:left" | Platform
|-
| [[QA/Loop/MSISDN_testplan|MSISDN Support]]
|
| Martijn Wargers
| {{ok|}}
| ''detailed status/blockers''
|-
| Performance (B2G)
|
| Geo Mealer
| {{ok|}}
| ''detailed status/blockers''
|-
| Privileged API Support
| {{bug|988285}}
| <strike>Jason Smith</strike>
| {{done|}}
|
|-
| [https://docs.google.com/a/mozilla.com/spreadsheets/d/1y3ByW96g2F_nrtbfF-lQZ1Yvm1VM666q7jfuyWhMeXA/edit#gid=2101170456 Tokbox Support]
|
| Nils Ohlmeier
| {{ok|}}
| ''detailed status/blockers''
|-
| WebRTC/H264 Support
| {{bug|1004761}}
| Nils Ohlmeier
| {{ok|}}
| ''detailed status/blockers''
|-
| WebRTC Automation
|
| Syd Polk
| {{ok|}}
| ''detailed status/blockers''
|-
! colspan="5" style="text-align:left" | [[CloudServices/Loop|Services]]
|-
| Firefox Accounts
|
| Richard Pappalardo
|
| ''detailed status/blockers''
|-
| Server APIs
|
| Peter DeHaan
|
| ''detailed status/blockers''
|-
| [https://docs.google.com/a/mozilla.com/document/d/1rWik_NqqcvCT_EKtJqiEJgllK16teFP0EX1e-9AHVmA/edit Server Scalability]
|
| James Bonacci
|
| ''detailed status/blockers''
|}
''[[QA/Loop/Firefox_34|Details]]''
 
== How to Get Involved ==
* [https://oneanddone.mozilla.org/en-US/tasks/64/ Run our One & Done task for Firefox Aurora 34]
 
== Feature Tracking Bugs ==
<bugzilla>
{
"status_whiteboard":"ft:loop"
}
</bugzilla>
 
== Firefox 34 ==
=== Health ===
''Project QA Lead - Anthony Hughes''
 
==== Client ====
''Lead - Anthony Hughes''
* {{ok|}} Desktop client and standalone interface (Anthony Hughes)
* {{ok|}} Firefox OS client (<strike>Jason Smith</strike>)
==== Platform ====
''Lead - Syd Polk''
* {{ok|}} [https://docs.google.com/a/mozilla.com/spreadsheets/d/1y3ByW96g2F_nrtbfF-lQZ1Yvm1VM666q7jfuyWhMeXA/edit#gid=2101170456 Tokbox Integration] (Nils Ohlmeier)
* {{ok|}} Privileged API (<strike>Jason Smith</strike>)
* {{ok|}} Performance Automation (Geo Mealer)
* {{ok|}} [[Loop/QA/MSISDN_testplan|MSISDN Support]] (Martijn Wargers)
* {{ok|}} H.264 Support (Paul Yang)
 
==== Services ====
''Lead - Edwin Wong'' ([[CloudServices/Loop|wiki]])
* {{ok|}} [[Firefox Accounts Integration]] (Richard Pappalardo)
* {{ok|}} [[Server APIs]] (Peter DeHaan)
* {{ok|}} [[Server Scalability]] (James Bonacci)
* {{ok|}} [https://docs.google.com/a/mozilla.com/document/d/1rWik_NqqcvCT_EKtJqiEJgllK16teFP0EX1e-9AHVmA/edit Loop server error/failure escalation] (James Bonacci)


== Tracked Bugs ==
== Deliverables ==
For each milestone:
Client
* review that no unresolved bugs block that milestone
* {{ok|}} [[QA/Loop/Firefox_35|Firefox 35 Desktop Client]] (Anthony Hughes)
* review that all fixed bugs have been triaged for qe-verify+/-
* {{done|}} [[QA/Loop/Firefox_34|Firefox 34 Desktop Client]] (Anthony Hughes)
* review that all qe-verify+ bugs have been verified
* {{ok|}} [[QA/Loop/Firefox_OS|Firefox OS Mobile Client]] (Tony Chung)
* review that all qe-verify+ bugs have appropriate test coverage (automated & manual)


=== Mobile Client (Tony Chung) ===
Automation
<bugzilla>
* {{ok|}} [[QA/Loop/E2E|End-to-End Testing]] (Nils Ohlmeier)
{
* {{ok|}} [https://www.pivotaltracker.com/s/projects/1139894 WebRTC] (Syd Polk)
"include_fields":"id,summary,status,resolution,target_milestone",
* {{ok|}} [https://bugzilla.mozilla.org/show_bug.cgi?id=1092239 Standalone Page] (Stephen Donner)
"f1":"blocked",
"o1":"equals",
"v1":"988276"
}
</bugzilla>


=== Loop Server (James Bonacci) ===
Platform
<bugzilla>
* {{ok|}} [[QA/Loop/OpenH264|OpenH264]] (Nils Ohlmeier)
{
* {{done|}} [[QA/Loop/MSISDN|MSISDN Support]] (Martijn Wargers)
"include_fields":"id,summary,status,resolution,target_milestone",
* {{done|}} [[QA/Loop/PrivilegedAPI|Privileged API]] (Tony Chung)
"f1":"blocked",
* {{done|}} [https://docs.google.com/a/mozilla.com/spreadsheets/d/1y3ByW96g2F_nrtbfF-lQZ1Yvm1VM666q7jfuyWhMeXA/edit#gid=2101170456 Tokbox Back-end] (Nils Ohlmeier)
"o1":"equals",
"v1":"998332"
}
</bugzilla>


=== Privileged API (Jason Smith) ===
Server
<bugzilla>
* {{ok|}} [[Loop/Load_Handling|Server Scalability]] (James Bonacci)
{
* {{ok|}} [[CloudServices/Loop|Services]] (Richard Pappalardo)
"include_fields":"id,summary,status,resolution,target_milestone",
"f1":"blocked",
"o1":"equals",
"v1":"988285"
}
</bugzilla>

Latest revision as of 19:00, 6 January 2016

Summary

Loop (aka Firefox Hello) is a project to deliver rich real-time communication to the web. This page details the strategy to ensure this project delivers on time and to a high-level of quality. What to help? Run some tests!

More Information

People Involved

QA Lead Anthony Hughes
Product Anthony Hughes
Tony Chung 		QA contact for the Desktop client
QA contact for the Mobile client
Platform Geo Mealer
Nils Ohlmeier
Syd Polk
Jason Smith
Martijn Wargers
Paul Yang 		Automation support for mobile performance
QA contact for WebRTC, Screensharing, and Tokbox SDK support
Automation support for WebRTC
QA contact for Privileged API support
QA contact for MSISDN support
QA contact for H264 decoding support
Services James Bonacci
Peter DeHaan
Richard Pappalardo
Edwin Wong 		QA contact for server scalability
QA contact for server APIs
QA contact for Firefox Accounts integration
QA Lead for Services support

Test Plans

Meetings

Meeting When Where Notes Last Meeting
Project Status 11:30h Pacific on Tuesday Shell Escalante's Vidyo room Agenda
Partner Testing Coordination 09:30h Pacific on Wednesday Shell Escalante's Vidyo Room
Tokbox Testing Coordination 14:00h Pacific on Wednesday Opentok Agenda
QA Status 13:00h Pacific on Thursday Anthony Hughes' Vidyo room Agenda 2014-08-21

Dashboards

Deliverables

Client

Automation

Platform

Server

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Loop&oldid=1111634"