QA/Common voice: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
No edit summary
 
(23 intermediate revisions by 2 users not shown)
Line 2: Line 2:


== Ownership ==
== Ownership ==
Project manager: [mailto:mhenretty@mozilla.com Michael Henretty] [:mikehenrty] <br />
Product owner: [mailto:kdavis@mozilla.com Kelly Davis] [:kdavis] <br />
Product owner: [mailto:kdavis@mozilla.com Kelly Davis] [:kdavis] <br />
Developers lead: [mailto:mhenretty@mozilla.com Michael Henretty] [:mikehenrty] <br />
QA: [mailto:vioia@mozilla.com Viorela Ioia], [mailto:rleitan@mozilla.com Roxana Leitan]<br />
QA: [mailto:camelia.badau@softvision.ro Paul Silaghi] [:pauly]


== Summary ==
== Summary ==
Line 14: Line 14:
*[https://github.com/mozilla/voice-web Repo]
*[https://github.com/mozilla/voice-web Repo]
*[https://github.com/mozilla/voice-web/issues Issue tracking]
*[https://github.com/mozilla/voice-web/issues Issue tracking]
*[https://test.mozvoice.org/ Integration Test Website]
*[http://voice.mozilla.org/ Production url]
*[http://voice.allizom.org/ Staging url]


== Test Strategy ==
== Test Strategy ==
=== Environments ===
=== Environments ===
Testing will be performed on following OSs:
Testing will be performed on following OSs:
* Mac OS X 10
* Mac OS X 10.12
* Windows 7
* Windows 10
* Windows 10
* Ubuntu 16
* Ubuntu 16.04
* iOS x.x
* iOS 11


Testing will be performed on following browsers:
Testing will be performed on following browsers:
* Firefox 53.0.3
* Firefox 61
* Chrome 58
* Chrome 68
* Safari
* IE/Edge
* Opera
* Opera
* Safari


=== Test Types ===
=== Testing Types ===
{|class="wikitable" style="width:60%"
{|class="wikitable" style="width:60%"
|-
|-
! Type of Testing !! Required (Yes/No) !! Owners !! Details/Comments
! Type of Testing !! Required (Yes/No) !! Owners !! Details/Comments
|-
|-
| Manual
| Functional
|style="text-align:center;" | Yes  
|style="text-align:center;" | Yes  
|style="text-align:center;" | Moz QA Rel team ||
|style="text-align:center;" | Viorela Ioia / Roxana Leitan QA
|style="text-align:center;" | [https://github.com/mozilla/voice-web/issues Open issues]
|-
|-
| Automation
| UI
|style="text-align:center;" | No || ||
|style="text-align:center;" | Yes
|style="text-align:center;" | Viorela Ioia / Roxana Leitan QA
|style="text-align:center;" | [https://github.com/mozilla/voice-web/issues Open issues]
|-
|-
| Regression
|style="text-align:center;" | Yes
|style="text-align:center;" | Viorela Ioia / Roxana Leitan QA
|style="text-align:center;" | [https://github.com/mozilla/voice-web/issues Open issues]
|-
|-
| Performance
| Exploratory
|style="text-align:center;" | No || ||
|style="text-align:center;" | Yes
|style="text-align:center;" | Viorela Ioia / Roxana Leitan QA
|style="text-align:center;" | [https://github.com/mozilla/voice-web/issues Open issues]
|-
|-
| Security
| Load testing
|style="text-align:center;" | No || ||
|style="text-align:center;" | Yes
|style="text-align:center;" | Viorela Ioia / Roxana Leitan QA
|style="text-align:center;" | [https://docs.google.com/spreadsheets/d/1G-W5W74xv1hG0blcvoYTEteXnTYMe2nGwTo3AD9DUJY/edit#gid=1952645446 Initial results]
|-
|-
| Usability
| Automation
|style="text-align:center;" | No ||  ||
|style="text-align:center;" | TBD ||  ||
|-
| Metrics/Telemetry
|style="text-align:center;" | TBD||  ||
|}
|}


== Use Cases ==
== Use Cases ==
*User should be able to make a donation
*Users can listen to a recording
*User should be able to create a recording
*Users can validate sentences
*User should be able to listen a recording
*Users can create a recording
*User should be able to sign-up for a new account
*Users can easily switch from Record to Listen
*User should be able to share the project to others
*Users can skip sentences
*Users can user keyboard shortcuts for recording or validationg sentences
*Users can see number of records they validated
*Users can see number of recordings they did
*Users can review they recordings before submitting
*Users can re-record a sentence
*Users can cancel a re-recording
*Users can cancel recording/s submission
*Users get feedback (success message) when their recordings were successfully uploaded
*Users can see recordings upload progress
*Users can create a profile
*Users can view their profile
*Users can edit their profile
*Users can request a new language
*Users can see the list of languages that are in progress
*Users can download common voice data
*Users can see the site localized on different languages (total of 27)
*Users can visualize overall project status
*Users have access to CV privacy notice
*Users can access CV FAQ page
*Users can access CV legal terms info
*Users have quick access to the github repository of the project
*Users have quick access to the discourse CV topic
*Users can contact CV people via a contact form
*Users can share the project via twitter
*Users can share the project via facebook


== Test Cases ==
== Test Cases ==
*The test cases for this feature can be viewed [https://docs.google.com/spreadsheets/d/1TLvhVLKop__EWYUU3nq-Tjcwjg9efQXEaqAwkKgVl1Q/edit#gid=0 here]
*The test cases for this feature can be viewed [https://testrail.stage.mozaws.net/index.php?/suites/view/2782&group_by=cases:section_id&group_order=asc here]


== Important Bugs ==
== Important Bugs ==

Latest revision as of 08:14, 21 August 2018

Mozilla's Common Voice

Ownership

Project manager: Michael Henretty [:mikehenrty]
Product owner: Kelly Davis [:kdavis]
QA: Viorela Ioia, Roxana Leitan

Summary

  • a web application containing a set of voice data that researchers and others can use for free to create better voice technologies for the Internet
  • based on the speech synthesis technology

References

Test Strategy

Environments

Testing will be performed on following OSs:

  • Mac OS X 10.12
  • Windows 10
  • Ubuntu 16.04
  • iOS 11

Testing will be performed on following browsers:

  • Firefox 61
  • Chrome 68
  • Safari
  • IE/Edge
  • Opera

Testing Types

Type of Testing Required (Yes/No) Owners Details/Comments
Functional Yes Viorela Ioia / Roxana Leitan QA Open issues
UI Yes Viorela Ioia / Roxana Leitan QA Open issues
Regression Yes Viorela Ioia / Roxana Leitan QA Open issues
Exploratory Yes Viorela Ioia / Roxana Leitan QA Open issues
Load testing Yes Viorela Ioia / Roxana Leitan QA Initial results
Automation TBD

Use Cases

  • Users can listen to a recording
  • Users can validate sentences
  • Users can create a recording
  • Users can easily switch from Record to Listen
  • Users can skip sentences
  • Users can user keyboard shortcuts for recording or validationg sentences
  • Users can see number of records they validated
  • Users can see number of recordings they did
  • Users can review they recordings before submitting
  • Users can re-record a sentence
  • Users can cancel a re-recording
  • Users can cancel recording/s submission
  • Users get feedback (success message) when their recordings were successfully uploaded
  • Users can see recordings upload progress
  • Users can create a profile
  • Users can view their profile
  • Users can edit their profile
  • Users can request a new language
  • Users can see the list of languages that are in progress
  • Users can download common voice data
  • Users can see the site localized on different languages (total of 27)
  • Users can visualize overall project status
  • Users have access to CV privacy notice
  • Users can access CV FAQ page
  • Users can access CV legal terms info
  • Users have quick access to the github repository of the project
  • Users have quick access to the discourse CV topic
  • Users can contact CV people via a contact form
  • Users can share the project via twitter
  • Users can share the project via facebook

Test Cases

  • The test cases for this feature can be viewed here

Important Bugs

  • TBD

Not Tested

  • TBD

Sign off

Criteria

  • All the test cases were executed.
  • All the major bugs have been fixed.

Results

  • TBD