QA/Fennec/Estimated Reading Time: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
 
(12 intermediate revisions by the same user not shown)
Line 16: Line 16:
<small>'''<font color="green">[LANDED]</font>'''</small> Aurora: 2017-01-28
<small>'''<font color="green">[LANDED]</font>'''</small> Aurora: 2017-01-28


<small>'''<font color="red">[NOT LANDED]</font>'''</small> Beta: NA
<small>'''<font color="green">[LANDED]</font>'''</small> Beta: 2017-03-08


= Testing Summary =  
= Testing Summary =  
Line 44: Line 44:
* First run - Fennec 53 Aurora
* First run - Fennec 53 Aurora
** English US
** English US
** Hebrew עברית‎
** Hebrew - עברית‎
** Arabic - Israeli Literary
** Arabic - العامية
** Arabic - Egyptian اللغة المصرية العامية
** Persian - Farsi -  فارسی  
** Persian - Farsi فارسی  
** Urdu - اُردُو
** Urdu اُردُو
** Uyghur - ئۇيغۇر
** Uyghur - ئۇيغۇر


== Specifications ==
== Specifications ==
* {{Bug|1265304}} - Display estimated reading time in Reader Mode
* {{Bug|1265304}} - Display estimated reading time in Reader Mode
* To calculate the average reading time for each language, uses upper and lower bounds found in this study: http://iovs.arvojournals.org/article.aspx?articleid=2166061


== User stories ==
== User stories ==
Line 61: Line 61:


= Testing details =
= Testing details =
== Test Cases==
*[https://testrail.stage.mozaws.net/index.php?/suites/view/254/&group_by=cases:section_id&group_id=1754 TestRail - Estimated Reading Time test cases]
*https://docs.google.com/spreadsheets/d/1tQIBQtGVcYSBZIxWT6WcjqtWUy_cIU7x8jhezDB1KD8/edit#gid=0
== Testing days==
== Testing days==
===Date:02-13-2017===
===Date:02-13-2017===
* Created Test Plan
* Created Test Plan
* Created Test Cases
* Created Test Cases
===Date:02-15-2017===
* Testing on latest Aurora 53.0a2 on the following devices:
**LG G4 (Android 6.0)
**Lenovo A536 (Android 4.4.2)
**Asus Transformers Pad TF300T (Android 4.2.1)
**Asus ZenPad 8.0 Z380KL (Android 6.0.1)
===Date:02-20-2017===
* Testing on latest Aurora 53.0a2 on the following devices:
**Huawei MediaPad M2 (Android 5.1.1)
**HTC Nexus 9 (Android 7.1.1)
*Verified bugs:
**{{Bug|1323415}} - Use plural form for reader mode article reading time strings
**{{Bug|1318605}} - Do language detection for cases where we don't obtain a dir attribute
===Date:02-21-2017===
**Added test cases in [https://testrail.stage.mozaws.net/index.php?/suites/view/254/&group_by=cases:section_id&group_id=1754 TestRail]
**Exploratory testing on Aurora 53.0a2
===Date:03-13-2017===
* Testing on latest Beta 53.0b1 on the following devices:
**Prestigio Grace X5 (Android 4.4.2)
**Samsung Galaxy Note 4 (Android 5.0.1)
**LG G4 (Android 6.0)
**Asus ZenPad 8.0 Z380KL (Android 6.0.1)
**HTC Nexus 9 (Android 7.1.1)
**Lenovo Yoga Tablet 2 (Android 4.4.2)


=Bug Work=
=Bug Work=
Line 73: Line 102:
<bugzilla>
<bugzilla>
{
{
  "id": "1265304, 1318605, 1323415, 1323331, 1334483"
  "id": "1265304, 1318605, 1323415, 1323331, 1334483, 1346813, 1347460"
}
}
</bugzilla>
</bugzilla>
Line 88: Line 117:


'''Aurora testing'''
'''Aurora testing'''
*NA
*All tests have passed on Aurora 53.0a2. No new/known issues found while testing this feature.


'''Beta testing'''
'''Beta testing'''
*NA
*All tests have passed on Beta 53.0b1. No new/known issues found while testing this feature.

Latest revision as of 07:52, 30 March 2017

Last updated: 2017/03/30

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that users can see the articles estimated reading time in Reader mode.

Ownership

Developer contact:

QA: Oana Horvath (:oanah)

Overall Status

[LANDED] Nightly: 2016-12-13

[LANDED] Aurora: 2017-01-28

[LANDED] Beta: 2017-03-08

Testing Summary

Timeline

  • Priority 1
    • bug 1265304 - Display estimated reading time in Reader Mode
    • bug 1318605 - Do language detection for cases where we don't obtain a dir attribute
    • bug 1323415 - Use plural form for reader mode article reading time strings
    • bug 1323331 - Refactor AboutReader to remove the promise based language resolution supplied to NarrateControls

Scope of testing

The testing will focus on verifying the Reader Mode now displays the estimated reading time for the page, using orientation and language according with the page language detected.

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.x
  • Tablet
    • 4.x
    • 5.x
    • 6.0
    • 7.0

Languages covered

  • First run - Fennec 53 Aurora
    • English US
    • Hebrew - עברית‎
    • Arabic - العامية
    • Persian - Farsi - فارسی
    • Urdu - اُردُو
    • Uyghur - ئۇيغۇر

Specifications

User stories

  • As a user, I want to know how long would take to read a text, without scrolling down the page to form an idea.

Acceptance Criteria

Testing details

Test Cases

Testing days

Date:02-13-2017

  • Created Test Plan
  • Created Test Cases

Date:02-15-2017

  • Testing on latest Aurora 53.0a2 on the following devices:
    • LG G4 (Android 6.0)
    • Lenovo A536 (Android 4.4.2)
    • Asus Transformers Pad TF300T (Android 4.2.1)
    • Asus ZenPad 8.0 Z380KL (Android 6.0.1)

Date:02-20-2017

  • Testing on latest Aurora 53.0a2 on the following devices:
    • Huawei MediaPad M2 (Android 5.1.1)
    • HTC Nexus 9 (Android 7.1.1)
  • Verified bugs:
    • bug 1323415 - Use plural form for reader mode article reading time strings
    • bug 1318605 - Do language detection for cases where we don't obtain a dir attribute

Date:02-21-2017

    • Added test cases in TestRail
    • Exploratory testing on Aurora 53.0a2

Date:03-13-2017

  • Testing on latest Beta 53.0b1 on the following devices:
    • Prestigio Grace X5 (Android 4.4.2)
    • Samsung Galaxy Note 4 (Android 5.0.1)
    • LG G4 (Android 6.0)
    • Asus ZenPad 8.0 Z380KL (Android 6.0.1)
    • HTC Nexus 9 (Android 7.1.1)
    • Lenovo Yoga Tablet 2 (Android 4.4.2)

Bug Work

Tracking bugs

  • bugs to track the feature

ex:

Full Query
ID Summary Priority Status
1265304 Display estimated reading time in Reader Mode P5 VERIFIED
1318605 Do language detection for cases where we don't obtain a dir attribute -- VERIFIED
1323331 Improve reader mode code dealing with detected language/direction P5 RESOLVED
1323415 Use plural form for reader mode article reading time strings -- VERIFIED
1334483 Estimated time in Reader view could be displayed better -- RESOLVED
1346813 Estimated reading time needs localization for several languages -- RESOLVED
1347460 Polish styling of estimated reading time display in Reader Mode on Fennec P5 RESOLVED

7 Total; 0 Open (0%); 4 Resolved (57.14%); 3 Verified (42.86%);


Signoff

Criteria

Results

Nightly testing

  • NA

Aurora testing

  • All tests have passed on Aurora 53.0a2. No new/known issues found while testing this feature.

Beta testing

  • All tests have passed on Beta 53.0b1. No new/known issues found while testing this feature.
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec/Estimated_Reading_Time&oldid=1167063"