QA/Fennec/First time reader view prompt evaluation: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
(adding results)
Line 1: Line 1:
= Overview =
= Overview =
== Purpose ==
== Purpose ==
The purpose of this wiki is to serve as a general test plan for verifying that always a prompt is shown the first/third time a user enters reader view, regardless of whether another prompt is shown.
The purpose of this wiki is to serve as a general test plan for verifying that always a prompt is shown the first time a user enters reader view, regardless of whether another prompt is shown.


== Ownership ==
== Ownership ==
Line 10: Line 10:
== Overall Status ==
== Overall Status ==


<small>'''<font color="red">[AT RISK]</font>'''</small> Nightly  
<small>'''<font color="green">[ON TRACK]</font>'''</small> Nightly 52:


<small>'''<font color="red">[AT RISK]</font>'''</small> Aurora
<small>'''<font color="red">[AT RISK]</font>'''</small> Aurora 51: 2016-09-13


<small>'''<font color="red">[AT RISK]</font>'''</small> Beta
<small>'''<font color="greene">[ON TRACK]</font>'''</small> Beta 50


= Testing Summary =  
= Testing Summary =  
Line 43: Line 43:


= Testing details =
= Testing details =
==Date:05-09-2016==
- [https://bugzilla.mozilla.org/show_bug.cgi?id=1300532 Bug 1300532] Contextual hint about offline bookmarks is displayed in normal view instead of reader view
- [https://bugzilla.mozilla.org/show_bug.cgi?id=1300532 Bug 1300532] Contextual hint about offline bookmarks is displayed in normal view instead of reader view
*[[File:reader view.png|600px|thumb|center| Prompt]]
*[[File:reader view.png|600px|thumb|center| Prompt]]
==Date:19-09-2016==
*Device: One A2001(Android 6.0)
*Build: Firefox for Android 52.0a1 (2016-09-19)
*Load an article from news.google.com and tap the reader view icon from the URL Bar
**the page enters reader view and a prompt is displayed: "Available offline. Bookmark Reader View items to read them offline. Add to Bookmarks"
*Tap the "Add to Bookmarks" button.
**the second prompt is displayed: "Read offline. Find your Reader View items in Bookmarks, even offline. Go to Bookmarks".
==Date:21-09-2016==
*Device: One A2001 (Android 6.0)
*Build: Firefox for Android 50 Beta 1
*After tapping the reader view icon from the URL Bar, the page enters reader view and a prompt is displayed: "Available offline. Bookmark Reader View items to read them offline. Add to Bookmarks"
Tapping the "Add to Bookmarks" button, the second prompt is displayed: "Read offline. Find your Reader View items in Bookmarks, even offline. Go to Bookmarks".
==Date:22-09-2016==
*Device: One A2001 (Android 6.0)
*Build: Firefox for Android 51.0a2 (2016-09-21)
*After tapping the reader view icon from the URL Bar, the page enters reader view, but no prompt is displayed. If I open the menu and tap the bookmark icon, then "Read offline. Find your Reader View items in Bookmarks, even offline. Go to Bookmarks" prompt is displayed. But the prompt "Available offline. Bookmark Reader View items to read them offline. Add to Bookmarks" is never displayed.


=Bug Work=
=Bug Work=
Line 54: Line 70:
<bugzilla>
<bugzilla>
{
{
  "id": "1275784, migrate-RL, 1234314"
  "id": "1275784, migrate-RL, 1234314, 1300532"
}
}
</bugzilla>
</bugzilla>
Line 60: Line 76:


==Still issues==
==Still issues==
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id= Bug ] - Contextual hint about offline bookmarks is not displayed in Aurora  <br/>


<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1300532 Bug 1300532] - Contextual hint about offline bookmarks is displayed in normal view instead of reader view <br/>
===Bug fixed ===
===Bug fixed ===
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1270880 Bug 1270880] - Update "how to bookmark" helper UI to "first time" instead of "third time"  <br/>
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1270880 Bug 1270880] - Update "how to bookmark" helper UI to "first time" instead of "third time"  <br/>
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1275784 Bug 1275784] - Enable reader view bookmark hint up to beta  <br/>
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1275784 Bug 1275784] - Enable reader view bookmark hint up to beta  <br/>
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1300532 Bug 1300532] - Contextual hint about offline bookmarks is displayed in normal view instead of reader view <br/>


=Signoff=
=Signoff=
Line 72: Line 89:
* All test cases should be executed
* All test cases should be executed
* All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
* All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed


== Results ==
== Results ==
'''Nightly testing'''
'''Nightly testing'''
-Contextual hint about offline bookmarks is displayed in normal view instead of reader view
-Contextual hint about offline bookmarks is not displayed.


'''Aurora testing'''
'''Aurora testing'''
-Contextual hint about offline bookmarks is displayed in normal view instead of reader view
-Contextual hint about offline bookmarks is not displayed.


'''Beta testing'''
'''Beta testing'''
-Contextual hint about offline bookmarks is displayed in normal view instead of reader view
-Contextual hint about offline bookmarks is not displayed.

Revision as of 12:02, 29 September 2016

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that always a prompt is shown the first time a user enters reader view, regardless of whether another prompt is shown.

Ownership

Developer contact: Anthony Lam (:antlam), Sebastian Kaspari (:sebastian)

QA: Teodora Vermesan (:TeoVermesan)

Overall Status

[ON TRACK] Nightly 52:

[AT RISK] Aurora 51: 2016-09-13

[ON TRACK] Beta 50

Testing Summary

Scope of testing

The testing will be focus on

  • verifying that always a prompt is shown the first time a user enters reader view, regardless of whether another prompt is shown.

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.0
  • Tablet
    • 4.x
    • 5.x
    • 6.0

Specifications

  • "how to bookmark" helper UI is displayed

User stories

  • As a user, I want to be informed how to add items to reading list, after entering reader view since the "Add to RL" icon is now missing.

Acceptance Criteria

  • A prompt is shown, after user hits reader view

Testing details

Date:05-09-2016

- Bug 1300532 Contextual hint about offline bookmarks is displayed in normal view instead of reader view

  • Prompt

Date:19-09-2016

  • Device: One A2001(Android 6.0)
  • Build: Firefox for Android 52.0a1 (2016-09-19)
  • Load an article from news.google.com and tap the reader view icon from the URL Bar
    • the page enters reader view and a prompt is displayed: "Available offline. Bookmark Reader View items to read them offline. Add to Bookmarks"
  • Tap the "Add to Bookmarks" button.
    • the second prompt is displayed: "Read offline. Find your Reader View items in Bookmarks, even offline. Go to Bookmarks".

Date:21-09-2016

  • Device: One A2001 (Android 6.0)
  • Build: Firefox for Android 50 Beta 1
  • After tapping the reader view icon from the URL Bar, the page enters reader view and a prompt is displayed: "Available offline. Bookmark Reader View items to read them offline. Add to Bookmarks"

Tapping the "Add to Bookmarks" button, the second prompt is displayed: "Read offline. Find your Reader View items in Bookmarks, even offline. Go to Bookmarks".

Date:22-09-2016

  • Device: One A2001 (Android 6.0)
  • Build: Firefox for Android 51.0a2 (2016-09-21)
  • After tapping the reader view icon from the URL Bar, the page enters reader view, but no prompt is displayed. If I open the menu and tap the bookmark icon, then "Read offline. Find your Reader View items in Bookmarks, even offline. Go to Bookmarks" prompt is displayed. But the prompt "Available offline. Bookmark Reader View items to read them offline. Add to Bookmarks" is never displayed.

Bug Work

Tracking bugs

  • bugs to track the feature

ex:

Full Query
ID Summary Priority Status
1234314 [meta] Migrate reading list to bookmarks P5 RESOLVED
1275784 Enable reader view bookmark hint up to beta -- RESOLVED
1300532 Contextual hint about offline bookmarks is displayed in normal view instead of reader view P1 RESOLVED

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);


Still issues

[NEW] Bug  - Contextual hint about offline bookmarks is not displayed in Aurora

Bug fixed

[RESOLVED FIXED] Bug 1270880 - Update "how to bookmark" helper UI to "first time" instead of "third time"
[RESOLVED FIXED] Bug 1275784 - Enable reader view bookmark hint up to beta
[RESOLVED FIXED] Bug 1300532 - Contextual hint about offline bookmarks is displayed in normal view instead of reader view


Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing -Contextual hint about offline bookmarks is not displayed.

Aurora testing -Contextual hint about offline bookmarks is not displayed.

Beta testing -Contextual hint about offline bookmarks is not displayed.

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec/First_time_reader_view_prompt_evaluation&oldid=1149640"