QA/Fennec/First-run tips: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
 
(39 intermediate revisions by the same user not shown)
Line 5: Line 5:
** Nightly: {{mok}}
** Nightly: {{mok}}
** Aurora: {{mok}}
** Aurora: {{mok}}
** Beta:
** Beta: {{mok}}
* Owner:(Cristina Madaras, irc: CristinaM)
* Owner:(Cristina Madaras, irc: CristinaM)
===Documents===
===Documents===
<gallery  widths=700 heights=350 mode="packed-hover">
<gallery  widths=500 heights=250 mode="packed-hover">
File:OnboardingSplashScreen.png|First run experience Splash Screen
File:OnboardingSplashScreen.png|First run experience Splash Screen
</gallery>
</gallery>
Line 15: Line 15:
File:First-run tips.png|First-run tips Setup + Take a tour {{Bug|769683}}
File:First-run tips.png|First-run tips Setup + Take a tour {{Bug|769683}}
</gallery>
</gallery>
===Testing Details===
====Date: 2014-09-08====
*Exploratory testing using Asus Transformer Pad TF300T (Android 4.2.1) <br />
Firefox for Android 35.0a1 Nightly (2014-09-08) <br />
Firefox for Android 34.a02 Aurora (2014-09-08) <br />
====Date: 2014-09-18====
Bug verification [https://bugzilla.mozilla.org/show_bug.cgi?id=1059827 [7'' Tablet] First-run window navigation buttons are hidden in landscape ]
====Date: 2014-09-19====
*Exploratory testing using Kindle Fire 7" <br />
Firefox for Android 35.0a1 Nightly (2014-09-18) <br />
Firefox for Android 34.a02 Aurora (2014-09-18) <br />
====Date: 2014-09-25====
* Exploratory testing <br />
Build: Firefox for Android Nightly 35.0a1 (2014-09-25) <br />
Device: Samsung Galaxy R (Android 2.3.4) <br />
*Logged bug:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1072948 Kindle: The message from onboarding screen uses italic font style  ] <br />
====Date: 2014-10-03====
* Exploratory testing <br />
Builds: <br />
Firefox for Android Nightly 35.0a1 (2014-10-03) <br />
Firefox for Android Aurora 34.0a2 (2014-10-03) <br />
Devices: <br />
Nexus 4 (Android 4.4.4) <br />
Asus Transformer Pad TF300T (Android 4.2.1) <br />
* Bug verification on Nightly (2014-10-03):
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1074568 icons surrounding the Firefox icon look tappable ] <br />
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1074570 Dismiss start pane on touch ] <br/>
====Date: 2014-10-08====
* Exploratory testing <br />
Build: Firefox for Android Nightly 35.0a1 (2014-10-07) <br />
* Bug verification on Aurora (2014-10-08):
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1074570 Dismiss start pane on touch ] <br />
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1074568 icons surrounding the Firefox icon look tappable ] <br />
====Date: 2014-10-13====
*Bug verification:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1059792 Launching Firefox for the first time through an external intent should not display First Run experience ] <br />
* [https://oneanddone.mozilla.org/en-US/tasks/67/ First run experience - One and Done task updated ] <br />
====Date: 2014-10-29====
* Exploratory testing
** Devices:
*** Nexus 4 (Android 4.4.4)
*** Asus Transformer Pad TF300T (Android 4.2.1)
** Builds:
*** Firefox for Android 36.a01 (2014-10-29)
*** Firefox for Android 35.a02 (2014-10-29)
*Bug verification:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1072831  Use DialogFragment for Onboarding v1 start pane]
====Date: 2014-11-17====
* Exploratory testing
** Builds:
*** Firefox for Android 36.a01 (2014-11-17)
*** Firefox for Android 35.a02 (2014-11-17)
** Devices:
*** Nexus 7 (Android 4.4.4)
====Date: 2014-12-05====
* Exploratory testing
** Builds:
*** Firefox for Android 37.a01 (2014-12-05)
*** Firefox for Android 36.a02 (2014-12-05)
** Devices:
*** Nexus 7 (Android 4.4.4)
*** Asus Transformer Pad TF300T (Android 4.2.1)
====Date: 2014-12-10====
* Exploratory testing
** Builds:
*** Firefox for Android 37.a01 (2014-12-10)
** Device:
*** Samsung Galaxy R (Android 2.3.4)
*** Asus Transformer Pad TF300T (Android 4.2.1)
====Date: 2015-01-08====
* Exploratory testing
Start browsing from onboarding screen <br>
Sign in from onboarding screen <br>
Dismiss the onboarding screen on touch (touch on onboardiong screen/ touch outside the onboarding screen) <br>
Open Firefox through an external link <br>
** Builds:
*** Firefox for Android 37.a01 (2015-01-07)
*** Firefox for Android 36.a02 (2015-01-07)
** Device:
*** Samsung Galaxy S4 (Android 4.4.2)


===Bugzilla ===
===Bugzilla ===
*Tracking First-run tips Bugs:
==== [https://bugzilla.mozilla.org/show_bug.cgi?id=1063844 Onboarding META bug list] ====
<bugzilla>
{
    "blocks": "1073128",
    "include_fields": "id, priority, summary, status, assigned_to",
    "order": "Status"
}
</bugzilla>
 
==== [https://bugzilla.mozilla.org/show_bug.cgi?id=1042809 (firstrun) Lightweight first-run experience META bug list] ====
<bugzilla>
{
    "blocks": "1042809",
    "include_fields": "id, priority, summary, status, assigned_to",
    "order": "Status"
}
</bugzilla>
 
==== Tracking First-Run Bugs: ====
<onlyinclude>
<onlyinclude>
<bugzilla>
<bugzilla>
{
{
     "id": "769683,1042809,1059441,1059792,1060267,1059440",
     "id": "769683, 1042809, 1059441, 1059792, 1060267, 1059440, 1059827, 1065593, 1066300, 1058337, 1072831",
     "include_fields": "id, priority, summary, status, assigned_to",
     "include_fields": "id, priority, summary, status, assigned_to",
     "order": "Status"
     "order": "Status"
Line 30: Line 145:
===Moztrap===
===Moztrap===
* testcases related (easier to track so when feature changes - update testcases)
* testcases related (easier to track so when feature changes - update testcases)
** Test suite: [[https://moztrap.mozilla.org/manage/cases/?filter-suite=765|First run experience]]
** Test suite: [https://moztrap.mozilla.org/manage/cases/?filter-suite=765 First run experience ]

Latest revision as of 08:48, 8 January 2015

Feature Reference

  • The feature was moved from Firefox 33 (Aurora)
  • Meta Bug: bug 769683
  • Overal Status:
    • Nightly: [ON TRACK]
    • Aurora: [ON TRACK]
    • Beta: [ON TRACK]
  • Owner:(Cristina Madaras, irc: CristinaM)

Documents

Testing Details

Date: 2014-09-08

  • Exploratory testing using Asus Transformer Pad TF300T (Android 4.2.1)

Firefox for Android 35.0a1 Nightly (2014-09-08)
Firefox for Android 34.a02 Aurora (2014-09-08)

Date: 2014-09-18

Bug verification [7 Tablet First-run window navigation buttons are hidden in landscape ]

Date: 2014-09-19

  • Exploratory testing using Kindle Fire 7"

Firefox for Android 35.0a1 Nightly (2014-09-18)
Firefox for Android 34.a02 Aurora (2014-09-18)

Date: 2014-09-25

  • Exploratory testing

Build: Firefox for Android Nightly 35.0a1 (2014-09-25)
Device: Samsung Galaxy R (Android 2.3.4)

Date: 2014-10-03

  • Exploratory testing

Builds:
Firefox for Android Nightly 35.0a1 (2014-10-03)
Firefox for Android Aurora 34.0a2 (2014-10-03)

Devices:
Nexus 4 (Android 4.4.4)
Asus Transformer Pad TF300T (Android 4.2.1)

Date: 2014-10-08

  • Exploratory testing

Build: Firefox for Android Nightly 35.0a1 (2014-10-07)

Date: 2014-10-13

Date: 2014-10-29

  • Exploratory testing
    • Devices:
      • Nexus 4 (Android 4.4.4)
      • Asus Transformer Pad TF300T (Android 4.2.1)
    • Builds:
      • Firefox for Android 36.a01 (2014-10-29)
      • Firefox for Android 35.a02 (2014-10-29)

Date: 2014-11-17

  • Exploratory testing
    • Builds:
      • Firefox for Android 36.a01 (2014-11-17)
      • Firefox for Android 35.a02 (2014-11-17)
    • Devices:
      • Nexus 7 (Android 4.4.4)

Date: 2014-12-05

  • Exploratory testing
    • Builds:
      • Firefox for Android 37.a01 (2014-12-05)
      • Firefox for Android 36.a02 (2014-12-05)
    • Devices:
      • Nexus 7 (Android 4.4.4)
      • Asus Transformer Pad TF300T (Android 4.2.1)

Date: 2014-12-10

  • Exploratory testing
    • Builds:
      • Firefox for Android 37.a01 (2014-12-10)
    • Device:
      • Samsung Galaxy R (Android 2.3.4)
      • Asus Transformer Pad TF300T (Android 4.2.1)

Date: 2015-01-08

  • Exploratory testing

Start browsing from onboarding screen
Sign in from onboarding screen
Dismiss the onboarding screen on touch (touch on onboardiong screen/ touch outside the onboarding screen)
Open Firefox through an external link

    • Builds:
      • Firefox for Android 37.a01 (2015-01-07)
      • Firefox for Android 36.a02 (2015-01-07)
    • Device:
      • Samsung Galaxy S4 (Android 4.4.2)

Bugzilla

Onboarding META bug list

Full Query
ID Priority Summary Status Assigned to
769314 P3 Reader Mode: Provide first-launch help RESOLVED
963661 -- Importing Bookmarks & History from Chrome does nothing RESOLVED
1042809 -- Lightweight first-run experience VERIFIED Chenxia Liu [:liuche]
1063844 -- [onboarding] Start Pane v1.5 RESOLVED Chenxia Liu [:liuche]
1064538 -- Get Started for Android - content development RESOLVED Troy Palmer
1075643 -- Offer to import Android bookmarks and history during first run experience RESOLVED
1128431 -- 'Start browsing' link from onboarding v1.5 is not visible on small screen devices VERIFIED Allison Naaktgeboren :ally
1131806 -- Update Welcome Screen copy RESOLVED Chenxia Liu [:liuche]
1135770 -- "Welcome to Fennec" screen is too long for HTC EVO RESOLVED Allison Naaktgeboren :ally
1145858 -- Rename FirstrunPane to be less confusing RESOLVED Andrzej Hunt :ahunt
1148460 -- Create First Run builds for UserTesting baseline research RESOLVED Chenxia Liu [:liuche]
1171784 -- Merge Firstrun overlay with Doorhanger overlay RESOLVED
1172623 -- Prototype "Customize" Firstrun builds RESOLVED Chenxia Liu [:liuche]
1186032 -- Add telemetry probes to first app run RESOLVED
1186037 -- Import bookmarks and history from stock browser (Samsung S4, Android 4.4.2) doesn't work RESOLVED Chenxia Liu [:liuche]
1186056 -- Polish UX and copy for first app run and importing bookmarks RESOLVED
1190989 -- Add "Import" slide to first run RESOLVED
1196898 -- [meta] onboarding A/B testing RESOLVED
1199448 -- Use scrollable tabs in first run pager RESOLVED
1199859 -- Add two A/B testing options for Firstrun RESOLVED Chenxia Liu [:liuche]
1200277 -- Final copy for First Run a/b testing RESOLVED Matej Novak [:matej]
1208138 -- Firstrun is not dismissed in some cases RESOLVED Chenxia Liu [:liuche]
1209539 -- Disable "Transfer" in import dialog if no items are checked RESOLVED Chenxia Liu [:liuche]
1215728 -- [meta] Sensible defaults for onboarding RESOLVED
1217164 -- Back button during sync setup/ should return to previous Activity RESOLVED
1220244 -- [meta] Expanded first-run experience RESOLVED
1221163 -- Consider contextual hint for search engine settings button in search engine bar RESOLVED
1221217 -- Add callback after user completes Firefox Account sign-in flow RESOLVED
1232971 -- Import from onboarding screen does not work on Android M RESOLVED
1236626 -- Add "Show Tour" button in Settings> Mozilla Firefox RESOLVED
1241591 -- Switch onboarding to A version only RESOLVED Chenxia Liu [:liuche]
1245934 -- Add option to "Turn on search suggestions" in firstrun RESOLVED
1247146 -- Make firstrun panel telemetry extras more specific RESOLVED Chenxia Liu [:liuche]
1249331 -- Update copy for datasaving firstrun panel RESOLVED Chenxia Liu [:liuche]
1254555 -- Unnecessary scroll to reveal full first run panel and options RESOLVED Shubham
1256400 -- Update firstrun search image VERIFIED Chenxia Liu [:liuche]
1256583 -- Welcome screen is not displayed on first run RESOLVED Chenxia Liu [:liuche]
1258586 -- Switchboard experiment: display tab queue notification sooner RESOLVED
1259833 -- Add an onboarding slide about Tab Queues RESOLVED
1259835 -- Add an onboarding slide about reader mode RESOLVED
1268641 -- Feature-based onboarding RESOLVED

41 Total; 0 Open (0%); 38 Resolved (92.68%); 3 Verified (7.32%);


(firstrun) Lightweight first-run experience META bug list

Full Query
ID Priority Summary Status Assigned to
1059792 -- Launching Firefox for the first time through an external intent should not display First Run experience VERIFIED Chenxia Liu [:liuche]
1065593 -- StrictMode violation - eglCreateWindowSurface returned no surface @ at org.mozilla.gecko.StartPane.onCreate(StartPane.java:17) RESOLVED
1066222 -- It should be possible to get back to the first run screen RESOLVED
1066300 -- First Run dialog cut off on ADT-1 (Android TV) RESOLVED
1072948 -- Kindle: The message from onboarding screen uses italic font style RESOLVED
1074568 -- [first run] icons surrounding the Firefox icon look tappable VERIFIED
1074570 -- Dismiss start pane on touch VERIFIED Chenxia Liu [:liuche]
1075032 -- Dismiss start pane on touch RESOLVED
1077858 -- crash in java.lang.NullPointerException: at org.mozilla.gecko.db.BrowserDB.getCount(BrowserDB.java) RESOLVED Richard Newman [:rnewman]
1081768 -- Crash with java.lang.NullPointerException @ org.mozilla.gecko.gfx.LayerView.registerCxxCompositor(LayerView.java:525) when BrowserApp is immediately displaced as foreground activity RESOLVED
1093619 -- Don't display onboarding screen for Webapp profiles VERIFIED Chenxia Liu [:liuche]
1099436 -- Add telemetry for dismissing Onboarding start pane VERIFIED Chenxia Liu [:liuche]

12 Total; 0 Open (0%); 7 Resolved (58.33%); 5 Verified (41.67%);


Tracking First-Run Bugs:

Full Query
ID Priority Summary Status Assigned to
769683 -- [meta] First run feature introduction/tour RESOLVED
1042809 -- Lightweight first-run experience VERIFIED Chenxia Liu [:liuche]
1058337 -- Animate icons on onboarding screen RESOLVED
1059440 -- Don't set noHistory for onboarding activity VERIFIED Chenxia Liu [:liuche]
1059441 -- First run layout view is poor in landscape; cropped welcome message - layout should adopt to landscape view RESOLVED Chenxia Liu [:liuche]
1059792 -- Launching Firefox for the first time through an external intent should not display First Run experience VERIFIED Chenxia Liu [:liuche]
1059827 -- [7'' Tablet] First-run window navigation buttons are hidden in landscape VERIFIED Chenxia Liu [:liuche]
1060267 P5 crash in nsAppShell::ProcessNextNativeEvent(bool) RESOLVED
1065593 -- StrictMode violation - eglCreateWindowSurface returned no surface @ at org.mozilla.gecko.StartPane.onCreate(StartPane.java:17) RESOLVED
1066300 -- First Run dialog cut off on ADT-1 (Android TV) RESOLVED
1072831 -- Use DialogFragment for Onboarding v1 start pane VERIFIED Chenxia Liu [:liuche]

11 Total; 0 Open (0%); 6 Resolved (54.55%); 5 Verified (45.45%);


Moztrap

  • testcases related (easier to track so when feature changes - update testcases)