QA/Fennec/Play HLS: Difference between revisions

 
(39 intermediate revisions by 3 users not shown)
Line 6: Line 6:
Developer contact: [mailto:x@y.com X]  
Developer contact: [mailto:x@y.com X]  


QA: [mailto:mihai.ninu@softvision.com :Ninu]
QA: [mailto:mihai.ninu@softvision.ro :Ninu]
*From 2017-06 QA: [mailto:sorina.florean@softvision.ro Sorina]
*From 2017-11 QA: [mailto:oana.horvath@softvision.ro Oana]


== Overall Status ==
== Overall Status ==


<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 50.0a1: first landed on - '''30-07-2016 '''
<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 56.0a1


<small>'''<font color="green">[ LANDED]</font>'''</small> Aurora 50.a2: first landed on - '''02-08-2016 '''
<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 59.0a1


<small>'''<font color="red">[NOT LANDED]</font>'''</small> Beta 50: NA
<small>'''<font color="green">[LANDED]</font>'''</small> Beta 59: 1/23/2018


= Testing Summary =  
= Testing Summary =  
Line 26: Line 28:
Testing will be performed on following devices:  
Testing will be performed on following devices:  
* Phones
* Phones
** 4.x
** From Android 4.4 to 7.1
** 5.x
** 6.0
* Tablet
* Tablet
** 4.x
** From Android 4.4 to 7.1
** 5.x
** 6.0


== Specifications ==
== Specifications ==
*information about the feature
**how to use it
*[[File:HLS Player Portrait.png|600px|thumb|center| HLS Player Landscape]]
**turn on/off feature
*[[File:HLS Player Landscape.png|600px|thumb|center| HLS Player Portrait]]
*screenshots


== User stories ==
== User stories ==
*As a user, I want to
* As a user, I want to be able to play HLS videos without glitches and streaming problems, while the other app features are not impacted by a playing video.
*As a user, I want to
*As a user, I want to


== Acceptance Criteria==
== Acceptance Criteria==
Line 50: Line 45:
= Testing details =
= Testing details =
== Test Cases==
== Test Cases==
 
* https://docs.google.com/spreadsheets/d/1tZaPIq9kZ9PPEFO_8O3EcHGsxl0b3H3hYUqpgXJJVQY/edit#gid=0


Step  
Step  
Line 85: Line 80:


== Testing days==
== Testing days==
===Date:07-09-2016===


===Date:xx-yy-zz===
===Date:05-09-2016===
===Date:xx-yy-zz===
* Exploratory testing with focus on the Aurora build and creating a test plan for the feature


===Date:07-09-2016===
* Functional testing with focus on both Aurora and Nightly builds
Logged issues:
*  HLS video player overlaps other tabs once played - {{bug|1301043}}
*  A misleading error is received before playing an HLS video - {{bug|1301053}}
*  A HLS video cannot be played twice without reloading the whole page - {{bug|1301055}}


===Date:08-09-2016===
*  Creating test cases and exploratory testing on both Aurora and Nightly builds
Logged issues:
*  HLS videos automatically start playing when auto-play is OFF - {{bug|1301326}}
===Date:03-10-2016===
* Functional testing with focus on all: Beta Aurora and Nightly builds
Logged issues:
* Switching tabs will stop the HLS player - {{bug|1307074}}
* HLS Player breaks other video types in other tabs - {{bug|1307076}}
* Interrupting an HLS video with Task manager will lead to incorrect video resume - {{bug|1307078}}
===Date:22-06-2017===
* Exploratory testing with focus on links from duplicated bugs and GitHub issues with devices Asus ZenPad 8 (Android 6.0.1) and LG G4 (Android 5.1), build Nightly 56.0a1 from 2017/06/21
* New bugs found during testing
**{{Bug|1375478}} - HLS: "Full-screen" button not displayed in the right position
**{{Bug|1375474}} - Video doesn't play on observator.tv
===Date:03-07-2017===
* TCs and exploratory testing with devices Asus ZenPad 8 (Android 6.0.1) on build Nightly 56.0a1 from 2017/07/03
** Prerequisite: "media.mediasource.enabled" set to false
* New bugs found during testing
**{{Bug|1377873}} - [Fennec][HLS] Issues when changing device orientation
**{{Bug|1377891}} - [Fennec][HLS] Issues with videos from twitch.tv
===Date:06-07-2017===
* TCs and exploratory testing for Mid-Nightly Signoff on latest Nightly build
** Prerequisite: "media.mediasource.enabled" set to false
===Date:31-07-2017===
* Pre-Beta SignOff: GREEN
** https://testrail.stage.mozaws.net/index.php?/reports/view/485
===Date:22-11-2017===
* Exploratory testing and bug investigation on latest Nightly build (59.0a1-21/11/2017)
**{{Bug|1307074}} - Switching tabs will stop the HLS player
**{{Bug|1307078}} - Interrupting an HLS video with Task manager will lead to incorrect video resume
**{{Bug|1308205}} - While in landscape, HLS videos are played in FullScreen
**{{Bug|1302729}} - Media control notification is not displayed when HLS video is playing
**{{Bug|1307076}} - HLS Player breaks other video types in other tabs
**{{Bug|1310899}} - HLS VideoView prevents interacting with page, requires back button to close
**{{Bug|1377891}} - [Fennec][HLS] Issues with videos from twitch.tv.
===Date:23-11-2017===
*Feature testing on Nightly 59:
**Huawei P9 Lite (Android 6.0): https://testrail.stage.mozaws.net/index.php?/runs/view/7316
**Lenovo Yoga Tablet 2 (Android 4.4.2): https://testrail.stage.mozaws.net/index.php?/runs/view/7317
*Logged bug:
**{{Bug|1420192}} - Youtube and twitch.com live videos don't work when auto-play is off
===Date:27-11-2017===
*Feature testing on Nightly 59:
**Google Pixel (Android 8.0): https://testrail.stage.mozaws.net/index.php?/runs/view/7336
**Huawei MediaPad M2 (Android 5.1.1): https://testrail.stage.mozaws.net/index.php?/runs/view/7339
===Date:5-12-2017===
*Feature testing on Nightly 59:
**Samsung Galaxy Note 4 (Android 5.0.1): https://testrail.stage.mozaws.net/index.php?/runs/view/7473
**Mid-Nigthly signoff: Green
===Date:20-12-2017===
*Pre-Beta signoff: Green
===Date:25-01-2018===
Feature full testing on Beta 59:
*Prestigio Grace X5 (Android 4.4.2)
*Huawei Nexus 6P (Android 8.0)
*HTC Desire 820 (Android 6.0.1)
===Date: 30-01-2018===
Feature full testing on Beta 59:
*LG G4 (Android 5.1)
*Samsung Galaxy S8 (Android 7.0)
=Bug Work=
=Bug Work=
=Bug Work=
==Tracking bugs==
* Meta bug
* bugs to track the feature
**{{Bug|1345752}} - (HLS_on_Fennec) [META][HLS] Make Gecko native support HLS on Fennec 
ex:
<onlyinclude>
<onlyinclude>
<bugzilla>
<bugzilla>
{
{
"id": "1286133, 1286898, 1295398, 1294823, 1243304, 1274864, 1301043, 1301053, 1301055, 1301050 "
    "blocks": "1345752",
    "include_fields": "id, priority, summary, status, assigned_to",
    "order": "Status"
}
}
</bugzilla>
</bugzilla>
</onlyinclude>
</onlyinclude>
===Bug fixed ===


=Signoff=
=Signoff=
Line 111: Line 187:
== Results ==
== Results ==
'''Nightly testing'''
'''Nightly testing'''
 
*Done
 
'''Aurora testing'''
 
 
'''Beta testing'''
'''Beta testing'''
NA
*n/a
1,411

edits