QA/Fennec/Play HLS: Difference between revisions
Jump to navigation
Jump to search
Full Query
| Line 50: | Line 50: | ||
= Testing details = | = Testing details = | ||
== Test Cases== | == Test Cases== | ||
* https://docs.google.com/spreadsheets/d/1tZaPIq9kZ9PPEFO_8O3EcHGsxl0b3H3hYUqpgXJJVQY/edit#gid=0 | |||
Step | Step | ||
Revision as of 14:31, 3 July 2017
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that HLS video can be correctly played in any given condition.
Ownership
Developer contact: X
QA: :Ninu
- From 2017-06 QA: Sorina
Overall Status
[LANDED] Nightly 50.0a1: first landed on - 30-07-2016
- At risk
[ LANDED] Aurora 50.a2: first landed on - 02-08-2016
- At risk
[ LANDED] Beta 50: first landed on - 26-09-2016
Testing Summary
Scope of testing
The testing will be focus on
- making the HLS video watching experience good
- making sure that the implementation of HLS video controls don't impact other video playing type
Environments
Testing will be performed on following devices:
- Phones
- 4.x
- 5.x
- 6.0
- Tablet
- 4.x
- 5.x
- 6.0
Specifications
User stories
- As a user, I want to be able to play HLS videos without glitches and streaming problems, while the other app features are not impacted by a playing video.
Acceptance Criteria
Testing details
Test Cases
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played
Step
1. Go to goo.gl/LLxEY8 and play the HLS video in landscape/portrait R: The video plays correctly and the audio is correctly played 2. Change the device's orientation R: The video keeps playing and no interruptions or glitches are triggered
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played 2. Try the video-player media controls R: All buttons response is correctly applied in the video progress
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played 2. Close HLS video player and go to youtube, play a video R: Any other video player is not impacted by the HLS video player previous use
Step
Pre-Condition: Make sure Auto-Play is ON 1. Go to goo.gl/LLxEY8 and play the HLS video R: The video starts Auto-playing
Step
Pre-Condition: Make sure Auto-Play is OFF 1. Go to goo.gl/LLxEY8 and play the HLS video R: The video should not start Auto-playing
Testing days
Date:05-09-2016
- Exploratory testing with focus on the Aurora build and creating a test plan for the feature
Date:07-09-2016
- Functional testing with focus on both Aurora and Nightly builds
Logged issues:
- HLS video player overlaps other tabs once played - bug 1301043
- A misleading error is received before playing an HLS video - bug 1301053
- A HLS video cannot be played twice without reloading the whole page - bug 1301055
Date:08-09-2016
- Creating test cases and exploratory testing on both Aurora and Nightly builds
Logged issues:
- HLS videos automatically start playing when auto-play is OFF - bug 1301326
Date:03-10-2016
- Functional testing with focus on all: Beta Aurora and Nightly builds
Logged issues:
- Switching tabs will stop the HLS player - bug 1307074
- HLS Player breaks other video types in other tabs - bug 1307076
- Interrupting an HLS video with Task manager will lead to incorrect video resume - bug 1307078
Date:22-06-2017
- Exploratory testing with focus on links from duplicated bugs and GitHub issues with devices Asus ZenPad 8 (Android 6.0.1) and LG G4 (Android 5.1), build Nightly 56.0a1 from 2017/06/21
- New bugs found during testing
- bug 1375478 - HLS: "Full-screen" button not displayed in the right position
- bug 1375474 - Video doesn't play on observator.tv
Date:03-07-2017
- TCs and exploratory testing with devices Asus ZenPad 8 (Android 6.0.1) on build Nightly 56.0a1 from 2017/07/03
- Prerequisite: "media.mediasource.enabled" set to false
- New bugs found during testing
- bug 1377873 - [Fennec][HLS] Issues when changing device orientation
Bug Work
Bug Work
- Meta bug
- bug 1345752 - (HLS_on_Fennec) [META][HLS] Make Gecko native support HLS on Fennec
48 Total; 0 Open (0%); 46 Resolved (95.83%); 2 Verified (4.17%);
Bug fixed
Signoff
Criteria
- All test cases should be executed
- All blockers, critical issues must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- in progress
Beta testing
- n/a