QA/Fennec/Play HLS: Difference between revisions
Jump to navigation
Jump to search
Full Query
| Line 117: | Line 117: | ||
=Bug Work= | =Bug Work= | ||
= | =Bug Work= | ||
* | * Meta bug | ||
**{{Bug|1345752}} - (HLS_on_Fennec) [META][HLS] Make Gecko native support HLS on Fennec | |||
<onlyinclude> | <onlyinclude> | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
"blocks": "1329127", | |||
"include_fields": "id, priority, summary, status, assigned_to", | |||
"order": "Status" | |||
} | } | ||
</bugzilla> | </bugzilla> | ||
</onlyinclude> | </onlyinclude> | ||
===Bug fixed === | |||
=Signoff= | =Signoff= | ||
Revision as of 17:57, 29 June 2017
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that HLS video can be correctly played in any given condition.
Ownership
Developer contact: X
QA: :Ninu
- From 2017-06 QA: Sorina
Overall Status
[LANDED] Nightly 50.0a1: first landed on - 30-07-2016
- At risk
[ LANDED] Aurora 50.a2: first landed on - 02-08-2016
- At risk
[ LANDED] Beta 50: first landed on - 26-09-2016
Testing Summary
Scope of testing
The testing will be focus on
- making the HLS video watching experience good
- making sure that the implementation of HLS video controls don't impact other video playing type
Environments
Testing will be performed on following devices:
- Phones
- 4.x
- 5.x
- 6.0
- Tablet
- 4.x
- 5.x
- 6.0
Specifications
User stories
- As a user, I want to be able to play HLS videos without glitches and streaming problems, while the other app features are not impacted by a playing video.
Acceptance Criteria
Testing details
Test Cases
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played
Step
1. Go to goo.gl/LLxEY8 and play the HLS video in landscape/portrait R: The video plays correctly and the audio is correctly played 2. Change the device's orientation R: The video keeps playing and no interruptions or glitches are triggered
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played 2. Try the video-player media controls R: All buttons response is correctly applied in the video progress
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played 2. Close HLS video player and go to youtube, play a video R: Any other video player is not impacted by the HLS video player previous use
Step
Pre-Condition: Make sure Auto-Play is ON 1. Go to goo.gl/LLxEY8 and play the HLS video R: The video starts Auto-playing
Step
Pre-Condition: Make sure Auto-Play is OFF 1. Go to goo.gl/LLxEY8 and play the HLS video R: The video should not start Auto-playing
Testing days
Date:05-09-2016
- Exploratory testing with focus on the Aurora build and creating a test plan for the feature
Date:07-09-2016
- Functional testing with focus on both Aurora and Nightly builds
Logged issues:
- HLS video player overlaps other tabs once played - bug 1301043
- A misleading error is received before playing an HLS video - bug 1301053
- A HLS video cannot be played twice without reloading the whole page - bug 1301055
Date:08-09-2016
- Creating test cases and exploratory testing on both Aurora and Nightly builds
Logged issues:
- HLS videos automatically start playing when auto-play is OFF - bug 1301326
Date:03-10-2016
- Functional testing with focus on all: Beta Aurora and Nightly builds
Logged issues:
- Switching tabs will stop the HLS player - bug 1307074
- HLS Player breaks other video types in other tabs - bug 1307076
- Interrupting an HLS video with Task manager will lead to incorrect video resume - bug 1307078
Date:22-06-2017
- Exploratory testing with focus on links from duplicated bugs and GitHub issues with devices Asus ZenPad 8 (Android 6.0.1) and LG G4 (Android 5.1), build Nightly 56.0a1 from 2017/06/21
- New bugs found during testing
- bug 1375478 - HLS: "Full-screen" button not displayed in the right position
- bug 1375474 - Video doesn't play on observator.tv
Bug Work
Bug Work
- Meta bug
- bug 1345752 - (HLS_on_Fennec) [META][HLS] Make Gecko native support HLS on Fennec
35 Total; 0 Open (0%); 26 Resolved (74.29%); 9 Verified (25.71%);
Bug fixed
Signoff
Criteria
- All test cases should be executed
- All blockers, critical issues must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
Buggy but working for minimum requirements and functionality
Aurora testing
Buggy but working for minimum requirements and functionality
Beta testing
Buggy but working for minimum requirements and functionality