QA/Fennec/Play HLS: Difference between revisions
Jump to navigation
Jump to search
Full Query
| Line 137: | Line 137: | ||
'''Beta testing''' | '''Beta testing''' | ||
Buggy but working for minimum requirements and functionality | |||
Revision as of 13:15, 3 October 2016
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that HLS video can be correctly played in any given condition.
Ownership
Developer contact: X
QA: :Ninu
Overall Status
[LANDED] Nightly 50.0a1: first landed on - 30-07-2016
- At risk
[ LANDED] Aurora 50.a2: first landed on - 02-08-2016
- At risk
[ LANDED] Beta 50: first landed on - 26-09-2016
Testing Summary
Scope of testing
The testing will be focus on
- making the HLS video watching experience good
- making sure that the implementation of HLS video controls don't impact other video playing type
Environments
Testing will be performed on following devices:
- Phones
- 4.x
- 5.x
- 6.0
- Tablet
- 4.x
- 5.x
- 6.0
Specifications
User stories
- As a user, I want to be able to play HLS videos without glitches and streaming problems, while the other app features are not impacted by a playing video.
Acceptance Criteria
Testing details
Test Cases
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played
Step
1. Go to goo.gl/LLxEY8 and play the HLS video in landscape/portrait R: The video plays correctly and the audio is correctly played 2. Change the device's orientation R: The video keeps playing and no interruptions or glitches are triggered
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played 2. Try the video-player media controls R: All buttons response is correctly applied in the video progress
Step
1. Go to goo.gl/LLxEY8 and play the HLS video R: The video plays correctly and the audio is correctly played 2. Close HLS video player and go to youtube, play a video R: Any other video player is not impacted by the HLS video player previous use
Step
Pre-Condition: Make sure Auto-Play is ON 1. Go to goo.gl/LLxEY8 and play the HLS video R: The video starts Auto-playing
Step
Pre-Condition: Make sure Auto-Play is OFF 1. Go to goo.gl/LLxEY8 and play the HLS video R: The video should not start Auto-playing
Testing days
Date:05-09-2016
- Exploratory testing with focus on the Aurora build and creating a test plan for the feature
Date:07-09-2016
- Functional testing with focus on both Aurora and Nightly builds
Logged issues:
- HLS video player overlaps other tabs once played - bug 1301043
- A misleading error is received before playing an HLS video - bug 1301053
- A HLS video cannot be played twice without reloading the whole page - bug 1301055
Date:08-09-2016
- Creating test cases and exploratory testing on both Aurora and Nightly builds
Logged issues:
- HLS videos automatically start playing when auto-play is OFF - bug 1301326
Date:03-10-2016
- Functional testing with focus on all: Beta Aurora and Nightly builds
Logged issues:
- Switching tabs will stop the HLS player - bug 1307074
- HLS Player breaks other video types in other tabs - bug 1307076
- Interrupting an HLS video with Task manager will lead to incorrect video resume - bug 1307078
Bug Work
Tracking bugs
- bugs to track the feature
ex:
13 Total; 0 Open (0%); 10 Resolved (76.92%); 3 Verified (23.08%);
Signoff
Criteria
- All test cases should be executed
- All blockers, critical issues must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
Buggy but working for minimum requirements and functionality
Aurora testing
Buggy but working for minimum requirements and functionality
Beta testing
Buggy but working for minimum requirements and functionality