QA/Fennec/Play HLS

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that HLS video can be correctly played in any given condition.

Ownership

Developer contact: X

QA: :Ninu

Overall Status

[LANDED] Nightly 50.0a1: first landed on - 30-07-2016

[ LANDED] Aurora 50.a2: first landed on - 02-08-2016

[NOT LANDED] Beta 50: NA

Testing Summary

Scope of testing

The testing will be focus on

• making the HLS video watching experience good
• making sure that the implementation of HLS video controls don't impact other video playing type

Environments

Testing will be performed on following devices:

• Phones
  • 4.x
  • 5.x
  • 6.0
• Tablet
  • 4.x
  • 5.x
  • 6.0

Specifications

• information about the feature
  • how to use it
  • turn on/off feature
• screenshots

User stories

• As a user, I want to
• As a user, I want to
• As a user, I want to

Testing details

Test Cases

Step

1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video plays correctly and the audio is correctly played

Step

1. Go to goo.gl/LLxEY8 and play the HLS video in landscape/portrait
R: The video plays correctly and the audio is correctly played
2. Change the device's orientation 
R: The video keeps playing and no interruptions or glitches are triggered

Step

1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video plays correctly and the audio is correctly played
2. Try the video-player media controls
R: All buttons response is correctly applied in the video progress  

Step

1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video plays correctly and the audio is correctly played
2. Close HLS video player and go to youtube, play a video
R: Any other video player is not impacted by the HLS video player previous use

Step

Pre-Condition:  Make sure Auto-Play is ON
1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video starts Auto-playing

Step

Pre-Condition:  Make sure Auto-Play is OFF
1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video should not start Auto-playing

Bug Work

Tracking bugs

• bugs to track the feature

ex:

Full Query

ID	Summary	Priority	Status
1243304	Brightcove videos on www.independent.co.uk don't work in Firefox for Android and Firefox OS	--	RESOLVED
1274864	Some videos on ilfattoquotidiano.it can't be played	P3	RESOLVED
1286133	Play HLS video in an Android VideoView	--	RESOLVED
1294823	Don't use a fullscreen view for HLS	P2	VERIFIED
1295398	Media volume control remains active after pushing Firefox to the background	P3	RESOLVED
1301043	HLS video player overlaps other tabs once played	P1	VERIFIED
1301050	Android VideoView makes browser unusable when loading videos from independent.co.uk (all sites using the Brightcove player?)	P1	RESOLVED
1301053	A misleading error is received before playing an HLS video	P2	RESOLVED
1301055	A HLS video cannot be played twice without reloading the whole page	P1	RESOLVED
1301326	HLS videos automatically start playing when auto-play is OFF	--	RESOLVED

10 Total; 0 Open (0%); 8 Resolved (80%); 2 Verified (20%);

Signoff

Criteria

• All test cases should be executed
• All blockers, critical issues must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

Aurora testing

Beta testing NA