QA/Fennec/Play HLS: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
Line 109: Line 109:
<bugzilla>
<bugzilla>
{
{
  "id": "1286133, 1286898, 1295398, 1294823, 1243304, 1274864, 1301043, 1301053, 1301055, 1301050, 1301326 "
  "id": "1286133, 1286898, 1295398, 1294823, 1243304, 1274864, 1301043, 1301053, 1301055, 1301050, 1301326, 1307074, 1307076, 1307078 "
}
}
</bugzilla>
</bugzilla>

Revision as of 13:09, 3 October 2016

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that HLS video can be correctly played in any given condition.

Ownership

Developer contact: X

QA: :Ninu

Overall Status

[LANDED] Nightly 50.0a1: first landed on - 30-07-2016

  • At risk

[ LANDED] Aurora 50.a2: first landed on - 02-08-2016

  • At risk

[NOT LANDED] Beta 50: NA

Testing Summary

Scope of testing

The testing will be focus on

  • making the HLS video watching experience good
  • making sure that the implementation of HLS video controls don't impact other video playing type

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.0
  • Tablet
    • 4.x
    • 5.x
    • 6.0

Specifications

  • HLS Player Landscape
  • HLS Player Portrait

User stories

  • As a user, I want to be able to play HLS videos without glitches and streaming problems, while the other app features are not impacted by a playing video.

Acceptance Criteria

Testing details

Test Cases

Step 

1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video plays correctly and the audio is correctly played

Step 

1. Go to goo.gl/LLxEY8 and play the HLS video in landscape/portrait
R: The video plays correctly and the audio is correctly played
2. Change the device's orientation 
R: The video keeps playing and no interruptions or glitches are triggered

Step 

1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video plays correctly and the audio is correctly played
2. Try the video-player media controls
R: All buttons response is correctly applied in the video progress

Step 

1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video plays correctly and the audio is correctly played
2. Close HLS video player and go to youtube, play a video
R: Any other video player is not impacted by the HLS video player previous use

Step 

Pre-Condition:  Make sure Auto-Play is ON
1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video starts Auto-playing

Step 

Pre-Condition:  Make sure Auto-Play is OFF
1. Go to goo.gl/LLxEY8 and play the HLS video
R: The video should not start Auto-playing

Testing days

Date:05-09-2016

  • Exploratory testing with focus on the Aurora build and creating a test plan for the feature

Date:07-09-2016

  • Functional testing with focus on both Aurora and Nightly builds

Logged issues:

  • HLS video player overlaps other tabs once played - bug 1301043
  • A misleading error is received before playing an HLS video - bug 1301053
  • A HLS video cannot be played twice without reloading the whole page - bug 1301055

Date:08-09-2016

  • Creating test cases and exploratory testing on both Aurora and Nightly builds

Logged issues:

  • HLS videos automatically start playing when auto-play is OFF - bug 1301326

Bug Work

Tracking bugs

  • bugs to track the feature

ex:

Full Query
ID Summary Priority Status
1243304 Brightcove videos on www.independent.co.uk don't work in Firefox for Android and Firefox OS -- RESOLVED
1274864 Some videos on ilfattoquotidiano.it can't be played P3 RESOLVED
1286133 Play HLS video in an Android VideoView -- RESOLVED
1294823 Don't use a fullscreen view for HLS P2 VERIFIED
1295398 Media volume control remains active after pushing Firefox to the background P3 RESOLVED
1301043 HLS video player overlaps other tabs once played P1 VERIFIED
1301050 Android VideoView makes browser unusable when loading videos from independent.co.uk (all sites using the Brightcove player?) P1 RESOLVED
1301053 A misleading error is received before playing an HLS video P2 RESOLVED
1301055 A HLS video cannot be played twice without reloading the whole page P1 RESOLVED
1301326 HLS videos automatically start playing when auto-play is OFF -- RESOLVED
1307074 Switching tabs will stop the HLS player P5 RESOLVED
1307076 HLS Player breaks other video types in other tabs -- VERIFIED
1307078 Interrupting an HLS video with Task manager will lead to incorrect video resume P5 RESOLVED

13 Total; 0 Open (0%); 10 Resolved (76.92%); 3 Verified (23.08%);


Signoff

Criteria

  • All test cases should be executed
  • All blockers, critical issues must be fixed and verified or have an agreed-upon timeline for being fixed


Results

Nightly testing 

Buggy but working for minimum requirements and functionality

Aurora testing 

Buggy but working for minimum requirements and functionality

Beta testing NA

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec/Play_HLS&oldid=1149900"