Auto-tools/Projects/Platform Quality/External Media Tests: Difference between revisions
m (→Contacts: update roles) |
(Update info about pf-jenkins versus buildbot jobs) |
||
| Line 3: | Line 3: | ||
== Results Reported to Treeherder == | == Results Reported to Treeherder == | ||
These are Tier-2 jobs, meaning they are visible by default but not sheriff-managed. | These are Tier-2 jobs, meaning they are visible by default but not sheriff-managed. | ||
* Repos: mozilla-central, mozilla- | |||
There are two short test jobs that run in buildbot | |||
* Repos: trunk | |||
* Platforms: Linux x64 (opt only), Windows 7, Windows 8 x64, OS X 10.10 | |||
* Group Name: VideoPuppeteer | |||
* Group Symbol: VP | |||
* Jobs: | |||
** b-m - "media-tests" short tests using standard video API on YouTube; equivalent to 'm' below | |||
** b-y - "media-youtube-tests" short tests using YouTube JS API on YouTube; equivalent to 'y' below | |||
All available test jobs also run in our Jenkins instance, [http://pf-jenkins.qa.mtv2.mozilla.com:8080/ pf-jenkins]. (Soon-to-move to mozmill-ci) | |||
* Repos: mozilla-central, mozilla-aurora | |||
* Platforms: OS X 10.10 opt, Windows 7 opt, Windows 8 opt | |||
* Group Name: VideoPuppeteer | * Group Name: VideoPuppeteer | ||
* Group Symbol: VP | * Group Symbol: VP | ||
| Line 18: | Line 30: | ||
Please see the project's [https://github.com/mjzffr/firefox-media-tests/blob/master/README.md readme] | Please see the project's [https://github.com/mjzffr/firefox-media-tests/blob/master/README.md readme] | ||
== How to disable an individual failing test. == | Note that this project has just been moved into mozilla-central and the Github repo will soon be deprecated. | ||
== How to disable an individual failing test on pf-jenkins. == | |||
Visit [http://pf-jenkins.qa.mtv2.mozilla.com:8080/ pf-jenkins] (VPN required), open the summary page of the job you want to disable and click 'Disable Project'. When a job is reported to Treeherder, its Jenkins build url and build id are listed in the Job Details pane. | Visit [http://pf-jenkins.qa.mtv2.mozilla.com:8080/ pf-jenkins] (VPN required), open the summary page of the job you want to disable and click 'Disable Project'. When a job is reported to Treeherder, its Jenkins build url and build id are listed in the Job Details pane. | ||
Revision as of 16:02, 12 January 2016
firefox-media-tests is a suite of Marionette Python tests for media playback in Mozilla Firefox. Its aim is to test MSE (Media Source Extensions) and EME (Encrypted Media Extensions) on specific websites such as YouTube.
Results Reported to Treeherder
These are Tier-2 jobs, meaning they are visible by default but not sheriff-managed.
There are two short test jobs that run in buildbot
- Repos: trunk
- Platforms: Linux x64 (opt only), Windows 7, Windows 8 x64, OS X 10.10
- Group Name: VideoPuppeteer
- Group Symbol: VP
- Jobs:
- b-m - "media-tests" short tests using standard video API on YouTube; equivalent to 'm' below
- b-y - "media-youtube-tests" short tests using YouTube JS API on YouTube; equivalent to 'y' below
All available test jobs also run in our Jenkins instance, pf-jenkins. (Soon-to-move to mozmill-ci)
- Repos: mozilla-central, mozilla-aurora
- Platforms: OS X 10.10 opt, Windows 7 opt, Windows 8 opt
- Group Name: VideoPuppeteer
- Group Symbol: VP
- Jobs:
- m - short tests using standard video API on YouTube
- y - short tests using YouTube JS API on YouTube
- ym1-60 - hour-long tests using YouTube JS API on YouTube
- e - short tests using standard video API to test EME
- e-f - full tests using standard video API to test EME
- *-e10s - job that is run with e10s enabled e.g. m-e10s, y-e10s
- *-bw - tests that runs for various bandwidths
Instructions for running locally.
Please see the project's readme
Note that this project has just been moved into mozilla-central and the Github repo will soon be deprecated.
How to disable an individual failing test on pf-jenkins.
Visit pf-jenkins (VPN required), open the summary page of the job you want to disable and click 'Disable Project'. When a job is reported to Treeherder, its Jenkins build url and build id are listed in the Job Details pane.
Contacts
- :sydpolk (primary contact)
- :maja_zf (YouTube JS API, MSE, code review)
Where to file bugs
Test failures seen on Treeherder should be filed under Core::Audio/Video: Playback