QA/Platform/Graphics/Betabreakers: Difference between revisions
| Line 9: | Line 9: | ||
* Firefox 48: ? | * Firefox 48: ? | ||
* Firefox 47: ? | * Firefox 47: ? | ||
* {{ | * {{ok|}} [[QA/Platform/Betabreakers/Firefox_46|Firefox 46]]: Sanity test software accelerated video playback | ||
* {{done|}} [https://docs.google.com/spreadsheets/d/1jw0sZxLPLgRs8s_LoNYH6aaPc9AXE5o9uorbSIF8EVc/edit#gid=0 Firefox 45]: WinXP D3D9 E10S compatibility | * {{done|}} [https://docs.google.com/spreadsheets/d/1jw0sZxLPLgRs8s_LoNYH6aaPc9AXE5o9uorbSIF8EVc/edit#gid=0 Firefox 45]: WinXP D3D9 E10S compatibility | ||
* {{done|}} [[QA/Platform/Graphics/Firefox_44|Firefox 44]]: Country-specific top sites | * {{done|}} [[QA/Platform/Graphics/Firefox_44|Firefox 44]]: Country-specific top sites | ||
Revision as of 21:00, 14 April 2016
Summary
There is a large discrepancy between the platform/hardware/driver configurations we see on Release versus what we see on our test branches. Additionally, the Graphics team and our testing community does not and can not provide sufficient test coverage to fill this gap. As a result we've historically been notified far too late about critical graphics issues triggering multiple chemspill releases and a loss of users.
In an effort to improve pre-release visibility of graphics regressions we have partnered with Betabreakers, a company that maintains a lab specifically designed to test various modern and legacy configurations of Windows versions, graphics hardware, and graphics drivers. We try to coordinate a graphics sanity testrun with them once per mozilla-aurora cycle, as detailed below.
More information about our relationship with Betabreakers can be found on mana.mozilla.org.
Test Runs
- Firefox 48: ?
- Firefox 47: ?
- [ON TRACK] Firefox 46: Sanity test software accelerated video playback
- [DONE] Firefox 45: WinXP D3D9 E10S compatibility
- [DONE] Firefox 44: Country-specific top sites
- [DONE] Firefox 43: Typical sanity check plus bug cleanup
- [DONE] Firefox 42: Windows 10 AMD/NVidia stability
- [DONE] Firefox 41: WARP disabled on Windows 7 and earlier
- [DONE] Firefox 40: WebGL with e10s
- [DONE] Firefox 39: beta sanity check
- [DONE] Firefox 38: MSE stress test
Bugs
99 Total; 5 Open (5.05%); 90 Resolved (90.91%); 4 Verified (4.04%);