Releases/Firefox 22/Test Plan

« Firefox 21 | Firefox 22 | Firefox 23 »

Firefox 22 Test Plan

Summary

Milestone	Firefox 22
Status	Currently in Aurora -- merging to Beta on 2013-05-14
Lead	Juan Becerra (irc: juanb)
2nd	Anthony Hughes (irc: ashughes)
Builds	[ftp] [http] [web]

The following is the test plan for Firefox 22 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 22. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Features

See the Feature Release Tracking wiki for a general overview

Feature	Owner	Status	Tests
WebRTC	Jason Smith

Endurance Automation

The purpose of this section is to track any potential memory regressions via spikes reported in the dashboard.

What to Do

1. Check the Endurance Charts
2. If you see an anomalous event (ie. spike or dip), get the report for the specific event
3. If the event happens twice in a row, file a bug under Mozmill Tests
4. Notify Anthony Hughes of the issue
5. Record the event in this wiki below

Current Status (Mihaela Velimiroviciu) - Last Updated - yyyy.mm.dd

Bugzilla query error

Query options must be valid JSON.1

Functional Automation

The purpose of this section is to track any potential functional regressions via results reported in the dashboard.

What to Do

1. Check the testrun reports
2. If you see any failing tests, check that there are not any bugs on file for it already
3. If not, file a bug under Mozmill Tests
4. Notify Anthony Hughes of the issue
5. Record the event in this wiki below

Current Status (SoftVision) - Last Updated - yyyy-mm-dd

Bug Triage

The purpose of this section is to triage UNCONFIRMED incoming bugs.

What to Do

1. Check the UNCONFIRMED bugs
2. Test the bugs in the latest Firefox Nightly
3. If you can't reproduce the bug, ask for the reporter to provide more information
4. If you reproduce the bug, add your testing information and mark the bug NEW
5. Notify Anthony Hughes of the NEW issue

Current Status (SoftVision) - Last Updated

Result Spreadsheet

Beta 1

Builds	FTP, HTTP
ID	20130514181517
Changeset	75aa37cf382c

Checklist

• [DONE] Automated Tests
• [DONE] Feature Sign-off
• [DONE] Regression Tests
• [ON TRACK] Bug Fix Verifications
• [DONE] Update Tests (betatest)
• [DONE] Update Tests (releasetest)
• [ON TRACK] Update Tests (beta)

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Results [dashboard]
Windows XP	[DONE] en-US & da
Windows Vista	[DONE] en-US & it
Windows 7 32-bit	[DONE] en-US & zh-TW
Windows 7 64-bit	[DONE] en-US & ro
Windows 8 32-bit	[DONE] en-US & es-ES
Windows 8 64-bit	[DONE] en-US & pt-BR
Mac OSX 10.6	[DONE] en-US & de
Mac OSX 10.7	[DONE] en-US & fr
Mac OSX 10.8	[DONE] en-US & it
Ubuntu 12.04 32-bit	[DONE] en-US & de
Ubuntu 12.04 64-bit	[DONE] en-US & fr

Known test failures in bugzilla

Feature Sign Off

• [DONE] Win32 H264/AAC/MP3 Support (Cornel Ionce)
• [DONE] Font inspector (Manuela Muntean)
• [DONE] Block cookies from sites I haven't visited (Bogdan Maris)
• [DONE] Notification API (Cornel Ionce)

Regression Tests

As per the checklist we will regression test the following areas.

Test	Windows 7 32-bit	Windows 8 64-bit	Mac OSX 10.8	Ubuntu 12.04 32-bit
Breakpad end-to-end functionality	[DONE] Cornel Ionce	[DONE] Simona Marcu	[DONE] Bogdan Maris	[DONE] Paul Silaghi
Mac OSX 10.8 code signing	N/A	N/A	[DONE] Bogdan Maris	N/A
HTML5 Audio/Video playback	[DONE] Cornel Ionce	[DONE] Simona Marcu	[DONE] Bogdan Maris	[DONE] Paul Silaghi
Feedly Add-on Compatibility	[DONE] Cornel Ionce	[DONE] Simona Marcu	[DONE] Bogdan Maris	[DONE] Paul Silaghi

Bug Fix Verifications

List of fixed bugs in Firefox where the status for Firefox 22 is set to fixed and need verification: http://mzl.la/15LLemh

• [DONE] bug 738952 "Save as..." File menu entry or Ctrl+S produces unexpected results when having a PDF file opened within PDF Viewer (Ioana Budnar)
• [DONE] bug 854926 Firefox prompts a warning when closing private windows with multiple tabs open (Ioana Budnar)
• [DONE] bug 846186 Tilt error flooding error console (TypeError: mouseLerp is undefined) (Ioana Budnar)
• [DONE] bug 839515 Tiny fonts in the remote connection screen (Ioana Budnar)
• [DONE] bug 844466 When opening a link from a modal dialog, the tab strip doesn't show the new tab until you close the dialog (Ioana Budnar)
• [DONE] bug 849500 navigate and will-navigate events for remoted targets carry payload that is incompatible with the non-remoted case (Ioana Budnar)
• [DONE] bug 859027 Garbled PDF output (bgb/gesamt.pdf) (Ioana Budnar)
• [DONE] bug 851630 - Can't open popup notifications with the keyboard (focus gets stuck at the identity icon) (Manuela Muntean)
• [DONE] bug 851436 - pinned tabs sometimes scroll with normal tabs (Manuela Muntean)
• [DONE] bug 838864 - keyword.URL reset interferes poorly with some partner add-ons (Manuela Muntean)
• [DONE] bug 860578 - No favicons in Panorama view (Manuela Muntean)
• [DONE] bug 866354 - Social notification icons are too wide and not jutting right up next to each other (Manuela Muntean)
• [DONE] bug 844406 - Greasemonkey script stops working correctly in Firefox 20. 'self-hosted' builtin functions destroy js-callstack in certain case. (Manuela Muntean)
• [DONE] bug 851967 - Easy YouTube Video Downloader addon stopped working after dummy Private Browsing service removed (Manuela Muntean)
• [DONE] bug 785433 - The input field is covered by Autocomplete suggestions panel if Web Console position set below (Alexandra Lucinet)
• [DONE] bug 799172 - "Back" after "Options" just returns to the first dialog (Alexandra Lucinet)
• [DONE] bug 813569 - Long string (ONE_MOMENT) not fully displayed in localized stub installer (Alexandra Lucinet)
• [DONE] bug 843342 - PDF doesn't print correctly on USPS.com with pdfjs (pdf.js does not support automatic print using Adobe JavaScript) (Alexandra Lucinet)
• [DONE] bug 852530 - notificationBox is not visible on Linux (Alexandra Lucinet)
• [DONE] bug 857817 - [NBV] Consumes all client resources when load is slightly increased (Alexandra Lucinet)

Update Tests

The following is the results of the Mozmill automated update tests.

Platform	Betatest [dashboard]	Releasetest [dashboard]	Beta [dashboard]
Windows XP	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows Vista	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows 7 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows 7 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows 8 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows 8 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Mac OSX 10.6	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Mac OSX 10.7	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Mac OSX 10.8	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Ubuntu 12.04 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Ubuntu 12.04 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL

New Issues

The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.

• bug 000000 - Bug Summary - Severity (normal/blocker?) (name of the person who filed it)

Beta 2

Builds	FTP, HTTP
ID	20130521223249
Changeset	1b5782f637b3 (pushlog)

Checklist

• [DONE] Automated Tests
• [DONE] Feature Sign-off
• [DONE] Regression Tests
• [ON TRACK] Bug Fix Verifications
• [DONE] Update Tests (betatest)
• [DONE] Update Tests (releasetest)
• [ON TRACK] Update Tests (beta)

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Results [dashboard]
Windows XP	[DONE] en-US & da
Windows Vista	[DONE] en-US & it
Windows 7 32-bit	[DONE] en-US & zh-TW
Windows 7 64-bit	[DONE] en-US & ro
Windows 8 32-bit	[DONE] en-US & es-ES
Windows 8 64-bit	[DONE] en-US & pt-BR
Mac OSX 10.6	[DONE] en-US & de
Mac OSX 10.7	[DONE] en-US & fr
Mac OSX 10.8	[DONE] en-US & it
Ubuntu 12.04 32-bit	[DONE] en-US & de
Ubuntu 12.04 64-bit	[DONE] en-US & fr

Known test failures in bugzilla

Regression Tests

As per the checklist we will regression test the following areas.

Test	Windows 7 64-bit	Windows 8 32-bit	Mac OSX 10.7	Ubuntu 12.10 64-bit
Breakpad end-to-end functionality	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi	[DONE] Manuela Muntean	[DONE] Mihaela Velimiroviciu
Stop accepting MD5 as a hash algorithm in signatures	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi	[DONE] Manuela Muntean	[DONE] Mihaela Velimiroviciu
Plug-in compatibility	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi	[DONE] Manuela Muntean	[DONE] Mihaela Velimiroviciu
Font Inspector	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi	[DONE] Manuela Muntean	[DONE] Mihaela Velimiroviciu
Block cookies	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi	[DONE] Manuela Muntean	[DONE] Mihaela Velimiroviciu

Details:

• Breakpad end-to-end functionality
  • ensure that crash reports are submitted with the current build,
  • use this Moztrap test as a rough guideline.
• Stop accepting MD5 as a hash algorithm in signatures
  • ensure MD5 is no longer accepted as a hash algorithm in signatures,
  • use this Moztrap test as guideline.
• Plug-in compatibility
  • ensure that plug-in content works fine and it doesn't affect browser functionality.
  • plugins: Flash 11.7, 11.2, Java 7, Apple QuickTime, Microsoft Silverlight 5, Flip4Mac, Unity 3D.
• Font Inspector
  • ensure that this feature is stable and ready for release,
  • use the existing tests as guidelines.
• Block cookies
  • ensure that this feature is stable and ready for release,
  • use the existing tests as guidelines.

Bug Fix Verifications

List of fixed bugs in Firefox where the status for Firefox 22 is set to fixed and need verification: http://mzl.la/15LLemh

• [DONE] bug 858643 "TypeError: candidate is undefined" when closing tabs. (Ioana Budnar)
• [DONE] bug 855900 Change Profiler shortcut to Shift-F5 in Aurora (Ioana Budnar)
• [DONE] bug 835899 Web Console autocomplete popup could need some UI love (Ioana Budnar)
• [DONE] bug 866254 Starting firefox with search windows not working / issues at about:home in Private Browsing mode (Ioana Budnar)
• [DONE] bug 831693 Experiment with auto completion in Inspector Searchbox (Ioana Budnar)
• [DONE] bug 862679 integrated pdf prints black areas outside paper area (Ioana Budnar)
• [DONE] bug 845555 After showing statistics, context menu item to switch to hide statistics instead of offering to show statistics again (Cornel Ionce)
• [DONE] bug 861270 menu behavior is unstable depending on value of devPixelsPerPx (Cornel Ionce)
  • This also needs to be checked on a HI-DPI display
• [DONE] bug 860897 Add locale to stub installer fallback url (Cornel Ionce)
• [DONE] bug 817947 Move a background unloaded tab to New Window fails (Cornel Ionce)
• [DONE] bug 851836 breakpoints[aLocation.line] is undefined after bug 820012 (Simona Marcu)
• [DONE] bug 862314 possible to install a provider twice (Bogdan Maris)
• [DROPPED] bug 841967 What should we do about security.notification_enable_delay? (Paul Silaghi)
• [ON TRACK] bug 854018 Longitudinal recording of FHR submission activity (Simona Marcu) - to be verified on Firefox 22 beta 3.
• [DROPPED] bug 860094 Remove saving of payload to disk (Simona Marcu)
• [DONE] bug 846133 Store FHR state in files, not prefs (Simona Marcu) - need more info.
• [ON TRACK] bug 866915 No XHR Preflight request in Firefox 20 for a HEAD request during a CSRF proof of concept. (Ioana Budnar) - need more info
• [ON TRACK] bug 866823 Xray Waivers can be used to bypass COWs (Ioana Budnar) - need more info
• [DONE] bug 862309 "ASSERTION: wrong shell" with editor, cross-document selection (Ioana Budnar)
• [DONE] bug 857883 Crash with onreadystatechange and reload (Ioana Budnar)

Update Tests

The following is the results of the Mozmill automated update tests.

Platform	Betatest [dashboard]	Releasetest [dashboard]	Beta [dashboard]
Windows XP	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows Vista	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows 7 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows 7 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows 8 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Windows 8 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Mac OSX 10.6	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Mac OSX 10.7	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Mac OSX 10.8	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Ubuntu 12.04 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL
Ubuntu 12.04 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - PASS/FAIL

New Issues

The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.

• bug 874907 - Zoom in/out not working on Flash content - Normal (Alexandra Lucinet)

Beta 3

Builds	FTP, HTTP
ID	20130528181031
Changeset	8ca75debb97a (pushlog)

Checklist

• [DONE] Automated Tests
• [DONE] Regression Tests
• [DONE] Bug Fix Verifications
• [DONE] Update Tests (betatest)
• [DONE] Update Tests (releasetest)
• [DONE] Update Tests (beta)

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Results [dashboard]
Windows XP	[DONE] en-US & da
Windows Vista	[DONE] en-US & it
Windows 7 32-bit	[DONE] en-US & zh-TW
Windows 7 64-bit	[DONE] en-US & ro
Windows 8 32-bit	[DONE] en-US & es-ES
Windows 8 64-bit	[DONE] en-US & pt-BR
Mac OSX 10.6	[DONE] en-US & de
Mac OSX 10.7	[DONE] en-US & fr
Mac OSX 10.8	[DONE] en-US & it
Ubuntu 12.04 32-bit	[DONE] en-US & de
Ubuntu 12.04 64-bit	[DONE] en-US & fr

Known test failures in bugzilla

Regression Tests

As per the checklist we will regression test the following areas.

Test	Windows 7 32-bit	Windows Vista	Mac OSX 10.6	Ubuntu 12.10 32-bit
Breakpad end-to-end functionality	[DONE] Alexandra Lucinet	[DONE] Simona Marcu	[DONE] Cornel Ionce	[DONE] Bogdan Maris
Mac OSX 32-bit mode	N/A	NA	[DONE] Cornel Ionce	NA
Web compatibility	[DONE] Alexandra Lucinet	[DONE] Simona Marcu	[DONE] Cornel Ionce	[DONE] Bogdan Maris
PDF Viewer	[DONE] Alexandra Lucinet	[DONE] Simona Marcu	[DONE] Cornel Ionce	[DONE] Bogdan Maris
Social API	[DONE] Alexandra Lucinet	[DONE] Simona Marcu	[DONE] Cornel Ionce	[DONE] Bogdan Maris

Details:

• Breakpad end-to-end functionality
  • ensure that crash reports are submitted with the current build,
  • use this Moztrap test as a rough guideline.
• Mac OSX 32-bit mode
  • ensure Firefox basic functionality stays compatible to Mac OSX 32-bit mode,
  • use this Moztrap test as guideline.
• Web compatibility
  • ensure that web content stays compatible to Firefox and is stable.
  • search, webmail, banking, video, audio, gaming, news, cms, etc.
• PDF Viewer
  • ensure the many Firefox 22 fixes for PDF Viewer did not cause regressions.
  • open simple and complex pdfs with the viewer, use all the available functionalities.
• Social API
  • ensure the many Firefox 22 fixes for this feature did not cause regressions.
  • enable the sidebar, use all it's functionalities with Facebook accounts.

Bug Fix Verifications

List of fixed bugs in Firefox where the status for Firefox 22 is set to fixed and need verification: http://mzl.la/15LLemh

• [DONE] bug 52500 (input[type=file]) Make regular CSS properties apply on <input type='file'> (Ioana Budnar)
• [DONE] bug 871887 marquee's _setEventListener does not work (Ioana Budnar)
• [DONE] bug 840098 "ASSERTION: Unexpected aDocument" after adopting content from XBL (Ioana Budnar)
• [DONE] bug 868300 [FIX] Heap-use-after-free in mozilla::dom::ValidityStateBinding::get_valueMissing (Matt Wobensmith)
• [DROPPED] bug 872324 Restored maximized windows blank or incorrectly positioned (Ioana Budnar)
  • Couldn't reproduce completely locally. Verified what was reproducible, asked the reporter to verify the initial bug.
• [DONE] bug 857324 Tbpl's bottom-right summary pane cuts off entries as of the 2013-03-08 nightly (Paul Silaghi)
• [DONE] bug 863159 Rendering PDF results in huge temporary pixmaps to be created (crashing X) (Paul Silaghi)
• [DONE] bug 872235 should we disable bug 689623 on beta (22)? (Paul Silaghi)
• [DONE] bug 857040 PNG Image "contains errors" on Nightly, but renders fine in Safari (Paul Silaghi)
• [DONE] bug 866444 No Site favicon in History submenus – Recently Closed Tabs, Windows (Bogdan Maris)
• [DONE] bug 874600 <input type=file> has unreadable text on dark/black background now (Mihaela Velimiroviciu)
• [DONE] bug 865702 Weirdness with comboboxes pushed aside by Bookmarks sidebar (Mihaela Velimiroviciu)
• [DONE] bug 855221 crash in _cairo_quartz_draw_image @ CGAccessSessionRewind (Manuela Muntean)
• [DONE] bug 873926 Github fragment links don't work (Manuela Muntean)
• [DONE] bug 871942 crash in nsWebShellWindow::RequestWindowClose (Manuela Muntean)
• [DONE] bug 873527 Panels can't be anchored to widgets in Firefox 22 (Paul Silaghi)

Update Tests

The following is the results of the Mozmill automated update tests.

Platform	Betatest [dashboard]	Releasetest [dashboard]	Beta [dashboard]
Windows XP	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows Vista	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows 7 32-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows 7 64-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows 8 32-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows 8 64-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Mac OSX 10.6	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Mac OSX 10.7	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Mac OSX 10.8	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Ubuntu 12.04 32-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Ubuntu 12.04 64-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS

New Issues

The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.

• bug 877612 - Pdf remembers next page command on multiple buttons - Normal (Bogdan Maris)
• bug 877664 - Popup notifications are blocking a small area of the buttons - Normal (Bogdan Maris)
• bug 877642 - Panels are not closed properly in Social API - Normal (Alexandra Lucinet)
• bug 877649 - On Facebook - the content of the page rearranges after completely loading - Normal (Simona Marcu)
• bug 877660 - Settings panel is not opened on the first click in chat window - Normal (Alexandra Lucinet)

Beta 4

Builds	FTP, HTTP
ID	TBD
Changeset	80d4a7fac73e (pushlog)

Checklist

• [DONE] Automated Tests
• [DONE] Regression Tests
• [ON TRACK] Bug Fix Verifications
• [DONE] Update Tests (betatest)
• [DONE] Update Tests (releasetest)
• [ON TRACK] Update Tests (beta)

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Results [dashboard]
Windows XP	[DONE] en-US & da
Windows Vista	[DONE] en-US & it
Windows 7 32-bit	[DONE] en-US & zh-TW
Windows 7 64-bit	[DONE] en-US & ro
Windows 8 32-bit	[DONE] en-US & es-ES
Windows 8 64-bit	[DONE] en-US & pt-BR
Mac OSX 10.6	[DONE] en-US & de
Mac OSX 10.7	[DONE] en-US & fr
Mac OSX 10.8	[DONE] en-US & it
Ubuntu 12.04 32-bit	[DONE] en-US & de
Ubuntu 12.04 64-bit	[DONE] en-US & fr

Known test failures in bugzilla

Regression Tests

As per the checklist we will regression test the following areas.

Test	Windows 7 64-bit	Windows XP 32-bit	Mac OSX 10.6	Ubuntu 12.04 32-bit
Breakpad end-to-end functionality	[DONE] Bogdan Maris	[DONE] Virgil Dicu	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi
Plug-in compatibility	[DONE] Bogdan Maris	[DONE] Virgil Dicu	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi
hiDPI displays	N/A	N/A	N/A	N/A
Unity 3d gaming plugin	[DONE] Bogdan Maris	[DONE] Virgil Dicu	[DONE] Alexandra Lucinet	N/A
Network Proxys	[DONE] Bogdan Maris	[DONE] Virgil Dicu	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi
Printing (Save as PDF)	[DONE] Bogdan Maris	[DONE] Virgil Dicu	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi
WebRTC Spot Check	[DONE] Bogdan Maris	[DONE] Virgil Dicu	[DONE] Alexandra Lucinet	[DONE] Paul Silaghi

Details:

• Breakpad end-to-end functionality
  • ensure that crash reports are submitted with the current build,
  • use this Moztrap test as a rough guideline.
• Plug-in compatibility
  • ensure that plug-in content works fine and it doesn't affect browser functionality.
  • plugins: Flash 11.7, 11.2, Java 7, Apple QuickTime, Microsoft Silverlight 5, Flip4Mac, Unity 3D.

Bug Fix Verifications

List of fixed bugs in Firefox where the status for Firefox 22 is set to fixed and need verification: http://mzl.la/15LLemh

• [DONE] bug 873963 Arbitrary code execution from Font Inspector (Manuela Muntean)
• [DONE] bug 876098 property added to DOM element somehow got missing after scrolling (Manuela Muntean)
• [DONE] bug 874090 Crash in mozilla::dom::Notification::GetPermissionInternal (Manuela Muntean)
• [DONE] bug 874407 new visits are inserted incorrectly in the Library and the sidebar treeviews (Manuela Muntean)
• [DONE] bug 878509 Restore the HTMLImageElement.lowsrc, x, y attributes that were unintentionally removed (Manuela Muntean)
• [ON TRACK] bug 876878 crash in webrtc::videocapturemodule::GetMaxOfFrameArray (Manuela Muntean)
  • Note: to be verified with Firefox 22 beta 5 (need to check if new crash reports appear in Socorro, after the fix)
• [DONE] bug 855221 crash in _cairo_quartz_draw_image @ CGAccessSessionRewind (Manuela Muntean)
• [DONE] bug 876080 (Mihaela Velimiroviciu)
• [DONE] bug 878037 Crash on print if list-style-image (or :after|:before content) is animated gif (Cornel Ionce)
• [ON TRACK] bug 876167 SCTP library crash when processing association abort while closing socket (Mihaela Velimiroviciu)
  • verified by checking the TBPL logs; waiting for more details about manual testing
• [ON TRACK] bug 878945 Update DataChannel WebIDL to match spec changes (renaming dictionary values)(Mihaela Velimiroviciu)
  • asked for guidelines
• [DONE] bug 875609 Refactor jump list code to decode images on the main thread (Mihaela Velimiroviciu)
• [DONE] bug 856858 Alert service notifications open in the wrong place and don't auto-dismiss (Simona Marcu)
• [DONE] bug 876856 Crash [@ mozilla::dom::MediaStreamList::Length] after closing a peer connection (Simona Marcu)
• [DONE] bug 875252 Google+ "Upload from computer" unclickable on Firefox (Simona Marcu)
• [DONE] bug 870529 Windows jumplist not showing anymore (Simona Marcu)
• [ON TRACK] bug 876313 [New Tab Page] Unpinning a site doesn't update pref (Simona Marcu)
  • Note: commented, need more info
• [DROPPED] bug 872978 Intermittent data channel leaks - "9378 bytes leaked (DataChannel, DataChannelConnection, DtlsIdentity, Mutex, NrIceCtx, ...)"
  • the bug was marked [qa-] (Simona Marcu)
• [DROPPED] bug 872839 Intermittent 182, 188, 197, 221, 716, 763, 767 bytes leaked (Mutex, NrIceResolver, PeerConnectionMedia, ReentrantMonitor, nsSocketTransport, nsTArray_base, nsThread) (Simona Marcu)
  • the bug was marked [qa-]
• [DONE] bug 828284 Force shortcut desktop icons off on Windows XP (Simona Marcu)
• [ON TRACK] bug 877057 Engine fetches seem to have lost their download limit (Mihaela Velimiroviciu)
  • need more info befor marking verified
• [ON TRACK] bug 873888 Media Stream returned from onaddstream should only return when all media tracks are available (Simona Marcu)
  • Note: commented, need more info
• [DONE] bug 859714 file open dialog buttons not working (Simona Marcu)

Update Tests

The following is the results of the Mozmill automated update tests.

Platform	Betatest [dashboard]	Releasetest [dashboard]	Beta [dashboard]
Windows XP	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Windows Vista	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Windows 7 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Windows 7 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Windows 8 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Windows 8 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Mac OSX 10.6	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Mac OSX 10.7	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Mac OSX 10.8	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Ubuntu 12.04 32-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT
Ubuntu 12.04 64-bit	[DONE] - PASS	[DONE] - PASS	[ON TRACK] - RESULT

New Issues

The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.

Beta 5

Builds	FTP, HTTP
ID	20130612084701
Changeset	c7ae9b066608 (pushlog)

Checklist

• [DONE] Automated Tests
• [DONE] Regression Tests
• [DONE] Bug Fix Verifications
• [DONE] Update Tests (betatest)
• [DONE] Update Tests (releasetest)
• [DONE] Update Tests (beta)

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Results [dashboard]
Windows XP	[DONE] en-US & da
Windows Vista	[DONE] en-US & it
Windows 7 32-bit	[DONE] en-US & zh-TW
Windows 7 64-bit	[DONE] en-US & ro
Windows 8 32-bit	[DONE] en-US & es-ES
Windows 8 64-bit	[DONE] en-US & pt-BR
Mac OSX 10.6	[DONE] en-US & de
Mac OSX 10.7	[DONE] en-US & fr
Mac OSX 10.8	[DONE] en-US & it
Ubuntu 12.04 32-bit	[DONE] en-US & de
Ubuntu 12.04 64-bit	[DONE] en-US & fr

Known test failures in bugzilla

Regression Tests

As per the checklist we will regression test the following areas.

Test	Windows 7 32-bit	Windows 8 64-bit	Mac OSX 10.7	Ubuntu 13.04 32-bit
Breakpad end-to-end functionality	[DONE] Cornel Ionce	[DONE] Alexandra Lucinet	[DONE] Paul	[DONE] Mihai Morar
Add-on compatibility	[DONE] Cornel Ionce	[DONE] Alexandra Lucinet	[DONE] Paul	[DONE] Mihai Morar
What's New Page on Firefox update	[DONE] Cornel Ionce	[DONE] Alexandra Lucinet	[DONE] Paul	[DONE] Mihai Morar
File picker on Linux	N/A	N/A	N/A	[DONE] Mihai Morar
WebRTC Spot Check	[DONE] Cornel Ionce	[DONE] Alexandra Lucinet	[DONE] Paul	[DONE] Mihai Morar

Details:

• Breakpad end-to-end functionality
  • ensure that crash reports are submitted with the current build,
  • use this Moztrap test as a rough guideline.
• Add-on compatibility
  • top third-party and addons.mozilla.org hosted

Bug Fix Verifications

List of fixed bugs in Firefox where the status for Firefox 22 is set to fixed and need verification: http://mzl.la/15LLemh

• [DONE] bug 876878 crash in webrtc::videocapturemodule::GetMaxOfFrameArray (Manuela Muntean)
  • Note: commented; 4 new crash reports; need more info
• [DONE] bug 867226 Incomplete framebuffer abort in mozilla::layers::LayerManagerOGL::CreateFBOWithTexture with "error 0x8cdd" (Manuela Muntean)
• [DONE] bug 863063 quitting private browsing mode does not delete partially downloaded files (Manuela Muntean)
• [DONE] bug 880042 file[multiple] form field nsIFilePicker crash if overriding component has not implemented a domfiles getter (Firefox 22+) (Manuela Muntean)
• [DONE] bug 859715 SocialServiceInternal.providers is undefined (Manuela Muntean)
  • Note: automated test exists
• [DONE] bug 833333 Autocompletion should be smarter and fill any common prefix of the available suggestions (Manuela Muntean)
• [DONE] bug 858800 crash in mozilla::plugins::MiniShmBase::GetWritePtr (Manuela Muntean)
• [DONE] bug 854319 crash in mozilla::MediaResource::`.* deleting destructor (Manuela Muntean)
• [DONE] bug 877612 Cannot enter into fullscreen mode after print dialog is opened (Bogdan Maris)
• [DONE] bug 870794 [snappy] View Source renders very slowly on large pages. Freezes Firefox for 5-45 seconds. (Bogdan Maris)
• [DONE] bug 879999 crash [@ fsmdef_ev_setremotedesc] Fix null deref in SetRemoteDescription (Bogdan Maris)
• [DONE] bug 845397 Requesting access to your camera when it's in use by an external program still shows a visible indicator that the camera is in use (Bogdan Maris)
• [DONE] bug 583175 Add a security delay to the main action of PopupNotifications (Bogdan Maris)
• [DONE] bug 711043 (Mihaela Velimiroviciu)
• [DONE] bug 878392 (Mihaela Velimiroviciu)
• [DONE] bug 878751 (Mihaela Velimiroviciu)
  • need more info
• [DONE] bug 876155 (Mihaela Velimiroviciu)
  • need more info
• [DONE] bug 865537 (Mihaela Velimiroviciu)
  • need more info

Update Tests

The following is the results of the Mozmill automated update tests.

Platform	Betatest [dashboard]	Releasetest [dashboard]	Beta [dashboard]
Windows XP	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows Vista	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows 7 32-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows 7 64-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows 8 32-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Windows 8 64-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Mac OSX 10.6	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Mac OSX 10.7	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Mac OSX 10.8	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Ubuntu 12.04 32-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS
Ubuntu 12.04 64-bit	[DONE] - PASS	[DONE] - PASS	[DONE] - PASS

New Issues

The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.

• bug 882730 - Rules box not overlapping every button when stretched to left side - Normal (Bogdan Maris)

Beta 6

Builds	FTP, HTTP
ID	20130617145905
Changeset	9f0d4fe5db55 (pushlog)

Checklist

• [ON TRACK] Automated Tests
• [ON TRACK] Regression Tests
• [ON TRACK] Bug Fix Verifications
• [ON TRACK] Update Tests (betatest)
• [ON TRACK] Update Tests (releasetest)
• [ON TRACK] Update Tests (beta)

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Results [dashboard]
Windows XP	[ON TRACK] en-US & da
Windows Vista	[ON TRACK] en-US & it
Windows 7 32-bit	[ON TRACK] en-US & zh-TW
Windows 7 64-bit	[ON TRACK] en-US & ro
Windows 8 32-bit	[ON TRACK] en-US & es-ES
Windows 8 64-bit	[ON TRACK] en-US & pt-BR
Mac OSX 10.6	[ON TRACK] en-US & de
Mac OSX 10.7	[ON TRACK] en-US & fr
Mac OSX 10.8	[ON TRACK] en-US & it
Ubuntu 12.04 32-bit	[ON TRACK] en-US & de
Ubuntu 12.04 64-bit	[ON TRACK] en-US & fr

Known test failures in bugzilla

Regression Tests

As per the checklist we will regression test the following areas.

Test	Windows 7 64-bit	Windows 8 32-bit	Mac OSX 10.6	Ubuntu 12.10 64-bit	Mac OSX 10.5	Windows 2000
Breakpad end-to-end functionality	[DONE] Mihai Morar	[DONE] Alexandra Lucinet	[DONE] Bogdan Maris	[DONE] Manuela Muntean	N/A	N/A
Mac OSX 10.5 and Windows 2000 de-support (install and update)	N/A	N/A	N/A	N/A	[DONE] Mihaela Velimiroviciu	[DONE] Mihaela Velimiroviciu
NVidia 3D compatibility	[ON TRACK]	N/A	N/A	N/A	N/A	N/A
Web Compatibility (search, webmail, banking, video, audio, gaming, news, cms, etc.)	[DONE] Mihai Morar	[ON TRACK] Alexandra Lucinet	[ON TRACK] Bogdan Maris	[DONE] Manuela Muntean	N/A	N/A
WebRTC Spot Check and Bug Triage	[ON TRACK] Mihai Morar	[ON TRACK] Alexandra Lucinet	[ON TRACK] Bogdan Maris	[ON TRACK] Manuela Muntean	N/A	N/A

Details:

• Breakpad end-to-end functionality
  • ensure that crash reports are submitted with the current build,
  • use this Moztrap test as a rough guideline.
• Platform de-support
  • Ensure that platforms which are no longer supported do not receive software updates to this Beta.
• Web compatibility
  • ensure that web content stays compatible to Firefox and is stable.
  • search, webmail, banking, video, audio, gaming, news, cms, etc.
• WebRTC Bug Triage
  • [DONE] bug 801385 (Manuela Muntean)
  • [ON TRACK] bug 844071 (Alexandra Lucinet) - NEEDINFO

Bug Fix Verifications

List of fixed bugs in Firefox where the status for Firefox 22 is set to fixed and need verification: http://mzl.la/15LLemh

• [DONE] bug 855502 we need a proper design for the new checkboxes (Cornel Ionce)
• [DONE] bug 850513 [style inspector] Remove notification when navigating away with unsaved changes (Cornel Ionce)
• [DONE] bug 833823 Random, unpredictable behavior with multiple YouTube embeds (Ioana Budnar)
• [DONE] bug 743252 Don't print the URL and other information when printing PDFs (Ioana Budnar)
• [ON TRACK] bug 864478 Unable to upload receipt to our Health and Wellness provider (Ioana Budnar) - NEEDINFO

Update Tests

The following is the results of the Mozmill automated update tests.

Platform	Betatest [dashboard]	Releasetest [dashboard]	Beta [dashboard]
Windows XP	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Windows Vista	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Windows 7 32-bit	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Windows 7 64-bit	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Windows 8 32-bit	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Windows 8 64-bit	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Mac OSX 10.6	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Mac OSX 10.7	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Mac OSX 10.8	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Ubuntu 12.04 32-bit	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT
Ubuntu 12.04 64-bit	[ON TRACK] - RESULT	[ON TRACK] - RESULT	[ON TRACK] - RESULT

New Issues

The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.

Known Issues

Full Query

ID	Summary	Priority	Status
449392	Running the Java Applet Video Player together with scrolling the Site causes paint error	--	RESOLVED
742573	Remove fullscreen button from controls in top level audio element	--	RESOLVED
807673	Social chat panels are not displayed right when resizing Firefox vertically	--	RESOLVED
825329	Properly get the playbackRate from the AudioClock.	--	RESOLVED
854923	Resize window icon is not visible	--	RESOLVED
870779	Video area is also shown for audio files	--	RESOLVED
870825	Font Inspector (built in) displayed in a separate window loses focus after re-opening it in a second Firefox window	--	RESOLVED

7 Total; 0 Open (0%); 7 Resolved (100%); 0 Verified (0%);

QAWANTED

QAWANTED: triage these bugs and test to fulfill the QA request

UNCONFIRMED

UNCONFIRMED: triage these bugs for potential new regressions