MozillaWiki

Releases/Firefox 24 ESR/Test Plan

< Releases
Revision as of 07:25, 24 October 2013 by Manuela.muntean (talk | contribs) (→‎Bug Fix Verifications)

Firefox 24 ESR

Builds FTP, HTTP
ID 20130910201120
Changeset c5fc2f003e4d (pushlog)
Checklist
  • [DONE] Functional automation
  • [DONE] Manual tests
  • [DONE] Bug fix verifications

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results (report)
Windows XP PASS
Windows Vista PASS
Windows 7 32-bit PASS
Windows 7 64-bit PASS
Windows 8 32-bit PASS
Windows 8 64-bit PASS
Mac OS X 10.6 PASS
Mac OS X 10.7 PASS
Mac OS X 10.8 PASS
Ubuntu 12.04 32-bit PASS
Ubuntu 12.04 64-bit PASS

Manual Smoketests

Run the Firefox ESR 24 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 8 32-bit Manuela Muntean [DONE]
Windows 7 64-bit Mihai Morar [DONE]
Mac OS X 10.7 Bogdan Maris [DONE]
Ubuntu 12.04 32-bit Petruta Rasa [DONE]


Additional Spotchecks
  • Pave-over install of FF24esr over FF17esr [DONE]
    • From 17.0.x to 24
    • From 17.0.8 to 24
    • From 17.0.9 to 24
  • Firefox Desktop : Sync : Account [DONE]
    • Moztrap tests
    • Notes/Issues:
      • on Win 8 32bit, Ubuntu 32bit and Mac OS X 10.7.5: regarding "View and dismiss Sync discovery notifications" test -> there is no "browser.syncPromoViewsLeft" option in "about:config"
  • Show PDF inline Smoketests [DONE]
    • Moztrap tests
    • Notes/Issues:
      • on Win 8 32bit, Ubuntu 32bit and Mac OS X 10.7.5: "Display embedded PDF" test fails, because the PDF embedded with the object tag isn't displayed; known issue: see bug 738967
  • SocialAPI Service Management [DONE]
  • Mixed Content Blocker [DONE]
    • Moztrap tests
    • Notes/Issues:
      • on all platforms:
        • the behavior explained in bug 906190 is encountered
        • the prefs used in the test cases aren't the correct ones; these are the correct prefs: "security.mixed_content.block_active_content" and "security.mixed_content.block_display_content"

Bug Fix Verifications

  • [DONE] bug 633001 VERIFIED: SSL cannot set exceptions on IPv6 addresses
  • [DONE] bug 888820 VERIFIED: Crash in nsHtml5TreeBuilder
  • [DONE] bug 887334 NOT VERIFIED: GC hazard with default compartments and frame chain restoration
    • No test case or STR. Also, developer has created his own tests.
  • [DONE] bug 874952 VERIFIED: Always create enough last chunks for an engine, even if we don't end up calling into its ProduceAudioBlock function
  • List of all security bugs verified in FF24

Issues

New
Known


Firefox 24.1 ESR

Builds FTP, HTTP
ID 20131021230807
Changeset b6aa22c418f4 (pushlog)
Checklist
  • {{|}} Functional automation
  • {{|}} Manual smoketests
  • [ON TRACK] Bug fix verifications
  • {{|}} Update automation on esrtest
  • {{|}} Conditional sign-off for push to mirrors
  • {{|}} Update automation on releasetest
  • {{|}} Final sign-off for push to esr
  • {{|}} Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform Functional [report]
Windows XP
Windows Vista
Windows 7 32-bit
Windows 7 64-bit
Windows 8 32-bit
Windows 8 64-bit
Mac OS X 10.6
Mac OS X 10.7
Mac OS X 10.8
Ubuntu 12.04 32-bit
Ubuntu 12.04 64-bit
Ubuntu 13.04 32-bit
Ubuntu 13.04 64-bit

Manual Smoketests

Run the Firefox ESR 24.1 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 8 32-bit
Windows 7 64-bit
Mac OS X 10.7
Ubuntu 12.04 32-bit

Update Testing

  • Complete: 24.0
Platform Target Version esrtest releasetest esr
Windows XP Firefox 24.0
Windows Vista Firefox 24.0
Windows 7 32-bit Firefox 24.0
Windows 7 64-bit Firefox 24.0
Windows 8 32-bit Firefox 24.0
Windows 8 64-bit Firefox 24.0
Mac OS X 10.6 Firefox 24.0
Mac OS X 10.7 Firefox 24.0
Mac OS X 10.8 Firefox 24.0
Ubuntu 12.04 32-bit Firefox 24.0
Ubuntu 12.04 64-bit Firefox 24.0
Ubuntu 13.04 32-bit Firefox 24.0
Ubuntu 13.04 64-bit Firefox 24.0

Bug Fix Verifications

  • [DONE] bug 913614 NO VERIFY: For lines and rectangles, skip the work when the input is invalid
    • Verification of related bug is enough
  • [DONE] bug 914667 VERIFIED: PDF viewer doesn't resolve base URIs properly
  • [DONE] bug 897678 VERIFIED: Make worker code stop using propertyops, as a step toward removing propertyops altogether.
  • [DONE] bug 918864 VERIFIED: Improve doStopDocumentLoad
  • [DONE] bug 914017 VERIFIED: Initialize members variables of the document hash correctly. (mwobensmith)
  • [DONE] bug 916580 NO VERIFY: Fix bugs related to the usage of calloc (mwobensmith)
    • No test case
  • [DONE] bug 916404 NO VERIFY: ContentIsHostIncludingDescendantOf,
    • Can't reproduce, relying on reporter's verification
  • [DONE] bug 869406 NO VERIFY: Really enforce non-parallel build of ICU.
    • Can't verify, no test case
  • [ON TRACK] bug 910881 NOT VERIFIED: Do not call RasterImage::DoError off the main thread. (Ioana)
    • Still crashes, cannot mark bug as verified
  • [DONE] bug 916404 NO VERIFY, relying on reporter
  • [DONE] bug 838105 VERIFIED: Don't rely on key lookup to remove items from the user font cache, as the principal could have changed (Cornel)
  • [DONE] bug 788031 VERIFIED: For object/embed/applet tags, pass baseURI to shouldProcess if mURI is null.
  • [DONE] bug 868327 VERIFIED: Only allow the drop-down menu to open above the combobox if there is room for it, otherwise open it below even though it doesn't fit.
  • [DONE] bug 911158 VERIFIED: Removal of URL Protocol from FirefoxURL causes problems for some users. (Ioana)
  • [DONE] bug 916126 VERIFIED: Move IDL addition to the end of the IDL since we're not bumping the IID, (Manuela)
  • [DONE] bug 915210 VERIFIED: Improve GetPresContext
  • [DONE] bug 860123 VERIFIED: Disallow extending or collapsing selections across documents.
  • [DONE] bug 916576 VERIFIED: Follow the com rules when calling LoadURI.
  • [DONE] bug 921090 NO VERIFY: Upgrade Firefox to NSS 3.15.2
    • All-or-nothing change, can't easily verify just this fix
  • [DONE] bug 917160 VERIFIED: AssureBlitted before switching EGLSurfaces with MakeCurrent. (Cornel)
  • [DONE] bug 914618 VERIFIED: Reimplement XML pretty printing with events
  • [DONE] bug 916685 NO VERIFY: No need to store empty event handlers no verify,
    • Can't reproduce, relying on reporter's verification

Issues

New

Known

Full Query
ID Summary Priority Status
918864 [FIX] Heap-use-after-free in nsDocLoader::doStopDocumentLoad() -- RESOLVED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

Retrieved from "https://wiki.allizom.org/index.php?title=Releases/Firefox_24_ESR/Test_Plan&oldid=735959"