MozillaWiki

QA/TDAI/Inventory: Difference between revisions

Page Discussion

QA/TDAI/Inventory (view source)

Revision as of 23:30, 23 April 2010

9,848 bytes added ,  23 April 2010
m
→‎Suites? Harnesses? Tests?: correct punctuation
(→‎Test Harnesses: fix link brackets)
m (→‎Suites? Harnesses? Tests?: correct punctuation)
 
(45 intermediate revisions by 7 users not shown)
Line 1: Line 1:
<small>[[QA/TDAI|&laquo; QA/TDAI]]</small>
{{draft}}
=== Suites? Harnesses? Tests? ===
We all want quality to happen. How can we help? What is being run? What can I run something with? What does any of this mean? Not all questions are answered, but some.
We all want quality to happen. How can we help? What is being run? What can I run something with? What does any of this mean? Not all questions are answered, but some.


Line 7: Line 13:
# Test Infrastructure - the environments the test tools and test cases run in. This includes machine, operating system and physical location (ex: QA farm vs QA lab vs someone's desktop)
# Test Infrastructure - the environments the test tools and test cases run in. This includes machine, operating system and physical location (ex: QA farm vs QA lab vs someone's desktop)


{{draft}}
There are questions to be answered about any of our tests. If anyone has information or suggestions, please [mailto:rkiddy@mozilla.com let us know].
 
# What tests do we have now, how current are they and how they should be run? Should they be expected to pass?
# What features or modules need tests to be written for them? What are the requirements of the testing that should happen?
# What tools do we have now that can be used to write tests? What tools outside of mozilla have people used to build tests and test tools?
# Of the tests currently in existence, which of them are outside the "mozilla.org" umbrella? Which use resources from outside? What is the reliability and accessibility of these resources? Are there issues which keep us  from keeping local copies?
 
Any questions and suggestions are welcome!
 
=== Criteria for Colors ===
 
<div class="note">'''NOTE''': that judgments are subjective and not "hard and fast". Caring enough to discuss will change a rating. Not caring enough to discuss is explanation enough.</div>
 
* Green: Generously defined now. Info is current or findable. Something is buildable and runnable by someone. There may still be obvious improvements needed.
* Yellow: Little may be known. Probably not completely broken. Work to bring current is unknown.
* Red: Obviously broken or missing. Info not findable. People not locatable.
 
= Test Harnesses =
= Test Harnesses =


{| class="fullwidth-table"
{| class="fullwidth-table"
| style="background:#efefef" | '''Test Harness Name'''
!Test Harness Name
| style="background:#efefef" | '''Brief Description'''
!Brief Description
| style="background:#efefef" | '''Language Used'''
!Language Used
| style="background:#efefef" | '''Status of Harness'''
!Status of Harness
| style="background:#efefef" | '''Notes'''
!Notes
|-  
|-  
| MochiTest
| MochiTest
| based on the MochiKit framework
| built by [mailto:sayrer@gmail.com sayrer] using the [http://www.mochikit.com MochiKit] framework
| JavaScript
| JavaScript
| Invocation by buildbot on QA machines is being set up. Invocation of tests by inidividuals on built trunk is possible with setup. Currently being made to work in automated test harnesses.
| Automation being set up on QA Farm. Exec by community is possible.
| [http://developer.mozilla.org/en/docs/Writing_MochiTest-based_unit_tests MochiTest on devmo]
| [[mdc:Writing MochiTest-based unit tests|mochitest]]
|-
|-
| jsunit
| reftest
|  
| comparison of two pages, via JavaScript and Canvas, for visual equivalency
| JavaScript
| runnable on built trunk. There is a list of [[mdc:reftest opportunities files|reftest opportunities]], but it is not clear if we want to use them.
| [[mdc:Creating reftest-based unit tests|reftest]]
|-
| xpcshell
| used by 40+ tests, plans for use by many more
| JavaScript
| JavaScript
|
| recent care and feeding, very usable
|  
| [[mdc:Writing_xpcshell-based_unit_tests|xpcshell]]
|-
|-
| Acid2
| eggplant
| Web Standards Project compliance test page(s)
|
|  
|  
| [http://www.webstandards.org/action/acid2/ Stds page]
| uses VNC for device-level visual comparisons
| Being used for automation of Smoke Tests suites in [http://litmus.mozilla.org litmus]
| [http://www.redstonesoftware.com/ redstone]
|-
|-
| litmus
| litmus
| Catalog of manual test cases
| Catalog of manual test cases. [[Litmus|Being developed]] to allow community to [http://litmus.mozilla.org/run_tests.cgi run] the manual smoke tests, BFT, FFT and L10n tests. [http://litmus.mozilla.org/search_results.cgi GUI to capture results] and provide feedback to the QA team.  Reporting function to check test and platform coverage.
| English, German, French, etc.
| English, German, French, etc.
| The place to be on Community Test Day!
| The place to be on Community Test Day! Still in refinement by [mailto:zlipton@mozilla.com zlipton] and [mailto:ccooper@deadsquid.com coop]. 2445 test cases, 1994 tester accounts with 845 active
| [http://litmus.mozilla.org main site]
| [http://litmus.mozilla.org litmus]
|-
|-
| xpcshell
| T*
| lots of under-the-hood XPCOM smarts!
| perf tests, runs in tinderbox
| some JavaScript, much C++
|
|  
| running, passing, run by tinderbox
| [http://developer.mozilla.org/en/docs/Writing_xpcshell-based_unit_tests xpcshell on devmo]
| [[MozillaQualityAssurance:Performance_Testing|wiki]]
|-
|-
| SpiderMonkey
| test.js
| used only for the js/tests by bc, et al, for JS testing
| custom harnesses
| JavaScript
| JavaScript
|  
| an opportunity for consolidation
| [http://bclary.com/projects/spider/ bc's page]
| [http://lxr.mozilla.org/mozilla/source/toolkit/components/feeds/test/test.js] [http://lxr.mozilla.org/mozilla/source/suite/common/history/history-test.js] [http://lxr.mozilla.org/mozilla/source/webtools/lxr/tests/syntax-highlighting/test.js] [http://lxr.mozilla.org/mozilla/source/intl/strres/tests/strres-test.js] [http://lxr.mozilla.org/mozilla/source/content/xslt/tests/buster/buster-test.js] [http://lxr.mozilla.org/mozilla/source/content/xslt/tests/XSLTMark/XSLTMark-test.js] [http://lxr.mozilla.org/mozilla/source/cck/muc/test/test.js] [http://lxr.mozilla.org/mozilla/source/js2/tests/js/dinkytest.js] [http://lxr.mozilla.org/mozilla/source/layout/tools/reftest/reftest.js] [http://lxr.mozilla.org/mozilla/source/js/tests/js1_2/regexp/test.js] [http://lxr.mozilla.org/mozilla/source/js/jsdj/test/jsdb.bat] [http://lxr.mozilla.org/mozilla/source/js/jsd/jsdb/test.js] [http://lxr.mozilla.org/mozilla/source/js/src/xpconnect/tests/js/old/simpletest.js] [http://lxr.mozilla.org/mozilla/source/js/rhino/toolsrc/org/mozilla/javascript/tools/debugger/test.js] [http://lxr.mozilla.org/mozilla/source/extensions/webservices/interfaceinfo/tests/ifaceinfotest.js] [http://lxr.mozilla.org/mozilla/source/extensions/sql/sqltest/sqltest.js]
|-
|-
| reftest
| Spider
| comparison of two pages, via JavaScript and Canvas, for visual equivalency
| crawls a site to specified depth, loading CSS, executing JS along the way.
| JavaScript
| JavaScript
| runnable on built trunk
| used only for the [http://lxr.mozilla.org/mozilla/source/js/tests js/tests] by [mailto:bc@mozilla.com bc], et al, for JS testing
| [http://developer.mozilla.org/en/docs/Creating_reftest-based_unit_tests reftest on devmo]
| [http://bclary.com/projects/spider/ bc]
|-
|-
| jssh
| build/make
| a javascript shell. What more can you say?
| a [[Creating_StandAlone_Executable_Tests|standard for invoking stand-alone test executables]], and for integrating invocation of other harnesses into MoCo automated systems
| JavaScript
| described as "largely defunct"
|
|-
| Tp
| test of page loading
|
| currently runs in tinderbox
|  
|  
| "make check" is accepted standard, being integrated with buildbot
| [http://tinderbox.mozilla.org/showbuilds.cgi?tree=MozillaTest tinderbox]
|-
|-
| Tp2
| XULUnit
| test of page loading
| "XulUnit is a simple, yet powerful and easy to use framework for Unit Testing in XUL applications (XPFE)."
|
| being developed to run in buildbot
|
|
| any info known? please [mailto:rkiddy@mozilla.com share].
| [http://xulunit.mozdev.org xulunit.m.o]
|-
|-
| T*
|litmus2
| includes Tdhtml, Ts, Txul, Trender (aka Tgfx), Z, and mZ
|redesign/rework of the test case management tool.
|
|
| [http://wiki.mozilla.org/Performance:Tinderbox_Tests most T] [http://wiki.mozilla.org/Mozilla2:Trender Trender]
|-
| 'Browser and Eyeballs'
| The most common test harness in use today.
| wetware
| There is a new tester born every day! :-)
|
|
|in idea phase
|[https://wiki.mozilla.org/index.php?title=QA/TDAI/Inventory:notes notes]
|}
|}


Line 93: Line 109:


{| class="fullwidth-table"
{| class="fullwidth-table"
| style="background:#efefef" | '''Test Suite Name'''
!
| style="background:#efefef" | '''Brief Description'''
!Test Suite Name
| style="background:#efefef" | '''Test Harness(es)'''
!Brief Description
| style="background:#efefef" | '''Status'''
!Test Harness(es)
| style="background:#efefef" | '''Notes'''
!Status
| style="background:#efefef" | '''Owner'''
!Last Info
|-  
|-  
| JS tests
| style="background:#00ff00" |
| well-developed suite of tests of the JavaScript language
| [http://lxr.mozilla.org/mozilla/source/js/tests/ js/tests]
| Custom framework in [http://lxr.mozilla.org/mozilla/source/js/tests/ js/tests]. Runs on QA Farm.
| [http://www.mozilla.org/js/tests/library.html well-developed suite] of tests of the JavaScript language in [http://lxr.mozilla.org/mozilla/source/js/tests/ js/tests]
| [http://bclary.com/projects/spider/ SpiderMonkey] Runs on QA Farm. Stable and not necessary to use or share.
| Semi-automated.  Plans to fully automate with Alice and Rob's help in Q1 2007
| Semi-automated.  Plans to fully automate with Alice and Rob's help in Q1 2007
| Run in customized harness, stable and not necessary to use or share.
| Info is current. See [mailto:bc@mozilla.com bc], [mailto:alice@mozilla.com alice], [mailto:rcampbell@mozilla.com robcee].
| [mailto:bc@mozilla.com bc]
|-
|-
| style="background:#00ff00" |
| Security tests
| Security tests
|  
|  
| Custom framework.  Runs on QA Farm.
| Custom framework.  Runs on QA Farm. When bugs were filed, regression test cases are usually added.
| Semi-automated.  Plans to fully automate with Eggplant in Q1 2007
| Semi-automated.  Plans to fully automate with Eggplant in Q1 2007
| When bugs were filed, regression test cases are usually added.
| Info is current. See [mailto:bc@mozilla.com bc], [mailto:jruderman@gmail.com jruderman]. Definite opportunity to mine bugs for test cases.
| bc@mozilla.com
|-
|-
| Automated Smoke Tests - FFx 1.5
| style="background:#00ff00" |
|
| Automated Smoke Tests
| Eggplant.  Runs on Tracy's machines.
| Fully automated.  Completed porting to Mac and Linux in Q4 2006.  Plan to move  executiion to QA Farm in Q1 2007
| A "Smoke Test" is a quick, basic qualification.
| A "Smoke Test" is a quick, basic qualification.
| tracy@mozilla.com
| Eggplant. Runs on Tracy's machines. Tests for FFx 1.5 and 2.0
|-
| Fully automated.  Completed porting to Mac and Linux in Q4 2006.  Plan to move execution to QA Farm in Q1 2007
| Automated Smoke Tests - FFx 2.0
| Info is current. See [mailto:twalker@mozilla.com tracy].
|
| Eggplant, runs on Tracy's machines. Originally a litmus suite.
| Fully automated.  Completed porting 1.5 tests to the 3 platforms for 2.0 in Q4 2006.  Plan to move execution to QA Farm in Q1 2007
|  
| tracy@mozilla.com
|-
|-
| style="background:#00ff00" |
| Basic Functionality Tests (BFT)
| Basic Functionality Tests (BFT)
| 130+ manual test cases, broadly covering major features
| 130+ manual test cases, broadly covering major features
| for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=7 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=25 2.0]
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=7 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=25 2.0]
|
| will be updated for FF3
|  
| Info is current. See [mailto:marcia@mozilla.org marcia], [mailto:timr@mozilla.com timr].
|
|-
|-
| style="background:#00ff00" |
| Full Functionality Tests (FFT)
| Full Functionality Tests (FFT)
| approx. 280 manual test cases, covering most features
| approx. 280 manual test cases, covering most features
| for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=2 1.0], [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=26 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=27 2.0]
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=2 1.0], [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=26 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=27 2.0]
|
| will be updated for FF3
|  
| Info is current. See [mailto:marcia@mozilla.org marcia], [mailto:timr@mozilla.com timr].
|
|-
|-
| style="background:#00ff00" |
| Localization Tests
| Localization Tests
| 15 test cases
| 15 test cases
| for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=10 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=39 2.0]
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=10 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=39 2.0]
|
| engaged and open to design
|  
| Info is current. Proposed designs and issues current in newsgroups. See [mailto:axel@mozilla.com axel]
|
|-
|-
| style="background:#00ff00" |
| Software Update Suite
| Software Update Suite
| approx. 50 tests, targeted to update process itself
| approx. 50 tests, targeted to update process itself
| [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38 litmus]
| [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38 litmus]
|  
|  
| Info is current. See [mailto:bc@mozilla.com bc].
|-
| style="background:#00ff00" |
| T*
| includes Tdhtml, Ts, Txul, [[Trender]] (aka Tgfx), Z, and mZ, [[Performance:Tinderbox_Tests|wiki for most T]]
|
| running, but not growing
| Info is current. Tests need transition to buildbot. See [mailto:rcampbell@mozilla.com robcee], [mailto:timr@mozilla.com timr].
|-
| style="background:#00ff00" |
| Accessibility
| [[Accessibility/qa]]
|  
|  
| Info is current. A lot is going on, but opportunities to automate are not as developed as they could be. See [mailto:aaronleventhal@moonset.net Aaron Leventhal].
|
|-
|-
| Browser/Content
| style="background:#00ff00" |
| Will be transitioned to reftest or MochiTest, as appropriate.
| Update Checker
| [[Custom Test Executables|custom executable/C++]]
| validity of update mar files
| currently automated on release machines, moving to buildbot, [[MozillaQualityAssurance:Update_Checker|wiki]]
|  
|  
| Info is out of date. See [mailto:rhelmer@mozilla.com rhelmer].
|-
| style="background:#00ff00" |
| L10n checker/metadiff
| verify that :<ul><li>en-US build matches locale build</li><li>ensure no read-only files</li><li>show differences from last release</li>
|  
|  
browser/components/places=9<br>browser/components/safebrowsing=1<br>browser/components/sessionstore=1<br>content/base=9<br>content/events=0<br>content/html/content=15<br>content=10<br>content/xml=35<br>content/xslt=23<br>content/xslt/XSLTMark=5
| currently automated on release machines, moving to buildbot, [[MozillaQualityAssurance:MetaDiff|wiki]]
| Info is out of date. See [mailto:rhelmer@mozilla.com rhelmer].
|-
| style="background:#00ff00" |
| Tp2
| new page load tests
| "make check"/buildbot
| nearing complete automation
| Info is current. Being integrated into automation. See [mailto:alice@mozilla.com alice], [mailto:rcampbell@mozilla.com robcee].
|-
| style="background:#00ff00" |
| Download Checker
| verify integrity of major released
| manual, [[MozillaQualityAssurance:Download_Checker|wiki]]
| runnable, passing
| Info is current. See [mailto:bc@mozilla.com bc].
|-
| style="background:#00ff00" |
| L10N Search Verifier
|
|
| manual, [[MozillaQualityAssurance:l10n_Search_Verifier|wiki]]
| runnable, passing
| Info is current, but current plans are unclear.
|-
|-
| Buster
| style="background:#00ff00" |
| [http://lxr.mozilla.org/mozilla/source/content/xslt/tests/buster content/xslt/tests/buster]
| re-purposing of the Adobe Xalan tests.
| re-purposing of the Adobe Xalan tests.
| [[Custom Test Executables|custom executable/C++]]
| [[Custom Test Executables|custom executable/C++]]
| Driver is in mozilla, but test content gets re-downloaded.
| Driver is in mozilla, but test content is at Apache.
| content/xslt/buster<br>I have received info from Jonas on the location of this.
| Info is current, but current run occasionally. Need automation.
|
|-
|-
| style="background:#00ff00" |
| DOM
| DOM
|  
| being transitioned into MochiTest
| browser and eyeballs?
| browser and eyeballs?
|  
|  
| Info is currrent. More tests to be transitioned. See [mailto:robert@ocallahan.org roc], [mailto:rcampbell@mozilla.com robcee].
|-
| style="background:#00ff00" |
| CSS
| verify spec compliance
| reftest
| running, passing, needing much to be added
| Info is current. More tests needed. See [mailto:rcampbell@mozilla.com robcee], [mailto:dbaron@mozilla.com dbaron].
|-
| style="background:#ffff00" |
| XBL2
| [[MozillaQualityAssurance:Test_Development_Projects#Platform_Content_Area|wiki]]
|  
|  
|
| XBL2 still in design
| Info is current. [mailto:jonas@sicking.cc jonas]
|-
| style="background:#ffff00" |
| Browser/Content
| May be transitioned to reftest or MochiTest, as appropriate.
| [[Custom Test Executables|custom executable/C++]]
|
| Info is current. Several groups of tests need to be seperated, given TLC, automation.
|-
|-
| style="background:#ffff00" |
| Embedding
| Embedding
|  
| Tests seem fairly current but not building, why?
| [[Custom Test Executables|custom executable/C++]]
| [[Custom Test Executables|custom executable/C++]]
|
|
|
| Info is in source, but not sure of source for more info.
|
|-
|-
| style="background:#ffff00" |
| Extensions
| Extensions
|  
|  
| [[Custom Test Executables|custom executable/C++]]
| [[Custom Test Executables|custom executable/C++]]
|  
|  
| extensions/canvas3d=6<br>extensions/java/xpcom=10<br>extensions/metrics=5<br>extensions/mono=5<br>extensions/python=31<br>extensions/schema-validation=9<br>extensions/spatialnavigation=5<br>extensions/universalchardet=2<br>extensions/webdav=1
| Info is in source, but not sure of source for more info.
|
|-
| style="background:#ffff00" |
| Java Applets
| list suggested by Java team at Apple
| browser and eyeballs, [[MozillaQualityAssurance:Test_JavaApplets|wiki]]
| Just a list. No automation is currently in process.
| Info is current. See [mailto:rkiddy@mozilla.com ray].
|-
| style="background:#ffff00" |
| I18N
|
| [[Custom Test Executables|custom executable/C++]]
|
| Info is current, but not sure of approach to automation plans.
|-
|-
| style="background:#ffff00" |
| Graphics
| Graphics
|  
|  
| [[Custom Test Executables|custom executable/C++]]
| [[Custom Test Executables|custom executable/C++]]
|  
|  
| gfx=8
| Info is current, but tests will need to be made current. Match to external Cairo testing for relevance.
|
|-
|-
| style="background:#00ff00" |
| HTML Parsing
| HTML Parsing
|  
| Will need to deal with WHATWG/html5lib tests {{bug|366936}}. The htmlparser/tests/html test vs a baseline, but a baseline has not been stored.
| [[Custom Test Executables|custom executable/C++]] (non-functioning). Moving to WHATWG/html5lib tests [[https://bugzilla.mozilla.org/show_bug.cgi?id=366936 366936]]
| [[Custom Test Executables|custom executable/C++]]  
|
|
| [[http://lxr.mozilla.org/mozilla/source/parser/htmlparser/tests/html/README README]]<br>parser/htmlparser=327
| Info is in source. Other source of info is unclear (perhaps [mailto:mrbkap@mozilla.com mrbkap]?)
| Blake Kaplan
|-
|-
| I18N
| style="background:#00ff00" |
|  
| Acid2
| [[Custom Test Executables|custom executable/C++]]
| compliance tests from outside standards "watcher"
|  
| manually executed, [http://www.webstandards.org/action/acid2/ Acid2 Browser Test]
| intl=37
| currently passing
|
| Info is current. See [mailto:timr@mozilla.com timr].
|-
|-
| style="background:#ffff00" |
| XPConnect
| XPConnect
|  
| TestXPC -> "FAILED to get a JSRuntime"
| [[Custom Test Executables|custom executable/C++]]
| [[Custom Test Executables|custom executable/C++]]
|  
|  
| js/src/xpconnect=142
| Info is in source, but not sure of source for more info.
|
|-
|-
| style="background:#00ff00" |
| Layout/HTML
| Layout/HTML
|  
| 1800+ files. These can be transitioned, probably to reftest. HTML file groups: CellMapTest, FrameSetNav, SlideShow, attributes, block, css, formctls, frameset, printer, style, table, tags, xbl.
| "the old regression test suite" and reftest. Older tests will go to reftest.
| "the old regression test suite" and reftest. Older tests will go to reftest.
|  
|  
| There are a lot of test files here. It is hard to say how current or correct they are.
| Info is current, but a lot of tests need TLC, automation.
|
|-
|-
| Math/ML
| style="background:#ffff00" |
| MathML
| Do mathematical glyphs display correctly on all platforms?
| Do mathematical glyphs display correctly on all platforms?
| "browsers and eyeballs"
| "browsers and eyeballs"
| also using w3c.org site content
| also using w3c.org site content
| layout/mathml=7
| Info is current, May be able to automate with reftest.
|-
| style="background:#ffff00" |
| Plugins
|
|
|
| Not known
| Info is in source, but not sure of source for more info.
|-
|-
| ???
| style="background:#ffff00" |
| Java Plugin
|  
|  
|
|  
|  
| modules/libjar=4<br>modules/oji=758<br>modules/plugin=63
| not current, dev may feel out of loop
|
| Info is current, but not sure of approach to automation plans.
|-
|-
| style="background:#00ff00" |
| Networking
| Networking
|  
| 25 test executables, but all must be given parameters
| [[Custom Test Executables|custom executable/C++]]
| [[Custom Test Executables|custom executable/C++]]
|  
|  
| netwerk=121
| Info is in source, but not sure of source for more info.
|
|-
|-
| style="background:#ffff00" |
| NSPR
| NSPR
|
| approx 150 test executables, most pass.
| custom executable/c
| custom executable/c
|  
|  
| nsprpub/lib=3
| Info is in source, but not sure of source for more info.
|
|-
|-
| style="background:#ffff00" |
| RDF
| RDF
|  
|  
| [[Custom Test Executables|custom executable/C++]]
| [[Custom Test Executables|custom executable/C++]]
|
| dsds (not being built), rdfcat, rdfpoll, triplescat (doc for invoke?)
| rdf=11
| Info is in source, but not sure of source for more info.
|
|-
|-
| style="background:#00ff00" |
| Security/NSS
| Security/NSS
|  
| 26 tests, but not runnable without info
| [[Custom Test Executables|custom executable/C++]] and "make check"
| [[Custom Test Executables|custom executable/C++]] and "make check"
|
|
| security/dbm=0<br>security/nss=56
| Info is current. NSS tests run externally. Need tests relevant to MoCo.
|
|-
|-
| style="background:#00ff00" |
| XPCOM
| XPCOM
|
| 28 custom executables, most pass, can be better documented, xpcom/tests/unit/test_pipe.js (xpcshell)
| [[Custom Test Executables|custom executable/C++]]
| [[Custom Test Executables|custom executable/C++]]
|  
|  
| xpcom/proxy=6<br>xpcom=66
| Info is current, but not sure of source for more info.
|
|-
|-
| style="background:#ffff00" |
| XPFE
| XPFE
| winopen.xul, runs but does not show final results
|  
|  
| JavaScript/XULRunner?
|
|
| xpfe=3
| Info is in source, but not sure of source for more info.
|-
| style="background:#ffff00" |
| XPInstall
| pre_checkin_trigger.html, runs in browser, passes
|
|
| Info is in source, but not sure of source for more info.
|}
 
= External Resources/Tests =
 
{| class="fullwidth-table"
!Test&nbsp;Resource
!Brief&nbsp;Description
!Status&nbsp;of&nbsp;the&nbsp;Instructure
!Notes
|-
| http://www.propagandism.org/tests/domts/
| Mentioned in Bug 346627.
| Runnable with FF 2.0.0.8 but shows errors. Does not seem to run on FF 3 (custom build).
|
|-
| http://test.bclary.com/
| Not sure. Anybody can say? Mentioned in Bug 346627.
|
|
|-
| http://www.w3.org/DOM/Test/
| W3. What else is there to say? Mentioned in Bug 346627.
|
|
|-
| http://fantasai.inkedblade.net/style/tests/css2.1/
|
|
|
|-
| http://www.w3.org/International/tests/#rtl-chrome
|
|
|
|
|-
|-
| XPInstall
| http://www.mozilla.org/projects/mathml/demo/tester.html
|  
|  
| ???
|  
|  
| xpinstall=3
|
|
|-
| http://cgi.din.or.jp/~hagi3/JavaScript/Mozilla/SampleList.cgi?fmt=html
| List of Mozilla DOM Samples
|
|
|-
| http://mochikit.com/examples/effects/full.html
|
|
|
|-
| http://www.maths-informatique-jeux.com/international/mathml_test/index.xml
|
|
|
|-
| http://cgi.din.or.jp/~hagi3/JavaScript/Mozilla/SampleList.cgi?fmt=html
|
|
|
|-
| http://bclary.com/projects/spider/
|
|
|
|-
| http://www.webstandards.org/action/acid2/
| Acid2 Browser Test
|
|
|-
| http://hixie.ch/tests/
|
|
|
|-
| http://www.cynthiasays.com/
| Cynthia Says™ Portal
|
|
|-
| http://webxact.watchfire.com/
| watchfire WebXACT
|
|
|-
| http://www.tawdis.net/taw3/cms/en
| TAW (Web Accessibility Test)
|
|
|}
|}


Line 293: Line 475:


{| class="fullwidth-table"
{| class="fullwidth-table"
| style="background:#efefef" | '''Test Infrastructure Name'''
!TestInfrastructure Name
| style="background:#efefef" | '''Brief Description'''
!Brief Description
| style="background:#efefef" | '''Harnesses and Test Suites in the Infrastructure'''
!Harnesses and Test Suites in the Infrastructure
| style="background:#efefef" | '''Status of the Instructure'''
!Status of the Instructure
| style="background:#efefef" | '''Notes'''
!Notes
|-  
|-  
| tinderboxen
| tinderboxen
Line 308: Line 490:
| Continuous build engines, written in Python, cycling rapidly based on Bonsai checkins.
| Continuous build engines, written in Python, cycling rapidly based on Bonsai checkins.
| "make check", reftest and MochiTest
| "make check", reftest and MochiTest
| reported via [http://tinderbox.mozilla.org/showbuilds.cgi?tree=MozillaTest MozillaTest] tinderbox
| reported via [http://tinderbox.mozilla.org/showbuilds.cgi?tree=Firefox Firefox] tinderbox
|-
|-
| QA Farm
| QA Farm
Jhammel
947

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/49066...218191"