QA/TDAI/Inventory: Difference between revisions

→‎Test Suites: add info from timr
(→‎Test Harnesses: add info from timr)
(→‎Test Suites: add info from timr)
Line 75: Line 75:
|-  
|-  
| JS tests
| JS tests
| well-developed suite of tests of the JavaScript language
| well-developed suite of tests of the JavaScript language in [http://lxr.mozilla.org/mozilla/source/js/tests/ js/tests]
| Custom framework in [http://lxr.mozilla.org/mozilla/source/js/tests/ js/tests]. Runs on QA Farm.
| [http://bclary.com/projects/spider/ SpiderMonkey] Runs on QA Farm
| Semi-automated.  Plans to fully automate with Alice and Rob's help in Q1 2007
| Semi-automated.  Plans to fully automate with Alice and Rob's help in Q1 2007
| Run in customized harness, stable and not necessary to use or share.
| Run in customized harness, stable and not necessary to use or share.
Line 98: Line 98:
| 130+ manual test cases, broadly covering major features
| 130+ manual test cases, broadly covering major features
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=7 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=25 2.0]
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=7 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=25 2.0]
|
| will be updated for FF3
|  
|  
|
|
Line 105: Line 105:
| approx. 280 manual test cases, covering most features
| approx. 280 manual test cases, covering most features
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=2 1.0], [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=26 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=27 2.0]
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=2 1.0], [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=26 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=27 2.0]
|
| will be updated for FF3
|  
|  
|
|
Line 112: Line 112:
| 15 test cases
| 15 test cases
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=10 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=39 2.0]
| litmus for [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=10 1.5] and [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=39 2.0]
|
| engaged and open to design
|  
|  
|
| [mailto:axel@pike.org axel]
|-
|-
| Software Update Suite
| Software Update Suite
Line 120: Line 120:
| [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38 litmus]
| [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38 litmus]
|  
|  
|
|
|-
| T*
| includes Tdhtml, Ts, Txul, Trender (aka Tgfx), Z, and mZ
| "make check"
| running, but not growing
| [http://wiki.mozilla.org/Performance:Tinderbox_Tests most T] [http://wiki.mozilla.org/Mozilla2:Trender Trender]
|
|-
| Tp2
| new page load tests
| "make check"/buildbot
| nearing complete automation
|  
|  
| [mailto:alice@mozilla.com alice]
|-
|-
| Browser/Content
| Download Checker
| May be transitioned to reftest or MochiTest, as appropriate.
| verify integrity of major released
| [[Custom Test Executables|custom executable/C++]]
| manual
| (I need to break this category up. Too much is happening in here. -rrk)
| runnable, passing
| dirs = browser/components/places, browser/components/safebrowsing, browser/components/sessionstore, content/base, content/events, content/html/content, content, content/xml, content/xslt
| [http://wiki.mozilla.org/MozillaQualityAssurance:Download_Checker wiki]
|
| [mailto:bc@mozilla.com bc]
|-
| L10N Search Verifier
|
|
| manual
| runnable, passing
| [http://wiki.mozilla.org/MozillaQualityAssurance:l10n_Search_Verifier wiki]
| [mailto:bc@mozilla.com bc]
|-
|-
| XSLT
| XSLT
Line 142: Line 163:
|  
|  
| dom/tests/js/*html and js
| dom/tests/js/*html and js
|
|-
| Browser/Content
| May be transitioned to reftest or MochiTest, as appropriate.
| [[Custom Test Executables|custom executable/C++]]
| (I need to break this category up. Too much is happening in here. -rrk)
| dirs = browser/components/places, browser/components/safebrowsing, browser/components/sessionstore, content/base, content/events, content/html/content, content, content/xml, content/xslt
|
|
|-
|-
Line 157: Line 185:
|  
|  
| dirs = extensions/canvas3d, extensions/java/xpcom, extensions/metrics, extensions/mono, extensions/python, extensions/schema-validation, extensions/spatialnavigation, extensions/webdav
| dirs = extensions/canvas3d, extensions/java/xpcom, extensions/metrics, extensions/mono, extensions/python, extensions/schema-validation, extensions/spatialnavigation, extensions/webdav
|
|-
| I18N
|
| [[Custom Test Executables|custom executable/C++]]
|
| dirs = intl, extensions/universalchardet
|
|
|-
|-
Line 173: Line 208:
| [mailto:mrbkap@mozilla.com mrbkap]
| [mailto:mrbkap@mozilla.com mrbkap]
|-
|-
| I18N
| Acid2
| compliance tests from outside standards "watcher"
| manual
| currently passing
| [http://www.webstandards.org/action/acid2/ Acid2 Browser Test]
|  
|  
| [[Custom Test Executables|custom executable/C++]]
|-
| Update Checker
| validity of update mar files
| currently manual in QA Farm, moving to buildbot
|  
|  
| dirs = intl, extensions/universalchardet
| [http://wiki.mozilla.org/MozillaQualityAssurance:Update_Checker wiki]
|
| [mailto:bc@mozilla.com bc]
|-
|-
| XPConnect
| XPConnect
99

edits