99
edits
QA/TDAI/Inventory: Difference between revisions
→Test Suites: update descriptions
(→Test Harnesses: add desc of spindermonkey) |
(→Test Suites: update descriptions) |
||
| Line 119: | Line 119: | ||
|- | |- | ||
| JS tests | | JS tests | ||
| | | well-developed suite of tests of the JavaScript language | ||
| Custom framework. Runs on QA Farm. | | Custom framework. Runs on QA Farm. | ||
| Semi-automated. Plans to fully automate with Alice and Rob's help in Q1 2007 | | Semi-automated. Plans to fully automate with Alice and Rob's help in Q1 2007 | ||
| | | Run in customized harness, stable and not necessary to use or share. | ||
| | | [mailto:bc@mozilla.com bc] | ||
|- | |- | ||
| Security tests | | Security tests | ||
| | | well-developed suite security tests | ||
| Custom framework. Runs on QA Farm. | | Custom framework. Runs on QA Farm. | ||
| Semi-automated. Plans to fully automate with Eggplant in Q1 2007 | | Semi-automated. Plans to fully automate with Eggplant in Q1 2007 | ||
| | | Not checked in to repository for security reasons. | ||
| | | bc@mozilla.com | ||
|- | |- | ||
| Automated Smoke Tests - FFx 1.5 | | Automated Smoke Tests - FFx 1.5 | ||
| Line 136: | Line 136: | ||
| Eggplant. Runs on Tracy's machines. | | Eggplant. Runs on Tracy's machines. | ||
| Fully automated. Completed porting to Mac and Linux in Q4 2006. Plan to move executiion to QA Farm in Q1 2007 | | Fully automated. Completed porting to Mac and Linux in Q4 2006. Plan to move executiion to QA Farm in Q1 2007 | ||
| | | A "Smoke Test" is a quick, basic qualification. | ||
| | | tracy@mozilla.com | ||
|- | |- | ||
| Automated Smoke Tests - FFx 2.0 | | Automated Smoke Tests - FFx 2.0 | ||
| | | | ||
| Eggplant, runs on Tracy's machines. Originally a litmus suite. | | Eggplant, runs on Tracy's machines. Originally a litmus suite. | ||
| Fully automated. Completed porting 1.5 tests to the 3 platforms for 2.0 in Q4 2006. Plan to move | | Fully automated. Completed porting 1.5 tests to the 3 platforms for 2.0 in Q4 2006. Plan to move execution to QA Farm in Q1 2007 | ||
| | | | ||
| tracy@mozilla.com | |||
|- | |- | ||
| Basic Functionality Tests (BFT) | | Basic Functionality Tests (BFT) | ||
| Line 174: | Line 174: | ||
|- | |- | ||
| Browser/Content | | Browser/Content | ||
| | | Will be transitioned to reftest of MochiTest or reftest as appropriate. | ||
| custom and/or old, not functional | | custom and/or old, not functional | ||
| | | | ||
| | | | ||
browser/components/places=9<br>browser/components/safebrowsing=1<br>browser/components/sessionstore=1<br>content/base=9<br>content/events=0<br>content/html/content=15<br>content=10<br>content/xml=35<br>content/xslt=23<br>content/xslt/XSLTMark=5 | browser/components/places=9<br>browser/components/safebrowsing=1<br>browser/components/sessionstore=1<br>content/base=9<br>content/events=0<br>content/html/content=15<br>content=10<br>content/xml=35<br>content/xslt=23<br>content/xslt/XSLTMark=5 | ||
| | | | ||
| Line 185: | Line 185: | ||
| custom driver in repository | | custom driver in repository | ||
| Driver is in mozilla, but test content gets re-downloaded. | | Driver is in mozilla, but test content gets re-downloaded. | ||
| content/xslt/buster | | content/xslt/buster<br>ToDo: downloadable tests are not easy to find. Where are they? | ||
| | | | ||
|- | |- | ||
| Line 241: | Line 241: | ||
| "the old regression test suite" and reftest. Older tests will go to reftest. | | "the old regression test suite" and reftest. Older tests will go to reftest. | ||
| | | | ||
| | | There are a lot of test files here. It is hard to say how current or correct they are. | ||
| | | | ||
|- | |- | ||
| Math/ML | | Math/ML | ||
| | | Do mathematical glyphs display correctly on all platforms? | ||
| "browsers and eyeballs" | | "browsers and eyeballs" | ||
| also using w3c.org site content | | also using w3c.org site content | ||