Compatibility/Automated compat testing
About
The tool Compatipede (built on SlimerJS for Gecko and PhantomJS for Webkit rendering) can do automated testing of live websites.
The framework consists of the projects jannah for the infrastructure that's capable of scaling up to testing many pages at once across many computers and boar for the script that controls SlimerJS/PhantomJS.
Roadmap
Compatipede 2 is still under development. This is a prioritised list of tasks we would like to complete:
- Implement support for plugins [1]
- Database for result storage (compat-entomology re-use or similar schema)
- Integrate with DB for result storage
- Improve client scripts - implement scaling up to n tabs functionality
- Automated tests for the framework
- Support getting bugs directly from Bugzilla or Webcompat searches for a test run (likely in a client script)
- Support AWCY list mode (likely in client script)
- Do live CSS analysis across Gecko+WebKit, find a suitable way to store this information
- Track and report JS errors
- Track and report redirects
- Way to run Hallvord's existing regression tests from the old extension/slimertester.js
- Selenium support to facilitate easier automation, e.g. log in
Compatipede 2 architecture
