Confirmed users
513
edits
Klahnakoski (talk | contribs) (Add links) |
Klahnakoski (talk | contribs) (update progress on ActiveData) |
||
Line 128: | Line 128: | ||
* details: Create a Proof of Concept “big data” project which will store information about every test file we run: test status, error details, test machine and test duration to begin with. We will use this project to develop schemas and queries that work with data this large, and we will use this data to normalize chunk sizes and provide details about which tests never fail. | * details: Create a Proof of Concept “big data” project which will store information about every test file we run: test status, error details, test machine and test duration to begin with. We will use this project to develop schemas and queries that work with data this large, and we will use this data to normalize chunk sizes and provide details about which tests never fail. | ||
* '''progress since last update''': | * '''progress since last update''': | ||
** More Documentation, and added tutorial | |||
** Removed many bugs, many more remain | |||
** Reduce number of machines for ongoing | |||
* '''Incomplete''' | |||
** Cancelled looking into Spark, requires Hadoop and even more machines | |||
** Query to show test failure rate by directory | |||
=== Implement the ability to normalize chunk durations in mochitest [ahal] === | === Implement the ability to normalize chunk durations in mochitest [ahal] === |