Mobile/Fennec Automation: Difference between revisions

← Older edit

Mobile/Fennec Automation (view source)

Revision as of 15:20, 18 June 2009

1,108 bytes removed , 18 June 2009

→‎Maemkit Toolset

Jmaher

Confirmed users

3,376

edits

@@ Line 7: / Line 7: @@
 Below is a table outlining what is needed and where we are.  Below the table is a log of actions which is intended for people to see what has been done and when if they want more details about a specific item.
-=== Toolset ===
-Until we get a lot of changes backported into the build system (makefiles, test running scripts, etc...) we will have a temporary test framework that wraps around the build system and test scripts to run all tests on maemo.  We will call this the maemkit.
-Here are a list of things the maemkit needs to do:
-* Package the tests
-** mochitest: tar -chf $(xr_objdir)/_tests/ $(objdir)/_profile/ tests.tar
-** chrometest: same as mochitest
-** reftest: run reftest_extract.py
-** crashtests: run crashtest_extract.py
-* copy to device/unpack (leave manual for now)
-* run tests in a chunked method
-** mochitest - run_tests_chunked.py
-*** test 1 directory at a time
-***splits known large directories into smaller chunks
-** chrometest - run_chrome_chunked.py
-*** make _tests/testing/chrome.bak
-*** copies 1 directory at a time from chrome.bak to chrome
-** reftest - reftest_chunked.py
-*** parse manifest, run 1 dir at a time
-*** for large dir, split into multiple manifests
-** crashtest - reftest_chunked.py
-*** parse manifest, run 1 dir at a time
-* concat logs into a common log format
-** mochitest - run script to parse each chunk and cat together with summary
-** chrometest - run script to parse each chunk and cat together with summary
-** reftest - run script to remove file:///<rootdir> tags and cat together
-** crashtest - cat log files together
-* copy logs off device (leave manual for now)
-* report results with new failures highlighted
-** a system to keep track of known failures (json data provider)
-** a system to show results of tests including historical data
-I propose writing 2 master scripts and 1 website to deal with this:
-* maemkit-packager.py
-** packages all (or one type) the test files from the src and objdir trees
-** creates a .tar file that we can copy
-* maemkit-chunked.py
-** run a test (or all) as chunked
-** create a log file that is compatible for comparison purposes
-* maemkit-viewer website
-** provider on known failures
-** provides quick summary of tests
-** provides in depth view of tests
-** provides access to download logs
 === Nokia Status Table ===
@@ Line 92: / Line 46: @@
 |Done
 |Done
-|
+|Done
 |-
 |Results: fennec(install) == fennec(tree)
@@ Line 113: / Line 67: @@
 |Done
 |Done
-|
+|Done
 |-
 |Run automated on Nokia device
@@ Line 120: / Line 74: @@
 |Done
 |Done
-|
+|Done
 |-
 |Results: fennec(device) == firefox
@@ Line 131: / Line 85: @@
 |Documented tools/steps to run on device
 |[[http://wiki.mozilla.org/Mobile/Fennec_Mochitest Done]]
-|[[http://wiki.mozilla.org/Mobile/Fennec_Chrome Draft]]
+|[[http://wiki.mozilla.org/Mobile/Fennec_Chrome Done]]
-|[[http://wiki.mozilla.org/Mobile/Fennec_Reftests Draft]]
+|[[http://wiki.mozilla.org/Mobile/Fennec_Reftests Done]]
-|[[http://wiki.mozilla.org/Mobile/Fennec_Reftests Draft]]
+|[[http://wiki.mozilla.org/Mobile/Fennec_Reftests Done]]
-|
+|[[https://wiki.mozilla.org/Mobile/Fennec_Xpcshell Draft]]
 |-
 |Initial handoff to build
@@ Line 152: / Line 106: @@
 === Action Log ===
+* 2009-03-27 - Updated all documentation to run tests on Maemo
+* 2009-03-26 - Updated [[http://hg.mozilla.org/qa/maemkit/file/527dc910d556/ maemkit]] code
+* 2009-03-23 - Initial drop of maemkit code
+* 2009-01-30 - Added [[https://wiki.mozilla.org/Mobile/Fennec_Xpcshell xpcshell]] instructions
+* 2009-01-29 - Updated [[https://wiki.mozilla.org/Mobile/Fennec_Mochitest mochitest]] instructions
+* 2009-01-28 - Added {{bug|475778}} to figure out how to checkin maemkit
+* 2009-01-27 - Completed initial draft of maemkit-chunked
+* 2009-01-23 - Updated [[https://wiki.mozilla.org/Mobile/Fennec_Chrome#TODO Chrome]] document with {{bug|457098}} to track fix to mochitest
+* 2009-01-23 - coded up [[http://people.mozilla.com/~jmaher/fennec/maemkit/ mochitest/chrome]] for maemkit-chunked
+* 2009-01-15 - Updated maemkit for run_chunked to define config file
+* 2009-01-12 - Created maemkit tool section
 * 2009-01-07 - Updated [[https://wiki.mozilla.org/Mobile/Fennec_Chrome#TODO Chrome]] document with additional TODO items
 * 2009-01-07 - Added chrome investigation at [[http://people.mozilla.com/~jmaher/mochitest.htm 100%]]