User:Rcampbell/QA Projects: Difference between revisions

(User page moved)
 
(35 intermediate revisions by 2 users not shown)
Line 1: Line 1:
=== jssh test harness documentation ===
== Buildbot ==


[[User:Davel|Dave Liebreich]] has [[SoftwareTesting:Tools:TestRunnerPython|documented]] this and will likely contain updates as he moves forward with this test harness.
* [[Buildbot]]


==== requirements ====
* [[BuildbotTestfarm|Buildbot Test Farm]]


python (2.3 or greater)
* [[BuildbotTalos|Buildbot Talos]]


firefox 1.5 with jssh - built with mozconfig
Consolidate buildbot packages.


<pre>. $topsrcdir/browser/config/mozconfig
=== unittest todos ===


mk_add_options MOZ_CO_PROJECT=browser
* add js tests
mk_add_options MOZ_OBJDIR=@topsrcdir@/../objdir/browser
* convert RLk and Lk to buildbot
# mk_add_options MOZ_CO_MODULE=mozilla/js/tests
** [[User:Rcampbell/LeakTests|discussion with bz in #build]]
* reftest profile creation, [https://bugzilla.mozilla.org/show_bug.cgi?id=393410 393410]
* reboot, restart on-demand and automatically, [https://bugzilla.mozilla.org/show_bug.cgi?id=393411 393411]
* clobber in unittest directory, [https://bugzilla.mozilla.org/show_bug.cgi?id=393413 393413]
* stacktrace support, [https://bugzilla.mozilla.org/show_bug.cgi?id=393415 393415]
* update buildbot code automatically, [https://bugzilla.mozilla.org/show_bug.cgi?id=393290 393290]
* clobber + debug options on waterfall force page, [https://bugzilla.mozilla.org/show_bug.cgi?id=393417 393417]
* abort build, reboot slaves (from waterfall) [https://bugzilla.mozilla.org/show_bug.cgi?id=393418 393418]
* <strike>create tracking bug and add these to it</strike> DONE
** [https://bugzilla.mozilla.org/show_bug.cgi?id=393112 https://bugzilla.mozilla.org/show_bug.cgi?id=393112]
* create ssh key for qa machine cvs access (done, bug filed with IT by bhearsum)
* update machines with ssh key and modify checkout code to use it


ac_add_options --enable-extensions=default,jssh
=== talos todos ===
mk_add_options MOZ_MAKE_FLAGS="-j4"</pre>


firefox 2.0 with jssh
* ManifestDirectoryStreamer needs parameters for non-windows platforms [https://bugzilla.mozilla.org/show_bug.cgi?id=393048 393048] [https://bugzilla.mozilla.org/show_bug.cgi?id=393291 393291]
* Startup automation [https://bugzilla.mozilla.org/show_bug.cgi?id=393419 393419]
** Depending on task, may be undesireable to automatically startup particular masters and/or slaves
* PerfConfigurator.py checked in with Talos code [https://bugzilla.mozilla.org/show_bug.cgi?id=393266 393266]
* Buildbot master should probably be moved to a VM for easier backup and restoration/migration - qm-rhel02? [https://bugzilla.mozilla.org/show_bug.cgi?id=393421 393421]
* buildbot should clean up after faulty runs better [https://bugzilla.mozilla.org/show_bug.cgi?id=393420 393420]
** better dependent build steps
* <strike>create tracking bug and add these to it</strike> DONE
** [https://bugzilla.mozilla.org/show_bug.cgi?id=393044 https://bugzilla.mozilla.org/show_bug.cgi?id=393044]


pull MOZILLA_1_8_BRANCH from cvs
== Unit Testing Framework ==


<pre>cvs -d :pserver:anonymous@cvs-mirror.mozilla.org:/cvsroot co -r MOZILLA_1_8_BRANCH mozilla/client.mk</pre>
As documented in bug# [https://bugzilla.mozilla.org/show_bug.cgi?id=343673 343673]


or, checkout the client.mk
[[SoftwareTesting:Tools:UnitTest]]


<pre>cvs co -r MOZILLA_1_8_BRANCH mozilla/client.mk</pre>
== Automated Testing Frameworks ==


checkout source via make
[[SoftwareTesting:Tools:l10nVerifier|l10n Verification Tool]]


<pre>make client.mk checkout</pre>
== Extensions ==


add jssh extension to source
[[SoftwareTesting:Extensions:BookmarkTester|Bookmark Tester]]
 
<pre>cvs co -D 2006-04-15 mozilla/extensions/jsshcvs checkout: Updating mozilla/extensions/jssh</pre>
 
modify the mozilla/browser/config/mozconfig file with the above extensions modifications.
 
build the package
 
<pre>make client.mk build</pre>
 
python test harness and jssh driver
 
[http://people.mozilla.org/~davel/test_harness_spike/ JSSH Test Harness Spike]

Latest revision as of 00:55, 11 May 2015

Buildbot

Consolidate buildbot packages.

unittest todos

  • add js tests
  • convert RLk and Lk to buildbot
  • reftest profile creation, 393410
  • reboot, restart on-demand and automatically, 393411
  • clobber in unittest directory, 393413
  • stacktrace support, 393415
  • update buildbot code automatically, 393290
  • clobber + debug options on waterfall force page, 393417
  • abort build, reboot slaves (from waterfall) 393418
  • create tracking bug and add these to it DONE
  • create ssh key for qa machine cvs access (done, bug filed with IT by bhearsum)
  • update machines with ssh key and modify checkout code to use it

talos todos

  • ManifestDirectoryStreamer needs parameters for non-windows platforms 393048 393291
  • Startup automation 393419
    • Depending on task, may be undesireable to automatically startup particular masters and/or slaves
  • PerfConfigurator.py checked in with Talos code 393266
  • Buildbot master should probably be moved to a VM for easier backup and restoration/migration - qm-rhel02? 393421
  • buildbot should clean up after faulty runs better 393420
    • better dependent build steps
  • create tracking bug and add these to it DONE

Unit Testing Framework

As documented in bug# 343673

SoftwareTesting:Tools:UnitTest

Automated Testing Frameworks

l10n Verification Tool

Extensions

Bookmark Tester