Firefox/Input/Crons

< Firefox‎ | Input
Revision as of 18:38, 30 November 2010 by Stephend (talk | contribs) (→‎Staging)

Our Crons

Production

Feedback

Cron 1

  • Here is a summary of what it does
  • Here is a link to the code

Themes

Sites

Sites Processing

  1. The backup drop job puts a dump of the input.mozilla.com production DB onto the host cm-metricsetl02 (/data/backup-drop/a01/mysql/input_mozilla_com/ as of 2010-09-15)
  2. At midnight, sites clusters will be generated by a cronjob running on cm-metricsetl02, first for stage, a few minutes later for production (the responsible scripts are located in the directory /home/mkurze)/jobs/input_mozilla_com_metrics
  3. For production, those generated sites-clusters are pushed into the database "mozilla_input_metrics" (user "metricswriter"), that is 10.2.70.90 (tp-a01-master01) as of 2010-09-15.
  4. For staging, the host is tm-stage01-master01, the db name is input_metrics_stage_mozilla_com (user is metricswriter as well)

Staging

Build stuff (GitHub):

*/5 * * * * root (cd /data/www/input.stage.mozilla.com/reporter/;
./bin/update_staging.sh) > /dev/null
*/30 * * * * apache /data/virtualenvs/input/bin/python26
/data/www/input.stage.mozilla.com/reporter/manage.py update_product_details &>
/dev/null
35 * * * * apache /data/virtualenvs/input/bin/python26
/data/www/input.stage.mozilla.com/reporter/manage.py cron cluster &> /dev/null

DB stuff:

Feedback

Themes

Sites

Sites Processing

  1. The backup drop job puts a dump of the input.mozilla.com production DB onto the host cm-metricsetl02 (/data/backup-drop/a01/mysql/input_mozilla_com/ as of 2010-09-15)
  2. At midnight, sites clusters will be generated by a cronjob running on cm-metricsetl02, first for stage, a few minutes later for production (the responsible scripts are located in the directory /home/mkurze)/jobs/input_mozilla_com_metrics
  3. For production, those generated sites-clusters are pushed into the database "mozilla_input_metrics" (user "metricswriter"), that is 10.2.70.90 (tp-a01-master01) as of 2010-09-15.
  4. For staging, the host is tm-stage01-master01, the db name is input_metrics_stage_mozilla_com (user is metricswriter as well)

When testing on stage, keep in mind that the underlying feedback objects won’t be available in the database. So when viewing a cluster, you will like see an empty page.