Mobile/Testing/01 29 14: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "= Previous Action Items = * Install flash on pandas - {{bug|958710}} * <s>gbrown will ask graydon to attend this meeting</s> * <s>gbrown/graydon to consider using /data/local ...")
 
 
(11 intermediate revisions by 7 users not shown)
Line 8: Line 8:
== Dev team ==
== Dev team ==
== Rel Eng ==
== Rel Eng ==
* deployed flash on pandas ~ an hour ago.
* Mozpool caching of device state eliminated to help with some retries
* Deployed: {{Bug|664857}} - Create a 'reftest' alias for 'reftest-1' and 'reftest-2' linux-android unittest suites
* About to deply: {{Bug|964620}} - Increase mozpoolclient timeout for creating a new request
* Working on (properly) fixing: {{Bug|895466}} - Increase mozpool request time
** Should eliminate the need for doing {{Bug|964363}} - split Android 4.0 robocop (rc) into 5 chunks


== IT ==
== IT ==
New Mozpool shipped.
Network lag. Firewall is overwhelmed.
* https://bugzilla.mozilla.org/show_bug.cgi?id=964853
* https://bugzilla.mozilla.org/show_bug.cgi?id=957502
== A Team ==
== A Team ==
* tegra failure rate: [[http://54.215.155.53/android_failures.html?platform=android2.2 2.54%]]
* panda failure rate: [[http://54.215.155.53/android_failures.html?platform=android4.0 27.08%]]
** last week was ~16%
** excluding retries: 1.01, last week was ~1% as well
** Bump in retry is likely due to the network issues we are hitting with throughput over firewall
== Android 2.3 emulator ==
== Android 2.3 emulator ==
* Single-emulator mochitest run working on AWS loaner:
** https://bugzilla.mozilla.org/show_bug.cgi?id=910092#c209
* Remaining issues:
** checking other test runs work (if slowly)
** merging script changes back to mozharness repo
** archiving AVD-building machine AMI
** any residual documentation
** selection of instance / job mixture for deployment
== Android x86 emulator ==
== Android x86 emulator ==
* All tests running on Cedar and Ash, with some failures
* All tests running on Cedar and Ash, with some failures
* S4 (only) running on trunk
* S4 (only) running on trunk
* Biggest remaining issue is intermittent loss of connectivity: bug 927602  
* Status summary at https://bugzilla.mozilla.org/show_bug.cgi?id=936226#c36
* Biggest remaining issue is intermittent loss of connectivity: bug 927602
 
== Autophone ==
== Autophone ==
* Still running into memory pressure on autophone host. Removed singleton lg-revolution as being redundant.
* Nexus 5s were on back order. ETA is next week.
* {{Bug|964645}} Autophone - improve logging, error recovery and throbber measurements.
** Tested alternative iteration counts 4, 8, 16, 64. 8 should be sufficient.
** [http://people.mozilla.org/~bclary/log/2014/01/27/autophone/index.html Compare Autophone behavior for various iterations before and after starttime patch]
* 2014-01-27 - Enabled fx-team repo along side mozilla-central.
* 2014-01-29 - Changed iterations to 8 and Enabled all 3 repos fx-team, mozilla-inbound, mozilla-central.
** Temporarily disabled Mochitest-Canvas testing during initial multiple repo testing.


== Eideticker ==
== Eideticker ==
* Should soon be rebooting eideticker phones once daily to keep state cleaner between runs {{bug|964301}}
= Round Table =
= Round Table =
 
* Is anyone else worried by {{bug|963317}} Intermittent Android Shutdown | application crashed [@ nssCertificate_Destroy] ?


= Action Items =
= Action Items =
* snorp will verify that flash apk installed on pandas via try
* snorp will talk to jmaher about talos improvements to find gradual, long-term regressions

Latest revision as of 18:46, 29 January 2014

Previous Action Items

Status reports

Dev team

Rel Eng

  • deployed flash on pandas ~ an hour ago.
  • Mozpool caching of device state eliminated to help with some retries
  • Deployed: bug 664857 - Create a 'reftest' alias for 'reftest-1' and 'reftest-2' linux-android unittest suites
  • About to deply: bug 964620 - Increase mozpoolclient timeout for creating a new request
  • Working on (properly) fixing: bug 895466 - Increase mozpool request time
    • Should eliminate the need for doing bug 964363 - split Android 4.0 robocop (rc) into 5 chunks

IT

New Mozpool shipped.

Network lag. Firewall is overwhelmed.

A Team

  • tegra failure rate: [2.54%]
  • panda failure rate: [27.08%]
    • last week was ~16%
    • excluding retries: 1.01, last week was ~1% as well
    • Bump in retry is likely due to the network issues we are hitting with throughput over firewall

Android 2.3 emulator

  • Remaining issues:
    • checking other test runs work (if slowly)
    • merging script changes back to mozharness repo
    • archiving AVD-building machine AMI
    • any residual documentation
    • selection of instance / job mixture for deployment

Android x86 emulator

Autophone

  • Still running into memory pressure on autophone host. Removed singleton lg-revolution as being redundant.
  • Nexus 5s were on back order. ETA is next week.
  • bug 964645 Autophone - improve logging, error recovery and throbber measurements.
  • 2014-01-27 - Enabled fx-team repo along side mozilla-central.
  • 2014-01-29 - Changed iterations to 8 and Enabled all 3 repos fx-team, mozilla-inbound, mozilla-central.
    • Temporarily disabled Mochitest-Canvas testing during initial multiple repo testing.

Eideticker

  • Should soon be rebooting eideticker phones once daily to keep state cleaner between runs bug 964301

Round Table

  • Is anyone else worried by bug 963317 Intermittent Android Shutdown | application crashed [@ nssCertificate_Destroy] ?

Action Items

  • snorp will verify that flash apk installed on pandas via try
  • snorp will talk to jmaher about talos improvements to find gradual, long-term regressions
Retrieved from "https://wiki.allizom.org/index.php?title=Mobile/Testing/01_29_14&oldid=910056"