QA/Browser Technologies/2011-11-03
< QA | Browser Technologies
Discussion Items
- Mobile
- Amazon App store investigation
- Test Strategy for Fennec Native 1.0. Use https://etherpad.mozilla.org/fennec-native-ui-qa-bugs for notes.
- My ideas: Functional Testplan, Older devices compatibility, Website compatibility, feature breakdown, Schedule?, new litmus test repo, testday plan (focused one for internal first, external later), Automation section on Marionette
- Services
- JRGM Starts next monday
- ChenXia and jrgrlicky started working on Native Fennec Support. Need to incorporate mobile testing into the plan
- BrowserID deployment support plan? Mid december will be final release to millions.
- Community Growth
- How are we tracking with our community team goals?
Project Status
Fennec
Execution (kevin, aaron)
- Nightly (10.0a1) status
- Likely a XUL fennec 'maintenance' release
- Chance that we might not do a 10 release
- Aurora (9.0a2) status (merge to beta Nov 8th)
- tracking firefox 9, not fixed
- Going to try out a different beta status structure for this release
- Beta (8.0) RC status (release next week)
- Waiting on releng on beta 6 build 2
- Release on Friday
- Native Java UI status
Automation (martijn, John)
- Crowdbot extension
- Browserchrome and mochitests (subset of them) are working locally, need to figure out how to package them in jar format and run them from there
- Logging is working
- Will post an updated version later today
- Proof of concept for functional automation
- Clint/Trevor have a version of robotium working well enough to launch fennec, hit address bar
- have native battery app
- should be possible now to launch fennec and point to webapi battery app/compare values
Specialized (naoki)
- Crash Reporting
- This Week:
- Crash Reporting
- Socorro changes have taken place. 8 beta is now showing
- Next Week:
- Crash Reporting needs to be separated out for Native Fennec vs XUL fennec Nightlies
- some skiplist tweaks are still being done.
- Blocked:
- None
- This Week:
- Performance Testing:
- Past Weeks:
- for Droid Pro has been complete for this week
- cTalbert has worked on some things for the automation with python; isn't quite finished.
- he's going to implement it to work with the server that's in the coloc; at first there was a misunderstanding that it had to go through a Firewall, but it turned out not to be the case
- Some questions have popped up in the numbers; trying to smooth out why the numbers vary see chat section in https://etherpad.mozilla.org/fennec-perf-ts-take2 for more details
- Next Weeks:
- automation: Clint gave me some stuff yesterday to hack on.
- he pointed me to SUTagent. Would probably be more robust if we went that way instead as we can't kill the android applications without another android application or rerooting or reprogramming fennec
- http://mxr.mozilla.org/mozilla-central/source/build/mobile/sutagent/android/DoCommand.java
- http://mxr.mozilla.org/mozilla-central/source/build/mobile/
- http://mxr.mozilla.org/mozilla-central/source/testing/mochitest/runtestsremote.py
- automation: Clint gave me some stuff yesterday to hack on.
- Blocked:
- None; Trying to working around how to kill the android app without rooting
- Past Weeks:
- Memshrink :
- Past Weeks: None
- Next Weeks: still waiting for valgrind for android.
- Blocked: Mike Hommey is working on that.
- Newsletter
- Past Weeks : Newsletter released on Tuesday
- Next Weeks : Newsletter to be worked on
- Blocked : None
- Exploratory Testing:
- Past Weeks: try IME build tested for alexp;
- Next Weeks: try build for panning and zooming; nightlies testing
- blocked : none
Sync
Client (Tracy)
- weekly trains have been rolling but often delayed by issues found in testing.
- train delays have kept devs from working on other projects/features. Devs have complained the code is comparable to a sieve. future rewrite?
- respect back-off fixes have landed across the board (channels) to assist OPs if servers fall over again.
- Need to add regular back-off testing into test plan.
- weekly smoketest
- a full functional pass 2 weeks prior to channel merges
Server (James)
- Completed Trains
- Bug 695564 - Deploy account-portal rpm-2.9-3 (along with server-core rpm-2.7-2)
- Current Trains
- Bug 694222 - Test and deploy MySQL option innodb_locks_unsafe_for_binlog + READ COMMITTED
- Bug 693385 - deploy updated server-core (2.6.x) to syncstorage
- Continued forward progress on Sync6 setup for general QA test, tools, development usage
Test pilot (tracy)
- only thing slated is a new study on broken add-ons. jono to provide details when it is ready.
BrowserID (james)
- Completed Train
- Train 10: Bug 696415 - QA and deploy BrowserID train-2011.10.20 to production
- Current Train
- Train 11: Bug 697785 - QA and deploy BrowserID train-2011.10.27 to production
- NOTE: This train is on hold pending debug/triage of a couple open issues
- Continued forward progress on ID2 setup for general QA test, tools, development usage
Pancake (Naoki)
- Future Pancake
- iBarlow has created some designs :
- User stories - https://etherpad.mozilla.org/pancake-design-exploration
- Sketches (very rough) - http://dl.dropbox.com/u/2182500/Mozilla/pancake%20sketching%20oct14.pdf
- (note: not all the user stories are covered by these sketches, but a number of them are)
- Stuart is working on some sketches
- iBarlow has created some designs :
- Current Pancake
- Current
- Documentation work and Process stuff being handled
- iOS .17 version finished
- old fxhome has new email - tested a little to see how old version of app handled email
- recent upgrade to Python 2.7;
- Next Week
- Addon will be completed; need to test
- Blocked by
- Waiting for Addon to test
- Current
WebAPI (John)
- Currently working APIs
- Camera API
- Testpage available
- Mac, Linux changes landed; testing needed
- Battery API
- Testpage available
- Native android app available (for automating comparison)
- need to combine app + testpage, e.g. using robotium for one automation piece
- IndexedDB API
- Testpage Started
- Possibly need more mochitest coverage; needs investigation
- SMS API
- Not landed yet
- Camera API
Vibrator API
- Not landed yet
- Testplan
- Not available yet