QA/Fennec/14/Beta/1: Difference between revisions
Jump to navigation
Jump to search
| (19 intermediate revisions by 2 users not shown) | |||
| Line 19: | Line 19: | ||
| Every Beta | | Every Beta | ||
|} | |} | ||
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | ||
{{:QA/Fennec/14/Beta/1/smoketests-results}} | {{:QA/Fennec/14/Beta/1/smoketests-results}} | ||
[[QA/Fennec/14/Beta/1/smoketests-results|Detailed Smoketest results]] | [[QA/Fennec/14/Beta/1/smoketests-results|Detailed Smoketest results]] | ||
=== BFTs for Features === | === BFTs and Exploratory for Features === | ||
{|width=100% | {|width=100% | ||
|- | |- | ||
| Line 32: | Line 30: | ||
| style="background-color: #efefef;"|'''How Often?''' | | style="background-color: #efefef;"|'''How Often?''' | ||
|- | |- | ||
| BFTs | | BFTs | ||
| Waverley | | Waverley | ||
| Once | | Once | ||
|} | |} | ||
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. | BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. | ||
{{:QA/Fennec/14/Beta/1/bft-results}} | {{:QA/Fennec/14/Beta/1/bft-results}} | ||
[[QA/Fennec/14/Beta/1/bft-results|Detailed BFT results]] | [[QA/Fennec/14/Beta/1/bft-results|Detailed BFT results]] | ||
| Line 49: | Line 45: | ||
| style="background-color: #efefef;"|'''How Often?''' | | style="background-color: #efefef;"|'''How Often?''' | ||
|- | |- | ||
| | | Verification | ||
| Waverley | | Waverley | ||
| Every Beta | | Every Beta | ||
| Line 58: | Line 54: | ||
=== L10N Spot Checks === | === L10N Spot Checks === | ||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Spot Check Verification | |||
| Waverley | |||
| Every Beta | |||
|} | |||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | ||
{{:QA/Fennec/14/Beta/1/L10N matrix}} | {{:QA/Fennec/14/Beta/1/L10N matrix}} | ||
| Line 69: | Line 76: | ||
| style="background-color: #efefef;"|'''How Often?''' | | style="background-color: #efefef;"|'''How Often?''' | ||
|- | |- | ||
| | | Verification | ||
| Waverley | | Waverley | ||
| Every Beta | | Every Beta | ||
|} | |} | ||
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;type0-0-0=equals;value0-0-0=fixed | * [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14] | ||
= XUL Fennec 14 Beta 1 Test Plan = | = <strike>XUL Fennec 14 Beta 1 Test Plan</strike> = | ||
* Release: May 10th 2012 | * Release: May 10th 2012 | ||
* QA Contact: [mailto:atrain@mozilla.com Aaron Train] | * QA Contact: [mailto:atrain@mozilla.com Aaron Train] | ||
| Line 92: | Line 99: | ||
| Every Beta | | Every Beta | ||
|} | |} | ||
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. | Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. | ||
{{:QA/Fennec/14/Beta/1/smoketests-xul-results}} | {{:QA/Fennec/14/Beta/1/smoketests-xul-results}} | ||
[[QA/Fennec/14/Beta/1/smoketests-xul-results|Detailed Smoketest results]] | [[QA/Fennec/14/Beta/1/smoketests-xul-results|Detailed Smoketest results]] | ||
| Line 109: | Line 114: | ||
| Once | | Once | ||
|} | |} | ||
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. | BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. | ||
{{:QA/Fennec/14/Beta/1/bft-xul-results}} | {{:QA/Fennec/14/Beta/1/bft-xul-results}} | ||
[[QA/Fennec/14/Beta/1/bft-xul-results|Detailed BFT results]] | [[QA/Fennec/14/Beta/1/bft-xul-results|Detailed BFT results]] | ||
=== Android Permissions Testing === | === Android Permissions Testing === | ||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Waverley | |||
| Every Beta | |||
|} | |||
{{:QA/Fennec/14/Beta/1/permissions-xul-results}} | {{:QA/Fennec/14/Beta/1/permissions-xul-results}} | ||
[[QA/Fennec/14/Beta/1/permissions-xul-results|Detailed Android Permissions Testing Results]] | [[QA/Fennec/14/Beta/1/permissions-xul-results|Detailed Android Permissions Testing Results]] | ||
| Line 121: | Line 134: | ||
=== L10N Spot Checks === | === L10N Spot Checks === | ||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Spot Check Verification | |||
| Waverley | |||
| Every Beta | |||
|} | |||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | ||
{{:QA/Fennec/14/Beta/1/L10N xul matrix}} | {{:QA/Fennec/14/Beta/1/L10N xul matrix}} | ||
| Line 126: | Line 150: | ||
=== Bug Fix Verification === | === Bug Fix Verification === | ||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Waverley | |||
| Every Beta | |||
|} | |||
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;type0-0-0=equals;value0-0-0=fixed;classification=Client%20Software;query_format=advanced;product=Fennec Fixes uplifted to 14] | * [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;type0-0-0=equals;value0-0-0=fixed;classification=Client%20Software;query_format=advanced;product=Fennec Fixes uplifted to 14] | ||
Latest revision as of 21:46, 11 May 2012
« Fennec 14 Beta | Fennec 14 Beta 1 | » Fennec 14 Beta 2
Native Fennec 14 Beta 1 Test Plan
- Release: May 10th 2012
- QA Contact: Kevin Brosnan
- IRC: irc://irc.mozilla.org#qa ping kbrosnan
- Builds: Firefox 14b1 | changeset | pushlog
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Waverley | Every Beta |
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| Assigned | Device | Completed | Results |
| Andreea Pod | LG Optimus 2X (Android 2.2.2) | May 11th, 2012 | PASS |
| Nicolae Cristian | Samsung Galaxy Nexus (Android 4.0.2) | May 11th, 2012 | PASS |
BFTs and Exploratory for Features
| QA Task | Person/Group | How Often? |
| BFTs | Waverley | Once |
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite.
| Assigned | Device | Completed | Results |
| Paul Feher | HTC Desire Z (Android 2.3.3) | May 11th, 2012 | PASS |
| Adrian Tamas | HTC Desire (Android 2.2) | May 11th, 2012 | PASS |
| Cata Suciu | Samsung Galaxy SII (Android 2.3.4) | May 11th, 2012 | PASS |
Android Permissions Testing
| QA Task | Person/Group | How Often? |
| Verification | Waverley | Every Beta |
| Assigned | Device | Completed | Results |
| Andreea Pod | LG Optimus 2X (Android 2.2.2) | May 11th, 2012 | PASS |
Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions
L10N Spot Checks
| QA Task | Person/Group | How Often? |
| Spot Check Verification | Waverley | Every Beta |
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| Assigned | Device | Completed |
| N/A | No localized builds were released |
Bug Fix Verification
| QA Task | Person/Group | How Often? |
| Verification | Waverley | Every Beta |
XUL Fennec 14 Beta 1 Test Plan
- Release: May 10th 2012
- QA Contact: Aaron Train
- IRC: irc://irc.mozilla.org#qa ping AaronMT
- Builds: Firefox 14b1 | changeset | pushlog
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Waverley | Every Beta |
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Tablet 14 Test Suite.
| Assigned | Device | Completed | Results |
| Softvision | Tablet |
BFTs for Features
| QA Task | Person/Group | How Often? |
| BFTs | Waverley | Once |
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under Fennec Tablet 14 Test Suite.
| Assigned | Device | Completed | Results |
| Softvision | Tablet |
Android Permissions Testing
| QA Task | Person/Group | How Often? |
| Verification | Waverley | Every Beta |
| Assigned | Device | Completed | Results |
| Softvision | Tablet |
Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions
L10N Spot Checks
| QA Task | Person/Group | How Often? |
| Spot Check Verification | Waverley | Every Beta |
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. QA/Fennec/14/Beta/1/L10N xul matrix Detailed L10N matrix
Bug Fix Verification
| QA Task | Person/Group | How Often? |
| Verification | Waverley | Every Beta |