TestEngineering/Web/Automation/AMO Hudson Logs Summary November 2010: Difference between revisions
< TestEngineering | Web | Automation
(→BFT) |
StuartPhilp (talk | contribs) m (StuartPhilp moved page QA/Execution/Web Testing/Automation/AMO Hudson Logs Summary November 2010 to TestEngineering/Web/Automation/AMO Hudson Logs Summary November 2010: reorganizing wiki under Test Engineering) |
||
| (12 intermediate revisions by one other user not shown) | |||
| Line 3: | Line 3: | ||
<br> | <br> | ||
{| | {| cellspacing="1" cellpadding="5" border="1" width="648" style="" | ||
|- | |- | ||
! width="45" scope="col" | Date | ! width="45" scope="col" | Date | ||
| Line 12: | Line 12: | ||
! scope="col" | Resolution / Comment | ! scope="col" | Resolution / Comment | ||
|- | |- | ||
| 11/8/10 - 11/ | | 11/8/10 - 11/12/10 | ||
| | | | ||
| 1925 - | | 1925 - 1947 | ||
| | | | ||
| | | | ||
| GREEN | | GREEN | ||
|- | |- | ||
| 11/9/10 | | 11/9/10 | ||
| | | | ||
| 1924 | | 1924 | ||
| persona landing page layout | | persona landing page layout | ||
| page timeout | | page timeout | ||
| | | | ||
|- | |- | ||
| Line 106: | Line 106: | ||
<br> | <br> | ||
{| | {| cellspacing="1" cellpadding="5" border="1" width="648" style="" | ||
|- | |- | ||
! width="45" scope="col" | Date | ! width="45" scope="col" | Date | ||
| Line 115: | Line 115: | ||
! scope="col" | Resolution / Comment | ! scope="col" | Resolution / Comment | ||
|- | |- | ||
| 11/11/10 | | 11/11/10 - 11/12/10 | ||
| | |||
| 724 - 734 | |||
| | |||
| | |||
| GREEN | |||
|- | |||
| 11/11/10 | |||
| | | | ||
| 722, 723 | | 722, 723 | ||
| suite not run | | suite not run | ||
| http status code 500 | | http status code 500 | ||
| | | | ||
|- | |- | ||
| Line 171: | Line 178: | ||
<br> | <br> | ||
{| | {| cellspacing="1" cellpadding="5" border="1" width="648" style="" | ||
|- | |- | ||
! width="45" scope="col" | Date | ! width="45" scope="col" | Date | ||
| Line 180: | Line 187: | ||
! scope="col" | Resolution / Comment | ! scope="col" | Resolution / Comment | ||
|- | |- | ||
| 11/11/10<br> | | 11/12/10 | ||
| <br> | | | ||
| 129<br> | | 132 | ||
| search for add-on by name<br> | | | ||
| search for add-on "fbbutton for Facebook" did not return search results<br> | | | ||
| GREEN | |||
|- | |||
| 11/12/10 | |||
| | |||
| 131 | |||
| home page layout | |||
| page header stat: 0 downloads in use | |||
| | |||
|- | |||
| 11/11/10 | |||
| | |||
| 130 | |||
| | |||
| | |||
| GREEN | |||
|- | |||
| 11/11/10<br> | |||
| <br> | |||
| 129<br> | |||
| search for add-on by name<br> | |||
| search for add-on "fbbutton for Facebook" did not return search results<br> | |||
| add-on not found by manual search or seen on browse pages.<br> | | add-on not found by manual search or seen on browse pages.<br> | ||
|- | |- | ||
| 11/9/10 - 11/10/10 | | 11/9/10 - 11/10/10 | ||
| <br> | | <br> | ||
| 126, 128 | | 126, 128 | ||
| <br> | | <br> | ||
| <br> | | <br> | ||
| GREEN | | GREEN | ||
|- | |- | ||
| 11/9/10 | | 11/9/10 | ||
| <br> | | <br> | ||
| 125 | | 125 | ||
| search for persona by name | | search for persona by name | ||
| Line 202: | Line 230: | ||
|- | |- | ||
| 11/9/10 | | 11/9/10 | ||
| <br> | | <br> | ||
| | | | ||
124, 125 | 124, 125 | ||
| Line 211: | Line 239: | ||
|- | |- | ||
| 11/8/10 | | 11/8/10 | ||
| <br> | | <br> | ||
| 123 | | 123 | ||
| <br> | | <br> | ||
| <br> | | <br> | ||
| GREEN | | GREEN | ||
|- | |- | ||
| Line 238: | Line 266: | ||
= BFT = | = BFT = | ||
{| | {| cellspacing="1" cellpadding="5" border="1" width="648" style="" | ||
|- | |- | ||
! width="45" scope="col" | Date | ! width="45" scope="col" | Date | ||
| Line 246: | Line 274: | ||
! scope="col" | Issue | ! scope="col" | Issue | ||
! scope="col" | Resolution / Comment | ! scope="col" | Resolution / Comment | ||
|- | |||
| 11/12/10 | |||
| | |||
| 132 | |||
| | |||
| | |||
| GREEN | |||
|- | |- | ||
| 11/11/10 | | 11/11/10 | ||
| | | | ||
| | | 131 | ||
| | | various test cases | ||
| login failed | |||
| not seen in manual review. | |||
|- | |||
| 11/11/10 | |||
| | | | ||
. add-on name does not match page breadcrumb for long names. | | 130 | ||
| add-on detail page layout | |||
| | |||
. add-on name does not match page breadcrumb for long names. | |||
. "Tags" header not present when no tag list. | . "Tags" header not present when no tag list. | ||
| web pages have changed. test case needs to be updated. | | web pages have changed. test case needs to be updated. | ||
| Line 326: | Line 368: | ||
= Search suite = | = Search suite = | ||
{| | {| cellspacing="1" cellpadding="5" border="1" width="648" style="" | ||
|- | |- | ||
! width="45" scope="col" | Date | ! width="45" scope="col" | Date | ||
| Line 335: | Line 377: | ||
! scope="col" | Resolution / Comment | ! scope="col" | Resolution / Comment | ||
|- | |- | ||
| 11/1/10 - 11/ | | 11/1/10 - 11/12/10<br> | ||
| | | | ||
| 171 - | | 171 - 182<br> | ||
| | | | ||
| GREEN | | GREEN | ||
| Line 347: | Line 389: | ||
= Sort suite = | = Sort suite = | ||
{| | {| cellspacing="1" cellpadding="5" border="1" width="648" style="" | ||
|- | |- | ||
! width="45" scope="col" | Date | ! width="45" scope="col" | Date | ||
| Line 356: | Line 398: | ||
! scope="col" | Resolution / Comment | ! scope="col" | Resolution / Comment | ||
|- | |- | ||
| 11/10/10 | | 11/10/10 - 11/12/10 | ||
| | | | ||
| 28 | | 28 - 30 | ||
| | | | ||
| | | | ||
| Line 426: | Line 468: | ||
! scope="col" | Resolution / Comment | ! scope="col" | Resolution / Comment | ||
|- | |- | ||
| 11/8/10 - 11/10/10<br> | | 11/11/10 - 11/12/10 | ||
| | |||
| 35 - 36 | |||
| | |||
| | |||
| GREEN | |||
|- | |||
| 11/11/10 | |||
| | |||
| 34 | |||
| add-on detail page layout | |||
| | |||
. add-on name does not match page breadcrumb for long names. | |||
. "Tags" header not present when no tag list. | |||
| web pages have changed. test case needs to be updated. | |||
|- | |||
| 11/8/10 - 11/10/10<br> | |||
| | | | ||
| 31 - 33<br> | | 31 - 33<br> | ||
| | | | ||
| | | | ||
Latest revision as of 20:21, 26 August 2016
Smoke tests amo.preview
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 11/8/10 - 11/12/10 | 1925 - 1947 | GREEN | |||
| 11/9/10 | 1924 | persona landing page layout | page timeout | ||
| 11/3/10 - 11/9/10 |
1875 - 1923 | GREEN | |||
| 11/3/10 | 1874 | home page layout | add-on list sort does not have expected element | ||
| 11/3/10 | 1873 - 1874 | persona landing page layout | scrolling buttons missing on featured box | ||
| 11/3/10 | 1872 | suite not run | http status 500 | ||
| 11/2/10 - 11/3/10 | 1867 - 1871 |
GREEN | |||
| 11/2/10 | 6:09 am | 1866 | various test cases |
. "The service is temporarily unavailable" messages returned. . elements missing from pages. |
no errors in following run. |
| 11/1/10 - 11/2/10 | 1861 - 1865 | GREEN | |||
| 11/1/10 | 12:01 pm | 1860 | various tests cases |
. "The service is temporarily unavailable" message returned. . elements missing from pages. |
no errors in following run. |
| 11/1/10 | 1856 - 1859 | GREEN |
go to Smoke tests preview | next | production
Other amo.preview BFT | Search suite | Sort suite | Layout suite
Smoke tests amo.next
run during code freeze only
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 11/11/10 - 11/12/10 | 724 - 734 | GREEN | |||
| 11/11/10 | 722, 723 | suite not run | http status code 500 | ||
| 11/9/10 - 11/11/10 | 714 - 721 | GREEN | |||
| 11/9/10 | 712 - 713 | suite not run | connection error, SVN error | ||
| 11/9/10 | 711 | verify login; verify logout | login failed. | ||
| 11/8/10 | 707 - 710 | GREEN | |||
| 11/8/10 | 7:00 pm | 706 | suite not run | http status code 500 | |
| 11/3/10 - 11/8/10 |
665 - 705 | GREEN |
go to Smoke tests preview | next | production
Other amo.preview BFT | FFT | Search suite | Sort suite | Layout suite
Smoke tests amo.prod
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 11/12/10 | 132 | GREEN | |||
| 11/12/10 | 131 | home page layout | page header stat: 0 downloads in use | ||
| 11/11/10 | 130 | GREEN | |||
| 11/11/10 |
129 |
search for add-on by name |
search for add-on "fbbutton for Facebook" did not return search results |
add-on not found by manual search or seen on browse pages. | |
| 11/9/10 - 11/10/10 | 126, 128 | GREEN | |||
| 11/9/10 | 125 | search for persona by name | known personas not found. browse page persona URL contains "/z//en-US" | updated test case to handle /z// | |
| 11/9/10 |
124, 125 |
AMO home page layout | add-on with a null name | add-on ID 251538. no longer on home page's Recently Added sort | |
| 11/8/10 | 123 | GREEN | |||
| 11/8/10 |
122 |
search for personas by name |
known personas not found |
issue not seen in following run | |
| 11/1/10 - 11/7/10 |
115 - 121 | GREEN |
go to Smoke tests preview | next | production
Other amo.preview BFT | Search suite | Sort suite | Layout suite
Other amo.preview
BFT
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 11/12/10 | 132 | GREEN | |||
| 11/11/10 | 131 | various test cases | login failed | not seen in manual review. | |
| 11/11/10 | 130 | add-on detail page layout |
. add-on name does not match page breadcrumb for long names. . "Tags" header not present when no tag list. |
web pages have changed. test case needs to be updated. | |
| 11/8/10 - 11/10/10 | 127 - 129 | GREEN | |||
| 11/6/10 - 11/8/10 | 124 - 126 | add-on detail page layout | tags not found on any add-ons | tags list DOM changed. fixed by updating locators file. | |
| add and remove tags | 'add tag' element not found | ||||
| 11/4/10 - 11/5/10 |
122 - 123 |
GREEN | |||
| 11/3/10 | 120 | various test cases | http status code 500 errors | ||
| 11/2/10 | 119 | various search API test cases | element not found | ||
| 11/2/10 | 118 | add-on privacy page layout | element not found | test case to be updated with new locator | |
| add-on EULA page layout | element not found | test case to be updated with new locator | |||
| 11/1/10 | 117 | GREEN |
go to Smoke tests preview | next | production
Other amo.preview BFT | Search suite | Sort suite | Layout suite
Search suite
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 11/1/10 - 11/12/10 |
171 - 182 |
GREEN |
go to Smoke tests preview | next | production
Other amo.preview BFT | FFT | Search suite | Sort suite | Layout suite
Sort suite
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 11/10/10 - 11/12/10 | 28 - 30 | GREEN | |||
| 11/9/10 | 27 | add-on category browse page sorts | page timeout | ||
| 11/9/10 |
26 |
add-on category browse page sorts |
"View All" link to browse page not found. |
Categories with short lists now go to browse page instead of landing page which contains View All link. Test case updated to check for presence of browse page as alternate to landing page. | |
| 11/9/10 | 25 | test suite not run | http status 500 | ||
| 11/9/10 | 24 | various test cases | Landing page is missing lists of top add-ons and 'View All' link |
||
| 11/3/10 - 11/8/10 | 18 - 23 | GREEN | |||
| 11/3/10 | 17 | test suite not run | http status 500 | ||
| 11/1/10 - 11/2/10 | 15 - 16 | GREEN |
go to Smoke tests preview | next | production
Other amo.preview BFT Search suite | Sort suite | Layout suite
Layout suite
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 11/11/10 - 11/12/10 | 35 - 36 | GREEN | |||
| 11/11/10 | 34 | add-on detail page layout |
. add-on name does not match page breadcrumb for long names. . "Tags" header not present when no tag list. |
web pages have changed. test case needs to be updated. | |
| 11/8/10 - 11/10/10 |
31 - 33 |
GREEN | |||
| 11/8/10 | 30 | add-on detail page layout | links to login or register not found at tags list | TC update for page change incomplete. | |
| 11/6/10 - 11/8/10 | 27 - 29 | add-on detail page layout | tags not found on any add-ons | tags list DOM changed. fixed by updating locators file. | |
| 11/3/10 - 11/5/10 | 24 - 26 | GREEN | |||
| 11/3/10 | 23 | home page layout | in add-on list, elements did not reference the selected sort as expected | page update with selected list might have taken longer than before. test case changed to check for updated add-on list smarter. | |
| add-on detail page layout | no add-ons seen with tags. approx 100 add-ons checked. | tags seen with manual check. | |||
| persona landing page layout | scroll elements missing in featured personas box | JS broken. bug filed. | |||
| 11/2/10 | 22 | GREEN | |||
| 11/2/10 | 21 | add-on privacy page layout | element not found | test case to be updated with new locator | |
| 11/1/10 | 20 | GREEN |
go to Smoke tests preview | next | production
Other amo.preview BFT | Search suite | Sort suite | Layout suite