86
edits
No edit summary |
No edit summary |
||
Line 35: | Line 35: | ||
doing that. Possibly to include in the relnotes. | doing that. Possibly to include in the relnotes. | ||
ctalbert: I'm going to head back to the top of the existing list and go straight | ctalbert: I'm going to head back to the top of the existing list and go straight | ||
down it. I think that will be more expedient. | |||
ctalbert: So, Looks like we can remove 323171 from the urgent blocker category. | ctalbert: So, Looks like we can remove 323171 from the urgent blocker category. | ||
ctalbert: QA Wanted bugs will stay on the list | ctalbert: QA Wanted bugs will stay on the list | ||
ctalbert: (the list is here, by the way: http://wiki.mozilla.org/Calendar:QA_TODO | ctalbert: (the list is here, by the way: http://wiki.mozilla.org/Calendar:QA_TODO | ||
ctalbert: Do we need to keep the "Upgrade testing from 0.3a2 and 0.3a1 on the | ctalbert: Do we need to keep the "Upgrade testing from 0.3a2 and 0.3a1 on the | ||
list for another week? Sebo did some testing on it. | |||
ctalbert: What do people think? | ctalbert: What do people think? | ||
lilmatt: More testing == better until we have something else folks need to | lilmatt: More testing == better until we have something else folks need to | ||
focus on IMHO | |||
lilmatt: but if there's more important stuff, we can cut it | lilmatt: but if there's more important stuff, we can cut it | ||
ctalbert: Let's see what people suggest to add. | ctalbert: Let's see what people suggest to add. | ||
ctalbert: I think we'll leave lightning upgrade testing on the list. Bery has | ctalbert: I think we'll leave lightning upgrade testing on the list. Bery has | ||
done a bit of work with it, but we'd like to get more coverage there. | |||
Bery: good plan | Bery: good plan | ||
Bery: I only tested one scenario, after all :) | Bery: I only tested one scenario, after all :) | ||
ctalbert: The next three have had no takers, so they stay. | ctalbert: The next three have had no takers, so they stay. | ||
ctalbert: Damian has been really working hard on Litmus. So we'll take his | ctalbert: Damian has been really working hard on Litmus. So we'll take his | ||
completed tasks off. | |||
ctalbert: I'm going to make those quick edits now. While I'm doing that, does | ctalbert: I'm going to make those quick edits now. While I'm doing that, does | ||
anyone have any suggestions for new items to go onto the list? | |||
Bery: *checks the list for items related to printing* | Bery: *checks the list for items related to printing* | ||
celina63: I'm curious about the 3rd item on the current list | celina63: I'm curious about the 3rd item on the current list | ||
Bery: The primary focus of my users is with printing and task list items | Bery: The primary focus of my users is with printing and task list items | ||
(and, printing task list items :)) | |||
celina63: how can we test upgrading from the a1 and a2 to 0.3, until 0.3 is | celina63: how can we test upgrading from the a1 and a2 to 0.3, until 0.3 is | ||
released? | |||
lilmatt: to the nightly | lilmatt: to the nightly | ||
lilmatt: since all 0.3 will be is a "blessed" nightly | lilmatt: since all 0.3 will be is a "blessed" nightly | ||
ctalbert: lilmatt: What's the official story on printing? Your stuff landed in | ctalbert: lilmatt: What's the official story on printing? Your stuff landed in | ||
sunbird, right? | |||
lilmatt: Yes. | lilmatt: Yes. | ||
lilmatt: If we get time to do the crappy menuitem hack in Lightning, we'll put | lilmatt: If we get time to do the crappy menuitem hack in Lightning, we'll put | ||
that in as well. | |||
Bery: oh, whatever happened to the "hide completed items" checkbox for todo | Bery: oh, whatever happened to the "hide completed items" checkbox for todo | ||
lists? | |||
ctalbert: Ok folks can reload the TODO list. It's updated | ctalbert: Ok folks can reload the TODO list. It's updated | ||
ctalbert: I think one of the important things we need to do right now, is to | ctalbert: I think one of the important things we need to do right now, is to | ||
verify the fixes that are landing as the blockers get fixed. | |||
ctalbert: Bery: I'm not sure | ctalbert: Bery: I'm not sure | ||
Bery: One of my users extensively used the task list feature, but when the | Bery: One of my users extensively used the task list feature, but when the | ||
checkbox disappeared it got kind of useless (because his list was so darn long) | |||
ctalbert: I understand. But, we can't promise any new features at this late | ctalbert: I understand. But, we can't promise any new features at this late | ||
stage for 0.3. | |||
ctalbert: lilmatt: did the timezone database changes go in, or were those | ctalbert: lilmatt: did the timezone database changes go in, or were those | ||
removed in the last round of triaging? | removed in the last round of triaging? | ||
Line 86: | Line 86: | ||
mikeal: hiya | mikeal: hiya | ||
Bery: https://bugzilla.mozilla.org/show_bug.cgi?id=310258 - it has a bug report | Bery: https://bugzilla.mozilla.org/show_bug.cgi?id=310258 - it has a bug report | ||
already, that's good enough for me | |||
ctalbert: Does anyone have any other ideas of what to Add to the QA Todo list? | ctalbert: Does anyone have any other ideas of what to Add to the QA Todo list? | ||
I think I'll add some printing testcases for Sunbird. If those seem to work out | |||
okay, then perhaps we can convince dmose to put printing support into | |||
Lightning. | |||
ctalbert: Besides, I don't think the Sunbird printing feature has been throughly | ctalbert: Besides, I don't think the Sunbird printing feature has been throughly | ||
tested yet. | |||
ctalbert: mikeal: the ToDo list in question is at: http://wiki.mozilla.org/Calendar:QA_TODO | ctalbert: mikeal: the ToDo list in question is at: http://wiki.mozilla.org/Calendar:QA_TODO | ||
mikeal: ok, thanks | mikeal: ok, thanks | ||
ctalbert: np | ctalbert: np | ||
ctalbert: Speak up if anyone has ideas of things to add (or remove) from that | ctalbert: Speak up if anyone has ideas of things to add (or remove) from that | ||
list. I want to go on to the last agenda item. | |||
ctalbert: I believe that Damian wrote that, and he's not here at the moment. Essentially, he's wanting systematic way to scour the buglists for potential | ctalbert: I believe that Damian wrote that, and he's not here at the moment. | ||
Essentially, he's wanting systematic way to scour the buglists for potential | |||
litmus testcases. | |||
mikeal: do you guys have caldav tests written yet? | mikeal: do you guys have caldav tests written yet? | ||
mikeal: sorry, automated caldav tests | mikeal: sorry, automated caldav tests | ||
ctalbert: Not very many tests written, and no automated ones. | ctalbert: Not very many tests written, and no automated ones. | ||
ctalbert: jminta, lilmatt: would there be anyproblem with adding a whiteboard | ctalbert: jminta, lilmatt: would there be anyproblem with adding a whiteboard | ||
item to designate "potential testcase" in bugzilla? | |||
mikeal: ok, can you point me at docs on how to write/run automated | mikeal: ok, can you point me at docs on how to write/run automated | ||
sunbird/lighting tests | sunbird/lighting tests | ||
Line 119: | Line 120: | ||
xFallenAngel: there is a testcase keyword | xFallenAngel: there is a testcase keyword | ||
mikeal: most of the current server test tools just make raw HTTP requests, the | mikeal: most of the current server test tools just make raw HTTP requests, the | ||
web UI is tested with Selenium and the json-rpc backend it tested with a raw | |||
HTTP tool | |||
ctalbert: Yes, there's a lot of discussion in the mozilla QA side that is trying | ctalbert: Yes, there's a lot of discussion in the mozilla QA side that is trying | ||
to standarize on a common set, but I don't believe that has converged. Let's | |||
talk about this at the end of the calendar QA meeting, please. | |||
mikeal: and then Chandler has it's own scripting layer built on wx that we use | mikeal: and then Chandler has it's own scripting layer built on wx that we use | ||
to automate everything using the UI | |||
mikeal: ok | mikeal: ok | ||
ctalbert: xFallenAngel: Maybe then it would be best to use that keyword | ctalbert: xFallenAngel: Maybe then it would be best to use that keyword | ||
ctalbert: I think using that keyword would be the right approach. I'll take this | ctalbert: I think using that keyword would be the right approach. I'll take this | ||
up with dmose and any bugzilla admins I need to. | |||
xFallenAngel: does this keyword need to be set by a developer, or can it be | xFallenAngel: does this keyword need to be set by a developer, or can it be | ||
requested/set by anyone? | |||
jminta: the testcase keyword means a testcase exists for the bug already | jminta: the testcase keyword means a testcase exists for the bug already | ||
ctalbert: I just want to encourage everyone to add that keyword to bugs with | ctalbert: I just want to encourage everyone to add that keyword to bugs with | ||
good Steps to Reproduce that would make sense to be testcases that would be run | |||
on an ongoing basis. | |||
ctalbert: xFallenAngel: That's the kind of thing I need to figure out. | ctalbert: xFallenAngel: That's the kind of thing I need to figure out. | ||
ctalbert: jminta: then would a whiteboard item be better? | ctalbert: jminta: then would a whiteboard item be better? | ||
ctalbert: xFallenAngel: Ideally, I want both developer and QA to be able to set | ctalbert: xFallenAngel: Ideally, I want both developer and QA to be able to set | ||
the attribute. | |||
jminta: sure [needs testcase] or [testcase wanted] | jminta: sure [needs testcase] or [testcase wanted] | ||
ssitter: xFallenAngel: see https://bugzilla.mozilla.org/describekeywords.cgi | ssitter: xFallenAngel: see https://bugzilla.mozilla.org/describekeywords.cgi | ||
for meaning of keywords | |||
jminta: anyone with editbugs should be able to do that | jminta: anyone with editbugs should be able to do that | ||
ctalbert: Cool. I'll suggest those to Damian then. | ctalbert: Cool. I'll suggest those to Damian then. | ||
ssitter: mmh, it's not clear if you want a testcase attached to bug (e.g. ics | ssitter: mmh, it's not clear if you want a testcase attached to bug (e.g. ics | ||
sample) or a new testcase in litmus | |||
ctalbert: [litmus testcase wanted] | ctalbert: [litmus testcase wanted] | ||
ctalbert: how's that ^^^ | ctalbert: how's that ^^^ | ||
xFallenAngel: well, if the bug already has most steps for the testcase, they | xFallenAngel: well, if the bug already has most steps for the testcase, they | ||
litmus testcase wanted sounds more like there is something missing. I suggest | |||
[valid litmust testcase] | |||
xFallenAngel: -t | xFallenAngel: -t | ||
ctalbert: sounds good to me. | ctalbert: sounds good to me. | ||
ctalbert: Anyone else have a thought about it? It needs to be something we can | ctalbert: Anyone else have a thought about it? It needs to be something we can | ||
all remember easily. | |||
ctalbert: Going once.... | ctalbert: Going once.... | ||
celina63: sounds good to me | celina63: sounds good to me | ||
ctalbert: ssitter, what do you think about it? | ctalbert: ssitter, what do you think about it? | ||
xFallenAngel: we could note it on the wiki somewhere, then we can look it up if | xFallenAngel: we could note it on the wiki somewhere, then we can look it up if | ||
we forget? | |||
ssitter: maybe [litmus testcase wanted] and [has litmus testcase]? | ssitter: maybe [litmus testcase wanted] and [has litmus testcase]? | ||
ctalbert: xFallenAngel: we will. | ctalbert: xFallenAngel: we will. | ||
Line 168: | Line 169: | ||
ctalbert: That too | ctalbert: That too | ||
ctalbert: I think I'm going to change my vote to ssitter's proposal. I like the | ctalbert: I think I'm going to change my vote to ssitter's proposal. I like the | ||
idea of tracking what we've put into Litmus. Because Litmus isn't all that good | |||
at keeping track of these things yet. | |||
ssitter: or instead of [has litmus testcase] just create a bug comment like | ssitter: or instead of [has litmus testcase] just create a bug comment like | ||
'litmus testcase 12345 created' | |||
ssitter: this helps to keep status whiteboard clean | ssitter: this helps to keep status whiteboard clean | ||
ctalbert: good idea | ctalbert: good idea | ||
ctalbert: Does anyone object to that idea? | ctalbert: Does anyone object to that idea? | ||
ctalbert: Does anyone have anything else to add to the QA TODO list. I've made | ctalbert: Does anyone have anything else to add to the QA TODO list. I've made | ||
the updates we discussed. | |||
ctalbert: Okay. Anyone have anything else to discuss, we have about four minutes | ctalbert: Okay. Anyone have anything else to discuss, we have about four minutes | ||
left to this meeting. (Besides automated testing - we'll get to that next). | |||
* ctalbert hasn't forgotten mikeal | * ctalbert hasn't forgotten mikeal | ||
mikeal: :) | mikeal: :) | ||
ctalbert: Ok. Don't forget to update the ToDo list with the things you do. Thanks for all your time. | ctalbert: Ok. Don't forget to update the ToDo list with the things you do. | ||
Thanks for all your time. | |||
ctalbert: Happy testing. | ctalbert: Happy testing. | ||
* ctalbert takes off his "official calendar-qa meeting hat" | * ctalbert takes off his "official calendar-qa meeting hat" | ||
</pre> | </pre> |
edits