QA/Test Pilot Test Plan: Difference between revisions

m
Line 21: Line 21:
* Areas of test coverage
* Areas of test coverage
** Installing/Upgrading the extension
** Installing/Upgrading the extension
** General User Interface
** ''It is very important to ensure the quality for the following experiences, since it represents the ability for Test Pilot to roll out studies and gain data. This process won't be changed by individual studies.'' Verify:
*** Access to various pages
**# if users are able to quit the study after they opt in
*** Verify interfaces for surveys, experiments, etc.
**# if users are able to submit data when the study finishes
*** Verify data is collected as expected
**# if the data is still being collected when the study finishes
*** Confirm data is uploaded with feedback as to its status
**# if data set is empty
** Attempt to verify bug fixes a couple times a month
**# if users are asked again to submit their data after the submission
**# if the study is associated well with the survey
**# if users are able to participate multiple studies at the same time
**# if users get notification during the correct time
**The log and instruments for each concrete study.  ''This is very crucial for Test Pilot to get correct and meaningful data. For Q1, one study is scheduled per month.''
** Access to various pages linked from the extension or survey
** Verify interfaces for surveys, experiments, etc.
 
* Attempt to verify bug fixes a couple times a month


* Unit tests from developers?
* Unit tests from developers?
Confirmed users
4,072

edits