TestEngineering/Performance/Raptor: Difference between revisions

Jump to navigation Jump to search
Line 46: Line 46:


==== Cold Page-Load ====
==== Cold Page-Load ====
For cold page-load tests, the desktop browser (or android browser app) is shutdown and re-started between page load cycles; so the browser is cold on each page-load. This is what happens for Raptor cold page-load tests:
For cold page-load tests, the desktop browser (or android browser app) is shut down and restarted between page load cycles; so the browser is cold on each page-load. This is what happens for Raptor cold page-load tests:


'''Raptor cold page-load test process when running on Firefox/Chrome/Chromium desktop:'''
'''Raptor cold page-load test process when running on Firefox/Chrome/Chromium desktop:'''
Line 56: Line 56:
* The test URL is loaded; measurements taken
* The test URL is loaded; measurements taken
* The tab is closed
* The tab is closed
* The desktop browser is shutdown
* The desktop browser is shut down
* Entire process is repeated for the remaining browser cycles (25 cycles total)
* Entire process is repeated for the remaining browser cycles (25 cycles total)
* The measurements from all browser cycles are used to calculate overall results
* The measurements from all browser cycles are used to calculate overall results


'''Raptor cold page-load test process when running on Firefox android browser apps:'''
'''Raptor cold page-load test process when running on Firefox Android browser apps:'''


* The android app data is cleared (via `adb shell pm clear firefox.app.binary.name`)
* The Android app data is cleared (via `adb shell pm clear firefox.app.binary.name`)
* A new browser profile is created
* A new browser profile is created
* The new browser profile is copied onto the android device sdcard
* The new browser profile is copied onto the Android device sdcard
* The Firefox android app is started up
* The Firefox Android app is started up
* Post-startup browser settle pause of 30 seconds
* Post-startup browser settle pause of 30 seconds
* On Fennec only, a new browser tab is created (other Firefox apps use the single/existing tab)
* On Fennec only, a new browser tab is created (other Firefox apps use the single/existing tab)
* The test URL is loaded; measurements taken
* The test URL is loaded; measurements taken
* The android app is shutdown
* The Android app is shut down
* Entire process is repeated for the remaining browser cycles (15 cycles total)
* Entire process is repeated for the remaining browser cycles (15 cycles total)
* Note that the SSL cert DB is only created once (browser cycle 1) and copied into the profile for each additional browser cycle; thus not having to use the 'certutil' tool and re-created the db on each cycle
* Note that the SSL cert DB is only created once (browser cycle 1) and copied into the profile for each additional browser cycle; thus not having to use the 'certutil' tool and re-created the db on each cycle
Confirmed users
9,511

edits

Navigation menu