Confirmed users
3,376
edits
ReleaseEngineering/How To/Validate a New Config: Difference between revisions
Jump to navigation
Jump to search
ReleaseEngineering/How To/Validate a New Config (view source)
Revision as of 14:31, 26 February 2019
, 26 February 2019→Validate the config: - perf
(next steps) |
(→Validate the config: - perf) |
||
| Line 41: | Line 41: | ||
* for both try pushes ensure that we are building each job multiple times (I recommend 5 data points for each job) | * for both try pushes ensure that we are building each job multiple times (I recommend 5 data points for each job) | ||
* once complete, we want to build a spreadsheet of each job before/after and compare the average runtime and intermittent failure rate. | * once complete, we want to build a spreadsheet of each job before/after and compare the average runtime and intermittent failure rate. | ||
* if this is a change that affects the builds or the hardware, then we need to compare performance numbers before/after | |||
= TODO_INSERT_TOOL_HERE = | = TODO_INSERT_TOOL_HERE = | ||