Sheriffing/How To/Merges: Difference between revisions

← Older edit

Sheriffing/How To/Merges (view source)

Revision as of 10:13, 23 November 2021

5,800 bytes added , 23 November 2021

add instructions to request missing tasks to get merge candidate if no merge since last Nightly builds

Archaeopteryx

Confirmed users

571

edits

@@ Line 1: / Line 1: @@
-'''Merges:'''
+{{Sheriffing How To|Merges}}
+= Goal =
+'''Autoland''' is a repository opened for developers who work on bug fixes, improvements and other. Merging means that clean code is transferred from Autoland to Central, and back if there are any changes Central might hold, but Autoland not. <br />
+<span style="color:#14866d">'''''No sync is performed, only differences are transferred.'''''</span>
-''Merging around twice a day to/from autoland and mozilla-inbound to mozilla-central''
+= Choosing a changeset to merge =
+For merges from the integration trees to mozilla-central, you should choose a changeset with a green Shippable run to avoid bustages on nightly builds that also run on Shippable. You need to also make sure that are *NOT* any backouts *after* that changeset.
-'''Merges from the integration trees to mozilla-central are done on green PGO runs to avoid bustages on PGO which could affect as example Nightly Builds'''
+'''A more in depth view of the conditions a merge candidate must fulfill:'''
+#Candidate revision must be <span style="color:#14866d">'''100% completed'''</span> or <span style="color:#14866d">'''at least 98-99%'''</span>, with <span style="color:#14866d">'''maximum 15 jobs running'''</span>. The candidate revision will have the Windows 10 Shippable opt suite and the complete Windows 10 opt suite.
+#<span style="color:#FF0000">'''No jobs classified as fixed by commit'''</span>
+#'''Few''' or '''no unclassified''' jobs
+#Windows 10 '''Shippable''' platform and Windows 10 '''opt''' must have <span style="color:#14866d">'''all jobs finished'''</span> (see screenshot as an example)
+[[File:Win10.png|center|windows 10]]
+#No backouts after merge candidate
+#If a merge candidate has more than 15 jobs running but they are autophone jobs, the candidate is good to use
+If the planned merge is scheduled directly before Nightly builds will run on mozilla-central and there is no merge candidate and there hasn't been a merge to mozilla-central since the last Nightly builds ran, check if requesting all missing tasks for an autoland push has a good chance to turn it into a merge candidate. If that applies, request the missing tasks from the push's menu.
-= Step 1=
+Onboarding code sheriffs shall let the merge candidate they identified get checked by another sheriff.
-Merging from autoland and mozilla-inbound to mozilla-central
-Example mozilla-inbound to mozilla-central merge
+= Order of operations =
- -> cd into your mozilla-central directory
+Integration branches should be merged to mozilla-central first, then mozilla-central should be merged back to the integration branches. These merge instructions were copied from [[Sheriffing/How:To:SheriffingFromUnifiedRepos#Merges|Sheriffing From Unified Repos]] document.
- -> hg pull ssh://hg.mozilla.org/integration/mozilla-inbound -r (the green with PGO runs inbound revision changeset) - also make sure there are no backouts  after that etc
- -> hg merge && hg commit -m "merge inbound to mozilla-central"
- -> push
-'''don't forget to use Bugherder after that! It's available from the menu for the push on [https://treeherder.mozilla.org/#/jobs?repo=mozilla-central Treeherder]'''
+'''Merge pattern:'''
+# autoland > central
+# central > autoland <span style="color:#14866d">(if Central has changes Autoland might not)</span>
-= Step 2 =
+== Merging from autoland to mozilla-central ==
-Merging back from mozilla-central to autoland and mozilla-inbound
+Steps on how to do the <span style="color:#14866d">'''autoland to mozilla-central'''</span> merge:
-Example mozilla-central to mozilla-inbound merge
+# Have your revision ids ready
- -> go to your mozilla-inbound tree directory
+# In the console switch to Mozilla-unified directory: <code>cd mozilla-unified</code>
- -> hg pull && hg update to make sure its the latest
+# Download the Central repo: <code>hg pull central</code>
- -> hg pull ssh://hg.mozilla.org/mozilla-central/
+# Switch and update to it: <code>hg update central</code>
- -> hg merge
+# Autoland to central merge command: <code>hg merge -r <span style="color:#14866d"><autoland_revision_id></span></code>
- -> hg commit -m "merge mozilla-central to mozilla-inbound"
+# Add a commit message: <code>hg commit -m "Merge autoland to mozilla-central.  a=merge"</code>
- -> hg push
+# Transfer the files to Central repo: <code>hg push -r . central</code>
- since this above might result in race conditions on the tree
-(when its busy there) this works better ->
- go to your mozilla-inbound tree
- hg pull && hg update && hg pull ssh://hg.mozilla.org/mozilla-central/ && hg merge && hg commit -m  "Merge mozilla-central to [TREENAME]" &&  hg push
-Aliases for the various repositories make the above easier to type!
+After the merge is in Central, <span style="color:#FF0000">'''bugs need to be marked with Bugherder'''</span>: go to Central and in the top right side of each of your pushes to Central, click on '''Action Menu''' (arrow button next to the pin button) and choose '''Mark With Bugherder'''.
+[[File:Bugherder tool.png|frame|center]]
+Navigate through all the pages, check for any security bugs that can’t be updated by Bugherder and mention them to someone who can, check that Resolve and Fixed checkboxes are ticked and the correct version is set. At the last step click '''Submit''' and use your '''API key''' to finish the process. Leave the tab opened until the loadbar is not displayed anymore.
+Announce in the sheriffing chat if there are bugs shown as restricted by Bugherder because the tool cannot access it and they need to be updated manually. Some of these bugs are also not accessible to code sheriffs.
+<span style="color:#14866d">'''Monitor the pushes and check that the Gecko Decision Task opt job is running. If it fails, rerun it, if it fails again the tree should be closed and the issue escalated.'''</span>
+== Merging back from mozilla-central to autoland ==
+Steps on how to do the <span style="color:#14866d">'''mozilla-central to autoland'''</span> merge:
+# Close autoland from [https://mozilla-releng.net/treestatus Treestatus]
+# In the console switch to Mozilla-unified directory: <code>cd mozilla-unified</code>
+# Download the repos: <code>hg pull fxtrees</code>
+# Update autoland: <code>hg update autoland</code>
+# Merge from central to autoland: <code>hg merge central</code>
+# Add a commit message: <code>hg commit -m "Merge mozilla-central to autoland. CLOSED TREE"</code>
+# Transfer the files to Autoland: <code>hg push -r . autoland</code>
+These commands *might* result in race conditions on the tree when it is busy. Under those circumstances, this commands avoid delays between steps:
+ cd mozilla-unified
+ hg pull && hg update autoland && hg merge central && hg commit -m "Merge mozilla-central to autoland" && hg push -r . autoland
+<span style="color:#FF0000">'''Note'''</span>: For correcting a commit message, use <code>hg commit --amend</code>
+=== When there is nothing to merge ===
+You run <code>hg update</code> to get a working copy information, but there are no changes on mozilla-central and so nothing to merge. The workflow for this case is:
+# Run <code>hg update</code>
+#* You can run <code>hg out</code> to list all the changesets to merged to mozilla-central.
+# Because there's been no merge, you won't have a commit containing a approval message, e.g. "merge a to b a=me." This means you will run afoul of the hg hook telling you that the m-c repo is set to approval-only. You need to temporarily set the mozilla-central tree to "open" via [https://mozilla-releng.net/treestatus Treestatus] to be able to push.
+# Push your changes from Step 1.
+# Set the m-c tree back to "approval-required" in Treestatus. This is important because if we miss this, we risk unexpected pushes to mozilla-central since some people might think the open tree is intentional.
+# Use Bugherder to mark and failures as usual for your push. If all bugs failed to get marked, entered Bugzilla API might be wrong. Close the tab and try with a new one. If only some failed, open Bugherder for that push again and append <code>&resume=1</code> to the url.
+# Now when you merge from autoland you get the note that you need to merge.
+= Issues =
+== Push rejected: DOM peer review needed ==
+(fix still needs to be verified in production)
+If the server rejects the push with the merge and complains that a changeset needs review by a DOM peer, you can disable this check. The issue should only affect merges with changesets which initially landed on autoland. Temporarily add this to the <code>hgrc</code> file in the <code>.hg</code> folder of the repository:
+<code>mozilla.check.webidl_check = false</code>
+= Merges from central to beta etc. =
+These merges are done per release cycle to update the repository containing the code closer to the release repository with the code from the more development oriented repository. This merge is performed by the Release Engineering team.