Project

General

Profile

Release Process » History » Version 152

Dominic Cleal, 02/23/2016 06:12 AM
redmine releases

1 1 Dominic Cleal
h1. Release Process
2
3 134 Dominic Cleal
For each major release (i.e. not patch releases), the project selects a release manager who's responsible for taking the develop branch through to release.
4 1 Dominic Cleal
5
Please amend these lists as you see free, and as you find what works and what doesn't work.
6
7 51 Lukas Zapletal
h2. First steps
8 1 Dominic Cleal
9 132 Dominic Cleal
# Select the release manager
10 2 Dominic Cleal
# Ensure RPM and Debian nightly packages are in good shape and all RPM dependencies are up to date
11 7 Dominic Cleal
# Ensure "Transifex project":https://www.transifex.com/projects/p/foreman/ is up to date
12 1 Dominic Cleal
# Decide on the version number
13 2 Dominic Cleal
# If number has changed, update version number in redmine
14 94 Dominic Cleal
# Add _next+1_ anticipated version number to redmine under "Releases":http://projects.theforeman.org/rb/releases/foreman, sharing "With subprojects"
15 51 Lukas Zapletal
16 132 Dominic Cleal
h2. Near-end of development phase
17 51 Lukas Zapletal
18 1 Dominic Cleal
# Announce beginning of bug-squashing to foreman-dev ("example":http://groups.google.com/group/foreman-dev/browse_thread/thread/769d9060774da864)
19
# Copy website manual content ("theforeman.org repo":http://github.com/theforeman/theforeman.org) from previous version to this version ("example":https://github.com/theforeman/theforeman.org/pull/43)
20 132 Dominic Cleal
#* add version number to documentation.md dropdown menu
21 126 Dominic Cleal
# Change @$latest@ and @$next@ parameters on @web@ class to point to the new version numbers (see @foreman-infra/puppet/modules/web/manifests/init.pp@)
22 8 Dominic Cleal
# Update manual if applicable for any additional installation steps
23 58 Lukas Zapletal
# Draft release notes in markdown ("example":https://gist.github.com/domcleal/5567450) using roadmap, with these sections (and do not use personal pronouns):
24 6 Dominic Cleal
## Headline features: half a dozen important features with a few sentences description each
25
## Upgrade notes: all important notices that users must be aware of before upgrading
26 64 Lukas Zapletal
## Release notes: bullet point list by category of most changes, excluding bug fixes for issues introduced during the release cycle, include link to bug numbers (helper vim search and replace command bellow)
27 112 Dominic Cleal
## CLI release notes are taken from the hammer-cli and hammer-cli-foreman changelogs
28
## Link to installer changelogs and note the rough versions being used
29 60 Lukas Zapletal
# Check @git log@ for any changes without associated bug number and add to release notes if applicable (https://gist.github.com/lzap/6520535)
30 1 Dominic Cleal
# Refresh unattended templates from the community-templates to Foreman core, by running @script/sync_templates.sh@
31
# Create a new branch in community-templates for upcoming Foreman release (e.g. 1.2-stable)
32 132 Dominic Cleal
# Generate a release GPG key using [[GPG_Keys]]
33
#* publish to keyserver
34
#* security.md on the website
35
#* create @releases/1.2/RPM-GPG-KEY-foreman@ on yum.theforeman.org
36 117 Dominic Cleal
# Clone tags and create build targets in "Koji":http://koji.katello.org/koji using koji/copy-tags-commands.sh in foreman-packaging/rpm/develop
37 55 Lukas Zapletal
#* foreman-1.2-rhel6 etc. as clones of nightly tags
38 107 Dominic Cleal
#* foreman-plugins-1.2-rhel6 etc. with inheritance from the new Foreman tags
39 151 Dominic Cleal
#* Untag all git/nightly builds: @for t in foreman-1.2-rhel6 foreman-1.2-nonscl-rhel6 foreman-1.2-rhel7 foreman-1.2-nonscl-rhel7 foreman-1.2-fedora21; do kkoji list-tagged $t  | grep git | awk '{print $1}' | xargs kkoji untag-build  $t; done@
40 111 Dominic Cleal
# Create mash scripts and configuration on Koji
41
#* copy /usr/local/bin/foreman-mash-split-1.*.py to foreman-mash-split-1.2.py, update the OSes and version numbers at the bottom
42 147 Dominic Cleal
#* copy /etc/mash/foreman-1.*-*.mash and foreman-plugins-1.*-*.mash, update the version numbers, add/remove files for OS changes, set GPG key ID and ensure strict_keys=True
43 124 Dominic Cleal
# Add new plugin tags (i.e. 1.2) to Koji plugins mash script (foreman-mash-split-plugins.py), remove old ones (keep three)
44 150 Dominic Cleal
# Add version (1.2) to these jobs, remove old ones (keep three)
45
## "release_plugins_push":http://ci.theforeman.org/job/release_plugins_push (note, it will be added to tests later)
46
## "packaging_plugin_retag":http://ci.theforeman.org/job/packaging_plugin_retag/
47
## "packaging_retag":http://ci.theforeman.org/job/packaging_retag/
48 110 Dominic Cleal
# Clone Debian nightly repos to 1.2 using "copy/freight instructions":http://projects.theforeman.org/projects/foreman/wiki/Debian_Packaging#Project-sources
49 64 Lukas Zapletal
# Add release to "Found in release" list in redmine: http://projects.theforeman.org/custom_fields/4/edit
50
51 1 Dominic Cleal
Helper vim command to replace all @(#1234)@ bugs with links:
52 64 Lukas Zapletal
53
    %s/(\(#\)\([0-9]\+\))/(\[\1\2]\(http:\/\/projects.theforeman.org\/issues\/\2))/g
54 1 Dominic Cleal
55 140 Dominic Cleal
h2. Branching for series
56 8 Dominic Cleal
57 115 Dominic Cleal
When ready to branch for release candidates.
58 1 Dominic Cleal
59 40 Dominic Cleal
# Make releases of installer modules, usually new minor or major versions
60 61 Lukas Zapletal
# Add new languages that are at a reasonable completion on Transifex to *develop*
61 1 Dominic Cleal
# In foreman *develop* run @make -C locale tx-update@
62
# In foreman, smart-proxy, foreman-installer and foreman-selinux branch *develop* to *1.2-stable* (*from this point* cherry-picks into this branch only from this point using: @git cherry-pick -x SHA@)
63 132 Dominic Cleal
# In foreman-installer, branch *1.2-stable*,
64 1 Dominic Cleal
## change Puppetfile from git references to specific version ranges (e.g. @>= 1.3.1 < 1.4.0@)
65
# In foreman-packaging for RPMs:
66 70 Dominic Cleal
## branch *rpm/develop* to *rpm/1.2*
67 132 Dominic Cleal
## on *rpm/1.2*
68
### in rel-eng/releasers.conf and rel-eng/tito.props, replace "nightly" with "1.2"
69
### change @foreman/foreman.repo@ URLs from @/nightly@ to @/releases/1.2@, change "nightly" in name to "1.2" and enable gpg checking
70
### change @foreman/foreman-plugins.repo@ URLs from @/plugins/nightly@ to @/plugins/1.2@, change "nightly" in name to "1.2" and DO NOT enable GPG checking
71
### update @foreman/foreman.gpg@ with the release public key
72 127 Dominic Cleal
## on *rpm/develop*
73
### change foreman/foreman-proxy/foreman-installer/foreman-selinux version to 1.3.0, add %changelog entry
74 142 Dominic Cleal
### change tag_suffix to @.fm1_3@ in rel-eng/tito.props, and rel-eng/releasers.conf
75 122 Dominic Cleal
# In foreman-packaging for debs:
76
## on *deb/develop*, update debian/*/*/changelog with entries from 1.1, commit with message "Sync 1.1.x releases into changelogs"
77
## branch *deb/develop* to *deb/1.2*
78 144 Dominic Cleal
## on *deb/develop*, run @scripts/changelog.rb -v 1.3.0-1 -m "Bump changelog to 1.3.0 to match VERSION" debian/*/*/changelog@ 
79 1 Dominic Cleal
# In foreman *develop* commit with message "Bump version to 1.3-develop":
80 100 Dominic Cleal
## change to VERSION to 1.3.0-develop
81 106 Dominic Cleal
## run @extras/changelog@
82 100 Dominic Cleal
# In smart-proxy *develop* commit with message "Bump version to 1.3-develop":
83
## change to VERSION to 1.3.0-develop
84 1 Dominic Cleal
## run @extra/changelog@
85 52 Dominic Cleal
# In foreman-selinux *develop* commit with message "Bump version to 1.3-develop":
86 1 Dominic Cleal
## change to VERSION to 1.3.0-develop
87
## run @extras/changelog@
88
# In foreman-installer *develop* commit with message "Bump version to 1.3-develop":
89
## change to VERSION to 1.3.0-develop
90 101 Dominic Cleal
# Update foreman-dev with "translations status":https://www.transifex.com/projects/p/foreman/ to encourage 100% translations before release, announce string freeze date
91 1 Dominic Cleal
# Change Transifex resource URL to point to the 1.2-stable branch
92 102 Dominic Cleal
# Set up test_1_2_stable job on Jenkins, copy from existing stable or test_develop (don't use dots in the name, it breaks)
93 1 Dominic Cleal
# Set up test_proxy_1_2_stable job on Jenkins in the same way
94
# Update release notes in new website manual version
95 103 Dominic Cleal
96 140 Dominic Cleal
h2. Preparing a release
97 1 Dominic Cleal
98 132 Dominic Cleal
Version numbers for release candidates start with "1.2.0-RC1" (always hyphenated).  The first release after RC would be "1.2.0".  Change examples below as appropriate.
99
100 1 Dominic Cleal
# Make patch releases of installer modules that have important changes
101 132 Dominic Cleal
#* Branch to MAJ.MIN-stable if recent changes to the module aren't suitable for patch (x.y.z) release
102 1 Dominic Cleal
# Compare tagged packages in nightly vs. release koji tag and re-tag any updated dependencies that are required
103 152 Dominic Cleal
# Add a new "Redmine release":http://projects.theforeman.org/rb/releases/foreman for the next minor, unless the series is EOL
104
# Remove/change release field for any open Redmine tickets assigned to the release still (next minor, unset it or reject)
105
# Change Redmine release state to _Closed_
106 139 Dominic Cleal
# List all issues targeted at the release, order by Closed date ascending and use @git cherry-pick -x@ to cherry pick from develop to *1.2-stable* branch
107
# Clone "tool_belt":https://github.com/theforeman/tool_belt (foreman branch) and run:
108
## @./tools.rb setup-environment configs/foreman_12.yaml@
109 1 Dominic Cleal
## @./tools.rb cherry-picks --version 1.2.0 configs/foreman_12.yaml@
110
## Verify tickets in the @cherry_picks_1.2.0@ file are accounted for or additional cherry pick them
111 140 Dominic Cleal
112
h2. Tagging a release
113
114 1 Dominic Cleal
# In foreman *1.2-stable* run:
115
## @make -C locale tx-update@
116
## @script/sync_templates.sh@
117
# In foreman *1.2-stable* commit with message "Release 1.2.0":
118
## change VERSION to 1.2.0
119
## run @extras/changelog@
120 104 Dominic Cleal
# In smart-proxy *1.2-stable* commit with message "Release 1.2.0":
121
## change VERSION to 1.2.0
122 1 Dominic Cleal
## run @extra/changelog@
123 115 Dominic Cleal
# In foreman-selinux *1.2-stable* commit with message "Release 1.2.0":
124 109 Dominic Cleal
## change VERSION to 1.2.0
125 1 Dominic Cleal
## run extras/changelog
126
# In foreman-installer *1.2-stable* commit with message "Release 1.2.0":
127 115 Dominic Cleal
## change VERSION to 1.2.0
128
# Tag commits in foreman, smart-proxy, foreman-installer and foreman-selinux: @git tag -m "Release 1.2.0" 1.2.0@
129 52 Dominic Cleal
# Push to the project repos: @git push project && git push project 1.2.0@
130 1 Dominic Cleal
# Run the Jenkins "Release Pipeline":http://ci.theforeman.org/view/Release%20pipeline/ to create tarballs
131
# Verify tarballs are present on downloads.theforeman.org, download, sign and upload detached signatures
132 115 Dominic Cleal
## @gpg --homedir gnupg/1.2 -b -u packages@theforeman.org foreman-1.2.0.tar.bz2@ (requires 1.2 release GPG key generated above)
133 132 Dominic Cleal
134
h2. Packaging a release
135
136 1 Dominic Cleal
# In foreman-packaging rpm/1.2 branch, change foreman.spec, foreman-proxy.spec, foreman-selinux.spec, foreman-installer.spec:
137 132 Dominic Cleal
## set version to "1.2.0"
138
## For RCs: set release to "0.1%{?dotalpha....", uncomment alphatag* (replace # with %), change to RC1
139
## For non-RCs: set release to "1%{?dotalpha....", comment alphatag* (replace % with #)
140 52 Dominic Cleal
## in each package dir, run @spectool -g *.spec@ and @git annex add *.tar.bz2@
141 115 Dominic Cleal
## commit with message "Release 1.2.0"
142 1 Dominic Cleal
## perform RPM scratch build of each project (see [[RPM_Packaging]])
143 115 Dominic Cleal
## tag each project with @tito tag --keep-version --auto-changelog-message "Release 1.2.0"@
144 132 Dominic Cleal
# [[Debian_Packaging#foreman]]: Update changelog files
145
## @scripts/changelog.rb -v 1.2.0-1 -m "1.2.0 released" debian/*/*/changelog@
146 115 Dominic Cleal
# Trigger next step of release pipeline: @release_packages@
147 132 Dominic Cleal
# Use [[RPM_Packaging]] to sign RPMs
148
# Trigger next step of release pipeline: @release_mash@
149
# Trigger next step of release pipeline: @release_test@
150
# Trigger next step of release pipeline: @release_push_deb@ and @release_push_rpm@
151 115 Dominic Cleal
# Update theforeman.org sections:
152 138 Dominic Cleal
## @_includes/version.html@
153 132 Dominic Cleal
## @_includes/latest_news.html@ entry
154 149 Dominic Cleal
## @security.md@ for any released CVE fixes
155 115 Dominic Cleal
156 132 Dominic Cleal
h2. Completion tasks
157 41 Dominic Cleal
158 132 Dominic Cleal
If releasing the first non-RC release (i.e. 1.2.0), start with:
159
# update @$stable@ class parameter on @web@ class to point to the new version number (see @foreman-infra/puppet/modules/web/manifests/init.pp@)
160 137 Dominic Cleal
# deb.theforeman.org, changing stable:
161
## change web's /var/www/freight/apt/*/stable symlinks to the new version number
162
## @rm -rf /var/www/vhosts/deb/htdocs/pool/*/stable/@
163
## re-run freight cache
164 132 Dominic Cleal
# Update theforeman.org:
165
## @documentation.md@ change default version
166
## @_config.yml@ quickstart link
167
## @_layouts/manual.html@ latestversion
168
## @_layouts/homepage.html@ quickstart link
169 146 Dominic Cleal
## @plugins/index.md@ version
170 132 Dominic Cleal
171
If releasing the first release candidate (i.e. RC1), start with:
172
173
# add version (1.2) to "release_plugins_test":http://ci.theforeman.org/job/release_plugins_test/ job
174
175
For all releases:
176
177 1 Dominic Cleal
# Send announcement e-mail to foreman-announce, CC foreman-users, set reply-to to foreman-users
178 145 Greg Sutcliffe
# Link to announcement e-mail on IRC, Twitter, Google+ and update IRC /topic
179 84 Dominic Cleal
# Add release to "Found in release" list in redmine: http://projects.theforeman.org/custom_fields/4/edit
180 148 Dominic Cleal
# Update the release schedule on [[Development_Resources]] to enter the date and for the following release(s)
181 132 Dominic Cleal
# Final only: Update Wikipedia Foreman entry at: https://en.wikipedia.org/wiki/Foreman_(software)
182 40 Dominic Cleal
183
h2. After final release
184 115 Dominic Cleal
185 49 Dominic Cleal
# Sync translations from Transifex into *develop* and update i18n
186 1 Dominic Cleal
# Remove target version from all issues assigned to the current release, unless they will be fixed in a future point release