kotovalexarian-likes-gitlab/gitlab-org--gitlab-foss
1
0
Fork 0
Code Releases Activity
gitlab-org--gitlab-foss/PROCESS.md
Fabio Busatto 8f335b27b0 Add how to manage a regression
2018-06-18 08:44:14 -04:00

18 KiB
Raw Blame History

GitLab core team & GitLab Inc. contribution process

Table of Contents generated with DocToc

Purpose of describing the contributing process

Below we describe the contributing process to GitLab for two reasons:

  1. Contributors know what to expect from maintainers (possible responses, friendly treatment, etc.)
  2. Maintainers know what to expect from contributors (use the latest version, ensure that the issue is addressed, friendly treatment, etc.).

Common actions

Merge request coaching

Several people from the GitLab team are helping community members to get their contributions accepted by meeting our Definition of done.

What you can expect from them is described at https://about.gitlab.com/roles/merge-request-coach/.

Assigning issues

If an issue is complex and needs the attention of a specific person, assignment is a good option but assigning issues might discourage other people from contributing to that issue. We need all the contributions we can get so this should never be discouraged. Also, an assigned person might not have time for a few weeks, so others should feel free to takeover.

Be kind

Be kind to people trying to contribute. Be aware that people may be a non-native English speaker, they might not understand things or they might be very sensitive as to how you word things. Use Emoji to express your feelings (heart, star, smile, etc.). Some good tips about code reviews can be found in our Code Review Guidelines.

Feature freeze on the 7th for the release on the 22nd

After 7th at 23:59 (Pacific Time Zone) of each month, RC1 of the upcoming release (to be shipped on the 22nd) is created and deployed to GitLab.com and the stable branch for this release is frozen, which means master is no longer merged into it. Merge requests may still be merged into master during this period, but they will go into the next release, unless they are manually cherry-picked into the stable branch.

By freezing the stable branches 2 weeks prior to a release, we reduce the risk of a last minute merge request potentially breaking things.

Any release candidate that gets created after this date can become a final release, hence the name release candidate.

Between the 1st and the 7th

These types of merge requests for the upcoming release need special consideration:

  • Large features: a large feature is one that is highlighted in the kick-off and the release blogpost; typically this will have its own channel in Slack and a dedicated team with front-end, back-end, and UX.
  • Small features: any other feature request.

It is strongly recommended that large features be with a maintainer by the 1st. This means that:

  • There is a merge request (even if it's WIP).
  • The person (or people, if it needs a frontend and backend maintainer) who will ultimately be responsible for merging this have been pinged on the MR.

It's OK if merge request isn't completely done, but this allows the maintainer enough time to make the decision about whether this can make it in before the freeze. If the maintainer doesn't think it will make it, they should inform the developers working on it and the Product Manager responsible for the feature.

The maintainer can also choose to assign a reviewer to perform an initial review, but this way the maintainer is unlikely to be surprised by receiving an MR later in the cycle.

It is strongly recommended that small features be with a reviewer (not necessarily a maintainer) by the 3rd.

Most merge requests from the community do not have a specific release target. However, if one does and falls into either of the above categories, it's the reviewer's responsibility to manage the above communication and assignment on behalf of the community member.

What happens if these deadlines are missed?

If a small or large feature is not with a maintainer or reviewer by the recommended date, this does not mean that maintainers or reviewers will refuse to review or merge it, or that the feature will definitely not make it in before the feature freeze.

However, with every day that passes without review, it will become more likely that the feature will slip, because maintainers and reviewers may not have enough time to do a thorough review, and developers may not have enough time to adequately address any feedback that may come back.

A maintainer or reviewer may also determine that it will not be possible to finish the current scope of the feature in time, but that it is possible to reduce the scope so that something can still ship this month, with the remaining scope moving to the next release. The sooner this decision is made, in conversation with the Product Manager and developer, the more time there is to extract that which is now out of scope, and to finish that which remains in scope.

For these reasons, it is strongly recommended to follow the guidelines above, to maximize the chances of your feature making it in before the feature freeze, and to prevent any last minute surprises.

On the 7th

Merge requests should still be complete, following the definition of done. The single exception is documentation, and this can only be left until after the freeze if:

  • There is a follow-up issue to add documentation.
  • It is assigned to the person writing documentation for this feature, and they are aware of it.
  • It is in the correct milestone, with the ~Deliverable label.

If a merge request is not ready, but the developers and Product Manager responsible for the feature think it is essential that it is in the release, they can ask for an exception in advance. This is preferable to merging something that we are not confident in, but should still be a rare case: most features can be allowed to slip a release.

All Community Edition merge requests from GitLab team members merged on the freeze date (the 7th) should have a corresponding Enterprise Edition merge request, even if there are no conflicts. This is to reduce the size of the subsequent EE merge, as we often merge a lot to CE on the release date. For more information, see Automatic CE->EE merge and Guidelines for implementing Enterprise Edition features.

After the 7th

Once the stable branch is frozen, the only MRs that can be cherry-picked into the stable branch are:

  • Fixes for regressions
  • Fixes for security issues
  • Fixes or improvements to automated QA scenarios
  • Documentation updates for changes in the same release
  • New or updated translations (as long as they do not touch application code)

During the feature freeze all merge requests that are meant to go into the upcoming release should have the correct milestone assigned and the Pick into X.Y label where X.Y is equal to the milestone, so that release managers can find and pick them. Merge requests without this label will not be picked into the stable release.

For example, if the upcoming release is 10.2.0 you will need to set the Pick into 10.2 label.

Fixes marked like this will be shipped in the next RC (before the 22nd), or the next patch release.

If a merge request is to be picked into more than one release it will need one Pick into X.Y label per release where the merge request should be back-ported to. For example:

  • Pick into 10.1
  • Pick into 10.0
  • Pick into 9.5

Asking for an exception

If you think a merge request should go into an RC or patch even though it does not meet these requirements, you can ask for an exception to be made.

Go to Release tasks issue tracker and create an issue using the Exception-request issue template.

Do not set the relevant Pick into X.Y label (see above) before request an exception; this should be done after the exception is approved.

You can find who is who on the team page.

Whether an exception is made is determined by weighing the benefit and urgency of the change (how important it is to the company that this is released right now instead of in a month) against the potential negative impact (things breaking without enough time to comfortably find and fix them before the release on the 22nd). When in doubt, we err on the side of not cherry-picking.

For example, it is likely that an exception will be made for a trivial 1-5 line performance improvement (e.g. adding a database index or adding includes to a query), but not for a new feature, no matter how relatively small or thoroughly tested.

All MRs which have had exceptions granted must be merged by the 15th.

Regressions

A regression for a particular monthly release is a bug that exists in that release, but wasn't present in the release before. This includes bugs in features that were only added in that monthly release. Every regression must have the milestone of the release it was introduced in - if a regression doesn't have a milestone, it might be 'just' a bug!

For instance, if 10.5.0 adds a feature, and that feature doesn't work correctly, then this is a regression in 10.5. If 10.5.1 then fixes that, but 10.5.3 somehow reintroduces the bug, then this bug is still a regression in 10.5.

Because GitLab.com runs release candidates of new releases, a regression can be reported in a release before its 'official' release date on the 22nd of the month. When we say 'the most recent monthly release', this can refer to either the version currently running on GitLab.com, or the most recent version available in the package repositories.

How to manage a regression

Regressions are very important, and they should be considered high priority issues that should be solved as soon as possible, expecially if they affect users. Anyway, ~regression label itself is not a priority label, and this means that regressions should still follow the scheduling process.

When a regression is found:

  1. Create an issue describing the problem in the most detailed way possible
  2. Label the issue properly, using the team label, the subject label and any other label that may apply in the specific case
  3. Add the ~regression label
  4. Add the proper milestone
  5. Ping the Product Manager, see product categories to find who manages that specific area of the Product

A very important step is helping the PM to understand the impact the regression may have on users, by providing examples and how to reproduce it. This will allow proper scheduling with a priority label. Normally it will be ~"Next Patch Release" if after the final release, or ~Deliverable if between the feature freeze and the final release.

In case of very urgent fixes, a developer can choose to pick up the issue even before it is properly scheduled, in order to speed up the process. The PM should be pinged in the issue anyway to get confirmation about the actual priority as soon as possible.

Release retrospective and kickoff

Copy & paste responses

Improperly formatted issue

Thanks for the issue report. Please reformat your issue to conform to the contributing guidelines.

Issue report for old version

Thanks for the issue report but we only support issues for the latest stable version of GitLab. I'm closing this issue but if you still experience this problem in the latest stable version, please open a new issue (but also reference the old issue(s)). Make sure to also include the necessary debugging information conforming to the issue tracker guidelines found in our contributing guidelines.

Support requests and configuration questions

Thanks for your interest in GitLab. We don't use the issue tracker for support requests and configuration questions. Please check our getting help page to see all of the available support options. Also, have a look at the contribution guidelines for more information.

Code format

Please use ``` to format console output, logs, and code as it's very hard to read otherwise.

Issue fixed in newer version

Thanks for the issue report. This issue has already been fixed in newer versions of GitLab. Due to the size of this project and our limited resources we are only able to support the latest stable release as outlined in our contributing guidelines. In order to get this bug fix and enjoy many new features please upgrade. If you still experience issues at that time please open a new issue following our issue tracker guidelines found in the contributing guidelines.

Improperly formatted merge request

Thanks for your interest in improving the GitLab codebase! Please update your merge request according to the contributing guidelines.

Inactivity close of an issue

It's been at least 2 weeks (and a new release) since we heard from you. I'm closing this issue but if you still experience this problem, please open a new issue (but also reference the old issue(s)). Make sure to also include the necessary debugging information conforming to the issue tracker guidelines found in our contributing guidelines.

Inactivity close of a merge request

This merge request has been closed because a request for more information has not been reacted to for more than 2 weeks. If you respond and conform to the merge request guidelines in our contributing guidelines we will reopen this merge request.

Accepting merge requests

Is there an issue on the issue tracker that is similar to this? Could you please link it here? Please be aware that new functionality that is not marked accepting merge requests might not make it into GitLab.

Only accepting merge requests with green tests

We can only accept a merge request if all the tests are green. I've just restarted the build. When the tests are still not passing after this restart and you're sure that is does not have anything to do with your code changes, please rebase with master to see if that solves the issue.

Closing down the issue tracker on GitHub

We are currently in the process of closing down the issue tracker on GitHub, to prevent duplication with the GitLab.com issue tracker. Since this is an older issue I'll be closing this for now. If you think this is still an issue I encourage you to open it on the GitLab.com issue tracker.