kotovalexarian-likes-gitlab/gitlab-org--gitlab-foss
1
0
Fork 0
Code Releases Activity
gitlab-org--gitlab-foss/.gitlab/issue_templates/Acceptance_Testing.md
Zeger-Jan van de Weg e113671faa Add Acceptance testing issue template
2018-08-15 19:48:05 +00:00

3.5 KiB
Raw Blame History

Details

  • Feature Toggle Name: FEATURE_NAME
  • Required GitLab Version: vX.X

1. Preparation

  • Controllers and workers:
    1. Please link to dashboards of the workers, and the controllers and actions that can be impacted
    2. ...
    3. ...

2. Development Trial

Check Dev Server Versions

Enable on dev.gitlab.org:

  • /chatops feature set FEATURE_NAME true --dev in #dev-gitlab

Then leave running while monitoring and performing some testing through web, api or SSH.

Monitor

2. Staging Trial

Check Staging Server Versions

Enable on staging.gitlab.com

  • /chatops run feature set FEATURE_NAME true --staging in #development

Then leave running while monitoring for at least 15 minutes while performing some testing through web, api or SSH.

Monitor

4. Production Server Version Check

5. Initial Impact Check

  • Enable for a subset of users, when using percentage gates: 1%.

Then leave running while monitoring for at least 15 minutes while performing some testing through web, api or SSH.

Monitor

6. Low Impact Check

  • Enable for a bigger subset of users, when using percentage gates: 10%.

Then leave running while monitoring for at least 30 minutes while performing some testing through web, api or SSH.

Monitor

7. Mid Impact Trial

  • Enable for a big subset of users, when using percentage gates: 50%.

Then leave running while monitoring for at least 12 hours while performing some testing through web, api or SSH.

Monitor

8. Full Impact Trial

  • Enable for all users: `/chatops run feature set FEATURE_NAME true

Then leave running while monitoring for at least 1 week.

Monitor

Success?

  • Remove the feature gate from the code, and close this issue with that MR.