gitlab-org--gitlab-foss/qa
2018-01-09 12:34:47 +01:00
..
bin Fix bootable scenario arguments for OptionParser 2017-11-10 11:11:22 +00:00
qa Improve QA sanity selectors test output message 2018-01-09 12:34:47 +01:00
spec Improve QA sanity selectors test output message 2018-01-09 12:34:47 +01:00
.gitignore Make it possible to define global scenario attributes 2017-11-09 11:53:57 +00:00
.rspec Add GitLab QA integrations tests to GitLab CE / EE 2017-03-09 10:36:27 +01:00
Dockerfile Use new Ruby version 2.4 in GitLab QA images 2017-12-14 11:21:57 +01:00
Gemfile Update GitLab QA dependencies 2017-12-14 11:00:14 +01:00
Gemfile.lock Update GitLab QA dependencies 2017-12-14 11:00:14 +01:00
qa.rb Implement QA pages and views validator 2018-01-09 11:28:14 +01:00
README.md Specify how we're utilizing rspec here 2017-12-20 19:35:59 +08:00

GitLab QA - Integration tests for GitLab

This directory contains integration tests for GitLab.

It is part of the GitLab QA project.

What is it?

GitLab QA is an integration tests suite for GitLab.

These are black-box and entirely click-driven integration tests you can run against any existing instance.

How does it work?

  1. When we release a new version of GitLab, we build a Docker images for it.
  2. Along with GitLab Docker Images we also build and publish GitLab QA images.
  3. GitLab QA project uses these images to execute integration tests.

How can I use it?

You can use GitLab QA to exercise tests on any live instance! For example, the following call would login to a local GDK instance and run all specs in qa/specs/features:

bin/qa Test::Instance http://localhost:3000

Running specific tests

You can also supply specific tests to run as another parameter. For example, to test the EE license specs, you can run:

EE_LICENSE="<YOUR LICENSE KEY>" bin/qa Test::Instance http://localhost qa/specs/features/ee

Since the arguments would be passed to rspec, you could use all rspec options there. For example, passing --backtrace and also line number:

bin/qa Test::Instance http://localhost qa/specs/features/login/standard_spec.rb:3 --backtrace

Overriding the authenticated user

Unless told otherwise, the QA tests will run as the default root user seeded by the GDK.

If you need to authenticate as a different user, you can provide the GITLAB_USERNAME and GITLAB_PASSWORD environment variables:

GITLAB_USERNAME=jsmith GITLAB_PASSWORD=password bin/qa Test::Instance https://gitlab.example.com

All supported environment variables are here.