Commit Graph

18 Commits

Author SHA1 Message Date
Mark Lapierre 3922c6da84 Generate knapsack report for review-qa-all
Add knapsack qa report and use it to run tests in parallel

Use the RSpec runner with knapsack

The way the Knapsack runner uses exec to start rspec seems
incompatible with the way we expect it to work. Plus, it requires
specifying KNAPSACK_TEST_DIR.

Instead, we use knapsacks AllocatorBuilder to select the spec
files to run, and then start rspec as normal, via
RSpec::Core::Runner.run

This also means we can incorporate tags.

Let the job run automatically

Include KNAPSACK_TEST_FILE_PATTERN in vars

Check all defined knapsack env vars before requiring knapsack
2019-06-03 10:37:43 +00:00
Mark Lapierre ff6aa7906e Only retry failing QA tests in CI
No need to retry automatically when running tests locally
2019-05-20 17:09:47 +10:00
Thong Kuah 0be52bf32f Add frozen_string_literal to qa/
This will be default in Ruby 3, so will be good to apply in QA ahead of
time to be consistent.
2019-04-13 00:45:38 +12:00
Sanad Liaquat 0991dc8c82 Reduce number of rspec retries
In both e2e QA tests and unit tests, reduce the number of retires
to 2 (i.e., 1 initial and one retry)
2019-04-09 10:04:03 +00:00
Mark Lapierre c6a6b8a24e Skip contexts in quarantine
This avoids running before/after blocks for tests that are in quarantine
2019-03-11 11:50:09 +00:00
Sanad Liaquat d54cb37d29 Retry failed tests with rspec-retry
Does not retry if tagged :quarantine. Also adds unit tests.
2019-02-19 17:12:07 +05:00
Mark Lapierre e5e57df61c Move server responding check to scenario before hook
This checks that the server is responding before any other actions,
including before trying to add a license.
2019-02-14 12:06:39 -05:00
Mark Lapierre 8931420202 Skip contexts in quarantine
This avoids running before/after blocks for tests that are in quarantine
2019-02-14 04:35:20 +00:00
Mark Lapierre 97265d39e7 [CE] Improve `wait_for_push` 2019-02-11 09:04:59 +00:00
Sanad Liaquat 621b92120e Load login page only if gitlab_address is defined 2019-02-07 11:00:47 +05:00
Sanad Liaquat 784eb9a430 Wait for login page to load at the beginning of QA suite 2019-02-07 10:00:51 +05:00
Mark Lapierre f1b36aa46c Quarantine spec code review changes
- Clarify message shown when skipping quarantined tests because
they don't have all the specified tags.
- Simplify rejecting item from array
- Remove 'pass' from example descriptions to avoid confusion
2019-01-08 11:07:58 -05:00
Mark Lapierre 7d9262427f Skip quarantined tests via filters
Instead of modifying the runner, use config hooks to skip quarantined
tests, and to allow only quarantined tests to be run, if desired.

This way quarantined tests are skipped, not excluded completely, so
they are still included in test results.
2019-01-08 10:45:37 -05:00
Mark Lapierre 45860bc807 Log page actions
Override page object methods to log the actions taken by the methods
before or after the action, as appropriate.

Allow page object action logging to be turned on via a QA_DEBUG env var.
Unlike CHROME_HEADLESS (and the soon to arrive VERBOSE), QA_DEBUG
is false by default.

QA_DEBUG is used instead of just DEBUG because that enables Selenium
debug logging.

Mask passwords entered into fields with a QA selector with 'password'
in the name. Doesn't mask sensitive data entered into any other field.
2018-10-19 18:32:33 -04:00
Rémy Coutable d2db7d40dd
Disambiguate 'File' under qa/ since we have a QA::Factory::Resource::File class as well
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-07-18 15:06:53 +02:00
Brett Walker b8b9e9eb8e Add ability to drive the API in QA specs 2018-01-23 10:23:23 +00:00
Grzegorz Bizon 6984c2eede Use headless chrome instead of webkit via QtWebkit 2017-05-25 09:36:39 +02:00
Grzegorz Bizon 7d20e47622 Add GitLab QA integrations tests to GitLab CE / EE 2017-03-09 10:36:27 +01:00