Commit graph

17 commits

Author SHA1 Message Date
Desiree Chevalier
a1bee1a09d Generate parallel spec reports
Creates reports for parallel specs and collates them into a single
HTML report and displays results on the merge request.
2019-07-17 10:12:56 -04:00
Mark Lapierre
7d97102f72 Run tests in parallel via parallel_tests
Uses the parallel_tests gem to execute tests in multiple processes
simultaneously on the same machine.

Adds the `--parallel` CLI option that instructs the QA framework
to use the parallel_tests executable.

Tests need access to global state contained in `Runtime::Scenario`
so when `--parallel` is invoked `Runtime::Scenario` is serialized
to an environment variable, which is passed to parallel_tests,
and then deserialized in `spec_helper`.
2019-07-09 15:40:46 +00:00
Mark Lapierre
3922c6da84 Generate knapsack report for review-qa-all
Add knapsack qa report and use it to run tests in parallel

Use the RSpec runner with knapsack

The way the Knapsack runner uses exec to start rspec seems
incompatible with the way we expect it to work. Plus, it requires
specifying KNAPSACK_TEST_DIR.

Instead, we use knapsacks AllocatorBuilder to select the spec
files to run, and then start rspec as normal, via
RSpec::Core::Runner.run

This also means we can incorporate tags.

Let the job run automatically

Include KNAPSACK_TEST_FILE_PATTERN in vars

Check all defined knapsack env vars before requiring knapsack
2019-06-03 10:37:43 +00:00
Stan Hu
9d7bb9d8c2 Bump Nokogiri to 1.10.3
This pulls in a fix for libxslt that addresses CVE-2019-11068:
https://github.com/sparklemotion/nokogiri/releases
2019-04-22 13:59:15 -07:00
Ramya Authappan
31469e1835 Script to generate Perf Testdata 2019-03-05 08:39:04 +00:00
Sanad Liaquat
d54cb37d29 Retry failed tests with rspec-retry
Does not retry if tagged :quarantine. Also adds unit tests.
2019-02-19 17:12:07 +05:00
Brett Walker
800220bd72 Update to nokogiri 1.10.1 2019-01-17 10:35:18 -06:00
Stan Hu
1425ee50b8 Update gems in Gemfile and qa/Gemfile to be consistent
This will allow developers to run `bundle install` on both directories
and avoid additional calls to RubyGems for local development. Also sets
up the possibility of improved caching as mentioned in
https://gitlab.com/gitlab-org/gitlab-ce/issues/55843.
2019-01-02 23:01:24 -08:00
Lin Jen-Shin
211b2f390c Implement other ssh keys and use ssh-keygen instead 2018-03-29 19:40:32 +08:00
Lin Jen-Shin
ada39be67a Merge remote-tracking branch 'upstream/master' into qa-deploy-key-scenario
* upstream/master: (106 commits)
  Remove callback as we already update accordingly on services
  added missing imports
  correctly imports performance bar
  Added imports for dispatcher routes
  Make the exposing of the Application secret more explicit
  Add documentation about when the application API was added
  Add application create API
  Return a blank JSON response for a missing .js file to prevent Rails CSRF errors
  add CHANGELOG.md entry for !15804
  disable CopyAsGFM on iOS due to bug in webkit
  Update changelog
  GitalyClient::ConflictsService#conflicts? should return true for conflicts with missing side
  Return more consistent values for merge_status on MR API
  Fix a migration spec messing up the MergeRequestDiff DB schema
  Backport changes to Gitlab::Checks::ChangeAccess from EE
  remove webpack bundle tag for monitoring:environments:metrics
  Set timezone for karma to UTC
  Upgrade jasmine + raven to newer versions
  Ensure Gitaly Ruby gems are installed using the correct Gemfile and at the correct location
  Clarify that a feature that isn't in review by the 1st or 3rd doesn't necessarily miss the freeze
  ...
2018-01-24 23:13:56 +08:00
Brett Walker
b8b9e9eb8e Add ability to drive the API in QA specs 2018-01-23 10:23:23 +00:00
Lin Jen-Shin
ccceb26617 Generate ssh key on the fly for QA 2018-01-22 15:41:52 +08:00
Grzegorz Bizon
358732ef34 Update GitLab QA dependencies 2017-12-14 11:00:14 +01:00
Stan Hu
f7f9b1f20e Add byebug to GitLab QA gem list for debugging 2017-10-03 22:42:49 -07:00
Grzegorz Bizon
6984c2eede Use headless chrome instead of webkit via QtWebkit 2017-05-25 09:36:39 +02:00
Grzegorz Bizon
161d0aa43d Fix Rubocop offense and remove QA Rubocop from deps 2017-03-09 10:36:27 +01:00
Grzegorz Bizon
7d20e47622 Add GitLab QA integrations tests to GitLab CE / EE 2017-03-09 10:36:27 +01:00