summaryrefslogtreecommitdiff
path: root/qa/qa/specs/runner.rb
Commit message (Collapse)AuthorAgeFilesLines
* Run tests in parallel via parallel_testsMark Lapierre2019-07-091-23/+35
| | | | | | | | | | | | | Uses the parallel_tests gem to execute tests in multiple processes simultaneously on the same machine. Adds the `--parallel` CLI option that instructs the QA framework to use the parallel_tests executable. Tests need access to global state contained in `Runtime::Scenario` so when `--parallel` is invoked `Runtime::Scenario` is serialized to an environment variable, which is passed to parallel_tests, and then deserialized in `spec_helper`.
* Generate knapsack report for review-qa-allMark Lapierre2019-06-031-1/+18
| | | | | | | | | | | | | | | | | | | | | | Add knapsack qa report and use it to run tests in parallel Use the RSpec runner with knapsack The way the Knapsack runner uses exec to start rspec seems incompatible with the way we expect it to work. Plus, it requires specifying KNAPSACK_TEST_DIR. Instead, we use knapsacks AllocatorBuilder to select the spec files to run, and then start rspec as normal, via RSpec::Core::Runner.run This also means we can incorporate tags. Let the job run automatically Include KNAPSACK_TEST_FILE_PATTERN in vars Check all defined knapsack env vars before requiring knapsack
* Add frozen_string_literal to qa/frozen_string_literal_qaThong Kuah2019-04-131-0/+2
| | | | | This will be default in Ruby 3, so will be good to apply in QA ahead of time to be consistent.
* Add e2e test of push over SSH over Git protocol v2ml-qa-git-protocol-v2-specMark Lapierre2018-11-071-0/+4
| | | | | | | | Adds a new end-to-end test to check that Git protocol v2 can be used to push over SSH. Includes a change in Git::Repository to use Runtime::Env.debug? to enable logging instead of .verbose?
* Allow the registration e2e test to be skippedMark Lapierre2018-10-081-0/+2
| | | | | | | If SIGNUP_DISABLED is true skip any tests with a context :skip_signup_disabled. The context is set for the registration tests. This allows the tests to be skipped when run on the staging, which doesn't allow registration
* [QA] Fix arguments passed to RSpec::Core::RunnerRémy Coutable2018-09-071-2/+5
| | | | | | | - When -t or --tag are passed, we shouldn't exclude the :orchestrated tag - When test path is passed, we shouldn't append the default test path Signed-off-by: Rémy Coutable <remy@rymai.me>
* [QA] Fix Specs::Runner that would always excluding the orchectsrated tagRémy Coutable2018-09-041-2/+2
| | | | Signed-off-by: Rémy Coutable <remy@rymai.me>
* add initial smoke tests and documentationDan Davison2018-08-201-1/+7
|
* allow rspec files/options to be passed down in all casesBrett Walker2018-03-281-3/+3
|
* Expand QA spec file paths to allow running bin/qa from anywhereRobert Speicher2018-02-061-1/+1
|
* WIP Handle domain sessions better in QA test scenarioGrzegorz Bizon2017-11-171-1/+1
| | | | [ci skip]
* Refactor QA specs runners and improve specsGrzegorz Bizon2017-11-101-1/+9
|
* Configure RSpec from within RSpec runner classGrzegorz Bizon2017-11-101-9/+7
|
* Move rspec cli handling logic into Specs::RunnerRichard Clamp2017-10-161-1/+8
| | | | | | | | Here we convert Specs::Runner#rspec to use keyword arguments[1] and pass named parameters rather than a pre-processed array of cli switches. This allows parameter to cli logic to live just in Specs::Runner. [1] https://robots.thoughtbot.com/ruby-2-keyword-arguments
* Add GitLab QA integrations tests to GitLab CE / EEGrzegorz Bizon2017-03-091-0/+15