summaryrefslogtreecommitdiff
path: root/spec/workers
Commit message (Collapse)AuthorAgeFilesLines
* Add gitlab-managed option to clusters formMayra Cabrera2019-05-031-0/+10
| | | | | | | | When this option is enabled, GitLab will create namespaces and service accounts as usual. When disabled, GitLab wont create any project specific kubernetes resources Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/56557
* Use git_garbage_collect_worker to run pack_refsJan Provaznik2019-05-021-0/+13
| | | | | | | | PackRefs is not an expensive gitaly call - we want to call it more often (than as part of full `gc`) because it helps to keep number of refs files small - too many refs file may be a problem for deployments with slow storage.
* Remove disabled pages domainsVladimir Shushlin2019-04-302-4/+46
| | | | | Domain will be removed by verification worker after 1 week of being disabled
* Services to uninstall cluster applicationThong Kuah2019-04-291-0/+32
| | | | + to monitor progress of uninstallation pod
* Merge branch 'lock-pipeline-schedule-worker' into 'master'Stan Hu2019-04-291-0/+12
|\ | | | | | | | | | | | | Prevent concurrent execution of PipelineScheduleWorker Closes gitlab-com/gl-infra/production#805 See merge request gitlab-org/gitlab-ce!27781
| * Prevent concurrent execution of PipelineScheduleWorkerShinya Maeda2019-04-281-0/+12
| | | | | | | | | | | | Currently, PipelineScheduleWorker is fired in a short period on our production server. We can stop this behavior by locking the execution thread with in_lock method.
* | Add deployment events to chat notification servicesJason Goodman2019-04-262-0/+40
|/ | | | | This enables sending a chat message to Slack or Mattermost upon a successful, failed, or canceled deployment
* Merge branch ↵Kamil Trzciński2019-04-172-48/+34
|\ | | | | | | | | | | | | | | | | '60500-disable-jit-kubernetes-resource-creation-for-project-level-clusters' into 'master' Disable JIT Kubernetes resource creation for project level clusters Closes #60500 See merge request gitlab-org/gitlab-ce!27352
| * Disable JIT resource creation for project clusters60500-disable-jit-kubernetes-resource-creation-for-project-level-clustersTiger2019-04-162-48/+34
| | | | | | | | | | | | | | | | | | | | | | | | JIT resource creation blocks deployments if a user is self-managing their cluster, as it will fail the build if unable to create a namespace and service account. Using a custom namespace and service account was previously supported for project level clusters, so we should preserve this functionality. https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/27352
* | Properly expire all pipeline caches when pipeline is deletedsh-fix-pipeline-delete-cachingStan Hu2019-04-151-26/+3
|/ | | | | | | | | | | When deleting a pipeline, only some of the cache structures were being expired, but not the full pipeline list. We have to synchronously schedule a pipeline cache expiration because the pipeline will be deleted if the Sidekiq expiration job picks it up. To do this, properly extract all the logic buried in the Sidekiq worker into a service, and then call the service. Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/60469
* Process at most 4 pipelines during pushlimit-amount-of-created-pipelinesKamil Trzciński2019-04-101-3/+39
| | | | | | | | This adds a limitation that we will try to create pipeline for at most 4 first changes (branches and tags). This does not affect processing of Pipelines for Merge Requests, as each updated MR will have associated pipeline created.
* Merge branch 'delay-update-statictics' into 'master'Douwe Maan2019-04-092-17/+47
|\ | | | | | | | | Fix the bug that the project statistics is not updated See merge request gitlab-org/gitlab-ce!26854
| * Refactor: extract duplicate steps to a service classHiroyuki Sato2019-04-052-45/+17
| |
| * Update the project statistics immediatellyHiroyuki Sato2019-04-051-0/+4
| |
| * Refactor project_cache_worker_keyHiroyuki Sato2019-04-051-1/+1
| |
| * Fix the bug that the project statistics is not updatedHiroyuki Sato2019-04-052-15/+69
| |
* | Extract a Git::{Base,Tag,Branch}HooksServiceNick Thomas2019-04-051-7/+18
|/
* Add frozen_string_literal to spec/workersfrozen_string_spec_workersThong Kuah2019-04-01118-0/+236
| | | | Adds `# frozen_string_literal: true` to spec/workers ruby files
* Allow external diffs to be used conditionallyNick Thomas2019-03-272-0/+50
| | | | | | | | | | Since external diffs are likely to be a bit slower than in-database ones, add a mode that makes diffs external after they've been obsoleted by events. This should strike a balance between performance and disk space. A background cron drives the majority of migrations, since diffs become outdated through user actions.
* Rename GitPushService -> Git::BranchPushServiceNick Thomas2019-03-251-7/+7
|
* Rename GitTagPushService -> Git::TagPushServiceNick Thomas2019-03-251-6/+6
|
* Add feature flag for build preparing stateTiger2019-03-202-0/+37
| | | | | The flag is on by default, but allows us to revert back to the old behaviour if we encounter any problems.
* Create framework for build prerequisitesTiger2019-03-201-0/+30
| | | | | | | | | Introduces the concept of Prerequisites for a CI build. If a build has unmet prerequisites it will go through the :preparing state before being made available to a runner. There are no actual prerequisites yet, so current behaviour is unchanged.
* Merge dev master into GitLab.com masterYorick Peterse2019-03-041-1/+1
|\
| * Arbitrary file read via MergeRequestDiffFrancisco Javier López2019-03-041-1/+1
| |
* | Merge branch '53966-make-hashed-storage-migration-safer-and-more-inviting' ↵Douglas Barbosa Alexandre2019-03-013-1/+78
|\ \ | | | | | | | | | | | | | | | | | | into 'master' Hashed Storage rollback mechanism See merge request gitlab-org/gitlab-ce!23955
| * | Added Rollbacker workers and support on the rake taskGabriel Mazetto2019-03-011-0/+27
| | | | | | | | | | | | | | | | | | | | | | | | | | | Rollback is done similar to Migration for the Hashed Storage. It also shares the same ExclusiveLease key to prevent both happening at the same time. All Hashed Storage related workers now share the same queue namespace which allows for assigning dedicated workers easily.
| * | Refactor ProjectMigrate and ProjectRollback workersGabriel Mazetto2019-03-012-2/+2
| | | | | | | | | | | | | | | Moved to HashedStorage namespace, and added them to the `:hashed_storage` queue namespace
| * | Adds Rollback functionality to HashedStorage migrationGabriel Mazetto2019-03-011-0/+50
| | | | | | | | | | | | | | | | | | | | | We are adding sidekiq workers and service classes to allow to rollback a hashed storage migration. There are some refactoring involved as well as part of the code can be reused by both the migration and the rollback logic.
* | | Add suffix for merge request eventShinya Maeda2019-03-011-1/+1
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fix ok Add spec Fix ok Fix Add changelog Fix Add memoization a fix
* | Add project http fetch statistics APIJacopo2019-02-271-0/+35
|/ | | | | | The API get projects/:id/traffic/fetches allows user with write access to the repository to get the number of clones for the last 30 days.
* Move ChatOps to CoreJames Fargher2019-02-202-0/+110
| | | | ChatOps used to be in the Ultimate tier.
* Fix failing test in spec/workers/post_receive_spec.rbsh-fix-ee-issue-8871Stan Hu2019-02-061-4/+11
| | | | | | | | | | | | | | | | | This is what was happening before: 1. `Project#set_timestamps_for_create` was called at creation time and set the `last_activity_at` and `last_repository_updated_at` to the current timestamp T. 2. The test ran `PostReceive#perform`, which then called `PostReceive#process_wiki_changes`. If less than 500 milliseconds elapsed since T, then the update would just set the timestamp to T. To fix this problem, we can just use Timecop to ensure at least one second has elapsed after attempting to process changes. Closes https://gitlab.com/gitlab-org/gitlab-ee/issues/8871
* Clean up Shell.fork_repositoryStan Hu2019-02-051-8/+1
| | | | Use project models instead of a list of parameters.
* Send project name with Gitaly repository requestsStan Hu2019-02-051-1/+3
| | | | | | | When hashed storage is in use, it's helpful to have the project name associated with the request. Closes https://gitlab.com/gitlab-org/gitaly/issues/1394
* Make `ActionContorller::Parameters` serializable for sidekiq jobsPeter Leitzen2019-02-051-5/+44
|
* Refactor Storage MigrationGabriel Mazetto2019-01-252-13/+14
| | | | | | | | | Specs were reviewed and improved to better cover the current behavior. There was some standardization done as well to facilitate the implementation of the rollback functionality. StorageMigratorWorker was extracted to HashedStorage namespace were RollbackerWorker will live one as well.
* Move MigrationService to HashedStorage moduleGabriel Mazetto2019-01-251-4/+4
| | | | | This is part of the refactor to include a RollbackService into HashedStorage module
* Prepare rake task for storage rollbackGabriel Mazetto2019-01-251-1/+1
| | | | We are keeping compatibility with existing scheduled jobs.
* Merge branch 'container-repository-cleanup-api' into 'master'Grzegorz Bizon2019-01-251-0/+47
|\ | | | | | | | | | | | | Container repository cleanup API Closes #55978 See merge request gitlab-org/gitlab-ce!24303
| * Add Container Registry APIKamil Trzciński2019-01-251-0/+47
| | | | | | | | | | | | This includes a set of APIs to manipulate container registry. This includes also an ability to delete tags based on requested criteria, like keep-last-n, matching-name, older-than.
* | Merge branch '56392-enable-the-layout-extraspacing-cop' into 'master'Lin Jen-Shin2019-01-241-2/+2
|\ \ | | | | | | | | | | | | | | | | | | Enable the Layout/ExtraSpacing cop Closes #56392 See merge request gitlab-org/gitlab-ce!24423
| * | Enable the Layout/ExtraSpacing cop56392-enable-the-layout-extraspacing-copRémy Coutable2019-01-241-2/+2
| |/ | | | | | | Signed-off-by: Rémy Coutable <remy@rymai.me>
* | Remove expired artifacts periodicallyShinya Maeda2019-01-241-0/+14
|/ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Rename Introduce Destroy expired job artifacts service Revert a bit Add changelog Use expired Improve Fix spec Fix spec Use bang for destroy Introduce iteration limit Update comment Simplify more Refacor Remove unnecessary thing Fix comments Fix coding offence Make loop helper exception free
* Only send one notification for failed remote mirrorStan Hu2019-01-152-0/+46
| | | | | | | | | | | | | Retries in Sidekiq and in the remote mirror scheduler can cause repeated attempts in quick succession if the sync fails. Each failure will then send an e-mail to all project maintainers, which can spam users unnecessarily. Modify the logic to send one notification the first time the mirror fails by setting `error_notification_sent` to `true` and reset the flag after a successful sync. Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/56222
* Ensure pool participants are linked before GCZeger-Jan van de Weg2019-01-141-0/+11
| | | | | | | | | In theory the case could happen that the initial linking of the pool fails and so do all the retries that Sidekiq performs. This could lead to data loss. To prevent that case, linking is done before Gits GC too. This makes sure that case doesn't happen.
* Merge branch '49231-import-issues-csv' into 'master'Douwe Maan2019-01-071-0/+21
|\ | | | | | | | | | | | | Import issues from CSV Closes #49231 See merge request gitlab-org/gitlab-ce!23532
| * Import CSV BackendHeinrich Lee Yu2019-01-071-0/+21
| | | | | | | | Process CSV uploads async using a worker then email results
* | Refactor the logic of updating head pipelinesShinya Maeda2019-01-041-5/+5
|/ | | | Sort out some logic
* Merge branch 'blackst0ne-bump-rails-cve-2018-16476' into 'master'Grzegorz Bizon2019-01-021-3/+14
|\ | | | | | | | | Bump Ruby on Rails to 5.0.7.1 See merge request gitlab-org/gitlab-ce!23396