summaryrefslogtreecommitdiff
path: root/doc/README.md
Commit message (Collapse)AuthorAgeFilesLines
* fix typoMarcia Ramos2017-12-071-1/+1
|
* Docs: admin indexMarcia Ramos2017-12-071-73/+14
|
* Docs: add EEU tier to the landing pageMarcia Ramos2017-12-071-4/+5
|
* Add custom brand text on new project pagesMarkus Koller2017-12-041-0/+1
|
* Rewrite the GitHub importer from scratchYorick Peterse2017-11-071-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Prior to this MR there were two GitHub related importers: * Github::Import: the main importer used for GitHub projects * Gitlab::GithubImport: importer that's somewhat confusingly used for importing Gitea projects (apparently they have a compatible API) This MR renames the Gitea importer to Gitlab::LegacyGithubImport and introduces a new GitHub importer in the Gitlab::GithubImport namespace. This new GitHub importer uses Sidekiq for importing multiple resources in parallel, though it also has the ability to import data sequentially should this be necessary. The new code is spread across the following directories: * lib/gitlab/github_import: this directory contains most of the importer code such as the classes used for importing resources. * app/workers/gitlab/github_import: this directory contains the Sidekiq workers, most of which simply use the code from the directory above. * app/workers/concerns/gitlab/github_import: this directory provides a few modules that are included in every GitHub importer worker. == Stages The import work is divided into separate stages, with each stage importing a specific set of data. Stages will schedule the work that needs to be performed, followed by scheduling a job for the "AdvanceStageWorker" worker. This worker will periodically check if all work is completed and schedule the next stage if this is the case. If work is not yet completed this worker will reschedule itself. Using this approach we don't have to block threads by calling `sleep()`, as doing so for large projects could block the thread from doing any work for many hours. == Retrying Work Workers will reschedule themselves whenever necessary. For example, hitting the GitHub API's rate limit will result in jobs rescheduling themselves. These jobs are not processed until the rate limit has been reset. == User Lookups Part of the importing process involves looking up user details in the GitHub API so we can map them to GitLab users. The old importer used an in-memory cache, but this obviously doesn't work when the work is spread across different threads. The new importer uses a Redis cache and makes sure we only perform API/database calls if absolutely necessary. Frequently used keys are refreshed, and lookup misses are also cached; removing the need for performing API/database calls if we know we don't have the data we're looking for. == Performance & Models The new importer in various places uses raw INSERT statements (as generated by `Gitlab::Database.bulk_insert`) instead of using Rails models. This allows us to bypass any validations and callbacks, drastically reducing the number of SQL queries and Gitaly RPC calls necessary to import projects. To ensure the code produces valid data the corresponding tests check if the produced rows are valid according to the model validation rules.
* Exclude comments from specific docsAchilleas Pipinellis2017-11-011-0/+1
|
* Simple docs fixesConnor Shea2017-10-231-2/+2
|
* index project settings doc from other indexesMarcia Ramos2017-09-081-0/+1
|
* Docs new index for project's settingsMarcia Ramos2017-09-081-3/+4
|
* Add Auto DevOps docsAchilleas Pipinellis2017-09-071-1/+2
|
* Merge branch 'master' of gitlab.com:gitlab-org/gitlab-ce into ↵Simon Knox2017-09-061-2/+2
|\ | | | | | | ee_issue_928_backport
| * Deprecate Koding in docsdocs/rm-kodingAchilleas Pipinellis2017-09-011-1/+0
| |
| * Move GPG signed commits docs to new locationdocs/gpg-move-under-repositoryAchilleas Pipinellis2017-08-291-1/+2
| | | | | | | | Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/36804
* | Continue BE backportFelipe Artur2017-08-311-1/+1
|/
* Merge branch 'docs/gpg-refactor' into 'master'Marcia Ramos2017-08-211-1/+1
|\ | | | | | | | | Refactor GPG docs See merge request !13660
| * Change GPG docs locationAchilleas Pipinellis2017-08-181-1/+1
| |
* | Move workflow/importing/ to user/project/import/Achilleas Pipinellis2017-08-171-1/+1
|/
* link tech articles from the landing pageMarcia Ramos2017-08-151-0/+1
|
* Docs: update user docs indexMarcia Ramos2017-08-111-1/+3
|
* Merge branch 'docs/add-toc' into 'master'Achilleas Pipinellis2017-08-101-0/+4
|\ | | | | | | | | Start using 'toc' in yaml frontmatter to explicitly disable it See merge request !13310
| * Start using 'toc' in yaml frontmatter to explicitly disable itdocs/add-tocAchilleas Pipinellis2017-08-041-0/+4
| | | | | | | | See https://gitlab.com/gitlab-com/gitlab-docs/merge_requests/107
* | Merge branch 'patch-24' into 'master'Achilleas Pipinellis2017-08-091-1/+1
|\ \ | |/ |/| | | | | there are 3 dots but it says four products. fixed See merge request !13129
| * Update README.md with a more flexible sentencePaolo Falomo2017-08-071-1/+1
| |
| * there are 3 dots but it says four products. fixed Paolo Falomo2017-07-271-1/+1
| |
* | New doc topic user/project/indexMarcia Ramos2017-07-311-6/+7
| |
* | Docs new topic: "user/profile/index"Marcia Ramos2017-07-271-3/+4
| |
* | Docs new topic "user/project/repository/index.md"Marcia Ramos2017-07-271-1/+1
| |
* | documentation for gpg signed commitsAlexis Reigel2017-07-271-0/+1
|/
* Docs new topic "user/index"Marcia Ramos2017-07-261-5/+2
|
* Add GitLab Trello Power-Up DocumentationClement Ho2017-07-201-0/+1
|
* Refactor groups docsMarcia Ramos2017-07-161-2/+1
|
* Merge branch 'master' into 33929-allow-to-enable-perf-bar-for-a-groupSean McGivern2017-07-071-0/+1
|\
| * Remove option to disable Gitaly completelyJacob Vosmaer2017-07-071-0/+1
| |
* | Document the Performance BarRémy Coutable2017-07-061-0/+1
|/ | | | Signed-off-by: Rémy Coutable <remy@rymai.me>
* adjust EE landing page to unify CE and EE docsdocs/introduce-ee-unified-docsMarcia Ramos2017-06-271-8/+20
| | | | | | | == https://gitlab.com/gitlab-org/gitlab-ee/commit/30304bd2ab3c87d6304a3d4c4 bd71ab7ffd2794b from https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/2265
* Merge branch '27070-rename-slash-commands-to-quick-actions' into 'master'Sean McGivern2017-06-161-1/+1
|\ | | | | | | | | | | | | Rename "Slash commands" to "Quick actions" Closes #27070 See merge request !11811
| * Rename "Slash commands" to "Quick actions"Eric Eastwood2017-06-151-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | Fix https://gitlab.com/gitlab-org/gitlab-ce/issues/27070 Deprecate "chat commands" in favor of "slash commands" We looked for things like: - `slash commmand` - `slash_command` - `slash-command` - `SlashCommand`
* | Move branches docs to new location and copyeditdocs/branchesAchilleas Pipinellis2017-06-161-1/+1
| |
* | Document the Delete Merged Branches functionalityMark Fletcher2017-06-081-0/+1
|/ | | | * Note that protected branches will not be part of the deletion
* Move docs 'superpowers' items to respective sectionsdocs/rm-superpowersAchilleas Pipinellis2017-05-231-8/+3
|
* New doc topic: issuesMarcia Ramos2017-05-081-5/+2
|
* Fill in information about creating the wiki Home pageAchilleas Pipinellis2017-05-031-1/+1
|
* Reorg CE Docs landing pageMarcia Ramos2017-04-261-66/+181
|
* Refactor Discussions docsAchilleas Pipinellis2017-04-211-1/+1
| | | | | | - Move to dicsussions/index.md - Bring back previous path with a link to new location - Reorder sections
* Started on resolvable discussions docsLuke "Jared" Bennett2017-04-211-0/+1
|
* Merge branch 'usage-ping-port' into 'master' Sean McGivern2017-04-191-0/+1
|\ | | | | | | | | | | | | Usage ping port Closes #27750 See merge request !10481
| * Fix doc linksSean McGivern2017-04-141-1/+1
| |
| * Fix usage ping doc locationSean McGivern2017-04-141-0/+1
| |
* | Remove link to topics30841-remove-link-to-topics-pageSean Packham (GitLab)2017-04-121-4/+0
|/
* Document how polling interval is useddocument-polling-intervalAdam Niedzielski2017-04-101-0/+1
|
View Lorry Controller Status