summaryrefslogtreecommitdiff
path: root/doc/development
Commit message (Collapse)AuthorAgeFilesLines
...
* | | | | | | | Add "Guidelines for implementing Enterprise Edition features" in CE ↵docs/improve-limit-conflicts-with-eeRémy Coutable2017-12-061-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | development doc since the doc page is already there Signed-off-by: Rémy Coutable <remy@rymai.me>
* | | | | | | | Address Robert's and Axil's feedbackRémy Coutable2017-12-063-14/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Rémy Coutable <remy@rymai.me>
* | | | | | | | Move the "Limit conflicts with EE" doc to "Automatic CE-> EE merge"Rémy Coutable2017-12-054-348/+98
|/ / / / / / / | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Rémy Coutable <remy@rymai.me>
* | | | | | | Merge branch 'dm-application-worker' into 'master'Sean McGivern2017-12-052-22/+19
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add ApplicationWorker and make every worker include it See merge request gitlab-org/gitlab-ce!15632
| * | | | | | | Consistently schedule Sidekiq jobsdm-application-workerDouwe Maan2017-12-051-5/+5
| | | | | | | |
| * | | | | | | Update docsDouwe Maan2017-12-051-16/+14
| | | | | | | |
| * | | | | | | Add ApplicationWorker and make every worker include itDouwe Maan2017-12-051-2/+1
| | | | | | | |
* | | | | | | | Merge branch 'docs/clarify-review-docs-process' into 'master'Rémy Coutable2017-12-051-1/+12
|\ \ \ \ \ \ \ \ | |/ / / / / / / |/| | | | | | | | | | | | | | | | | | | | | | | Clarify the docs review process and mention the supported repos See merge request gitlab-org/gitlab-ce!15573
| * | | | | | | Clarify the docs review process and mention the supported reposdocs/clarify-review-docs-processAchilleas Pipinellis2017-11-231-1/+12
| | | | | | | |
* | | | | | | | Merge branch '40770-doc-elasticsearch' into 'master'Rémy Coutable2017-12-041-1/+1
|\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fix typo in Elasticsearch Closes #40770 See merge request gitlab-org/gitlab-ce!15699
| * | | | | | | | Fix typo in docs about ElasticsearchTakuya Noguchi2017-12-031-1/+1
| | |_|_|_|_|_|/ | |/| | | | | |
* | | | | | | | Add underline hover state to all linksAnnabel Dunstone Gray2017-12-041-6/+0
|/ / / / / / /
* | | | | | | Merge branch 'docs-what-requires-downtime-link' into 'master'Robert Speicher2017-11-291-1/+1
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | fix link that was linking to `html` instead of `md` See merge request gitlab-org/gitlab-ce!15646
| * | | | | | | fix link that was linking to `html` instead of `md`docs-what-requires-downtime-linkdigitalMoksha2017-11-291-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (to be consistent)
* | | | | | | | Fix instructions for creating project templatesSean McGivern2017-11-281-1/+1
|/ / / / / / / | | | | | | | | | | | | | | | | | | | | | Sidekiq has to be running too.
* | | | | | | Fix the redirect location wordingAchilleas Pipinellis2017-11-231-3/+3
|/ / / / / / | | | | | | | | | | | | | | | | | | Closes https://gitlab.com/gitlab-com/gitlab-docs/issues/142
* | | | | | Add QUERY_RECORDER_DEBUG environment variable to improve performance debuggingsh-add-query-recorder-debuggingStan Hu2017-11-211-0/+46
| |_|_|_|/ |/| | | |
* | | | | Merge branch '38451-fe-sprite-icons-vue-component' into 'master'Annabel Dunstone Gray2017-11-201-5/+25
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Update Icons Documentation about Icon Vue Component Closes #38451 See merge request gitlab-org/gitlab-ce!15171
| * | | | | Added info about tracking38451-fe-sprite-icons-vue-componentTim Zallmann2017-11-161-1/+1
| | | | | |
| * | | | | Added + Updated Document for Vue ComponentTim Zallmann2017-11-161-4/+24
| | | | | |
* | | | | | Use axios instead of vue resource - step 1Filipa Lacerda2017-11-204-131/+83
| | | | | |
* | | | | | Add computed update docs for update_column_in_batchesSean McGivern2017-11-171-1/+37
| |_|_|_|/ |/| | | |
* | | | | Add dropdowns documentationFilipa Lacerda2017-11-172-0/+40
| | | | |
* | | | | Update database_debugging.mdmk-update-database-debuggingMichael Kozono2017-11-161-4/+11
| | | | |
* | | | | Update database_debugging.mdMichael Kozono2017-11-161-4/+3
|/ / / /
* | | | Merge branch 'docs/db-debugging' into 'master'Yorick Peterse2017-11-162-0/+50
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | Add basic docs for troubleshooting database problems See merge request gitlab-org/gitlab-ce!15416
| * | | | Add basic docs for troubleshooting database problemsdocs/db-debuggingEric Eastwood2017-11-152-0/+50
| | | | |
* | | | | Resolve "npm list errors for gitlab-svgs and node-pre-gyp"Tim Zallmann2017-11-151-1/+1
|/ / / /
* | | | Merge branch 'update-emoji-digests-with-latest-from-gemojione' into 'master'Filipa Lacerda2017-11-153-0/+38
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Update Emoji digests and assets with latest from Gemojione v3.3.0 Closes #32634 See merge request gitlab-org/gitlab-ce!15390
| * | | | Add basic emoji development docsEric Eastwood2017-11-152-0/+28
| | | | |
| * | | | Regenerate emoji digests with latest gemojioneEric Eastwood2017-11-141-0/+10
| | | | |
* | | | | Merge branch '38007-update-licensing-docs' into 'master'Achilleas Pipinellis2017-11-151-3/+3
|\ \ \ \ \ | |/ / / / |/| | | | | | | | | | | | | | | | | | | | | | | | Update licensing docs to clarify process for node modules Closes #38007 See merge request gitlab-org/gitlab-ce!14575
| * | | | update licensing docs to mention that we check node_modules for license ↵38007-update-licensing-docsMike Greiling2017-09-291-3/+3
| | | | | | | | | | | | | | | | | | | | information as well
* | | | | Update limit_ee_conflicts.md with assets/gitlab-svgs conflict resolution.limit_ee_conflicts-gitlab-svgsLuke "Jared" Bennett2017-11-131-0/+6
| | | | |
* | | | | Merge branch 'update-upload-documentation' into 'master'Nick Thomas2017-11-081-0/+49
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | Added file storage documentation and updated hash storage one See merge request gitlab-org/gitlab-ce!15269
| * | | | | Added file storage documentation and updated hash storage oneGabriel Mazetto2017-11-081-0/+49
| | |_|_|/ | |/| | |
* | | | | Merge branch 'bvl-update-externalization-docs' into 'master'Achilleas Pipinellis2017-11-081-15/+12
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | Make a note of which files to check in after externalizing strings See merge request gitlab-org/gitlab-ce!15207
| * | | | | Make a note of which files to check in after externalizing stringsbvl-update-externalization-docsBob Van Landuyt2017-11-081-15/+12
| | | | | |
* | | | | | Merge branch 'github-importer-refactor' into 'master'Douwe Maan2017-11-082-0/+210
|\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Rewrite the GitHub importer to perform work in parallel and greatly improve performance Closes #33135, #38621, and #39361 See merge request gitlab-org/gitlab-ce!14731
| * | | | | | Rewrite the GitHub importer from scratchYorick Peterse2017-11-072-0/+210
| | |/ / / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Prior to this MR there were two GitHub related importers: * Github::Import: the main importer used for GitHub projects * Gitlab::GithubImport: importer that's somewhat confusingly used for importing Gitea projects (apparently they have a compatible API) This MR renames the Gitea importer to Gitlab::LegacyGithubImport and introduces a new GitHub importer in the Gitlab::GithubImport namespace. This new GitHub importer uses Sidekiq for importing multiple resources in parallel, though it also has the ability to import data sequentially should this be necessary. The new code is spread across the following directories: * lib/gitlab/github_import: this directory contains most of the importer code such as the classes used for importing resources. * app/workers/gitlab/github_import: this directory contains the Sidekiq workers, most of which simply use the code from the directory above. * app/workers/concerns/gitlab/github_import: this directory provides a few modules that are included in every GitHub importer worker. == Stages The import work is divided into separate stages, with each stage importing a specific set of data. Stages will schedule the work that needs to be performed, followed by scheduling a job for the "AdvanceStageWorker" worker. This worker will periodically check if all work is completed and schedule the next stage if this is the case. If work is not yet completed this worker will reschedule itself. Using this approach we don't have to block threads by calling `sleep()`, as doing so for large projects could block the thread from doing any work for many hours. == Retrying Work Workers will reschedule themselves whenever necessary. For example, hitting the GitHub API's rate limit will result in jobs rescheduling themselves. These jobs are not processed until the rate limit has been reset. == User Lookups Part of the importing process involves looking up user details in the GitHub API so we can map them to GitLab users. The old importer used an in-memory cache, but this obviously doesn't work when the work is spread across different threads. The new importer uses a Redis cache and makes sure we only perform API/database calls if absolutely necessary. Frequently used keys are refreshed, and lookup misses are also cached; removing the need for performing API/database calls if we know we don't have the data we're looking for. == Performance & Models The new importer in various places uses raw INSERT statements (as generated by `Gitlab::Database.bulk_insert`) instead of using Rails models. This allows us to bypass any validations and callbacks, drastically reducing the number of SQL queries and Gitaly RPC calls necessary to import projects. To ensure the code produces valid data the corresponding tests check if the produced rows are valid according to the model validation rules.
* | | | | | Merge branch 'ux-guide-components-modal' into 'master'Marcia Ramos2017-11-085-0/+33
|\ \ \ \ \ \ | |/ / / / / |/| | | | | | | | | | | | | | | | | Modals in UX guide See merge request gitlab-org/gitlab-ce!14886
| * | | | | Changed the order of buttons from left to rightux-guide-components-modalHazel2017-11-061-1/+2
| | | | | |
| * | | | | Modify the sentences and add TodoHazel2017-11-021-2/+4
| | | | | |
| * | | | | Modified the font family in the imagesHazel2017-10-186-1/+1
| | | | | |
| * | | | | Updated the sytle part - changed the order of header, body, and actionsHazel2017-10-171-3/+3
| | | | | |
| * | | | | Updated the content and added the imagesHazel2017-10-176-11/+12
| | | | | |
| * | | | | Modified the copyHazel2017-10-161-1/+1
| | | | | |
| * | | | | Draft a guide of modals in UX guideHazel2017-10-161-0/+29
| | | | | |
* | | | | | Add link to GitLab brand.ai pagedocs/add-link-to-brand-aiEric Eastwood2017-11-021-1/+5
| | | | | |
* | | | | | Merge branch 'dm-remove-private-token' into 'master'Sean McGivern2017-11-021-2/+2
|\ \ \ \ \ \ | |_|/ / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Remove Private Tokens Closes #38595 and #38447 See merge request gitlab-org/gitlab-ce!14838
View Lorry Controller Status