gitlab-org--gitlab-foss/config
Zeger-Jan van de Weg 79a5d76801
Add repository languages for projects
Our friends at GitHub show the programming languages for a long time,
and inspired by that this commit means to create about the same
functionality.

Language detection is done through Linguist, as before, where the
difference is that we cache the result in the database. Also, Gitaly can
incrementaly scan a repository. This is done through a shell out, which
creates overhead of about 3s each run. For now this won't be improved.

Scans are triggered by pushed to the default branch, usually `master`.
However, one exception to this rule the charts page. If we're requesting
this expensive data anyway, we just cache it in the database.

Edge cases where there is no repository, or its empty are caught in the
Repository model. This makes use of Redis caching, which is probably
already loaded.

The added model is called RepositoryLanguage, which will make it harder
if/when GitLab supports multiple repositories per project. However, for
now I think this shouldn't be a concern. Also, Language could be
confused with the i18n languages and felt like the current name was
suiteable too.

Design of the Project#Show page is done with help from @dimitrieh. This
change is not visible to the end user unless detections are done.
2018-08-01 18:58:29 +02:00
..
environments Move spec/mailers/previews to app/mailers/previews 2018-07-06 20:17:54 +08:00
initializers Merge branch 'feature/gb/login-activity-metrics' into 'master' 2018-07-31 10:44:22 +00:00
locales Update _scopes_form.html.haml to remove duplicate information 2018-06-26 13:54:23 +00:00
prometheus Update NGINX error rate to a percentage 2018-06-06 03:26:22 -04:00
routes Spec instance statistics 2018-07-27 15:54:28 +02:00
application.rb Use /-/health instead of breaking /-/liveness 2018-07-28 14:35:02 -07:00
boot.rb Add bootsnap to development/test bundle and enable it if available 2018-07-20 14:16:01 +02:00
database.yml.env
database.yml.mysql Set 'staging specific' in database.yml.mysql 2017-10-17 21:12:46 +03:00
database.yml.postgresql Update database.yml.postgresql 2017-10-17 21:15:01 +03:00
dependency_decisions.yml Replace issues time tracking progress bar with gitlab-ui's progress bar 2018-07-25 21:06:03 +00:00
environment.rb Updates from rubocop -a 2018-07-09 21:13:08 +08:00
gitlab.yml.example Fix theme index to match reality 2018-07-23 12:35:32 +05:30
karma.config.js disable nodeEnv within karma config 2018-06-21 12:36:17 -05:00
license_finder.yml
mail_room.yml Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
no_todos_messages.yml Improve empty states for TODOs and issues 2017-12-11 12:08:55 +00:00
object_store_settings.rb Make ObjectStoreSettings use more explicit and add specs 2018-07-24 14:44:44 +03:00
README.md Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
redis.cache.yml.example Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
redis.queues.yml.example Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
redis.shared_state.yml.example Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
resque.yml.example
routes.rb Merge branch 'master' into '41416-making-instance-wide-data-tools-more-accessible' 2018-07-31 16:29:13 +00:00
secrets.yml.example
settings.rb Fix attr_encryption key settings 2018-06-02 05:24:59 -07:00
sidekiq.yml.example
sidekiq_queues.yml Add repository languages for projects 2018-08-01 18:58:29 +02:00
spring.rb [Rails5] Update files by rails app:update 2018-03-22 09:37:57 +11:00
unicorn.rb.example Make rbtrace work under unicorn 2018-07-30 08:12:45 -07:00
unicorn.rb.example.development Prevent Unicorn crashing in development on macOS 2018-01-23 13:32:15 +00:00
webpack.config.js Merge branch 'fix-webpack-node-env' into 'master' 2018-06-21 20:11:28 +00:00

Configuration files Documentation

Note that most configuration files (config/*.*) committed into gitlab-ce will not be used for omnibus-gitlab. Configuration files committed into gitlab-ce are only used for development.

gitlab.yml

You can find most of GitLab configuration settings here.

mail_room.yml

This file is actually an YML wrapped inside an ERB file to enable templated values to be specified from gitlab.yml. mail_room loads this file first as an ERB file and then loads the resulting YML as its configuration.

resque.yml

This file is called resque.yml for historical reasons. We are NOT using Resque at the moment. It is used to specify Redis configuration values when a single database instance of Redis is desired.

Advanced Redis configuration files

In more advanced configurations of Redis key-value storage, it is desirable to separate the keys by lifecycle and intended use to ease provisioning and management of scalable Redis clusters.

These settings provide routing and other configuration data (such as sentinel, persistence policies, and other Redis customization) for connections to Redis single instances, Redis sentinel, and Redis clusters.

If desired, the routing URL provided by these settings can be used with:

  1. Unix Socket
    1. named socket for each Redis instance desired.
    2. database number for each Redis instance desired.
  2. TCP Socket
    1. host name or IP for each Redis instance desired
    2. TCP port number for each Redis instance desired
    3. database number for each Redis instance desired

Example URL attribute formats for GitLab Redis .yml configuration files

  • Unix Socket, default Redis database (0)
    • url: unix:/path/to/redis.sock
    • url: unix:/path/to/redis.sock?db=
  • Unix Socket, Redis database 44
    • url: unix:/path/to/redis.sock?db=44
    • url: unix:/path/to/redis.sock?extra=foo&db=44
  • TCP Socket for Redis on localhost, port 6379, database 33
    • url: redis://:mynewpassword@localhost:6379/33
  • TCP Socket for Redis on remote host myserver, port 6379, database 33
    • url: redis://:mynewpassword@myserver:6379/33

redis.cache.yml

If configured, redis.cache.yml overrides the resque.yml settings to configure the Redis database instance used for Rails.cache and other volatile non-persistent data which enhances the performance of GitLab. Settings here can be overridden by the environment variable GITLAB_REDIS_CACHE_CONFIG_FILE which provides an alternate location for configuration settings.

The order of precedence for the URL used to connect to the Redis instance used for cache is:

  1. URL from a configuration file pointed to by the GITLAB_REDIS_CACHE_CONFIG_FILE environment variable
  2. URL from redis.cache.yml
  3. URL from a configuration file pointed to by the GITLAB_REDIS_CONFIG_FILE environment variable
  4. URL from resque.yml
  5. redis://localhost:6380

The order of precedence for all other configuration settings for cache are selected from only the first of the following files found (if a setting is not provided in an earlier file, the remainder of the files are not searched):

  1. the configuration file pointed to by the GITLAB_REDIS_CACHE_CONFIG_FILE environment variable
  2. the configuration file redis.cache.yml
  3. the configuration file pointed to by the GITLAB_REDIS_CONFIG_FILE environment variable
  4. the configuration file resque.yml

redis.queues.yml

If configured, redis.queues.yml overrides the resque.yml settings to configure the Redis database instance used for clients of ::Gitlab::Redis::Queues. These queues are intended to be the foundation of reliable inter-process communication between modules, whether on the same host node, or within a cluster. The primary clients of the queues are SideKiq, Mailroom, CI Runner, Workhorse, and push services. Settings here can be overridden by the environment variable GITLAB_REDIS_QUEUES_CONFIG_FILE which provides an alternate location for configuration settings.

The order of precedence for the URL used to connect to the Redis instance used for queues is:

  1. URL from a configuration file pointed to by the GITLAB_REDIS_QUEUES_CONFIG_FILE environment variable
  2. URL from redis.queues.yml
  3. URL from a configuration file pointed to by the GITLAB_REDIS_CONFIG_FILE environment variable
  4. URL from resque.yml
  5. redis://localhost:6381

The order of precedence for all other configuration settings for queues are selected from only the first of the following files found (if a setting is not provided in an earlier file, the remainder of the files are not searched):

  1. the configuration file pointed to by the GITLAB_REDIS_QUEUES_CONFIG_FILE environment variable
  2. the configuration file redis.queues.yml
  3. the configuration file pointed to by the GITLAB_REDIS_CONFIG_FILE environment variable
  4. the configuration file resque.yml

redis.shared_state.yml

If configured, redis.shared_state.yml overrides the resque.yml settings to configure the Redis database instance used for clients of ::Gitlab::Redis::SharedState such as session state, and rate limiting. Settings here can be overridden by the environment variable GITLAB_REDIS_SHARED_STATE_CONFIG_FILE which provides an alternate location for configuration settings.

The order of precedence for the URL used to connect to the Redis instance used for shared_state is:

  1. URL from a configuration file pointed to by the GITLAB_REDIS_SHARED_STATE_CONFIG_FILE environment variable
  2. URL from redis.shared_state.yml
  3. URL from a configuration file pointed to by the GITLAB_REDIS_CONFIG_FILE environment variable
  4. URL from resque.yml
  5. redis://localhost:6382

The order of precedence for all other configuration settings for shared_state are selected from only the first of the following files found (if a setting is not provided in an earlier file, the remainder of the files are not searched):

  1. the configuration file pointed to by the GITLAB_REDIS_SHARED_STATE_CONFIG_FILE environment variable
  2. the configuration file redis.shared_state.yml
  3. the configuration file pointed to by the GITLAB_REDIS_CONFIG_FILE environment variable
  4. the configuration file resque.yml