Commit graph

15 commits

Author SHA1 Message Date
Achilleas Pipinellis
af1dabe805 Reduce size of images from 25MB to 13MB using pngquant
Took it from https://gitlab.com/gitlab-com/www-gitlab-com/merge_requests/3232

[ci skip]
2016-11-22 19:53:43 +01:00
Achilleas Pipinellis
8b7634c2b6 Fix old monitoring links to point to the new location 2016-10-24 16:45:00 +02:00
Ben Bodenmiller
d00f17c010 fix grafana_configuration.md move link 2016-10-13 21:56:28 +00:00
Achilleas Pipinellis
6207dc9037 Move monitoring/ to new location 2016-09-25 12:16:50 +02:00
Yorick Peterse
d345591fc8
Tracking of custom events
GitLab Performance Monitoring is now able to track custom events not
directly related to application performance. These events include the
number of tags pushed, repositories created, builds registered, etc.

The use of these events is to get a better overview of how a GitLab
instance is used and how that may affect performance. For example, a
large number of Git pushes may have a negative impact on the underlying
storage engine.

Events are stored in the "events" measurement and are not prefixed with
"rails_" or "sidekiq_", this makes it easier to query events with the
same name triggered from different parts of the application. All events
being stored in the same measurement also makes it easier to downsample
data.

Currently the following events are tracked:

* Creating repositories
* Removing repositories
* Changing the default branch of a repository
* Pushing a new tag
* Removing an existing tag
* Pushing a commit (along with the branch being pushed to)
* Pushing a new branch
* Removing an existing branch
* Importing a repository (along with the URL we're importing)
* Forking a repository (along with the source/target path)
* CI builds registered (and when no build could be found)
* CI builds being updated
* Rails and Sidekiq exceptions

Fixes gitlab-org/gitlab-ce#13720
2016-08-17 10:04:04 +02:00
Peter Dave Hello
9e6f99744e
optimize png images losslessly using zopflipng 2016-06-29 19:22:15 +08:00
Yorick Peterse
b8b09a8c0a
Use influxdb-management for managing InfluxDB
This removes the need for manually updating the list of queries every
time we make a change.

[ci skip]
2016-06-23 13:01:45 +02:00
Yorick Peterse
8d5bdf081a
Updated InfluxDB continuous queries for 8.9.0
[ci skip]
2016-06-23 11:37:02 +02:00
Connor Shea
f49d86cd5c Fix some broken links in the documentation [ci skip] 2016-04-29 13:11:23 -06:00
Yorick Peterse
76c2594a6a
Updated list of InfluxDB queries/config
This setup is quite a bit different from before. In the previous setup
raw data was kept around for 30 days and downsampled data for 7 days.
This became problematic for GitLab.com as the number of points and
series resulted in InfluxDB running out of memory when starting up
(besides taking up 30 GB of storage).

To work around this the new setup keeps raw data around for _only_ an
hour while keeping downsampled data around for 7 days. In turn all
Grafana dashboards _only_ query the downsampled data instead of also
querying raw data.

Based on rough calculations this setup needs around 2GB of storage for 1
week of data, excluding whatever is needed for storing the raw data
(this highly depends on the amount of traffic).

If users want to use this new setup they have to remove any existing
dashboards provided by GitLab.com and re-import the ones from the
Grafana dashboards repository
(https://gitlab.com/gitlab-org/grafana-dashboards/). Should users wish
to change their default retention policy the easiest way of doing so is
to simply drop the database and re-run the InfluxDB commands added by
this commit. Users who want to keep their default retention policy as-is
can simply create the "downsampled" policy and run the other commands.
2016-04-25 12:18:55 +02:00
Yorick Peterse
0a37976a4d
Updated InfluxDB/Grafana setup/import docs
The grafana-dashboards repository now contains _all_ GitLab.com
dashboards and thus requires some extra continuous queries to be set up.
The repository now also provided a way to automatically import/export
dashboards.

[ci skip]
2016-04-13 17:29:04 +02:00
Drew Blessing
4e5ae5a281 Fix Grafana docs and link from Influx page 2016-04-12 15:40:53 -05:00
Drew Blessing
1d99c8fe60 Grafana installation and configuration documentation. [ci skip] 2016-03-22 13:34:05 -05:00
Achilleas Pipinellis
dd59fc213c Change InfluxDB admin username
[ci skip]
2016-01-20 23:10:27 +01:00
Achilleas Pipinellis
82bc7679e7 Move integration/metrics to monitoring/performance
[ci skip]
2016-01-20 23:02:24 +01:00