2020-08-04 02:10:16 -04:00
---
stage: Verify
group: Continuous Integration
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/engineering/ux/technical-writing/#designated-technical-writers
---
2020-09-25 14:09:46 -04:00
# CI Lint API
2020-10-13 23:08:32 -04:00
## Validate the CI YAML configuration
2017-08-21 02:38:09 -04:00
2020-04-21 11:21:10 -04:00
> [Introduced](https://gitlab.com/gitlab-org/gitlab-foss/-/merge_requests/5953) in GitLab 8.12.
2017-08-21 02:38:09 -04:00
2020-09-25 14:09:46 -04:00
Checks if CI/CD YAML configuration is valid. This endpoint validates basic CI/CD
configuration syntax. It doesn't have any namespace specific context.
2017-08-21 02:38:09 -04:00
2020-02-27 04:09:01 -05:00
```plaintext
2019-03-01 19:40:49 -05:00
POST /ci/lint
2017-08-21 02:38:09 -04:00
```
| Attribute | Type | Required | Description |
| ---------- | ------- | -------- | -------- |
2020-09-25 14:09:46 -04:00
| `content` | string | yes | The CI/CD configuration content. |
| `include_merged_yaml` | boolean | no | If the [expanded CI/CD configuration ](#yaml-expansion ) should be included in the response. |
2017-08-21 02:38:09 -04:00
2020-01-30 10:09:15 -05:00
```shell
2020-05-27 20:08:37 -04:00
curl --header "Content-Type: application/json" "https://gitlab.example.com/api/v4/ci/lint" --data '{"content": "{ \"image\": \"ruby:2.6\", \"services\": [\"postgres\"], \"before_script\": [\"bundle install\", \"bundle exec rake db:create\"], \"variables\": {\"DB_NAME\": \"postgres\"}, \"types\": [\"test\", \"deploy\", \"notify\"], \"rspec\": { \"script\": \"rake spec\", \"tags\": [\"ruby\", \"postgres\"], \"only\": [\"branches\"]}}"}'
2017-08-21 02:38:09 -04:00
```
2020-10-13 23:08:32 -04:00
Be sure to paste the exact contents of your GitLab CI/CD YAML configuration because YAML
2020-09-25 14:09:46 -04:00
is very sensitive about indentation and spacing.
2017-08-21 02:38:09 -04:00
Example responses:
2018-11-13 01:07:16 -05:00
- Valid content:
2017-08-21 02:38:09 -04:00
2019-07-09 03:16:17 -04:00
```json
{
"status": "valid",
"errors": []
}
```
2017-08-21 02:38:09 -04:00
2018-11-13 01:07:16 -05:00
- Invalid content:
2017-08-21 02:38:09 -04:00
2019-07-09 03:16:17 -04:00
```json
{
"status": "invalid",
"errors": [
"variables config should be a hash of key value pairs"
]
}
```
2017-08-21 02:38:09 -04:00
2018-11-13 01:07:16 -05:00
- Without the content attribute:
2017-08-21 02:38:09 -04:00
2019-07-09 03:16:17 -04:00
```json
{
"error": "content is missing"
}
```
2020-09-25 14:09:46 -04:00
### YAML expansion
2020-10-13 23:08:32 -04:00
> [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/29568) in GitLab 13.5.
The CI lint returns an expanded version of the configuration. The expansion does not
2020-10-14 23:08:35 -04:00
work for CI configuration added with [`include: local` ](../ci/yaml/README.md#includelocal ),
or with [`extends:` ](../ci/yaml/README.md#extends ).
2020-09-25 14:09:46 -04:00
Example contents of a `.gitlab-ci.yml` passed to the CI Lint API with
`include_merged_yaml` set as true:
```yaml
include:
remote: 'https://example.com/remote.yaml'
test:
stage: test
script:
- echo 1
```
Example contents of `https://example.com/remote.yaml` :
```yaml
another_test:
stage: test
script:
- echo 2
```
Example response:
```json
{
"status": "valid",
"errors": [],
"merged_config": "---\n:another_test:\n :stage: test\n :script: echo 2\n:test:\n :stage: test\n :script: echo 1\n"
}
```
2020-10-05 08:08:47 -04:00
## Validate a project's CI configuration
> [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/231352) in GitLab 13.5.
Checks if a project's latest (`HEAD` of the project's default branch)
`.gitlab-ci.yml` configuration is valid. This endpoint uses all namespace
specific data available, including variables, local includes, and so on.
```plaintext
GET /projects/:id/ci/lint
```
| Attribute | Type | Required | Description |
| ---------- | ------- | -------- | -------- |
| `dry_run` | boolean | no | Run pipeline creation simulation, or only do static check. |
Example request:
```shell
curl "https://gitlab.example.com/api/v4/projects/:id/ci/lint"
```
Example responses:
2020-10-13 23:08:32 -04:00
- Valid configuration:
2020-10-05 08:08:47 -04:00
```json
{
"valid": true,
"merged_yaml": "---\n:test_job:\n :script: echo 1\n",
"errors": [],
"warnings": []
}
```
2020-10-13 23:08:32 -04:00
- Invalid configuration:
2020-10-05 08:08:47 -04:00
```json
{
"valid": false,
"merged_yaml": "---\n:test_job:\n :script: echo 1\n",
"errors": [
"jobs config should contain at least one visible job"
],
"warnings": []
}
```
2020-10-14 23:08:35 -04:00
## Use jq to create and process YAML & JSON payloads
To `POST` a YAML configuration to the CI Lint endpoint, it must be properly escaped and JSON encoded.
You can use `jq` and `curl` to escape and upload YAML to the GitLab API.
### Escape YAML for JSON encoding
To escape quotes and encode your YAML in a format suitable for embedding within
a JSON payload, you can use `jq` . For example, create a file named `example-gitlab-ci.yml` :
```yaml
.api_test:
rules:
- if: '$CI_PIPELINE_SOURCE=="merge_request_event"'
changes:
- src/api/*
deploy:
extends:
- .api_test
rules:
- when: manual
allow_failure: true
script:
- echo "hello world"
```
Next, use `jq` to escape and encode the YAML file into JSON:
```shell
jq --raw-input --slurp < example-gitlab-ci.yml
```
To escape and encode an input YAML file (`example-gitlab-ci.yml`), and `POST` it to the
GitLab API using `curl` and `jq` in a one-line command:
```shell
jq --null-input --arg yaml "$(< example-gitlab-ci.yml ) " ' . content = $yaml' \
| curl 'https://gitlab.com/api/v4/ci/lint?include_merged_yaml=true' \
--header 'Content-Type: application/json' \
--data @-
```
### Parse a CI Lint response
To reformat the CI Lint response, you can use `jq` . You can pipe the CI Lint response to `jq` ,
or store the API response as a text file and provide it as an argument:
```shell
jq --raw-output '.merged_yaml | fromjson' < your_input_here >
```
Example input:
```json
{"status":"valid","errors":[],"merged_yaml":"---\n:.api_test:\n :rules:\n - :if: $CI_PIPELINE_SOURCE==\"merge_request_event\"\n :changes:\n - src/api/*\n:deploy:\n :rules:\n - :when: manual\n :allow_failure: true\n :extends:\n - \".api_test\"\n :script:\n - echo \"hello world\"\n"}
```
Becomes:
```yaml
:.api_test:
:rules:
- :if: $CI_PIPELINE_SOURCE=="merge_request_event"
:changes:
- src/api/*
:deploy:
:rules:
- :when: manual
:allow_failure: true
:extends:
- ".api_test"
:script:
- echo "hello world"
```
With a one-line command, you can:
1. Escape the YAML
1. Encode it in JSON
1. POST it to the API with curl
1. Format the response
```shell
jq --null-input --arg yaml "$(< example-gitlab-ci.yml ) " ' . content = $yaml' \
| curl 'https://gitlab.com/api/v4/ci/lint?include_merged_yaml=true' \
--header 'Content-Type: application/json' --data @- \
| jq --raw-output '.merged_yaml | fromjson'
```