2020-08-04 02:10:16 -04:00
---
stage: Verify
2021-08-31 14:10:24 -04:00
group: Pipeline Authoring
2022-09-21 17:13:33 -04:00
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/product/ux/technical-writing/#assignments
2020-08-04 02:10:16 -04:00
---
2021-05-30 23:10:48 -04:00
# CI Lint API **(FREE)**
2020-09-25 14:09:46 -04:00
2020-10-13 23:08:32 -04:00
## Validate the CI YAML configuration
2017-08-21 02:38:09 -04:00
2020-09-25 14:09:46 -04:00
Checks if CI/CD YAML configuration is valid. This endpoint validates basic CI/CD
2021-08-26 14:10:35 -04:00
configuration syntax. It doesn't have any namespace-specific context.
2017-08-21 02:38:09 -04:00
2021-05-25 11:10:33 -04:00
Access to this endpoint does not require authentication when the instance
[allows new sign ups ](../user/admin_area/settings/sign_up_restrictions.md#disable-new-sign-ups )
and:
- Does not have an [allowlist or denylist ](../user/admin_area/settings/sign_up_restrictions.md#allow-or-deny-sign-ups-using-specific-email-domains ).
- Does not [require administrator approval for new sign ups ](../user/admin_area/settings/sign_up_restrictions.md#require-administrator-approval-for-new-sign-ups ).
2022-08-07 20:09:20 -04:00
- Does not have additional [sign up restrictions ](../user/admin_area/settings/sign_up_restrictions.md ).
2021-05-25 11:10:33 -04:00
Otherwise, authentication is required.
2021-02-16 01:09:07 -05:00
2020-02-27 04:09:01 -05:00
```plaintext
2019-03-01 19:40:49 -05:00
POST /ci/lint
2017-08-21 02:38:09 -04:00
```
| Attribute | Type | Required | Description |
| ---------- | ------- | -------- | -------- |
2020-09-25 14:09:46 -04:00
| `content` | string | yes | The CI/CD configuration content. |
| `include_merged_yaml` | boolean | no | If the [expanded CI/CD configuration ](#yaml-expansion ) should be included in the response. |
2021-11-03 14:13:40 -04:00
| `include_jobs` | boolean | no | If the list of jobs should be included in the response. This is false by default. |
2017-08-21 02:38:09 -04:00
2020-01-30 10:09:15 -05:00
```shell
2021-02-16 01:09:07 -05:00
curl --header "Content-Type: application/json" --header "PRIVATE-TOKEN: < your_access_token > " "https://gitlab.example.com/api/v4/ci/lint" --data '{"content": "{ \"image\": \"ruby:2.6\", \"services\": [\"postgres\"], \"before_script\": [\"bundle install\", \"bundle exec rake db:create\"], \"variables\": {\"DB_NAME\": \"postgres\"}, \"types\": [\"test\", \"deploy\", \"notify\"], \"rspec\": { \"script\": \"rake spec\", \"tags\": [\"ruby\", \"postgres\"], \"only\": [\"branches\"]}}"}'
2017-08-21 02:38:09 -04:00
```
2020-10-13 23:08:32 -04:00
Be sure to paste the exact contents of your GitLab CI/CD YAML configuration because YAML
2020-09-25 14:09:46 -04:00
is very sensitive about indentation and spacing.
2017-08-21 02:38:09 -04:00
Example responses:
2018-11-13 01:07:16 -05:00
- Valid content:
2017-08-21 02:38:09 -04:00
2019-07-09 03:16:17 -04:00
```json
{
"status": "valid",
2020-11-17 22:09:21 -05:00
"errors": [],
"warnings": []
}
```
- Valid content with warnings:
```json
{
"status": "valid",
"errors": [],
"warnings": ["jobs:job may allow multiple pipelines to run for a single action due to
`rules:when` clause with no `workflow:rules` - read more:
https://docs.gitlab.com/ee/ci/troubleshooting.html#pipeline-warnings"]
2019-07-09 03:16:17 -04:00
}
```
2017-08-21 02:38:09 -04:00
2018-11-13 01:07:16 -05:00
- Invalid content:
2017-08-21 02:38:09 -04:00
2019-07-09 03:16:17 -04:00
```json
{
"status": "invalid",
"errors": [
"variables config should be a hash of key value pairs"
2020-11-17 22:09:21 -05:00
],
"warnings": []
2019-07-09 03:16:17 -04:00
}
```
2017-08-21 02:38:09 -04:00
2018-11-13 01:07:16 -05:00
- Without the content attribute:
2017-08-21 02:38:09 -04:00
2019-07-09 03:16:17 -04:00
```json
{
"error": "content is missing"
}
```
2020-09-25 14:09:46 -04:00
### YAML expansion
2020-10-13 23:08:32 -04:00
> [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/29568) in GitLab 13.5.
The CI lint returns an expanded version of the configuration. The expansion does not
2021-06-28 17:10:13 -04:00
work for CI configuration added with [`include: local` ](../ci/yaml/index.md#includelocal ),
2022-02-17 10:18:08 -05:00
and the [`extends:` ](../ci/yaml/index.md#extends ) keyword is [not fully supported ](https://gitlab.com/gitlab-org/gitlab/-/issues/258843 ).
2020-09-25 14:09:46 -04:00
Example contents of a `.gitlab-ci.yml` passed to the CI Lint API with
2021-11-03 14:13:40 -04:00
`include_merged_yaml` and `include_jobs` set as true:
2020-09-25 14:09:46 -04:00
```yaml
include:
remote: 'https://example.com/remote.yaml'
test:
stage: test
script:
- echo 1
```
Example contents of `https://example.com/remote.yaml` :
```yaml
another_test:
stage: test
script:
- echo 2
```
Example response:
```json
{
"status": "valid",
"errors": [],
2021-11-03 14:13:40 -04:00
"merged_yaml": "---\n:another_test:\n :stage: test\n :script: echo 2\n:test:\n :stage: test\n :script: echo 1\n",
"jobs": [
{
"name":"test",
"stage":"test",
"before_script":[],
"script":["echo 1"],
2022-05-20 08:08:50 -04:00
"after_script":[],
2021-11-03 14:13:40 -04:00
"tag_list":[],
"environment":null,
"when":"on_success",
"allow_failure":false,
"only":{
"refs":["branches","tags"]
},
"except":null
},
{
"name":"another_test",
"stage":"test",
"before_script":[],
"script":["echo 2"],
"after_script":[],
"tag_list":[],
"environment":null,
"when":"on_success",
"allow_failure":false,
"only":{
"refs":["branches","tags"]
},
"except":null
}
]
2020-09-25 14:09:46 -04:00
}
```
2020-10-05 08:08:47 -04:00
2020-11-11 10:08:46 -05:00
## Validate a CI YAML configuration with a namespace
> [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/231352) in GitLab 13.6.
Checks if CI/CD YAML configuration is valid. This endpoint has namespace
specific context.
```plaintext
POST /projects/:id/ci/lint
```
| Attribute | Type | Required | Description |
| ---------- | ------- | -------- | -------- |
| `content` | string | yes | The CI/CD configuration content. |
2022-02-09 13:16:19 -05:00
| `dry_run` | boolean | no | Run [pipeline creation simulation ](../ci/lint.md#simulate-a-pipeline ), or only do static check. This is false by default. |
2021-11-03 14:13:40 -04:00
| `include_jobs` | boolean | no | If the list of jobs that would exist in a static check or pipeline simulation should be included in the response. This is false by default. |
2022-02-14 07:14:02 -05:00
| `ref` | string | no | When `dry_run` is `true` , sets the branch or tag to use. Defaults to the project's default branch when not set. |
2020-11-11 10:08:46 -05:00
Example request:
```shell
curl --header "Content-Type: application/json" "https://gitlab.example.com/api/v4/projects/:id/ci/lint" --data '{"content": "{ \"image\": \"ruby:2.6\", \"services\": [\"postgres\"], \"before_script\": [\"bundle install\", \"bundle exec rake db:create\"], \"variables\": {\"DB_NAME\": \"postgres\"}, \"types\": [\"test\", \"deploy\", \"notify\"], \"rspec\": { \"script\": \"rake spec\", \"tags\": [\"ruby\", \"postgres\"], \"only\": [\"branches\"]}}"}'
```
Example responses:
- Valid configuration:
```json
{
"valid": true,
"merged_yaml": "---\n:test_job:\n :script: echo 1\n",
"errors": [],
"warnings": []
}
```
- Invalid configuration:
```json
{
"valid": false,
"merged_yaml": "---\n:test_job:\n :script: echo 1\n",
"errors": [
"jobs config should contain at least one visible job"
],
"warnings": []
}
```
2020-10-05 08:08:47 -04:00
## Validate a project's CI configuration
> [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/231352) in GitLab 13.5.
Checks if a project's latest (`HEAD` of the project's default branch)
`.gitlab-ci.yml` configuration is valid. This endpoint uses all namespace
specific data available, including variables, local includes, and so on.
```plaintext
GET /projects/:id/ci/lint
```
| Attribute | Type | Required | Description |
| ---------- | ------- | -------- | -------- |
| `dry_run` | boolean | no | Run pipeline creation simulation, or only do static check. |
2021-11-03 14:13:40 -04:00
| `include_jobs` | boolean | no | If the list of jobs that would exist in a static check or pipeline simulation should be included in the response. This is false by default. |
2022-02-14 07:14:02 -05:00
| `ref` | string | no | When `dry_run` is `true` , sets the branch or tag to use. Defaults to the project's default branch when not set. |
2020-10-05 08:08:47 -04:00
Example request:
```shell
curl "https://gitlab.example.com/api/v4/projects/:id/ci/lint"
```
Example responses:
2020-10-13 23:08:32 -04:00
- Valid configuration:
2020-10-05 08:08:47 -04:00
```json
{
"valid": true,
"merged_yaml": "---\n:test_job:\n :script: echo 1\n",
"errors": [],
"warnings": []
}
```
2020-10-13 23:08:32 -04:00
- Invalid configuration:
2020-10-05 08:08:47 -04:00
```json
{
"valid": false,
"merged_yaml": "---\n:test_job:\n :script: echo 1\n",
"errors": [
"jobs config should contain at least one visible job"
],
"warnings": []
}
```
2020-10-14 23:08:35 -04:00
## Use jq to create and process YAML & JSON payloads
To `POST` a YAML configuration to the CI Lint endpoint, it must be properly escaped and JSON encoded.
You can use `jq` and `curl` to escape and upload YAML to the GitLab API.
### Escape YAML for JSON encoding
To escape quotes and encode your YAML in a format suitable for embedding within
a JSON payload, you can use `jq` . For example, create a file named `example-gitlab-ci.yml` :
```yaml
.api_test:
rules:
2022-04-27 05:10:46 -04:00
- if: $CI_PIPELINE_SOURCE=="merge_request_event"
2020-10-14 23:08:35 -04:00
changes:
- src/api/*
deploy:
extends:
- .api_test
rules:
- when: manual
allow_failure: true
script:
- echo "hello world"
```
Next, use `jq` to escape and encode the YAML file into JSON:
```shell
jq --raw-input --slurp < example-gitlab-ci.yml
```
To escape and encode an input YAML file (`example-gitlab-ci.yml`), and `POST` it to the
GitLab API using `curl` and `jq` in a one-line command:
```shell
jq --null-input --arg yaml "$(< example-gitlab-ci.yml ) " ' . content = $yaml' \
2020-12-08 04:09:41 -05:00
| curl "https://gitlab.com/api/v4/ci/lint?include_merged_yaml=true" \
2020-10-14 23:08:35 -04:00
--header 'Content-Type: application/json' \
--data @-
```
### Parse a CI Lint response
To reformat the CI Lint response, you can use `jq` . You can pipe the CI Lint response to `jq` ,
or store the API response as a text file and provide it as an argument:
```shell
jq --raw-output '.merged_yaml | fromjson' < your_input_here >
```
Example input:
```json
{"status":"valid","errors":[],"merged_yaml":"---\n:.api_test:\n :rules:\n - :if: $CI_PIPELINE_SOURCE==\"merge_request_event\"\n :changes:\n - src/api/*\n:deploy:\n :rules:\n - :when: manual\n :allow_failure: true\n :extends:\n - \".api_test\"\n :script:\n - echo \"hello world\"\n"}
```
Becomes:
```yaml
:.api_test:
:rules:
- :if: $CI_PIPELINE_SOURCE=="merge_request_event"
:changes:
- src/api/*
:deploy:
:rules:
- :when: manual
:allow_failure: true
:extends:
- ".api_test"
:script:
- echo "hello world"
```
With a one-line command, you can:
1. Escape the YAML
1. Encode it in JSON
1. POST it to the API with curl
1. Format the response
```shell
jq --null-input --arg yaml "$(< example-gitlab-ci.yml ) " ' . content = $yaml' \
2020-12-08 04:09:41 -05:00
| curl "https://gitlab.com/api/v4/ci/lint?include_merged_yaml=true" \
2020-10-14 23:08:35 -04:00
--header 'Content-Type: application/json' --data @- \
| jq --raw-output '.merged_yaml | fromjson'
```