moby--moby/integration-cli
Akihiro Suda 28797019b3 [EXPERIMENTAL] Integration Test on Swarm
This commit adds contrib/integration-cli-on-swarm/integration-cli-on-swarm.sh,
which enables IT to be running in parallel, using Swarm-mode and Funker.

Please refer to contrib/integration-cli-on-swarm/README.md

The test takes almost 5 to 6 minutes, with 10 n1-standard-4 GCE instances.

  $ ./contrib/integration-cli-on-swarm/integration-cli-on-swarm.sh --push-worker-image example.gcr.io/foo/bar --replicas 30 --shuffle
  2016/12/29 08:32:15 Loaded 1618 tests (30 chunks)
  2016/12/29 08:32:15 Executing 30 chunks in parallel, against "integration-cli-worker"
  2016/12/29 08:32:15 Executing chunk 0 (contains 54 test filters)
  ..
  2016/12/29 08:34:34 Finished chunk 28 [1/30] with 54 test filters in 2m19.098068003s, code=0.
  2016/12/29 08:34:38 Finished chunk 12 [2/30] with 54 test filters in 2m23.088569511s, code=0.
  2016/12/29 08:34:48 Finished chunk 10 [3/30] with 54 test filters in 2m33.880679079s, code=0.
  2016/12/29 08:34:54 Finished chunk 20 [4/30] with 54 test filters in 2m39.973747028s, code=0.
  2016/12/29 08:35:11 Finished chunk 18 [5/30] with 54 test filters in 2m56.28384361s, code=0.
  2016/12/29 08:35:11 Finished chunk 29 [6/30] with 52 test filters in 2m56.54047088s, code=0.
  2016/12/29 08:35:15 Finished chunk 1 [7/30] with 54 test filters in 3m0.285044426s, code=0.
  2016/12/29 08:35:22 Finished chunk 6 [8/30] with 54 test filters in 3m7.211775338s, code=0.
  2016/12/29 08:35:24 Finished chunk 25 [9/30] with 54 test filters in 3m9.938413009s, code=0.
  2016/12/29 08:35:30 Finished chunk 27 [10/30] with 54 test filters in 3m15.219834368s, code=0.
  2016/12/29 08:35:36 Finished chunk 9 [11/30] with 54 test filters in 3m21.615434162s, code=0.
  2016/12/29 08:35:41 Finished chunk 13 [12/30] with 54 test filters in 3m26.576907401s, code=0.
  2016/12/29 08:35:45 Finished chunk 17 [13/30] with 54 test filters in 3m30.290752537s, code=0.
  2016/12/29 08:35:53 Finished chunk 2 [14/30] with 54 test filters in 3m38.148423321s, code=0.
  2016/12/29 08:35:55 Finished chunk 24 [15/30] with 54 test filters in 3m40.09669137s, code=0.
  2016/12/29 08:35:57 Finished chunk 8 [16/30] with 54 test filters in 3m42.299945108s, code=0.
  2016/12/29 08:35:57 Finished chunk 22 [17/30] with 54 test filters in 3m42.946558809s, code=0.
  2016/12/29 08:35:59 Finished chunk 23 [18/30] with 54 test filters in 3m44.232557165s, code=0.
  2016/12/29 08:36:02 Finished chunk 3 [19/30] with 54 test filters in 3m47.112051358s, code=0.
  2016/12/29 08:36:11 Finished chunk 15 [20/30] with 54 test filters in 3m56.340656645s, code=0.
  2016/12/29 08:36:11 Finished chunk 11 [21/30] with 54 test filters in 3m56.882401231s, code=0.
  2016/12/29 08:36:22 Finished chunk 19 [22/30] with 54 test filters in 4m7.551093516s, code=0.
  2016/12/29 08:36:23 Finished chunk 21 [23/30] with 54 test filters in 4m8.221093446s, code=0.
  2016/12/29 08:36:25 Finished chunk 16 [24/30] with 54 test filters in 4m10.450451705s, code=0.
  2016/12/29 08:36:27 Finished chunk 5 [25/30] with 54 test filters in 4m12.162272692s, code=0.
  2016/12/29 08:36:28 Finished chunk 14 [26/30] with 54 test filters in 4m13.977801031s, code=0.
  2016/12/29 08:36:29 Finished chunk 0 [27/30] with 54 test filters in 4m14.34086812s, code=0.
  2016/12/29 08:36:49 Finished chunk 26 [28/30] with 54 test filters in 4m34.437085539s, code=0.
  2016/12/29 08:37:14 Finished chunk 7 [29/30] with 54 test filters in 4m59.22902721s, code=0.
  2016/12/29 08:37:20 Finished chunk 4 [30/30] with 54 test filters in 5m5.103469214s, code=0.
  2016/12/29 08:37:20 Executed 30 chunks in 5m5.104379119s. PASS: 30, FAIL: 0.

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-02-28 02:10:09 +00:00
..
checker
daemon [EXPERIMENTAL] Integration Test on Swarm 2017-02-28 02:10:09 +00:00
environment Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
fixtures Convert script shebangs from "#!/bin/bash" to "#!/usr/bin/env bash" 2017-02-13 11:01:54 -08:00
registry
request
requirement
benchmark_test.go
check_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
daemon_swarm_hack_test.go
docker_api_attach_test.go
docker_api_auth_test.go
docker_api_build_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_api_containers_test.go Remove most of the runCommandWithOutput from integration tests 2017-01-30 10:54:06 +01:00
docker_api_create_test.go validate healthcheck params in daemon side 2017-01-29 13:35:32 +08:00
docker_api_events_test.go
docker_api_exec_resize_test.go
docker_api_exec_test.go Fix #303111: dockerd leaks ExecIds on failed exec -i 2017-02-10 21:13:00 +02:00
docker_api_images_test.go Merge pull request #28409 from dnephin/swagger-gen-more 2017-01-26 10:35:34 -08:00
docker_api_info_test.go
docker_api_inspect_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_api_inspect_unix_test.go
docker_api_logs_test.go
docker_api_network_test.go
docker_api_resize_test.go
docker_api_stats_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_api_stats_unix_test.go
docker_api_swarm_node_test.go split docker_api_swarm_test.go into multiple files 2017-02-11 00:18:01 +08:00
docker_api_swarm_secret_test.go split docker_api_swarm_test.go into multiple files 2017-02-11 00:18:01 +08:00
docker_api_swarm_service_test.go split docker_api_swarm_test.go into multiple files 2017-02-11 00:18:01 +08:00
docker_api_swarm_test.go split docker_api_swarm_test.go into multiple files 2017-02-11 00:18:01 +08:00
docker_api_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_api_update_unix_test.go
docker_api_version_test.go
docker_api_volumes_test.go
docker_cli_attach_test.go
docker_cli_attach_unix_test.go
docker_cli_authz_plugin_v2_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_authz_unix_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_build_test.go Merge pull request #30383 from TDAbboud/30096-add-host-docker-build 2017-02-27 12:42:18 +01:00
docker_cli_build_unix_test.go fix some ineffectual assignments 2017-01-24 11:16:19 +01:00
docker_cli_by_digest_test.go fix DockerSchema1RegistrySuite.TestPullFailsWithAlteredLayer 2017-02-17 10:34:33 -08:00
docker_cli_commit_test.go fix some ineffectual assignments 2017-01-24 11:16:19 +01:00
docker_cli_config_test.go
docker_cli_cp_from_container_test.go
docker_cli_cp_test.go Remove most of the runCommandWithOutput from integration tests 2017-01-30 10:54:06 +01:00
docker_cli_cp_to_container_test.go fix some ineffectual assignments 2017-01-24 11:16:19 +01:00
docker_cli_cp_to_container_unix_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_cp_utils.go
docker_cli_create_test.go Remove use of forked reference package for cli 2017-01-19 16:04:50 -08:00
docker_cli_create_unix_test.go validate mount path for tmpfs 2017-01-20 06:01:48 +00:00
docker_cli_daemon_plugins_test.go Add `capability` filter to `docker plugin ls` 2017-01-27 07:32:22 -08:00
docker_cli_daemon_test.go Merge pull request #29552 from dnephin/fix-build-with-log-driver 2017-02-07 15:47:41 -05:00
docker_cli_diff_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_events_test.go Limit TestEventsLimit to 4 concurrent containers on Windows 2017-01-30 11:04:52 -08:00
docker_cli_events_unix_test.go Update opts.MemBytes to disable default, and move `docker run/create/build` to use opts.MemBytes 2017-01-27 12:17:06 -08:00
docker_cli_exec_test.go Merge pull request #30537 from DiSiqueira/asserting_error 2017-02-01 16:08:20 +01:00
docker_cli_exec_unix_test.go
docker_cli_experimental_test.go
docker_cli_export_import_test.go
docker_cli_external_graphdriver_unix_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_external_volume_driver_unix_test.go Merge pull request #29894 from cpuguy83/cleanup_volumedriver_retry_test 2017-02-17 09:46:31 +01:00
docker_cli_health_test.go validate healthcheck params in daemon side 2017-01-29 13:35:32 +08:00
docker_cli_help_test.go Wrap output of docker cli --help 2017-02-03 11:05:49 +00:00
docker_cli_history_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_cli_images_test.go Use distribution reference 2017-02-07 11:08:37 -08:00
docker_cli_import_test.go
docker_cli_info_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_info_unix_test.go
docker_cli_inspect_test.go Merge pull request #30165 from xulike666/fix-typo-6/36 2017-01-19 17:21:22 +01:00
docker_cli_kill_test.go
docker_cli_links_test.go Remove most of the runCommandWithOutput from integration tests 2017-01-30 10:54:06 +01:00
docker_cli_links_unix_test.go
docker_cli_login_test.go
docker_cli_logout_test.go
docker_cli_logs_bench_test.go
docker_cli_logs_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_cli_nat_test.go
docker_cli_netmode_test.go
docker_cli_network_unix_test.go Revert "Fix IT case for network name validation" 2017-02-02 15:38:12 -08:00
docker_cli_oom_killed_test.go
docker_cli_pause_test.go Remove most of the runCommandWithOutput from integration tests 2017-01-30 10:54:06 +01:00
docker_cli_plugins_test.go Make propagated mount persist outside rootfs 2017-02-03 16:22:58 -05:00
docker_cli_port_test.go
docker_cli_proxy_test.go
docker_cli_prune_unix_test.go
docker_cli_ps_test.go Bump go-units 2017-02-07 21:58:56 +01:00
docker_cli_pull_local_test.go fix some ineffectual assignments 2017-01-24 11:16:19 +01:00
docker_cli_pull_test.go Block Windows images on Linux 2017-02-02 11:07:30 -08:00
docker_cli_pull_trusted_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_cli_push_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_cli_registry_user_agent_test.go fix typo 2017-01-19 15:52:28 +08:00
docker_cli_rename_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_restart_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_cli_rm_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_cli_rmi_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_cli_run_test.go Merge pull request #30654 from Microsoft/jjh/unifyworkdir 2017-02-03 00:37:54 -08:00
docker_cli_run_unix_test.go rectify the function name used by note 2017-02-22 16:13:45 +08:00
docker_cli_save_load_test.go Remove most of the runCommandWithOutput from integration tests 2017-01-30 10:54:06 +01:00
docker_cli_save_load_unix_test.go Remove most of the runCommandWithOutput from integration tests 2017-01-30 10:54:06 +01:00
docker_cli_search_test.go fix some ineffectual assignments 2017-01-24 11:16:19 +01:00
docker_cli_secret_create_test.go Move secret name or ID prefix resolving from client to daemon 2017-01-27 10:40:05 -08:00
docker_cli_secret_inspect_test.go
docker_cli_service_create_test.go
docker_cli_service_health_test.go
docker_cli_service_logs_experimental_test.go
docker_cli_service_scale_test.go
docker_cli_service_update_test.go
docker_cli_sni_test.go
docker_cli_stack_test.go Add missing build tag for stack tests. 2017-02-01 13:25:37 -05:00
docker_cli_start_test.go
docker_cli_stats_test.go Send "Name" and "ID" when stating stopped containers 2017-02-09 09:46:59 +08:00
docker_cli_stop_test.go
docker_cli_swarm_test.go Release the network attachment on allocation failure 2017-02-16 05:21:06 -08:00
docker_cli_swarm_unix_test.go
docker_cli_tag_test.go Clean more build utils in integration cli 2017-01-17 15:42:38 +01:00
docker_cli_top_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_update_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_cli_update_unix_test.go
docker_cli_userns_test.go
docker_cli_v2_only_test.go
docker_cli_version_test.go
docker_cli_volume_test.go Fix duplicate mount point for `--volumes-from` in `docker run` 2017-02-07 08:30:56 -08:00
docker_cli_wait_test.go
docker_deprecated_api_v124_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_deprecated_api_v124_unix_test.go
docker_experimental_network_test.go
docker_hub_pull_suite_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
docker_utils_test.go Remove most of the runCommandWithOutput from integration tests 2017-01-30 10:54:06 +01:00
events_utils_test.go
fixtures_linux_daemon_test.go Block obsolete socket families in the default seccomp profile 2017-01-17 17:50:44 +00:00
fixtures_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
requirements_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
requirements_unix_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
test_vars_exec_test.go
test_vars_noexec_test.go
test_vars_noseccomp_test.go
test_vars_seccomp_test.go
test_vars_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00
test_vars_unix_test.go
test_vars_windows_test.go
trust_server_test.go
utils_test.go Use testEnv methods and remove most of the global variables 2017-01-17 12:39:08 +01:00