ansible/community.general
1
0
Fork 0
mirror of https://github.com/ansible-collections/community.general.git synced 2024-09-14 20:13:21 +02:00
Code Releases Activity
community.general/test/integration/Makefile

287 lines
16 KiB
Makefile
Raw Normal View History

Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
TEST_DIR ?= ~/ansible_testing
Add credentials.template and support custom INVENTORY Testers may override the inventory and vars-file using the environment variables 'INVENTORY' and 'VARS_FILE'.
2014-03-12 19:37:15 +01:00
INVENTORY ?= inventory
VARS_FILE ?= integration_config.yml
[test_ec2*] cloud integration test updates To support parallel cloud test execution, create and provide a random string to cloud integration tests. The variable 'resource_prefix' can be used in cloud roles and during resource cleanup to safely create/destroy cloud-based resources. Additional changes include: * The roles test_ec2_key and test_ec2_group were updated to use to {{resource_prefix}}. * Additionally, the Makefile was updated to set resource_prefix to a random string. The Makefile will also use 'resource_prefix' during cloud_cleanup. * All test_ec2* roles were updated to add 'setup_ec2' as a role dependency.
2014-03-13 14:52:36 +01:00
# Create a semi-random string for use when testing cloud-based resources
ifndef CLOUD_RESOURCE_PREFIX
Python 3: print function in a shell oneliner in Makefile Fixes File "<string>", line 1 import string,random; print 'ansible-testing-' + ''.join(random.choice(string.ascii_letters + string.digits) for _ in xrange(8)); ^ SyntaxError: invalid syntax when running integration tests with . hacking/env-setup . .tox/py35/bin/activate make -C test/integration test_var_precedence
2015-10-16 16:41:01 +02:00
CLOUD_RESOURCE_PREFIX := $(shell python -c "import string,random; print('ansible-testing-' + ''.join(random.choice(string.ascii_letters + string.digits) for _ in range(8)));")
[test_ec2*] cloud integration test updates To support parallel cloud test execution, create and provide a random string to cloud integration tests. The variable 'resource_prefix' can be used in cloud roles and during resource cleanup to safely create/destroy cloud-based resources. Additional changes include: * The roles test_ec2_key and test_ec2_group were updated to use to {{resource_prefix}}. * Additionally, the Makefile was updated to set resource_prefix to a random string. The Makefile will also use 'resource_prefix' during cloud_cleanup. * All test_ec2* roles were updated to add 'setup_ec2' as a role dependency.
2014-03-13 14:52:36 +01:00
endif
allow env variable override of creds file This is important because there is an integration test, test_git, that require an ssh key to clone a privileged github repo.
2015-10-17 18:45:29 +02:00
CREDENTIALS_FILE ?= credentials.yml
Update credentials.yml documentation and handling Changes include: * Update Makefile to use credentials.yml when it exists * Add details on the use of the credentials.yml file to README.md. * Update credentials.template comments
2014-03-18 15:15:02 +01:00
# If credentials.yml exists, use it
ifneq ("$(wildcard $(CREDENTIALS_FILE))","")
CREDENTIALS_ARG = -e @$(CREDENTIALS_FILE)
else
CREDENTIALS_ARG =
endif
Tidied up a little, added tests Moved repo_url_to_role_name to common method in ansible.utils Added unit test for repo_url_to_role_name Added integration tests for galaxy
2014-08-14 12:20:10 +02:00
# http://unix.stackexchange.com/questions/30091/fix-or-alternative-for-mktemp-in-os-x
Don't bash TMPDIR env var unnecessarily. Other programs might rely on it
2015-02-03 01:17:40 +01:00
MYTMPDIR = $(shell mktemp -d 2>/dev/null || mktemp -d -t 'mytmpdir')
Tidied up a little, added tests Moved repo_url_to_role_name to common method in ansible.utils Added unit test for repo_url_to_role_name Added integration tests for galaxy
2014-08-14 12:20:10 +02:00
Enabled integration tests for encrypted vars in Makefile
2014-05-21 21:17:53 +02:00
VAULT_PASSWORD_FILE = vault-password
Initial commit of Ansible support for the Consul clustering framework (http://consul.io). Submission includes support for - creating and registering services and checks - reading, writing and lookup for values in consul's kv store - creating and manipulating sessions for distributed locking on values in the kv - creating and manipulating ACLs for restricting access to the kv store - inventory support that reads the Consul catalog and group nodes according to - datacenters - exposed services - service availability - arbitrary groupings from the kv store This submission makes extensive use of the python-consul library and this is required as a dependency and can be installed from pip. The tests were written to target a vagrant cluster which can be setup by following the instructions here http://github.com/sgargan/consul-vagrant
2015-01-24 02:09:03 +01:00
CONSUL_RUNNING := $(shell python consul_running.py)
Add tests for connection plugins.
2016-03-04 20:21:43 +01:00
EUID := $(shell id -u -r)
Initial commit of Ansible support for the Consul clustering framework (http://consul.io). Submission includes support for - creating and registering services and checks - reading, writing and lookup for values in consul's kv store - creating and manipulating sessions for distributed locking on values in the kv - creating and manipulating ACLs for restricting access to the kv store - inventory support that reads the Consul catalog and group nodes according to - datacenters - exposed services - service availability - arbitrary groupings from the kv store This submission makes extensive use of the python-consul library and this is required as a dependency and can be installed from pip. The tests were written to target a vagrant cluster which can be setup by following the instructions here http://github.com/sgargan/consul-vagrant
2015-01-24 02:09:03 +01:00
Run more connection tests in Docker. Connection tests are now run before non_destructive to make sure that the known_hosts file in our Docker image has not been removed.
2016-03-21 00:24:01 +01:00
all: setup test_test_infra parsing test_var_precedence unicode test_templating_settings environment test_connection non_destructive destructive includes blocks pull check_mode test_hash test_handlers test_group_by test_vault test_tags test_lookup_paths no_log test_gathering_facts
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
ensure assert and fail work before we test anything else
2016-03-10 02:36:39 +01:00
test_test_infra:
re-integrate test_test_infra output checking added secondary run with overridden inventory/test args per bcoca request
2016-03-18 18:13:45 +01:00
# ensure fail/assert work locally and can stop execution with non-zero exit code
PB_OUT=$$(ansible-playbook -i inventory.local test_test_infra.yml) ; APB_RC=$$? ; echo "$$PB_OUT" ; echo "rc was $$APB_RC (must be non-zero)" ; [ $$APB_RC -ne 0 ] ; echo "ensure playbook output shows assert/fail works (True)" ; echo "$$PB_OUT" | grep "fail works (True)" || exit 1 ; echo "$$PB_OUT" | fgrep "assert works (True)" || exit 1
# ensure we work using all specified test args, overridden inventory, etc
PB_OUT=$$(ansible-playbook -i $(INVENTORY) test_test_infra.yml -e @$(VARS_FILE) $(CREDENTIALS_ARG) $(TEST_FLAGS)) ; APB_RC=$$? ; echo "$$PB_OUT" ; echo "rc was $$APB_RC (must be non-zero)" ; [ $$APB_RC -ne 0 ] ; echo "ensure playbook output shows assert/fail works (True)" ; echo "$$PB_OUT" | grep "fail works (True)" || exit 1 ; echo "$$PB_OUT" | fgrep "assert works (True)" || exit 1
ensure assert and fail work before we test anything else
2016-03-10 02:36:39 +01:00
removed test_infra from setup as it fails when using --tags
2016-03-10 06:29:32 +01:00
setup:
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
rm -rf $(TEST_DIR)
mkdir -p $(TEST_DIR)
Add a lot of tests to verify parsing routines for scenarios that should pass. Some changes TBD, like stripping command spaces off end of expressions.
2014-07-24 04:10:58 +02:00
Add as dependency of the parsing make target
2016-03-08 00:38:47 +01:00
parsing: setup
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
ansible-playbook bad_parsing.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -vvv $(TEST_FLAGS) --tags prepare,common,scenario5
ansible-playbook good_parsing.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS)
Convert test system to use Make
2014-02-20 19:00:05 +01:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
includes: setup
ansible-playbook test_includes.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) $(TEST_FLAGS)
Add some more integration tests for the task and playbook include mechanism.
2014-07-26 16:37:55 +02:00
removed test_infra from setup as it fails when using --tags
2016-03-10 06:29:32 +01:00
pull: pull_run pull_no_127 pull_limit_inventory
add integration test for ansible-pull * this test includes the behavior described in #13688 and #13681 * it runs a minimal playbook and checks for correct use of inventory and limit
2016-02-02 12:13:23 +01:00
pull_run:
ansible-pull -d $(MYTMPDIR) -U https://github.com/ansible-test-robinro/pull-integration-test.git | grep MAGICKEYWORD; \
RC=$$? ; \
rm -rf $(MYTMPDIR); \
exit $$RC
# test for https://github.com/ansible/ansible/issues/13681
pull_no_127:
ansible-pull -d $(MYTMPDIR) -U https://github.com/ansible-test-robinro/pull-integration-test.git | grep -v 127\.0\.0\.1; \
RC=$$? ; \
rm -rf $(MYTMPDIR); \
exit $$RC
# test for https://github.com/ansible/ansible/issues/13688
pull_limit_inventory:
ansible-pull -d $(MYTMPDIR) -U https://github.com/ansible-test-robinro/pull-integration-test.git; \
RC=$$? ; \
rm -rf $(MYTMPDIR); \
exit $$RC
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
unicode: setup
ansible-playbook unicode.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) -v $(TEST_FLAGS) -e 'extra_var=café'
Transform both values of a task name into a byte str prior to comparing Fixes #9571
2014-11-19 20:50:02 +01:00
# Test the start-at-task flag #9571
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
ansible-playbook unicode.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) -v --start-at-task '*¶' -e 'start_at_task=True' $(TEST_FLAGS)
Fix for unicode decoding error in new splitting code Also adds a new unicode integration test
2014-07-25 15:59:26 +02:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_templating_settings: setup
ansible-playbook test_templating_settings.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS)
Update core modules
2014-12-16 20:17:29 +01:00
Make ohai and facter work via module_utils Fact classes rather than in the setup module
2016-03-14 22:50:27 +01:00
test_gathering_facts: setup
ansible-playbook test_gathering_facts.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) -v $(TEST_FLAGS)
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
environment: setup
ansible-playbook test_environment.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) $(TEST_FLAGS)
added test for environment directive
2015-08-21 06:37:17 +02:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
non_destructive: setup
ansible-playbook non_destructive.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS)
Add destructive targets to Makefile.
2014-02-20 19:05:03 +01:00
Run more connection tests in Docker. Connection tests are now run before non_destructive to make sure that the known_hosts file in our Docker image has not been removed.
2016-03-21 00:24:01 +01:00
# For our Docker images, which identify themselves with "ENV container=docker", use the test_docker inventory group.
# Otherwise use the test_default inventory group, which runs fewer tests, but should work on any system.
ifeq ($(container),docker)
TEST_CONNECTION_FILTER := 'test_docker'
else
TEST_CONNECTION_FILTER := 'test_default'
endif
Use vars to eliminate redundant test commands.
2016-03-05 03:14:52 +01:00
# Skip connection plugins which require root when not running as root.
ifneq ($(EUID),0)
Run more connection tests in Docker. Connection tests are now run before non_destructive to make sure that the known_hosts file in our Docker image has not been removed.
2016-03-21 00:24:01 +01:00
TEST_CONNECTION_FILTER += !chroot
Add tests for connection plugins.
2016-03-04 20:21:43 +01:00
endif
Use vars to eliminate redundant test commands.
2016-03-05 03:14:52 +01:00
# Connection plugin test command to repeat with each locale setting.
Revert "Increase verbosity of connection tests." (#15305)
2016-04-14 17:06:46 +02:00
TEST_CONNECTION_CMD = $(1) ansible-playbook test_connection.yml -i test_connection.inventory -l '$(TEST_CONNECTION_FILTER)' $(TEST_FLAGS)
Use vars to eliminate redundant test commands.
2016-03-05 03:14:52 +01:00
test_connection: setup
$(call TEST_CONNECTION_CMD)
$(call TEST_CONNECTION_CMD, LC_ALL=C LANG=C)
Add connection tests for winrm connection plugin. These are the same tests used for the other connection plugins, adapted to use winrm modules and Windows friendly paths.
2016-03-24 18:00:24 +01:00
# Connection plugin test command to repeat with each locale setting. WinRM specific version.
TEST_CONNECTION_WINRM_CMD = $(1) ansible-playbook test_connection_winrm.yml -i inventory.winrm $(TEST_FLAGS)
test_connection_winrm: setup
$(call TEST_CONNECTION_WINRM_CMD)
$(call TEST_CONNECTION_WINRM_CMD, LC_ALL=C LANG=C)
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
destructive: setup
ansible-playbook destructive.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS)
Update makefile, add files for variable blending tests.
2014-02-20 19:25:19 +01:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
check_mode: setup
ansible-playbook check_mode.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v --check $(TEST_FLAGS)
Adding new test for always_run option in check mode
2014-02-20 22:10:44 +01:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_group_by: setup
ansible-playbook test_group_by.yml -i inventory.group_by -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS)
Add integration tests for group_by module. Fixed bug introduced by ansible/ansible#7273 while also fixing issue described in ansible/ansible#6953
2014-05-07 04:30:37 +02:00
Ensure handlers run when meta tasks are defined and add handler integration tests Fixes #6678 Fixes #6670
2014-03-25 18:32:11 +01:00
test_handlers:
tests: checks that handlers work with loops
2015-07-20 14:11:31 +02:00
ansible-playbook test_handlers.yml --tags scenario1 -i inventory.handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS)
[ "$$(ansible-playbook test_handlers.yml --tags scenario2 -l A -i inventory.handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | grep -Po 'RUNNING HANDLER \[test_handlers : \K[^\]]+')" = "test handler" ]
Fix --force-handlers, and allow it in plays and ansible.cfg The --force-handlers command line argument was not correctly running handlers on hosts which had tasks that later failed. This corrects that, and also allows you to specify force_handlers in ansible.cfg or in a play.
2015-04-04 22:37:14 +02:00
# Not forcing, should only run on successful host
[ "$$(ansible-playbook test_force_handlers.yml --tags normal -i inventory.handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | egrep -o CALLED_HANDLER_. | sort | uniq | xargs)" = "CALLED_HANDLER_B" ]
# Forcing from command line
[ "$$(ansible-playbook test_force_handlers.yml --tags normal -i inventory.handlers --force-handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | egrep -o CALLED_HANDLER_. | sort | uniq | xargs)" = "CALLED_HANDLER_A CALLED_HANDLER_B" ]
# Forcing from command line, should only run later tasks on unfailed hosts
[ "$$(ansible-playbook test_force_handlers.yml --tags normal -i inventory.handlers --force-handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | egrep -o CALLED_TASK_. | sort | uniq | xargs)" = "CALLED_TASK_B CALLED_TASK_D CALLED_TASK_E" ]
# Forcing from command line, should call handlers even if all hosts fail
[ "$$(ansible-playbook test_force_handlers.yml --tags normal -i inventory.handlers --force-handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v -e fail_all=yes $(TEST_FLAGS) | egrep -o CALLED_HANDLER_. | sort | uniq | xargs)" = "CALLED_HANDLER_A CALLED_HANDLER_B" ]
# Forcing from ansible.cfg
[ "$$(ANSIBLE_FORCE_HANDLERS=true ansible-playbook --tags normal test_force_handlers.yml -i inventory.handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | egrep -o CALLED_HANDLER_. | sort | uniq | xargs)" = "CALLED_HANDLER_A CALLED_HANDLER_B" ]
# Forcing true in play
[ "$$(ansible-playbook test_force_handlers.yml --tags force_true_in_play -i inventory.handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | egrep -o CALLED_HANDLER_. | sort | uniq | xargs)" = "CALLED_HANDLER_A CALLED_HANDLER_B" ]
# Forcing false in play, which overrides command line
[ "$$(ansible-playbook test_force_handlers.yml --force-handlers --tags force_false_in_play -i inventory.handlers -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | egrep -o CALLED_HANDLER_. | sort | uniq | xargs)" = "CALLED_HANDLER_B" ]
Ensure handlers run when meta tasks are defined and add handler integration tests Fixes #6678 Fixes #6670
2014-03-25 18:32:11 +01:00
Adding new test for hash behavior (merge vs. replace)
2014-02-20 21:23:51 +01:00
test_hash:
Add TEST_FLAGS to test_hash
2016-03-22 21:19:09 +01:00
ANSIBLE_HASH_BEHAVIOUR=replace ansible-playbook test_hash.yml -i $(INVENTORY) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) -e '{"test_hash":{"extra_args":"this is an extra arg"}}'
ANSIBLE_HASH_BEHAVIOUR=merge ansible-playbook test_hash.yml -i $(INVENTORY) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) -e '{"test_hash":{"extra_args":"this is an extra arg"}}'
First pass at ec2 module tests
2014-02-24 20:37:23 +01:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_var_precedence: setup
ansible-playbook test_var_precedence.yml -i $(INVENTORY) $(CREDENTIALS_ARG) $(TEST_FLAGS) -v -e outputdir=$(TEST_DIR) -e 'extra_var=extra_var' -e 'extra_var_override=extra_var_override'
Adding an integration test for variable precedence
2014-05-09 18:42:45 +02:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_vault: setup
ansible-playbook test_vault.yml -i $(INVENTORY) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) --vault-password-file $(VAULT_PASSWORD_FILE) --list-tasks -e outputdir=$(TEST_DIR)
ansible-playbook test_vault.yml -i $(INVENTORY) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) --vault-password-file $(VAULT_PASSWORD_FILE) --list-hosts -e outputdir=$(TEST_DIR)
ansible-playbook test_vault.yml -i $(INVENTORY) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) --vault-password-file $(VAULT_PASSWORD_FILE) --syntax-check -e outputdir=$(TEST_DIR)
ansible-playbook test_vault.yml -i $(INVENTORY) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) --vault-password-file $(VAULT_PASSWORD_FILE) -e outputdir=$(TEST_DIR)
Enabled integration tests for encrypted vars in Makefile
2014-05-21 21:17:53 +02:00
Disable automatic running of test_delegate_to with an explanation of what it would take to set this up in our automated test systems
2014-12-08 22:39:01 +01:00
# test_delegate_to does not work unless we have permission to ssh to localhost.
# Would take some more effort on our test systems to implement that -- probably
# the test node should create an ssh public-private key pair that allows the
# root user on a node to ssh to itself. Until then, this is not in make all.
# Have to run it manually. Ordinary users should be able to run this test as
# long as they have permissions to login to their local machine via ssh.
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_delegate_to: setup
ansible-playbook test_delegate_to.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS)
Fix remote_checksum with delegate_to and add tests for several ways that delegate_to works
2014-12-08 21:44:44 +01:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_winrm: setup
ansible-playbook test_winrm.yml -i inventory.winrm -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS)
Add winrm integration tests for raw, script and ping modules.
2014-06-18 06:04:17 +02:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_tags: setup
added tests refactored task selection into method list-tasks now uses common method of task selection always is now skippable if specified in --skip-tags
2015-02-13 02:58:30 +01:00
# Run everything by default
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
[ "$$(ansible-playbook --list-tasks test_tags.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | fgrep Task_with | xargs)" = "Task_with_tag TAGS: [tag] Task_with_always_tag TAGS: [always] Task_without_tag TAGS: []" ]
added tests refactored task selection into method list-tasks now uses common method of task selection always is now skippable if specified in --skip-tags
2015-02-13 02:58:30 +01:00
# Run the exact tags, and always
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
[ "$$(ansible-playbook --list-tasks --tags tag test_tags.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | fgrep Task_with | xargs)" = "Task_with_tag TAGS: [tag] Task_with_always_tag TAGS: [always]" ]
added tests refactored task selection into method list-tasks now uses common method of task selection always is now skippable if specified in --skip-tags
2015-02-13 02:58:30 +01:00
# Skip one tag
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
[ "$$(ansible-playbook --list-tasks --skip-tags tag test_tags.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -v $(TEST_FLAGS) | fgrep Task_with | xargs)" = "Task_with_always_tag TAGS: [always] Task_without_tag TAGS: []" ]
added tests refactored task selection into method list-tasks now uses common method of task selection always is now skippable if specified in --skip-tags
2015-02-13 02:58:30 +01:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
blocks: setup
Adding block integration tests
2016-02-03 20:53:47 +01:00
# remove old output log
rm -f block_test.out
Tweak block integration tests to also test the free strategy
2016-02-04 00:42:06 +01:00
# run the test and check to make sure the right number of completions was logged
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
ansible-playbook -vv -e outputdir=$(TEST_DIR) test_blocks/main.yml | tee block_test.out
Fix the Makefile to run under dash (POSIX /bin/test syntax)
2016-03-03 18:25:12 +01:00
[ "$$(grep 'TEST COMPLETE' block_test.out | wc -l)" = "$$(egrep '^[0-9]+ plays in' block_test.out | cut -f1 -d' ')" ]
Tweak block integration tests to also test the free strategy
2016-02-04 00:42:06 +01:00
# cleanup the output log again, to make sure the test is clean
rm -f block_test.out
# run test with free strategy and again count the completions
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
ansible-playbook -vv -e outputdir=$(TEST_DIR) test_blocks/main.yml -e test_strategy=free | tee block_test.out
Fix the Makefile to run under dash (POSIX /bin/test syntax)
2016-03-03 18:25:12 +01:00
[ "$$(grep 'TEST COMPLETE' block_test.out | wc -l)" = "$$(egrep '^[0-9]+ plays in' block_test.out | cut -f1 -d' ')" ]
added tests refactored task selection into method list-tasks now uses common method of task selection always is now skippable if specified in --skip-tags
2015-02-13 02:58:30 +01:00
azure changes to Makefile
2015-05-05 14:42:07 +02:00
cloud: amazon rackspace azure
First pass at ec2 module tests
2014-02-24 20:37:23 +01:00
Always run cleanup after running cloud_integration tests
2014-02-27 17:44:13 +01:00
cloud_cleanup: amazon_cleanup rackspace_cleanup
amazon_cleanup:
[test_ec2*] cloud integration test updates To support parallel cloud test execution, create and provide a random string to cloud integration tests. The variable 'resource_prefix' can be used in cloud roles and during resource cleanup to safely create/destroy cloud-based resources. Additional changes include: * The roles test_ec2_key and test_ec2_group were updated to use to {{resource_prefix}}. * Additionally, the Makefile was updated to set resource_prefix to a random string. The Makefile will also use 'resource_prefix' during cloud_cleanup. * All test_ec2* roles were updated to add 'setup_ec2' as a role dependency.
2014-03-13 14:52:36 +01:00
python cleanup_ec2.py -y --match="^$(CLOUD_RESOURCE_PREFIX)"
Always run cleanup after running cloud_integration tests
2014-02-27 17:44:13 +01:00
azure changes to Makefile
2015-05-05 14:42:07 +02:00
azure_cleanup:
python cleanup_azure.py -y --match="^$(CLOUD_RESOURCE_PREFIX)"
Adds support for creating GCE persistent disks from snapshots
2014-04-12 00:45:56 +02:00
gce_setup:
python setup_gce.py "$(CLOUD_RESOURCE_PREFIX)"
Adds integration tests for gce module.
2014-03-30 01:27:48 +01:00
gce_cleanup:
python cleanup_gce.py -y --match="^$(CLOUD_RESOURCE_PREFIX)"
Always run cleanup after running cloud_integration tests
2014-02-27 17:44:13 +01:00
rackspace_cleanup:
Add integration tests for the rax module
2015-01-09 21:50:23 +01:00
python cleanup_rax.py -y --match="^$(CLOUD_RESOURCE_PREFIX)"
Always run cleanup after running cloud_integration tests
2014-02-27 17:44:13 +01:00
Update credentials.yml documentation and handling Changes include: * Update Makefile to use credentials.yml when it exists * Add details on the use of the credentials.yml file to README.md. * Update credentials.template comments
2014-03-18 15:15:02 +01:00
$(CREDENTIALS_FILE):
@echo "No credentials file found. A file named '$(CREDENTIALS_FILE)' is needed to provide credentials needed to run cloud tests. See sample 'credentials.template' file."
First pass at ec2 module tests
2014-02-24 20:37:23 +01:00
@exit 1
Update credentials.yml documentation and handling Changes include: * Update Makefile to use credentials.yml when it exists * Add details on the use of the credentials.yml file to README.md. * Update credentials.template comments
2014-03-18 15:15:02 +01:00
amazon: $(CREDENTIALS_FILE)
Make sure amazon test doesn't check host keys
2014-05-05 22:07:59 +02:00
ANSIBLE_HOST_KEY_CHECKING=False ANSIBLE_SSH_PIPELINING=no BOTO_CONFIG=/dev/null ansible-playbook amazon.yml -i $(INVENTORY) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -e "resource_prefix=$(CLOUD_RESOURCE_PREFIX)" -v $(TEST_FLAGS) ; \
Always run cleanup after running cloud_integration tests
2014-02-27 17:44:13 +01:00
RC=$$? ; \
[test_ec2*] cloud integration test updates To support parallel cloud test execution, create and provide a random string to cloud integration tests. The variable 'resource_prefix' can be used in cloud roles and during resource cleanup to safely create/destroy cloud-based resources. Additional changes include: * The roles test_ec2_key and test_ec2_group were updated to use to {{resource_prefix}}. * Additionally, the Makefile was updated to set resource_prefix to a random string. The Makefile will also use 'resource_prefix' during cloud_cleanup. * All test_ec2* roles were updated to add 'setup_ec2' as a role dependency.
2014-03-13 14:52:36 +01:00
CLOUD_RESOURCE_PREFIX="$(CLOUD_RESOURCE_PREFIX)" make amazon_cleanup ; \
Always run cleanup after running cloud_integration tests
2014-02-27 17:44:13 +01:00
exit $$RC;
First pass at ec2 module tests
2014-02-24 20:37:23 +01:00
azure changes to Makefile
2015-05-05 14:42:07 +02:00
azure: $(CREDENTIALS_FILE)
ANSIBLE_HOST_KEY_CHECKING=False ansible-playbook azure.yml -i $(INVENTORY) $(CREDENTIALS_ARG) -e "resource_prefix=$(CLOUD_RESOURCE_PREFIX)" -v $(TEST_FLAGS) ; \
RC=$$? ; \
CLOUD_RESOURCE_PREFIX="$(CLOUD_RESOURCE_PREFIX)" make azure_cleanup ; \
exit $$RC;
Adds integration tests for gce module.
2014-03-30 01:27:48 +01:00
gce: $(CREDENTIALS_FILE)
Adds support for creating GCE persistent disks from snapshots
2014-04-12 00:45:56 +02:00
CLOUD_RESOURCE_PREFIX="$(CLOUD_RESOURCE_PREFIX)" make gce_setup ; \
ansible-playbook gce.yml -i $(INVENTORY) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -e "resource_prefix=$(CLOUD_RESOURCE_PREFIX)" -v $(TEST_FLAGS) ; \
Adds integration tests for gce module.
2014-03-30 01:27:48 +01:00
RC=$$? ; \
CLOUD_RESOURCE_PREFIX="$(CLOUD_RESOURCE_PREFIX)" make gce_cleanup ; \
exit $$RC;
Update credentials.yml documentation and handling Changes include: * Update Makefile to use credentials.yml when it exists * Add details on the use of the credentials.yml file to README.md. * Update credentials.template comments
2014-03-18 15:15:02 +01:00
rackspace: $(CREDENTIALS_FILE)
ansible-playbook rackspace.yml -i $(INVENTORY) -e @$(VARS_FILE) $(CREDENTIALS_ARG) -e "resource_prefix=$(CLOUD_RESOURCE_PREFIX)" -v $(TEST_FLAGS) ; \
Always run cleanup after running cloud_integration tests
2014-02-27 17:44:13 +01:00
RC=$$? ; \
[test_ec2*] cloud integration test updates To support parallel cloud test execution, create and provide a random string to cloud integration tests. The variable 'resource_prefix' can be used in cloud roles and during resource cleanup to safely create/destroy cloud-based resources. Additional changes include: * The roles test_ec2_key and test_ec2_group were updated to use to {{resource_prefix}}. * Additionally, the Makefile was updated to set resource_prefix to a random string. The Makefile will also use 'resource_prefix' during cloud_cleanup. * All test_ec2* roles were updated to add 'setup_ec2' as a role dependency.
2014-03-13 14:52:36 +01:00
CLOUD_RESOURCE_PREFIX="$(CLOUD_RESOURCE_PREFIX)" make rackspace_cleanup ; \
Always run cleanup after running cloud_integration tests
2014-02-27 17:44:13 +01:00
exit $$RC;
Tidied up a little, added tests Moved repo_url_to_role_name to common method in ansible.utils Added unit test for repo_url_to_role_name Added integration tests for galaxy
2014-08-14 12:20:10 +02:00
cloudstack: integration tests
2015-05-03 16:06:30 +02:00
cloudstack:
ansible-playbook cloudstack.yml -i $(INVENTORY) -e @$(VARS_FILE) -e "resource_prefix=$(CLOUD_RESOURCE_PREFIX)" -v $(TEST_FLAGS) ; \
RC=$$? ; \
exit $$RC;
Add integration tests for the cloudflare_dns module
2016-03-23 21:41:50 +01:00
cloudflare: $(CREDENTIALS_FILE)
ansible-playbook cloudflare.yml -i $(INVENTORY) -e @$(VARS_FILE) -e @$(CREDENTIALS_FILE) -e "resource_prefix=$(CLOUD_RESOURCE_PREFIX)" -v $(TEST_FLAGS) ; \
RC=$$? ; \
exit $$RC;
Initial commit of Ansible support for the Consul clustering framework (http://consul.io). Submission includes support for - creating and registering services and checks - reading, writing and lookup for values in consul's kv store - creating and manipulating sessions for distributed locking on values in the kv - creating and manipulating ACLs for restricting access to the kv store - inventory support that reads the Consul catalog and group nodes according to - datacenters - exposed services - service availability - arbitrary groupings from the kv store This submission makes extensive use of the python-consul library and this is required as a dependency and can be installed from pip. The tests were written to target a vagrant cluster which can be setup by following the instructions here http://github.com/sgargan/consul-vagrant
2015-01-24 02:09:03 +01:00
$(CONSUL_RUNNING):
consul:
ifeq ($(CONSUL_RUNNING), True)
ansible-playbook -i $(INVENTORY) consul.yml ; \
fixed all references to old plugins/inventory to point at contrib/inventory
2015-07-10 18:59:52 +02:00
ansible-playbook -i ../../contrib/inventory/consul_io.py consul_inventory.yml
Initial commit of Ansible support for the Consul clustering framework (http://consul.io). Submission includes support for - creating and registering services and checks - reading, writing and lookup for values in consul's kv store - creating and manipulating sessions for distributed locking on values in the kv - creating and manipulating ACLs for restricting access to the kv store - inventory support that reads the Consul catalog and group nodes according to - datacenters - exposed services - service availability - arbitrary groupings from the kv store This submission makes extensive use of the python-consul library and this is required as a dependency and can be installed from pip. The tests were written to target a vagrant cluster which can be setup by following the instructions here http://github.com/sgargan/consul-vagrant
2015-01-24 02:09:03 +01:00
else
@echo "Consul agent is not running locally. To run a cluster locally see http://github.com/sgargan/consul-vagrant"
endif
Adding support for scm-based role source urls (incl. integration test to cover it)
2016-01-21 13:00:29 +01:00
test_galaxy: test_galaxy_spec test_galaxy_yaml test_galaxy_git
Allow installation of roles from yaml roles file Added docs Added more tests Improved how roles are returned from the parsers
2014-08-18 13:27:41 +02:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_galaxy_spec: setup
Don't bash TMPDIR env var unnecessarily. Other programs might rely on it
2015-02-03 01:17:40 +01:00
mytmpdir=$(MYTMPDIR) ; \
galaxy updates better error reporting on fetching errors use scm if it exists over src unified functions in requirements simplified logic added verbose to tests cleanup code refs, unused options and dead code moved get_opt to base class fixes #11920 fixes #12612 fixes #10454
2015-10-03 16:29:28 +02:00
ansible-galaxy install -r galaxy_rolesfile -p $$mytmpdir/roles -vvvv ; \
Tidied up a little, added tests Moved repo_url_to_role_name to common method in ansible.utils Added unit test for repo_url_to_role_name Added integration tests for galaxy
2014-08-14 12:20:10 +02:00
cp galaxy_playbook.yml $$mytmpdir ; \
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
ansible-playbook -i $(INVENTORY) $$mytmpdir/galaxy_playbook.yml -e outputdir=$(TEST_DIR) -v $(TEST_FLAGS) ; \
Tidied up a little, added tests Moved repo_url_to_role_name to common method in ansible.utils Added unit test for repo_url_to_role_name Added integration tests for galaxy
2014-08-14 12:20:10 +02:00
RC=$$? ; \
rm -rf $$mytmpdir ; \
Allow installation of roles from yaml roles file Added docs Added more tests Improved how roles are returned from the parsers
2014-08-18 13:27:41 +02:00
exit $$RC
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_galaxy_yaml: setup
Don't bash TMPDIR env var unnecessarily. Other programs might rely on it
2015-02-03 01:17:40 +01:00
mytmpdir=$(MYTMPDIR) ; \
galaxy updates better error reporting on fetching errors use scm if it exists over src unified functions in requirements simplified logic added verbose to tests cleanup code refs, unused options and dead code moved get_opt to base class fixes #11920 fixes #12612 fixes #10454
2015-10-03 16:29:28 +02:00
ansible-galaxy install -r galaxy_roles.yml -p $$mytmpdir/roles -vvvv; \
Allow installation of roles from yaml roles file Added docs Added more tests Improved how roles are returned from the parsers
2014-08-18 13:27:41 +02:00
cp galaxy_playbook.yml $$mytmpdir ; \
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
ansible-playbook -i $(INVENTORY) $$mytmpdir/galaxy_playbook.yml -e outputdir=$(TEST_DIR) -v $(TEST_FLAGS) ; \
Allow installation of roles from yaml roles file Added docs Added more tests Improved how roles are returned from the parsers
2014-08-18 13:27:41 +02:00
RC=$$? ; \
rm -rf $$mytmpdir ; \
exit $$RC
added lookup paths testing
2015-08-13 01:00:54 +02:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_galaxy_git: setup
Adding support for scm-based role source urls (incl. integration test to cover it)
2016-01-21 13:00:29 +01:00
mytmpdir=$(MYTMPDIR) ; \
ansible-galaxy install git+https://bitbucket.org/willthames/git-ansible-galaxy,v1.6 -p $$mytmpdir/roles -vvvv; \
cp galaxy_playbook_git.yml $$mytmpdir ; \
ansible-playbook -i $(INVENTORY) $$mytmpdir/galaxy_playbook_git.yml -v $(TEST_FLAGS) ; \
RC=$$? ; \
rm -rf $$mytmpdir ; \
exit $$RC
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
test_lookup_paths: setup
ansible-playbook lookup_paths/play.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -v $(TEST_FLAGS)
added no_log tests as per #12214
2015-10-02 15:09:12 +02:00
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
no_log: setup
corrected no_log for items and skipped tasks corrected output from default callback added new tests for no_log loops updated makefile test to check for both positive and negative occurrences of no_log
2015-10-02 20:33:02 +02:00
# This test expects 7 loggable vars and 0 non loggable ones, if either mismatches it fails, run the ansible-playbook command to debug
Moving creating of testing work dir out of dep role and into Makefile
2016-03-03 21:22:35 +01:00
[ "$$(ansible-playbook no_log_local.yml -i $(INVENTORY) -e outputdir=$(TEST_DIR) -vvvvv | awk --source 'BEGIN { logme = 0; nolog = 0; } /LOG_ME/ { logme += 1;} /DO_NOT_LOG/ { nolog += 1;} END { printf "%d/%d", logme, nolog; }')" = "6/0" ]
Copy permalink