Matt Clay
4a013d6d69
Add RHEL 7.3 to ansible-test and CI. ( #26550 )
...
* Add support for RHEL to ansible-test.
* Enable RHEL 7.3 on Shippable.
2017-07-07 16:52:40 -07:00
David Newswanger
294c0f91c0
added option to ansible-test to run test playbooks using the debug strategy ( #26499 )
2017-07-07 12:37:08 -07:00
Matt Clay
a94156227d
Improve error handling for cs tests.
2017-07-06 17:55:51 -07:00
Matt Clay
45e377566c
Refactor ansible-test config classes. ( #26505 )
...
* Move Config classes from executor.py to config.py.
* Move Environment and Test config to config.py.
* Move Coverage/CoverageReport Config to config.py.
* Clean up type hints.
2017-07-06 16:14:44 -07:00
Matt Clay
bd8ea89b1b
Improve handling of network test changes.
2017-07-06 14:25:58 -07:00
Matt Clay
c26a556929
Add check for known_hosts changing during tests. ( #26470 )
...
* Add check for known_hosts changing during tests.
* Don't use known hosts file for delegate_to test.
2017-07-06 00:47:28 -07:00
Matt Clay
fba76444e0
Add ansible-test coverage report --show-missing
.
2017-07-05 17:11:41 -07:00
David Newswanger
0a6dcf4169
changed ansible-test so that it replaces . with - instead of . with _ so that the hostname is valid
2017-07-03 20:11:50 -07:00
Matt Clay
cd3a795e65
Permissions fix for remote coverage downloads.
2017-07-02 14:09:16 -07:00
Matt Clay
554423cf04
Expose docker socket to test containers.
2017-06-30 16:46:41 -07:00
René Moser
77d0542985
test, integration: add diff support ( #26296 )
2017-06-30 20:43:34 +02:00
Pierre-Louis Bonicoli
d08ff86169
ansible-test: pass --[skip-]tags to ansible-playbook
...
Thanks to Olaf Klischat for the idea.
2017-06-30 10:35:39 -07:00
Matt Clay
e56ea435f0
Skip dependency check for deleted files. ( #26112 )
2017-06-26 11:48:46 -07:00
David Newswanger
b2d88f8b73
updated ansible-test integration to skip any files in test/integration/targets/ that aren't directories.
...
Fixes #26007
2017-06-22 13:03:42 -07:00
jctanner
996dcb989c
Add the cloud provider script for the vcenter simulator container ( #25964 )
2017-06-22 10:49:58 -07:00
Matt Clay
53180ebb57
Fix Shippable BASE_BRANCH lookup on merges.
2017-05-19 01:51:24 +08:00
Matt Clay
5babe2daea
Increase python version coverage for tests. ( #24762 )
...
* Improve ansible-test inventory handling.
* Fix python 3 re-raise of exception from thread.
* Fix python 3 encoding for windows-integration.
* Run network tests on multiple python versions.
* Run windows tests on multiple python versions.
* Support Shippable delegation using --tox.
* Skip vyos_command on python 3 tests until fixed.
* Add python 3 filtering to local and tox.
* Fix tests to support back to back runs.
* Temporarily test networking with python 2.7 only.
Running the tests back to back causes intermittent test failures
which need to be addressed before we can test multiple versions
in a single test run.
2017-05-19 01:37:53 +08:00
Matt Clay
4daa16f9ce
Add --all and --stub coverage options.
...
ci_coverage
ci_complete
2017-05-16 12:02:03 +08:00
Matt Clay
6a2a7a2392
Enable codecov.io and add coverage grouping.
2017-05-15 19:14:05 +08:00
Matt Clay
fdcad0f44d
Improve on-demand coverage for Shippable.
2017-05-14 18:27:58 +08:00
John R Barker
e9e2d67035
Run vyos_command Network tests in Shippable ( #24514 )
...
* Run VyOS Network tests in Shippable
* net_command no longer exists
* network/ci
* Disable other network tests
* pep8 fix
* Fix PEP 8 issue.
2017-05-12 12:49:12 +01:00
Matt Clay
dfd19a812f
Miscellaneous bug fixes for ansible-test.
...
- Overhauled coverage injector to fix issues with non-local tests.
- Updated integration tests to work with the new coverage injector.
- Fix concurrency issue by using random temp files for delegation.
- Fix handling of coverage files from root user.
- Fix handling of coverage files without arcs.
- Make sure temp copy of injector is world readable and executable.
2017-05-12 14:55:48 +08:00
Matt Clay
fb9efd3c7e
Add --remote-terminate
option to ansible-test.
...
Set `--remote-terminate success` for osx tests.
2017-05-11 22:42:52 +08:00
Matt Clay
b8cb3f519b
Detect and fix environment tampering in tests.
2017-05-11 19:45:15 +08:00
Matt Clay
e6934e42be
Update ansible-test change handling and CS plugin. ( #24395 )
...
* Use CloudStack simulator from Ansible repo.
* Recognize cloud specific ansible-test changes.
* Hide ansible-test cs notice in explain mode.
2017-05-09 16:15:27 +08:00
Matt Clay
0573b8bcd2
Fix ansible-test cloud integration bugs.
2017-05-05 21:46:29 +08:00
Matt Clay
ac72fd9d2c
Add missing return statements.
2017-05-05 18:37:11 +08:00
Matt Clay
201242f302
Fix call to wrong method in ansible-test.
2017-05-05 18:18:40 +08:00
Matt Clay
1582e9bf7d
Fix handling of Shippable env vars.
2017-05-05 17:44:51 +08:00
Matt Clay
a07d42e16d
Add support for cloud tests to ansible-test. ( #24315 )
...
* Split out ansible-test docker functions.
* Add cloud support to ansible-test.
2017-05-05 16:23:00 +08:00
Matt Clay
6522d703a1
Fix ansible-test pylint and pep8 issues. ( #24245 )
...
* Fix pylint useless-super-delegation issues.
* Fix miscellaneous pylint issues.
* Fix PEP 8 issues.
* Fix warnings reported by PyCharm.
2017-05-03 23:19:44 +08:00
Matt Clay
d662f6f0db
Fix bugs in ansible-test units command. ( #24044 )
...
* Handle old versions of coverage.
* Handle old versions of setuptools.
* Detect python version for docker/remote units.
* Add sanity override for test constraints.
2017-04-27 11:21:11 +08:00
Matt Clay
cb1f57d4e5
Add rstcheck to ansible-test and correct issues. ( #23550 )
...
* Add rstcheck to ansible-test.
* Fix rst code-block languages and syntax errors.
* Fix rst inline literals.
* Update python 2 code block to pass tests on py 3.
2017-04-13 10:28:52 -07:00
Matt Clay
92ad9a19b6
Fix ansible-test empty diff handling on Shippable.
2017-04-08 22:08:08 -07:00
Matt Clay
0cf1e8e061
Fix ansible-test handling of import/syntax errors.
2017-04-07 12:20:31 -07:00
Matt Clay
1daa69d685
Initial pylint support for ansible-test sanity.
2017-04-04 16:16:21 -07:00
Matt Clay
4fdeade389
Overhaul ansible-test import analysis. ( #22888 )
...
- Add support for module_utils packages for better organization.
- Add support for "virtual" module_utils packages such as `six`.
2017-03-22 18:07:53 -07:00
Matt Clay
042e387f27
Fix metadata handling for shell command. ( #22801 )
2017-03-20 15:31:57 -07:00
Matt Clay
991bf0a1c3
Fix ansible-test base branch handling on merge. ( #22759 )
2017-03-17 23:33:32 -07:00
Matt Clay
47887a2edd
Fix ansible-test base branch usage on Shippable.
2017-03-17 17:35:09 -07:00
Matt Clay
f7c83ccdc0
Fix ansible-test PR diff handling.
...
Permits use of PRs on branches other than devel.
2017-03-16 10:34:31 -07:00
Matt Clay
3a22467b38
Remove python 2.4 compile test.
2017-03-15 15:46:12 -07:00
Matt Clay
869449e288
Add test verification to ansible-test. ( #22636 )
...
* Add unified git diff parser.
* Add metadata and diff handling.
* Add test confidence/verification to bot output.
2017-03-15 12:17:42 -07:00
Matt Clay
5e9a2b8528
Verify SHA in Shippable change detection.
2017-03-15 11:31:55 -07:00
Matt Clay
89559f78de
Add --failure-ok
option to ansible-test
. ( #22623 )
2017-03-14 16:32:21 -07:00
Matt Clay
771b14acb2
Sort test messages for deterministic output. ( #22581 )
2017-03-13 20:45:10 -07:00
Matt Clay
cfd313bced
Disable ansible color output on sanity tests.
2017-03-08 12:18:16 -08:00
Matt Clay
3ab344e8bd
Use lint/junit output for compile test. ( #22395 )
...
* Refactor sanity classes for use in all tests.
* Use lint/junit output for compile test.
* Add missing options for compile test.
* Fix early bailout on requirements install.
2017-03-08 00:47:21 -08:00
Matt Clay
fbf55886ba
Use lint friendly output for python syntax checks. ( #22390 )
2017-03-07 20:27:50 -08:00
Matt Clay
8f463fcdd2
Create bot friendly sanity output. ( #22381 )
2017-03-07 14:59:50 -08:00