- Martin Pitt: Why is there an "install the test" step? That seems thoroughly unnecessary with keeping the tests in dist-git, and in fact should be avoided as
/usr/really should remain package manager territory.
- Stef Walter: Is the run-tests.yml in the top level of the dist-git repo? If not, the standard should document the subdirectory that it lives in. The examples are confusing here although the standard says the tests are stored in dist-git the examples are not dist-git style repositories.
- Stef Walter: By default, Ansible sets the current directory to the one that stores the playbook. The output artifacts always end up in the same directory as
run-tests.yml. Should we make an environment variable or somehow specify a fixed directory where they should go?
- Handling test subjects in Ansible is hard. Should we have different entry point scripts for different kinds of test subjects? For example
test-ostree.yml. These playbooks could share Ansible roles and modules, or invoke one another (eg: against a VM the first ansible playbook provisioned).