Talk:Autotest

Will's notes (to be integrated into main page)

Test Results

The result of the test is the exit code of the command. Usually retrieved like so:

self.results = utils.system_output(cmd, retain_output=True)

Further test-level info can be returned by using test.write_test_keyval(dict):

extrainfo = dict()
for line in self.results.stdout:
    if line.startswith("kernel version "):
        extrainfo['kernelver'] = line.split()[3]
    ...
self.write_test_keyval(extrainfo)

• For per-iteration data (performance numbers, etc) there are three methods:
  • Just attr: test.write_attr_keyval(attr_dict)
  • Just perf: test.write_perf_keyval(perf_dict)
  • Both: test.write_iteration_keyval(attr_dict, perf_dict)

Test Directories

test objects have the following attributes available:

outputdir       eg. results/<job>/<testname.tag>
resultsdir      eg. results/<job>/<testname.tag>/results
profdir         eg. results/<job>/<testname.tag>/profiling
debugdir        eg. results/<job>/<testname.tag>/debug
bindir          eg. tests/<test>
src             eg. tests/<test>/src
tmpdir          eg. tmp/<tempname>_<testname.tag>