Autotest

From FedoraProject

(Difference between revisions)
Jump to: navigation, search
(first draft)
 
 
(11 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{draft}}
+
{{lang|en|zh-cn|page=Autotest}}
 +
 
 +
{{header|qa}}
  
 
== What is autotest? ==
 
== What is autotest? ==
  
Autotest is "a framework for automated testing". It gives us a way to run automated tests and collect results. For more information, see their wiki: http://autotest.kernel.org/
+
Autotest is "a framework for automated testing". It gives us a way to run automated tests and collect results. For more information, see their wiki: https://github.com/autotest/autotest/wiki
  
 
== How is it used in Fedora? ==
 
== How is it used in Fedora? ==
  
Currently there is no public autotest instance. The [[QA]] team has been working on [https://fedorahosted.org/autoqa/ticket/9 packaging autotest] for use in the Fedora infrastructure.
+
We're currently using it as the test harness for [[AutoQA]]. It handles the dirty work of getting code onto test machines, running it, and holding all the results.
 
+
We're planning to use it as the test harness for [https://fedorahosted.org/autoqa/ AutoQA], starting with the [[Israwhidebroken.com Proposal]]. In the future we may open it up to allow all Fedora contributors to write tests and have them be run automatically.
+
 
+
== How do I write a test for autotest? ==
+
 
+
The short version:
+
# Write a test. You can write it in whatever language you're comfortable with.
+
# Create a control file. This gives autotest some metadata about the test.
+
#* Some control file requirements are listed under [http://autotest.kernel.org/wiki/ControlRequirements ControlRequirements] on the autotest wiki.
+
# Create a test script. This runs your test program and reports back the results.
+
#* The test scripts are written in Python; see [http://autotest.kernel.org/wiki/AddingTest AddingTest] and [http://autotest.kernel.org/wiki/AutotestApi AutotestAPI] on the autotest wiki for details.
+
# Create a new dir in the autoqa git tree for your test.
+
#* The details of this process have yet to be finalized.
+
  
=== Writing a test ===
+
Currently there is a public autotest instance running at http://autoqa.fedoraproject.org.  This instance is hosted by the [[Infrastructure]] team and managed by [[QA]] team.  It is not integrated with Fedora account system, so public access to the autotest scheduler web-frontend is not enabled.  However, test results are available and links to results are included in all [https://fedorahosted.org/mailman/listinfo/autoqa-results test result emails].
TODO
+
  
=== Writing a control file ===
+
== How to ... ==
TODO
+
  
=== Writing the test script ===
+
* [[Install_and_configure_autotest|How to set up my own autotest server?]]
TODO
+
* [[How to add autotest clients]]?
 +
* [[How to fix failed autotest clients]]?
 +
* [[Writing AutoQA Tests|How to integrate existing tests?]]
  
=== Checking in the new test ===
+
[[Category:AutoQA]]
TODO
+

Latest revision as of 04:18, 3 June 2013

QA.png


[edit] What is autotest?

Autotest is "a framework for automated testing". It gives us a way to run automated tests and collect results. For more information, see their wiki: https://github.com/autotest/autotest/wiki

[edit] How is it used in Fedora?

We're currently using it as the test harness for AutoQA. It handles the dirty work of getting code onto test machines, running it, and holding all the results.

Currently there is a public autotest instance running at http://autoqa.fedoraproject.org. This instance is hosted by the Infrastructure team and managed by QA team. It is not integrated with Fedora account system, so public access to the autotest scheduler web-frontend is not enabled. However, test results are available and links to results are included in all test result emails.

[edit] How to ...