Revision as of 20:00, 22 January 2015

The QA team develops tools to make testing easier and more repeatable. Developing open source quality assurance tools is complex and challenging stuff at the cutting edge of the field. Contact Tim Flink if you're up to the challenge of building new tools for Fedora QA.

QA tools

Test Automation

Taskotron: Taskotron is our current in-development framework for automatically executing a number of Fedora related tests. Both Fedora infrastructure generic and Fedora packages specific tests should be supported. Package maintainers should have an easy way of providing tests for their packages. This framework is intended to obsolete AutoQA.

ResultsDB: A generic storage of (automated) test results. Designed to be lightweight, simple, scalable and fast. It's used by our automation frameworks (AutoQA and Taskotron).

AutoQA: AutoQA is an framework that provides tests, methods for automated execution, and displays for test results. AutoQA relies on the Autotest test harness for job scheduling and execution. Visit the AutoQA trac instance for development milestones and source code. AutoQA is an outgrowth of FudCon F11 collaboration. This project is going to be replaced by Taskotron.

Beaker: Beaker is an up and coming fully automated test framework that provides bare metal hardware provisioning including console and power management, and job scheduling and execution. Learn more at Beaker homepage.

Installation

SNAKE: Smart Network Automated Kickstart Environment. A small tool to assist with installing and pykickstart-based library for modeling sustainable kickstarts.

Release validation testing

python-wikitcms and relval: A Python library and CLI based upon it for performing various release validation testing tasks in the Wikitcms 'test management system' (the set of wiki pages in which release validation test results are stored).

Test case reporting

Test Days Frontend: A web application for providing results from Test Days events. It uses ResultsDB (legacy) as a backend.

Bug reporting

Blocker Bugs App: A web application to display current blocker bugs during our pre-release cycle.

python-bugzilla: Command-line interaction with Bugzilla. Supports searching, creating and modifying bugs.

Test update feedback

Fedora Gooey Karma: A graphical tool that makes it easy to report feedback for any updates-testing packages currently installed.

Fedora Easy Karma: A command line tool that makes it easy to report feedback for any updates-testing packages currently installed.

Mixed bag

Fedora QA scripts: A git repository containing various small scripts.

Infrastructure tools

These tools we use as our support infrastructure during QA tools development.

Bitbucket team repository: A list of repositories that are related to our tools and needs.

Phabricator: Our main issue and code review tracker for most of our projects.

@@ Line 2: / Line 2: @@
 {{autolang|base=yes}}
-__NOTOC__
+The [[QA]] team develops tools to make testing easier and more repeatable.  Developing open source quality assurance tools is complex and challenging stuff at the cutting edge of the field. Contact [[User:tflink|Tim Flink]] if you're up to the challenge of building new tools for Fedora QA.
-The [[QA]] Project develops tools to make testing easier and more repeatable.  Developing open source quality assurance tools is complex and challenging stuff at the cutting edge of the field. Contact [[User:tflink|Tim Flink]] if you're up to the challenge of building new tools for Fedora QA.
+= QA tools =
-= Test Automation =
+== Test Automation ==
-; [[AutoQA]] : AutoQA is an framework that provides tests, methods for automated execution, and displays for test results.  AutoQA relies on the [[Autotest]] test harness for job scheduling and execution.  Visit the [https://fedorahosted.org/autoqa AutoQA] trac instance for development milestones and source code.  AutoQA is an outgrowth of FudCon F11 [[Automated QA Testing Project|collaboration]].
+; [[Taskotron]] : Taskotron is our current in-development framework for automatically executing a number of Fedora related tests. Both Fedora infrastructure generic and Fedora packages specific tests should be supported. Package maintainers should have an easy way of providing tests for their packages. This framework is intended to obsolete [[AutoQA]].
-; [https://fedorahosted.org/beaker Beaker] : [https://fedorahosted.org/beaker Beaker] is an up and coming fully automated test framework that provides bare metal hardware provisioning including console and power management, and job scheduling and execution.  The mailing list is [https://fedorahosted.org/mailman/listinfo/beaker-devel beaker-devel].
-= Test Case Management =
+; [[ResultsDB]] : A generic storage of (automated) test results. Designed to be lightweight, simple, scalable and fast. It's used by our automation frameworks (AutoQA and Taskotron).
-; [https://fedorahosted.org/nitrate Nitrate] : The nitrate project intends to provide a web-based test management framework for test planning and test execution tracking.  Nitrate is being packaged for Fedora (refer to {{bz|690728}}) for updates on packaging.
+; [[AutoQA]] : AutoQA is an framework that provides tests, methods for automated execution, and displays for test results.  AutoQA relies on the [[Autotest]] test harness for job scheduling and execution.  Visit the [https://fedorahosted.org/autoqa AutoQA] trac instance for development milestones and source code.  AutoQA is an outgrowth of FudCon F11 [[Automated QA Testing Project|collaboration]]. ''This project is going to be replaced by Taskotron.''
-= Installation =
+; [http://beaker.fedoraproject.org Beaker] : Beaker is an up and coming fully automated test framework that provides bare metal hardware provisioning including console and power management, and job scheduling and execution. Learn more at [http://beaker-project.org/ Beaker homepage].
-; [https://fedorahosted.org/snake SNAKE] : Smart Network Automated Kickstart Environment.  A small tool to assist with installing and pykickstart-based library for modelling sustainable kickstarts.
-; [https://fedorahosted.org/cobbler Cobbler/koan] : Provisioning at it's best ... check out the [https://fedorahosted.org/cobbler trac] instance for documentation.
-= Bugzilla =
+== Installation ==
-; [https://fedorahosted.org/python-bugzilla/ python-bugzilla] : Command-line interaction with bugzilla.  Supports searching, creating and modifying bugs.
+; [https://fedorahosted.org/snake SNAKE] : Smart Network Automated Kickstart Environment.  A small tool to assist with installing and pykickstart-based library for modeling sustainable kickstarts.
-; Improvements to [https://bugzilla.redhat.com/ Bugzilla] :
-= Infrastructure =
+== Release validation testing ==
-; [https://fedorahosted.org/bodhi/ Bodhi] : Bodhi manages delivery of package updates for Fedora.
+; [https://www.happyassassin.net/wikitcms/ python-wikitcms and relval]: A Python library and CLI based upon it for performing various [[QA:Release_validation_test_plan|release validation testing]] tasks in the [[Wikitcms]] 'test management system' (the set of wiki pages in which release validation test results are stored).
-= Test update feedback =
+== Test case reporting ==
-; [[Fedora Easy Karma]] : A script that makes it easy to report feedback for any updates-testing packages currently installed. Direct download [http://fedorapeople.org/gitweb?p=till/public_git/fedora-easy-karma.git;a=blob_plain;f=fedora-easy-karma.py here].
+; [http://testdays.qa.fedoraproject.org/testdays/all_events Test Days Frontend] : A web application for providing results from [[QA/Test Days|Test Days]] events. It uses ResultsDB (legacy) as a backend.
+== Bug reporting ==
+; [https://qa.fedoraproject.org/blockerbugs/ Blocker Bugs App] : A web application to display current [[QA:SOP blocker bug process|blocker bugs]] during our pre-release cycle.
+; [https://fedorahosted.org/python-bugzilla/ python-bugzilla] : Command-line interaction with [https://bugzilla.redhat.com/ Bugzilla]. Supports searching, creating and modifying bugs.
+== Test update feedback ==
+; [[Fedora Gooey Karma]] : A graphical tool that makes it easy to report feedback for any updates-testing packages currently installed.
+; [[Fedora Easy Karma]] : A command line tool that makes it easy to report feedback for any updates-testing packages currently installed.
+== Mixed bag ==
+; [http://git.fedorahosted.org/git/?p=fedora-qa.git Fedora QA scripts] : A git repository containing various small scripts.
+= Infrastructure tools =
+These tools we use as our support infrastructure during QA tools development.
+; [https://bitbucket.org/fedoraqa Bitbucket team repository] : A list of repositories that are related to our tools and needs.
+; [[QA/Phabricator|Phabricator]] : Our main issue and code review tracker for most of our projects.
+[[Category:QA]]

Search

QA:Tools: Difference between revisions