QA:Updates Testing

From FedoraProject

(Difference between revisions)
Jump to: navigation, search
(move from Testing)
 
(extensive re-write, make it more detailed and friendly)
Line 1: Line 1:
The Fedora updates-testing repositories contain updates scheduled to be released for the maintained releases of Fedora. Testing them and providing feedback in the fedora-test mailing list and the relevant bugzilla reports helps developers to fix any potential regressions in them. To test this, enable updates-testing repository in /etc/yum.repos.d and run 'yum update' to get them. A dedicated test system is more useful for these checks. If you want to test specific packages or enable the testing repository on the fly, you can do the following:
+
{{header|qa}}
 +
__NOTOC__
 +
 
 +
The Fedora updates-testing repositories contain updates scheduled to be released for the maintained releases of Fedora. User testing and feedback provided via [http://bodhi.fedoraproject.org Bodhi], on the [https://www.redhat.com/mailman/listinfo/fedora-test-list fedora-test-list] mailing list and the relevant [http://bugzilla.redhat.com Bugzilla] is vital to ensure that good updates are released quickly and bad ones kept away from release.
 +
 
 +
== Using the updates-testing repository ==
 +
 
 +
=== Enabling the repository permanently ===
 +
 
 +
To enable the updates-testing repository permanently, run the repository configuration tool. From the Fedora menu, click ''Administration'' and then ''Software Sources''. Now check the box labelled '''Show debug and development software sources'''. Now, check the boxes with '''Test Updates''' (but not '''Test Updates Source''') in their name for your release of Fedora. From now on, when you update your system, test updates will be installed just as official updates were previously.
 +
 
 +
=== Enabling the repository temporarily ===
 +
 
 +
If you'd rather not enable the updates-testing repository permanently but just use it on a case-by-case basis, you can do this with ''yum''. The command:
  
 
:yum update --enablerepo=updates-testing
 
:yum update --enablerepo=updates-testing
 +
 +
will update the entire system using packages from the updates-testing repository, while the command:
 +
 
:yum install <foo> --enablerepo=updates-testing
 
:yum install <foo> --enablerepo=updates-testing
  
New updates are listed in the Bodhi tool at http://bodhi.fedoraproject.org/. Testers use Bodhi to rate and comment on each update, which is then released for general public consumption or withdrawn, depending on the results.
+
will install or update only the package named <foo> from the updates-testing repository.
 +
 
 +
== What to test, testing, and reporting results ===
 +
 
 +
The [http://bodhi.fedoraproject.org Bodhi] system is used to track and collate feedback on testing updates. All testing updates will be shown in the Bodhi system. First of all, if any test update package works worse for you in any respect than the pre-update version did, this is a problem that should be communicated to the developers. Secondly, when you click on a certain update, you will see a screen with more information on the update. The ''Details'' section should give you information on what the update is intended to fix. You should, if possible, test that the update does indeed fix the issues it claims to fix.
 +
 
 +
To give your feedback on a test update, use Bodhi. There is a ''Login'' link in the left-hand sidebar. Log in using your Fedora account. If you don't have a Fedora account, you can [https://admin.fedoraproject.org/accounts/user/new create an account here]. Once you are logged in, you will be able to leave a comment on the update. Underneath the comment box are three options: ''Untested'', ''Works for me'', and ''Does not work''.
 +
 
 +
* Use ''Untested'' if you need to comment without yet leaving definite positive or negative feedback on the update.
 +
* Use ''Works for me'' to report that you tested the update, found no problems compared to the previous package, and it addressed the issues it is intended to address (as far as you could test).
 +
* If you experience any problem with the test update, use the ''Does not work'' button, and leave a comment explaining exactly what problem you had.
  
You need a Fedora Account to log in to Bodhi. You can [https://admin.fedoraproject.org/accounts/user/new create an account now].
+
Each ''Works for me'' adds 1 to the test update's ''karma'', while each ''Does not work'' subtracts 1 from it. ''Untested'' leaves the karma unchanged. Test updates with karma of 3 are automatically sent out as full official updates, while test updates with karma of -3 are automatically withdrawn from the testing repository. As you can see, your testing and feedback is vital to make sure that good updates are released quickly and bad ones don't get out to the general public.

Revision as of 23:18, 16 February 2009

QA.png


The Fedora updates-testing repositories contain updates scheduled to be released for the maintained releases of Fedora. User testing and feedback provided via Bodhi, on the fedora-test-list mailing list and the relevant Bugzilla is vital to ensure that good updates are released quickly and bad ones kept away from release.

Using the updates-testing repository

Enabling the repository permanently

To enable the updates-testing repository permanently, run the repository configuration tool. From the Fedora menu, click Administration and then Software Sources. Now check the box labelled Show debug and development software sources. Now, check the boxes with Test Updates (but not Test Updates Source) in their name for your release of Fedora. From now on, when you update your system, test updates will be installed just as official updates were previously.

Enabling the repository temporarily

If you'd rather not enable the updates-testing repository permanently but just use it on a case-by-case basis, you can do this with yum. The command:

yum update --enablerepo=updates-testing

will update the entire system using packages from the updates-testing repository, while the command:

yum install <foo> --enablerepo=updates-testing

will install or update only the package named <foo> from the updates-testing repository.

What to test, testing, and reporting results =

The Bodhi system is used to track and collate feedback on testing updates. All testing updates will be shown in the Bodhi system. First of all, if any test update package works worse for you in any respect than the pre-update version did, this is a problem that should be communicated to the developers. Secondly, when you click on a certain update, you will see a screen with more information on the update. The Details section should give you information on what the update is intended to fix. You should, if possible, test that the update does indeed fix the issues it claims to fix.

To give your feedback on a test update, use Bodhi. There is a Login link in the left-hand sidebar. Log in using your Fedora account. If you don't have a Fedora account, you can create an account here. Once you are logged in, you will be able to leave a comment on the update. Underneath the comment box are three options: Untested, Works for me, and Does not work.

  • Use Untested if you need to comment without yet leaving definite positive or negative feedback on the update.
  • Use Works for me to report that you tested the update, found no problems compared to the previous package, and it addressed the issues it is intended to address (as far as you could test).
  • If you experience any problem with the test update, use the Does not work button, and leave a comment explaining exactly what problem you had.

Each Works for me adds 1 to the test update's karma, while each Does not work subtracts 1 from it. Untested leaves the karma unchanged. Test updates with karma of 3 are automatically sent out as full official updates, while test updates with karma of -3 are automatically withdrawn from the testing repository. As you can see, your testing and feedback is vital to make sure that good updates are released quickly and bad ones don't get out to the general public.