In this section, we cover the activities of the QA team.
Contributing Writer: Adam Williamson
This week's regular test day was on iSCSI. Martin Sivak and Hans de Goede represented the developers, and testing was lead by User:mganisin with assistance from Chris Williams, Mike Anderson, Michael Christie and James Laska. Test cases worked on during the test day can be seen on the page. Please record any additional test ideas or considerations at Exploratory Testing iSCSI. Consult the quick start guide for creating a software-based iscsi target for use with testing.
Next week's test day will be on the 20 Second Startup feature planned for Fedora 11. It will be held on Thursday (2009-02-19) in the #fedora-qa channel on Freenode IRC. Please drop by if you would like to help test and improve boot speed for Fedora 11.
The QA group weekly meeting was held on 2009-02-11. The full log is available. Will Woods gave a status report on the progress of the autoqa project, which is working on creating automated test scripts to run whenever certain events happen. He also reported on progress with the Nitrate project, which is for collecting test cases and test plans and compiling results from running them. Jóhann Guðmundsson asked if it will be possible to pull existing test cases from the current Wiki-based system into Nitrate when it is released, and Will Woods said this is likely to be possible.
The Bugzappers group weekly meeting was held on 2009-02-10. The group agreed that the current list of most-important components should be updated, and Edward Kirk will do this. Edward Kirk, Brennan Ashton and Adam Williamson (links) agreed that simple goals should be set for the group, but did not reach final agreement on what these should be. Adam Williamson suggested that Bug Days be revived and made weekly, and this idea was supported by Edward Kirk and Brennan Ashton.
The next QA weekly meeting will be held on 2009-02-18 at 1600 UTC in #fedora-qa, and the next Bugzappers weekly meeting on 2009-02-17 at 1700 UTC in #fedora-bugzappers.
Work continued on the ongoing project to rewrite and re-organize the main pages in the QA team's Wiki space. Adam Williamson, Jóhann Guðmundsson, Christopher Beland and Leam Hall all contributed ideas, suggestions and drafts.
Release-critical bug process
Adam Williamson initiated a discussion regarding the process for handling release-critical bugs. Matej Cepl, James Laska, Jesse Keating, and John Poelstra contributed opinions. In the end it was agreed that the basic shape of the current process is a good one but the groups involved - BugZappers, release engineering, and developers - should communicate and collaborate more in deciding on release-critical bugs.
François Cami, together with others, proposed a project to conduct organized testing of
DRI functionality with a range of common hardware for
Fedora 11. He highlighted four important areas he felt were needed for this: an opt-in system to record what hardware is owned by what testers (possibly utilizing Smolt), a system for producing test plans, a system for recording the results of tests, and regularly scheduled test sessions. Jóhann Guðmundsson supported the idea and suggested that, while some of the features would require help from the infrastructure group, the QA group could at least immediately start writing test cases. James Laska pointed out that extensive information is needed to diagnose and fix
X issues remotely. François will work with the X maintainers to define exactly what information needs to be provided.