From Fedora Project Wiki

< FWN‎ | Beats

(create draft for fwn 174)
(submit 175 draft)
Line 10: Line 10:
=== Test Days ===
=== Test Days ===


This week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2009-04-30</ref> was on SSSD<ref>http://fedoraproject.org/wiki/Features/SSSD</ref>, which provide a set of daemons to manage access to remote directories and authentication mechanisms. A good group of interested people turned out to help test the system, and several bug reports were filed.
This week's Test Day<ref>https://fedoraproject.org/wiki/Test_Day:2009-05-07_Virtualization</ref> was on virtualization<ref>https://fedoraproject.org/wiki/Virtualization</ref>, particularly the virtualization technologies most associated with Fedora - KVM, qemu, libvirt and virt-manager. We had a great turnout of developers and testers and managed to cover a lot of ground, and over 25 new bugs were discovered and reported.


Next week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2009-05-07_Virtualization</ref> will be on virtualization<ref>http://fedoraproject.org/wiki/Virtualization</ref>, with a particular emphasis on some of the new features in Fedora 11, mainly to do with KVM. The Test Day page already includes a list of test areas, with estimated test times and the number of testers needed for each area, so you can sign yourself up in the list in preparation for the test day. You will need an installed system fully updated to latest Rawhide (you can start by installing the Fedora 11 Preview release). If you're a virtualization enthusiast, please come along and help test! The Test Day will be held on 2009-05-07 (Thursday) in IRC #fedora-qa.
Next week's Test Day<ref>https://fedoraproject.org/wiki/Test_Day:2009-05-14_iBus</ref> will be on iBus<ref>https://fedoraproject.org/wiki/Features/IBus</ref>, the new default input framework for Asian languages for Fedora 11. If you use Fedora in one of these languages - for instance, Chinese, Japanese or Korean - you'll want to come out to this test day, as this is a significant change and we need to make sure it's working in all situations, and fix any bugs if it's not. The Test Day will be held on 2009-05-14 (Thursday) in IRC #fedora-qa.


<references/>
<references/>
Line 18: Line 18:
=== Weekly meetings ===
=== Weekly meetings ===


The QA group weekly meeting<ref>http://fedoraproject.org/wiki/QA/Meetings</ref> was held on 2009-04-29. The full log is available<ref>http://www.happyassassin.net/extras/fedora-qa-20090429.log</ref>. [[User:Adamwill|Adam Williamson]] reported on his request for feedback on PulseAudio in Fedora 11 from the forum community. He said the response had been quite small and had not reported any major problems, a good indication that things are quite solid. [[User:Wwoods|Will Woods]] mentioned that the known problems with some Intel chipsets and PA's glitch-free audio feature had now been mostly resolved.
The QA group weekly meeting<ref>http://fedoraproject.org/wiki/QA/Meetings</ref> was held on 2009-05-06. The full log is available<ref>http://www.happyassassin.net/extras/fedora-qa-20090506.log</ref>. [[User:Jlaska|James Laska]] reported solid progress in transferring future tasks for the autoqa project into trac.


[[User:Jlaska|James Laska]] noted that there were several reports indicating the new hard disk failure detection system may be reporting false positives. The group agreed it should keep an eye on this situation and try to determine for certain whether there were bugs in the detection.
[[User:Wwoods|Will Woods]] reported on several Fedora 10 to Fedora 11 upgrade bugs he has been tracking, and noted that he needs to write some more upgrade test cases to cover areas where bugs are consistently being found.


[[User:Wwoods|Will Woods]] reported on autoqa progress. A trac installation for autoqa is now available<ref>http://fedorahosted.org/autoqa/</ref>, but there has been no progress in the code since next week. [[User:Jlaska|James Laska]] suggested setting a goal of finishing the previously agreed-upon to-do list by the time of Fedora 11's release, and Will agreed that this was a sensible target.
[[User:Jlaska|James Laska]] reported that he had not had time to work with David Zeuthen and Lennart Poettering on false positives in the hard disk failure detection system, but [[User:Wwoods|Will Woods]] noted that relevant bugs had been filed by others<ref>http://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=495956</ref> and the issue is definitely on the active radar for the developers.


Will also reported on a planned new version of preupgrade, the tool for helping do smooth in-place upgrades of Fedora systems. It now attempts to find updated versions of all repositories, including third-party ones, and rejects /boot on mdraid.
[[User:Wwoods|Will Woods]], [[User:Jlaska|James Laska]] and [[User:Adamwill|Adam Williamson]] reported steady progress on reviewing blocker bugs for SELinux, anaconda and X.org for Fedora 11 respectively, and the discussion then turned into a debate about the process for resolving Rawhide bugs in Bugzilla. The group agreed that the maintainer should be allowed to choose whether to close a bug immediately after checking in a fix for the reported issue, or whether to set the status to MODIFIED and wait for confirmation from the reporter that the bug is truly fixed before closing.


The group then discussed the state of the Fedora 11 blocker bug list, with reference to the impending Fedora 11 RC cycle. They agreed that 2009-05-11 and 2009-05-12 would be set aside for review of the list, divided by component, with each team member working on components with which they are familiar.
[[User:jkeating|Jesse Keating]] reported on progress in the autoqa project. He has been working on a conflict finder test, and the autoqa team has been discussing directions for future development.


The group then discussed upgrade methods, with regard to a bug<ref>https://bugzilla.redhat.com/show_bug.cgi?id=494046</ref> noted by Seth Vidal which would essentially prevent an in-place upgrade using yum from working correctly. [[User:Wwoods|Will Woods]] reiterated that yum-based upgrading is intentionally undocumented and unsupported (i.e. yum's developer does not consider that it should be expected to work, FESco does not expect package maintainers to build their packages such that it works, and QA does not accept responsibility for ensuring it works). The intended method for doing such upgrades is to use the preupgrade tool.
[[User:Adamwill|Adam Williamson]] reported on the volume control application debate. His package of the old gnome-volume-control under the name gst-mixer has been accepted into the Fedora 11 repositories and added to the default package groups so that it will be installed by default in the DVD package selection and on the desktop spin for Fedora 11 release. The 'pavucontrol' mixer for PulseAudio has been removed, so Fedora 11's desktop spin and default DVD installation package set will include two graphical mixers, the new gnome-volume-control and gst-mixer. These between them cover all major use cases.


[[User:Jlaska|James Laska]] mentioned that he was looking for volunteers to help organize test cases for the upcoming virtualization Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2009-05-07_Virtualization</ref>. Please contact James if you're interested in helping out with this.
[[User:Johannbg|Jóhann Guðmundsson]] raised the issue of [[User:jkeating|Jesse Keating's]] proposal to drop the Alpha release for the Fedora 12 cycle. [[User:Jlaska|James Laska]] worried that it might cause trouble for Fedora 12 Test Days. Jóhann pointed out that live CDs are now habitually generated for each Test Day, but James worried about what would happen if it proved impossible to generate a live CD for a week. Jesse explained that as far as he saw it, the main value of Alpha was to be a known-good point to bootstrap a Rawhide installation, and it often fails at that. He suggested that for Fedora 12, Fedora 11 release could serve as the known-good point to bootstrap a Rawhide installation.


The Bugzappers group weekly meeting<ref>http://fedoraproject.org/wiki/BugZappers/Meetings</ref> was held on 2009-04-28. The full log is available<ref>http://fedoraproject.org/wiki/BugZappers/Meetings/Minutes-2009-Apr-28</ref>. [[User:poelstra|John Poelstra]] noted that, as the Fedora 11 release nears, it is time for the group to request the regularly scheduled Bugzilla changes that accompany a new release. John then selflessly volunteered to take care of this, with the help of [[User:Arxs|Niels Haase]].
The Bugzappers group weekly meeting<ref>http://fedoraproject.org/wiki/BugZappers/Meetings</ref> was held on 2009-05-05. The full log is available<ref>http://fedoraproject.org/wiki/BugZappers/Meetings/Minutes-2009-May-05</ref>. [[User:Adamwill|Adam Williamson]] reported on progress with the triage metrics project: members of the Fedora Python development group had volunteered and helped port the code to Python 2.4 (as is required before it can run on Infrastructure's servers), but wanted some test data to confirm that their fixes are valid. Adam will try to ensure Brennan provides the necessary test data, and then the application can likely go live.


In the absence of Brennan Ashton, [[User:Adamwill|Adam Williamson]] reported on the progress of the triage metrics project, having met with Brennan the previous weekend. He reported that the code for the project was essentially complete and hosting via the Infrastructure group had already been provisioned, but the code relied on Python 2.5-specific features, while Infrastructure's servers all run Python 2.4. Thus the project was waiting on Brennan, or someone else, to port the Python 2.5-specific code to Python 2.4 before it could be operational.
Adam also reported on the status of the Bugzilla priority/severity proposal. The group agreed that his final draft of the proposed email to the development group was good. Adam suggested that it would be a good idea for another group member to actually send the proposal, and Matej Cepl volunteered to do it.


Adam also reported on the status of the Bugzilla priority/severity proposal, and noted he was nearly ready to send the proposal to the development group.
[[User:Tk009|Edward Kirk]] reported on the progress of the SOP to cover accepting new members into the Bugzappers group. The group decided to put the SOP into place on the Wiki and work on any further changes 'live'. Edward agreed to take care of publishing the SOP with appropriate links.


[[User:poelstra|John Poelstra]] reported that the maintainers of the Red Hat Bugzilla installation were interested in feedback from the Bugzappers group on what proposed new features and fixes for Bugzilla would be of most interest to them. He promised to send relevant URLs to the mailing list.
The group then voted unanimously to adjourn the meeting and go eat cookies.


The next QA weekly meeting will be held on 2009-05-06 at 1600 UTC in #fedora-meeting, and the next Bugzappers weekly meeting on 2009-05-05 at 1500 UTC in #fedora-meeting.
The next QA weekly meeting will be held on 2009-05-13 at 1600 UTC in #fedora-meeting, and the next Bugzappers weekly meeting on 2009-05-12 at 1500 UTC in #fedora-meeting.


<references/>
<references/>


=== Special triage procedure requests from developers ===
=== Fedora bug workflow ===


The Bugzappers group continued its discussion of how to handle special triage procedure requests from maintainers (which was started<ref>http://www.redhat.com/archives/fedora-test-list/2009-April/msg01418.html</ref> the previous week by [[User:Adamwill|Adam Williamson]]). Adam continued to maintain that all special requests from maintainers should be respected if at all possible, as the triage process exists almost entirely to aid maintainers in their work. [[User:poelstra|John Poelstra]] worried<ref>http://www.redhat.com/archives/fedora-test-list/2009-April/msg01605.html</ref> that it may be impossible to accurately track all the different special requests that maintainers might make, a position backed up<ref>http://www.redhat.com/archives/fedora-test-list/2009-April/msg01623.html</ref> by John Summerfield. [[User:Beland|Christopher Beland]] felt<ref>http://www.redhat.com/archives/fedora-test-list/2009-April/msg01607.html</ref> that special requests have a cost in terms of recruiting triagers and performing system-wide tasks. [[User:kkofler|Kevin Kofler]] suggested<ref>http://www.redhat.com/archives/fedora-test-list/2009-April/msg01671.html</ref> an alternative system that might work without varying the standard triage process for the particular special request that had started the discussion, and pointed out that in the current process, the NEW, ASSIGNED and ON_DEV statuses are essentially being abused. No final agreement was reached on the various topics brooched as of yet, and it seems the issue might feed back into the problem of shared bug workflow between Fedora and RHEL.
[[User:Adamwill|Adam Williamson]] announced<ref>http://www.redhat.com/archives/fedora-test-list/2009-May/msg00304.html</ref> that he had extensively revised the Fedora bug workflow page<ref>http://fedoraproject.org/wiki/BugZappers/BugStatusWorkFlow</ref> to more extensively cover all the available statuses and resolutions, and all the common processes through which most bug reports go. [[User:arxs | Niels Haase]] pointed out<ref>http://www.redhat.com/archives/fedora-test-list/2009-May/msg00317.html</ref> that the NEXTRELEASE resolution, which Adam had described in the page as not used for Fedora, is actually used by the automated Bodhi scripts when resolving a bug for which an official update has been issued. Adam followed up this issue, and reported<ref>http://www.redhat.com/archives/fedora-test-list/2009-May/msg00374.html</ref> that his discussions indicated his interpretation - that bugs fixed in stable releases should be closed as ERRATA - is likely correct, and the Bodhi scripts should be adjusted.


<references/>
<references/>


=== Priority / severity proposal draft ===
=== Bugzappers new member SOP ===


[[User:Adamwill|Adam Williamson]] submitted<ref>http://www.redhat.com/archives/fedora-test-list/2009-May/msg00021.html</ref> a revised proposed draft of the email to the development list on the use of the priority and severity fields in Bugzilla, addressing the concerns raised since the previous draft, and including Matej Cepl's alternative proposal.
[[User:Tk009|Edward Kirk]] reported<ref>http://www.redhat.com/archives/fedora-test-list/2009-May/msg00333.html</ref> that he had put the new member SOP for the Bugzappers group live on the Wiki, as agreed at the weekly meeting. [[User:Beland|Christopher Beland]] suggested<ref>http://www.redhat.com/archives/fedora-test-list/2009-May/msg00349.html</ref> that the language used was very formal, and some areas might be a little vague. [[User:Adamwill|Adam Williamson]] promised<ref>http://www.redhat.com/archives/fedora-test-list/2009-May/msg00355.html</ref> to try and find time to revise the page a little.


<references/>
<references/>

Revision as of 01:58, 9 May 2009

QualityAssurance

In this section, we cover the activities of the QA team[1].

Contributing Writer: Adam Williamson

Test Days

This week's Test Day[1] was on virtualization[2], particularly the virtualization technologies most associated with Fedora - KVM, qemu, libvirt and virt-manager. We had a great turnout of developers and testers and managed to cover a lot of ground, and over 25 new bugs were discovered and reported.

Next week's Test Day[3] will be on iBus[4], the new default input framework for Asian languages for Fedora 11. If you use Fedora in one of these languages - for instance, Chinese, Japanese or Korean - you'll want to come out to this test day, as this is a significant change and we need to make sure it's working in all situations, and fix any bugs if it's not. The Test Day will be held on 2009-05-14 (Thursday) in IRC #fedora-qa.

Weekly meetings

The QA group weekly meeting[1] was held on 2009-05-06. The full log is available[2]. James Laska reported solid progress in transferring future tasks for the autoqa project into trac.

Will Woods reported on several Fedora 10 to Fedora 11 upgrade bugs he has been tracking, and noted that he needs to write some more upgrade test cases to cover areas where bugs are consistently being found.

James Laska reported that he had not had time to work with David Zeuthen and Lennart Poettering on false positives in the hard disk failure detection system, but Will Woods noted that relevant bugs had been filed by others[3] and the issue is definitely on the active radar for the developers.

Will Woods, James Laska and Adam Williamson reported steady progress on reviewing blocker bugs for SELinux, anaconda and X.org for Fedora 11 respectively, and the discussion then turned into a debate about the process for resolving Rawhide bugs in Bugzilla. The group agreed that the maintainer should be allowed to choose whether to close a bug immediately after checking in a fix for the reported issue, or whether to set the status to MODIFIED and wait for confirmation from the reporter that the bug is truly fixed before closing.

Jesse Keating reported on progress in the autoqa project. He has been working on a conflict finder test, and the autoqa team has been discussing directions for future development.

Adam Williamson reported on the volume control application debate. His package of the old gnome-volume-control under the name gst-mixer has been accepted into the Fedora 11 repositories and added to the default package groups so that it will be installed by default in the DVD package selection and on the desktop spin for Fedora 11 release. The 'pavucontrol' mixer for PulseAudio has been removed, so Fedora 11's desktop spin and default DVD installation package set will include two graphical mixers, the new gnome-volume-control and gst-mixer. These between them cover all major use cases.

Jóhann Guðmundsson raised the issue of Jesse Keating's proposal to drop the Alpha release for the Fedora 12 cycle. James Laska worried that it might cause trouble for Fedora 12 Test Days. Jóhann pointed out that live CDs are now habitually generated for each Test Day, but James worried about what would happen if it proved impossible to generate a live CD for a week. Jesse explained that as far as he saw it, the main value of Alpha was to be a known-good point to bootstrap a Rawhide installation, and it often fails at that. He suggested that for Fedora 12, Fedora 11 release could serve as the known-good point to bootstrap a Rawhide installation.

The Bugzappers group weekly meeting[4] was held on 2009-05-05. The full log is available[5]. Adam Williamson reported on progress with the triage metrics project: members of the Fedora Python development group had volunteered and helped port the code to Python 2.4 (as is required before it can run on Infrastructure's servers), but wanted some test data to confirm that their fixes are valid. Adam will try to ensure Brennan provides the necessary test data, and then the application can likely go live.

Adam also reported on the status of the Bugzilla priority/severity proposal. The group agreed that his final draft of the proposed email to the development group was good. Adam suggested that it would be a good idea for another group member to actually send the proposal, and Matej Cepl volunteered to do it.

Edward Kirk reported on the progress of the SOP to cover accepting new members into the Bugzappers group. The group decided to put the SOP into place on the Wiki and work on any further changes 'live'. Edward agreed to take care of publishing the SOP with appropriate links.

The group then voted unanimously to adjourn the meeting and go eat cookies.

The next QA weekly meeting will be held on 2009-05-13 at 1600 UTC in #fedora-meeting, and the next Bugzappers weekly meeting on 2009-05-12 at 1500 UTC in #fedora-meeting.

Fedora bug workflow

Adam Williamson announced[1] that he had extensively revised the Fedora bug workflow page[2] to more extensively cover all the available statuses and resolutions, and all the common processes through which most bug reports go. Niels Haase pointed out[3] that the NEXTRELEASE resolution, which Adam had described in the page as not used for Fedora, is actually used by the automated Bodhi scripts when resolving a bug for which an official update has been issued. Adam followed up this issue, and reported[4] that his discussions indicated his interpretation - that bugs fixed in stable releases should be closed as ERRATA - is likely correct, and the Bodhi scripts should be adjusted.

Bugzappers new member SOP

Edward Kirk reported[1] that he had put the new member SOP for the Bugzappers group live on the Wiki, as agreed at the weekly meeting. Christopher Beland suggested[2] that the language used was very formal, and some areas might be a little vague. Adam Williamson promised[3] to try and find time to revise the page a little.