From Fedora Project Wiki

< QA‎ | Meetings
Revision as of 17:45, 19 April 2010 by Jlaska (talk | contribs) (Add IRC transcript)

Attendees

People present (lines said)

Regrets:

Agenda

Previous meeting follow-up

Fedora 13 RC test status

Upcoming test milestones:

  • 2010-04-16 - Final Blocker Meeting (f13blocker) #1 (recap)
  • 2010-04-16 - Pre-RC Branched Acceptance Test Plan
  • 2010-04-23 - Final Blocker Meeting (f13blocker) #2
  • 2010-04-29 - Test 'Final' Test Compose
  • 2010-04-30 - Final Blocker Meeting (f13blocker) #3
  • 2010-05-05 - Final Blocker Meeting (f13blocker) #4
  • 2010-05-06 - Test 'Final' RC

Upcoming test days:

Fedora 13 QA Retrospective
Ideas have already been coming in since F-13-Alpha. It's not too early to note QA issues you felt where handled well, or could have been improved. Your ideas will be used during F-14 QA goal planning. Voice your comments at Fedora_13_QA_Retrospective.

Questions:

  • fenris02 - asked how to update boot.fedoraproject.org configs to use F-13-Beta. Jlaska noted that the configs appeared updated in (infrastructure.git), but promised to follow-up with fenris02' after the meeting

Bodhi QA workflow status check-in

  • adamw asked lmacken and mathieu for a heads up as to when the improved feedback system will be available. Adamw noted that mathieu is working on it in the 'tg2 branch' (turbogears 2). Jlaska asked if there were requirements for bodhi-2 posted, adamw indicated that his earlier email, and dledford's, were being used as the initial requirements.

Proventesters check-in

  • Adam Miller asked whether a vote was needed to move things forward. Adam Williamson offered sending a final draft mail to the list, noting the policy would go into effect if no serious objections surface.
  • After the final draft, jlaska asked what steps should follow. The group came up with:

Package Acceptance Test Plan check-in

  • Kamil Paral discussed the current state of the [[1]]. Kamil noted that we can have the test plan completed before F-13 is released, but work to automate the test plan won't be completed and will be tracked separately as a combination of AutoQA milestones (Package Sanity Test, Resultsdb, depcheck).
  • Kamil plans to send a final draft to the test@l.fp.org list for review. AdamW pointed out he was pretty please with the state of the test plan.

AutoQA check-in

There has been a lot of AutoQA activities in recent weeks, Jlaska asked the group to walk through some highlights.

Josef Skladanka updated the group on several AutoQA activities:

  1. Getting URLs of test results from AutoQA testruns is nearly finished. Patches out for review on autoqa-devel@lists.fedorahosted.org
  2. The beakerlib-based initscript test is now in production (see sample results)
  3. Making progress on the resultsDB - We have finished the db schema (see AutoQA_resultsdb_schema) and accepted a input API (see AutoQA_resultsdb_API)
  4. Next steps ...
    • Prototyping the resultsdb and using an XMLRPC based API to populate with results (jlaska, 16:06:12)
    • Creating a front-end which will be used for review/publish the data

Kamil Páral updated the group on his AutoQA focus areas:

  1. In addition to the notes above from Josef, working with Petr Splichal to automate the QA:Package_Sanity_Test_Plan (track plans using the autoqa PST milestone).
  2. Package Sanity ensures clean install, removal, upgrade, etc of the packages (see sample test output). There is already a 'pst' script in the repository which you can try to perform sanity tests on a downloaded package or package in a repo.
  3. Next steps ...
    • detect that new updates are pushed to bodhi
    • download the package and all relevant packages

Will Woods provide some updates on his AutoQA focus areas:

  1. We have enough info about current bodhi to write a bodhi update watcher, but it may have some shortcomings and will soon be obsoleted
  2. We have a proposed storage encoding for putting test plan metadata in the wiki (see QA:Test_Plan_Metadata_Test_Page), this will be used by the resultsdb

Open discussion - <Your topic here>

Upcoming QA events

Action items

  1. jlaska + fenris02 to review whether F-13-Beta is an option for boot.fedoraproject.org
  2. kparal will bother other QA members if they have some comments to the test plan :)
  3. maxamillion - send Proventester draft to test@l.fp.org for final review
  4. maxamillion - Request new proventester FAS group

IRC Transcript

=========================================
#fedora-meeting: Fedora Quality Assurance
=========================================
Meeting started by jlaska at 15:00:05 UTC. The full logs are available
at
http://meetbot.fedoraproject.org/fedora-meeting/2010-04-19/fedora-qa.2010-04-19-15.00.log.html
.
Meeting summary
---------------
* Waiting for participants ... (jlaska, 15:00:24)
* Previous meeting follow-up (jlaska, 15:05:39)
* Fedora 13 RC test status (jlaska, 15:07:31)
* Blocker review - Last friday we had our first F-13-RC blocker
meeting, and another is scheduled for this week (jlaska, 15:10:12)
* LINK:
http://poelstra.fedorapeople.org/schedules/f-13/f-13-quality-tasks.html
(maxamillion, 15:10:29)
* Acceptance test - This thursday a test run is scheduled for a new
post-beta anaconda build (jlaska, 15:10:46)
* 2010-04-29 - Test 'Final' Test Compose (jlaska, 15:11:19)
* 2010-05-06 - Test 'Final' RC (jlaska, 15:11:26)
* 2010-04-22 -
https://fedoraproject.org/wiki/Test_Day:2010-04-22_StorageFiltering
(jlaska, 15:12:44)
* 2010-04-29 - Preupgrade test day
(https://fedoraproject.org/wiki/Test_Day:2010-04-29_Preupgrade)
(jlaska, 15:13:00)
* F-13 QA retrospective - now accepting ideas for improvement
https://fedoraproject.org/wiki/Fedora_13_QA_Retrospective (jlaska,
15:16:21)
* LINK: https://fedoraproject.org/wiki/XFCE_Test_Day:Tentative
(maxamillion, 15:19:30)
* Bodhi QA workflow status check-in (jlaska, 15:20:09)
* fenris02 asked how to update boot.fedoraproject.org with F-13-Beta
(jlaska, 15:21:34)
* LINK:
http://git.fedorahosted.org/git/?p=fedora-infrastructure.git;a=blob;f=bfo/pxelinux.cfg/fedora_install.conf;h=26acb46afa285f999356c912305395294240b0dd;hb=HEAD
(jlaska, 15:22:54)
* ACTION: jlaska + fenris02 to review whether F-13-Beta is an option
for boot.fedoraproject.org (jlaska, 15:23:45)
* adamw asked lmacken and mathieu for a heads up as to when the
improved feedback system will be available (jlaska, 15:30:18)
* Proventesters check-in (jlaska, 15:31:23)
* As a nice April fools joke, maxamillion sent out the proventesters
draft
(http://lists.fedoraproject.org/pipermail/test/2010-April/089847.html)
(jlaska, 15:32:00)
* Package Acceptance Test Plan check-in (jlaska, 15:36:20)
* LINK:
https://fedoraproject.org/wiki/User:Kparal/Proposal:Package_update_acceptance_test_plan
(kparal, 15:36:56)
* kparal asked for additional input on the package update acceptance
test plan (jlaska, 15:46:14)
* ACTION: kparal will bother other QA members if they have some
comments to the test plan :) (jlaska, 15:46:46)
* Proventesters check-in (jlaska, 15:48:10)
* maxamillion notes, "it looks like we're ready to move forward with
the proposal" (jlaska, 15:48:33)
* ACTION: maxamillion - send Proventester draft to test@l.fp.org for
final review (jlaska, 15:54:52)
* ACTION: maxamillion - Request new proventester FAS group (jlaska,
15:55:25)
* AutoQA check-in (jlaska, 15:56:07)
* Test results sent to autoqa-results will include a link to the
autotest results for additional details (patches under review)
(jlaska, 15:59:31)
* Getting URLs of test results from AutoQA testruns is nearly finished
(jskladan, 15:59:41)
* LINK:
https://fedorahosted.org/pipermail/autoqa-results/2010-April/016011.html
(jlaska, 16:01:18)
* the beakerlib-based initscript test is now in production and sending
results (jlaska, 16:01:46)
* made a progress on the ResultsDB front. We have finished the db
schema <https://fedoraproject.org/wiki/AutoQA_resultsdb_schema> and
accepted a input API
<https://fedoraproject.org/wiki/AutoQA_resultsdb_API> (jlaska,
16:03:26)
* Next steps ... prototyping the resultsdb and using an XMLRPC based
API to populate with results (jlaska, 16:06:12)
* Next steps ... Creating a front-end which will be used for
review/publish the data (jlaska, 16:06:36)
* LINK: https://fedoraproject.org/wiki/Test_Package_Sanity (kparal,
16:08:04)
* LINK:
https://fedorahosted.org/autoqa/milestone/Package%20Sanity%20Tests
(kparal, 16:08:09)
* code for sanity tests is in AutoQA pst branch (kparal, 16:10:15)
* LINK:
http://git.fedorahosted.org/git/?p=autoqa.git;a=shortlog;h=refs/heads/pst
(jlaska, 16:10:25)
* Open discussion - <Your topic here> (jlaska, 16:18:23)
* AutoQA depcheck - we have enough info about current bodhi to write a
update watcher, but it may have some shortcomings and will soon be
obsoleted (jlaska, 16:22:42)
* AutoQA - we have a proposed storage encoding for putting test plan
metadata in the wiki, and some code to pull that data back out as
nice python dicts (jlaska, 16:24:13)
* LINK: https://fedorahosted.org/autoqa/ticket/137 has the link to the
parsing code (wwoods, 16:25:13)
Meeting ended at 16:26:06 UTC.
Action Items
------------
* jlaska + fenris02 to review whether F-13-Beta is an option for
boot.fedoraproject.org
* kparal will bother other QA members if they have some comments to the
test plan :)
* maxamillion - send Proventester draft to test@l.fp.org for final
review
* maxamillion - Request new proventester FAS group
Action Items, by person
-----------------------
* fenris02
* jlaska + fenris02 to review whether F-13-Beta is an option for
boot.fedoraproject.org
* jlaska
* jlaska + fenris02 to review whether F-13-Beta is an option for
boot.fedoraproject.org
* kparal
* kparal will bother other QA members if they have some comments to
the test plan :)
* maxamillion
* maxamillion - send Proventester draft to test@l.fp.org for final
review
* maxamillion - Request new proventester FAS group
* **UNASSIGNED**
* (none)
People Present (lines said)
---------------------------
* jlaska (174)
* kparal (39)
* maxamillion (28)
* adamw (23)
* jskladan (19)
* wwoods (16)
* fenris02 (8)
* zodbot (4)
* Oxf13 (3)
* _lmr_ (2)
Generated by MeetBot_ 0.1.4
.. _MeetBot: http://wiki.debian.org/MeetBot

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!