From Fedora Project Wiki

< QA‎ | Meetings

(add note on mejla's proposed ftbfs bug filing day)
m (internal link cleaning)
 
(7 intermediate revisions by one other user not shown)
Line 1: Line 1:
= Proposed topics =
= Attendees =


* Viking-Ice suggested adding a locale test - see link https://www.redhat.com/archives/fedora-test-list/2009-October/msg00503.html
People present (lines said)
* Milos Jakubicek suggested a day/project to work on filing FTBFS bugs for all remaining packages that failed to build in F12 mass rebuild (see fedora-qa logs, 2009-10-26 00:07 UTC)
 
* jlaska (160)
* wwoods (58)
* adamw (46)
* Oxf13 (35)
* Viking-Ice (24)
* kparal (17)
* jwb (7)
* jeff_hann (4)
* mether (3)
* zodbot (3)
* buggbot (2)
* Jeff_S (2)
* skvidal (1)
 
 
Regrets:
* [[User:Liam]]
* [[User:rhe]]
 
= Agenda =
 
* [https://www.redhat.com/archives/fedora-test-list/2009-October/msg00600.html Proposed meeting agenda]
* [http://meetbot.fedoraproject.org/fedora-meeting/2009-10-26/fedora-meeting.2009-10-26-16.08.html meetbot summary]
 
 
== Previous meeting follow-up ==
See [[QA/Meetings/20091019#Action_items]]
 
* jlaska to rename other debug pages (see [[Category:Debugging)]] to be consistent with "How to debug <component> problems". Update back-links also
 
I believe this task is complete.  See [[:Category:Debugging]] for feedback.  I've also organized the pages by the component name. 
 
'''Remaining Question''' - What do folks want to do with ... [[KernelBugTriage]]?  Should this change to [[How to debug kernel problems]]
 
== Viking_Ice locale test suggestion ==
Background - https://www.redhat.com/archives/fedora-test-list/2009-October/msg00503.html
 
Viking-Ice posted a sample script to demonstrate what an automated test should do (see http://pastie.org/671497).  Some discussion followed on where best to implement this additional automated test in [[AutoQA]].  The group felt that adding the test to [[Israwhidebroken.com_Proposal]] was not appropriate.  Jlaska felt that this test would be best suited for the [[QA:Fedora_12_Install_Test_Plan]], is it currently is light on i18n verification.  Viking-Ice took an action item to create a [[Template:QA/Test_Case|test case]] and propose adding it to the test plan.  Once added, that test can be included in upcoming automation efforts [[User:Liam]] and [[User:Rhe]] are investigating.
 
== Milos Jakubicek suggestion on FTBFS bugs ==
Background - Milos Jakubicek suggested a day/project to work on filing FTBFS(''fails-to-build-from-scratch'') bugs for all remaining packages that failed to build in F12 mass rebuild (see http://mjakubicek.fedorapeople.org/need-rebuild.html).  Some discussion followed on what a QA effort around this might look like.  F13 indicated he would have no problems tagging FTBFS rebuilds for F12.  Mether provided a link to an existing effort (see [[FTBFS]]). 
 
Unfortunately, Milos was not available during the meeting.  Adamw took an action item to follow-up with Milos for next weeks meeting (or on fedora-test-list).
 
== Marcela Maslanova test day proposal ==
Marcela Maslanova sent a test day proposal for including all tests in a package (see http://jvcelak.fedorapeople.org/testday-091022/testday-pm-0.6-1.fc12.src.rpm).  Marcela was not present for the meeting, and Jlaska indicated further power management test day feedback was expected from Phil Knirsch soon.  Jlaska wanted to highlight that this was the first test day that included a test day rpm which provided scripts to automate test cases and test results collection.
 
Some outstanding questions for the group:
# Is there anything we need to be thinking or doing to support this type of work in the future?
# Where should the test scripts used to in test day packages live?
 
== AutoQA Updates from wwoods and kparal ==
 
'''autoqa-devel list now active'''
Wwoods reminded the group that the autoqa development mailing list for patch review, autoqa progress and test development.  Join the [https://fedorahosted.org/mailman/listinfo/autoqa-devel autoqa-devel] list and contribute today!.
 
'''RpmGuard update'''
Kparal directed the group to a [http://kparal.wordpress.com/2009/10/21/rpmguard-print-important-differences-between-rpms blog post] detailing his current status on the rpmguard effort.  Kparal received some feedback from the post, including:
* skvidal directed kparal towards a potentially useful script -- http://skvidal.fedorapeople.org/misc/mungingdiff.py
* alexey torkhov suggested leveraging {{command|rpmsodiff}} (see https://fedorahosted.org/autoqa/ticket/75 for tracking)
 
The next task for Kparal is to investigate the koji-build watcher wwoods is working on and integrate rpmguard into autoqa to have it up and running.
 
'''Post-koji-build watcher'''
Wwoods provided a brief update on the ''post-koji-build'' which picks up every new build in a set of koji tags specified by autoqa.  Some discussion followed on between kparal and wwoods on how to pass data between the tests and the watcher script.  Wwoods indicated his current post-koji-build watcher would be landing in [http://git.fedorahosted.org/git/?p=autoqa.git;a=summary autoqa.git] soon.
 
'''AutoQA library'''
Wwoods indicated a library would also be landing in git soon that takes a package NVR and a koji tag, and returns the previous released versions of that package.  Wwoods also noted a plan to create a general purpose autoqa library for use by all tests with helpers for koji interaction and virt guest creation.
 
'''Critical Path Package List'''
Due to recent questions around the current critical path package list, wwoods reminded the group about the script http://wwoods.fedorapeople.org/files/critical-path/critpath.py.  This script will solve the critical path package set and write output to {{filename|critpath.txt}}.  Jwb notified the group that he would be incorporating this script into the rawhide compose process.  Future rawhide composes will include a critpath.txt file (e.g. http://kojipkgs.fedoraproject.org/mash/rawhide-20091027/logs/critpath.txt).
 
== Open discussion - <Your topic here> ==
 
=== FUDCon Attendees ===
 
F13 asked who was planning to attend FUDCon.  Since wwoods was planning for an AutoQA talk on how maintainers could add tests into PkgCVS, F13 would focus on the messagebus talk.
 
= Upcoming QA events =
 
* 2009-10-29 - i18n Test Day - [[Test_Day:2009-10-29]]
 
{{admon/hint|Testers needed|Interested in helping test i18n?  Please plan to join the event on Thursday, or add your name to the [https://fedorahosted.org/fedora-qa/ticket/25 fedora-qa trac ticket] to help planning efforts.}}
 
* 2009-10-30 - Blocker Bug Day (F12Blocker) #2
 
= Action items =
 
* adamw will ask Milos to follow-up at next week's meeting or on the list on the FTBFS topic
* Viking-Ice investigating creating a test case for bug#530452 ... and adding to F12 install matrix
* wwoods to add roadmap/tickets for reworking shared autoqa code (watchers, test helper methods, etc) into a proper library
 
= IRC Transcript =
 
{|
|- id="t16:08:23"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #startmeeting Fedora QA Meeting - [[QA/Meetings/20091026]]
|| [[#t16:08:23|16:08]]
|- id="t16:08:23"
! style="background-color: #42427e" | zodbot
| style="color: #42427e" | Meeting started Mon Oct 26 16:08:23 2009 UTC.  The chair is jlaska. Information about MeetBot at http://wiki.debian.org/MeetBot.
|| [[#t16:08:23|16:08]]
|- id="t16:08:23"
! style="background-color: #42427e" | zodbot
| style="color: #42427e" | Useful Commands: #action #agreed #halp #info #idea #link #topic.
|| [[#t16:08:23|16:08]]
|- id="t16:08:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #chair adamw
|| [[#t16:08:31|16:08]]
|- id="t16:08:31"
! style="background-color: #42427e" | zodbot
| style="color: #42427e" | Current chairs: adamw jlaska
|| [[#t16:08:31|16:08]]
|- id="t16:08:45"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Gathering
|| [[#t16:08:45|16:08]]
|- id="t16:09:14"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | hey gang, show of $limb ... who do we have joining today?
|| [[#t16:09:14|16:09]]
|- id="t16:09:57"
| colspan="2" | * jlaska notes ... Oxf13 indicated he would arrive late
|| [[#t16:09:57|16:09]]
|- id="t16:10:01"
| colspan="2" | * skvidal worries about this $limb thing
|| [[#t16:10:01|16:10]]
|- id="t16:10:02"
| colspan="2" | * kparal here
|| [[#t16:10:02|16:10]]
|- id="t16:10:32"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | kparal: howdy
|| [[#t16:10:32|16:10]]
|- id="t16:11:04"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: adamw: wwoods: and anyone else I'm forgetting
|| [[#t16:11:04|16:11]]
|- id="t16:11:11"
| colspan="2" | * Viking-Ice here..
|| [[#t16:11:11|16:11]]
|- id="t16:11:17"
| colspan="2" | * wwoods is here
|| [[#t16:11:17|16:11]]
|- id="t16:11:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | greetings gents
|| [[#t16:11:25|16:11]]
|- id="t16:12:16"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw might be running late, so just going to kick things off and he run things when he returns
|| [[#t16:12:16|16:12]]
|- id="t16:12:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | skvidal: don't be afraid :)
|| [[#t16:12:25|16:12]]
|- id="t16:12:44"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I put adamw's proposed agenda on the wiki, and plan to just walk the list (see [[QA/Meetings/20091026)]]
|| [[#t16:12:44|16:12]]
|- id="t16:12:48"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | starting with ...
|| [[#t16:12:48|16:12]]
|- id="t16:12:52"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Previous meeting follow-up
|| [[#t16:12:52|16:12]]
|- id="t16:13:32"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I took an action item to rename the existing debug pages to the new format "How to debug &lt;component&gt; problems"
|| [[#t16:13:32|16:13]]
|- id="t16:13:41"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so I think we're good there
|| [[#t16:13:41|16:13]]
|- id="t16:13:42"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | [[Category:Debugging]]
|| [[#t16:13:42|16:13]]
|- id="t16:13:52"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | there was 1 page left that I was unclear how folks wanted that
|| [[#t16:13:52|16:13]]
|- id="t16:14:27"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info So the only open item on my list is ... should [[KernelBugTriage]] be renamed to [[How to debug kernel problems]]?
|| [[#t16:14:27|16:14]]
|- id="t16:14:59"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I'll follow up with cebbert before renaming that page
|| [[#t16:14:59|16:14]]
|- id="t16:15:23"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | besides, I think that page is more about traiging and not so much debugging, but could be wrong
|| [[#t16:15:23|16:15]]
|- id="t16:15:41"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | that's all I had recorded for last week, any other items before we dive into the agenda?
|| [[#t16:15:41|16:15]]
|- id="t16:16:33"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Okay ... then first topic up ...
|| [[#t16:16:33|16:16]]
|- id="t16:16:39"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Viking_Ice locale test suggestion
|| [[#t16:16:39|16:16]]
|- id="t16:16:48"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://www.redhat.com/archives/fedora-test-list/2009-October/msg00503.html
|| [[#t16:16:48|16:16]]
|- id="t16:17:22"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: you raised this on f-t-list this past week, sounds like you felt this is something that could be automated?
|| [[#t16:17:22|16:17]]
|- id="t16:17:40"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | yup give me sec..
|| [[#t16:17:40|16:17]]
|- id="t16:17:43"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | sure
|| [[#t16:17:43|16:17]]
|- id="t16:20:01"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: want us to come back to this topic?
|| [[#t16:20:01|16:20]]
|- id="t16:20:13"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | yup
|| [[#t16:20:13|16:20]]
|- id="t16:21:05"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | alright ... I'll move that to the end
|| [[#t16:21:05|16:21]]
|- id="t16:21:39"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | the next topic is around a discussion that milos Jakubicek and adamw had ... I'll save that for when Adamw returns
|| [[#t16:21:39|16:21]]
|- id="t16:22:01"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Marcela Maslanova test day proposal
|| [[#t16:22:01|16:22]]
|- id="t16:22:09"
! style="background-color: #854685" | adamw
| style="color: #854685" | morning - sorry, I overslept
|| [[#t16:22:09|16:22]]
|- id="t16:22:37"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: welcome morning ...
|| [[#t16:22:37|16:22]]
|- id="t16:22:50"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | you need a few minutes?  Or should we jump back to the FTBFS topic?
|| [[#t16:22:50|16:22]]
|- id="t16:23:07"
! style="background-color: #854685" | adamw
| style="color: #854685" | go for it
|| [[#t16:23:07|16:23]]
|- id="t16:23:29"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay ... just a quick update on the current topic
|| [[#t16:23:29|16:23]]
|- id="t16:23:49"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | pknirsch is will be providing a formal summary of last weeks power management test day
|| [[#t16:23:49|16:23]]
|- id="t16:24:21"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | but I also received some updates from Marcela Maslanova around his experiences creating a test day rpm with automated scripts
|| [[#t16:24:21|16:24]]
|- id="t16:24:37"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | not sure if everyone had a chance to participate in this last event ... there's always time to jump in
|| [[#t16:24:37|16:24]]
|- id="t16:24:49"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link [[Test_Day:2009-10-22]]
|| [[#t16:24:49|16:24]]
|- id="t16:25:04"
! style="background-color: #488888" | kparal
| style="color: #488888" | *her* experience :)
|| [[#t16:25:04|16:25]]
|- id="t16:25:23"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | kparal: doh, thank you :)
|| [[#t16:25:23|16:25]]
|- id="t16:26:02"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Just a summary for me ... the test day was awesome from a preparation stand-point
|| [[#t16:26:02|16:26]]
|- id="t16:26:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | you download a test day rpm ... and each of the tests was a script provided by the package
|| [[#t16:26:20|16:26]]
|- id="t16:26:42"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so, the only thing I wanted to raise here was just around building on this process
|| [[#t16:26:42|16:26]]
|- id="t16:26:57"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I know that not all test day topics are as easily automated
|| [[#t16:26:57|16:26]]
|- id="t16:27:34"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | but certainly need help from folks in identifying ways to automate future test days in much the same format that Marcela and team have
|| [[#t16:27:34|16:27]]
|- id="t16:27:48"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | installer might be one of those easy topics (w/ virt)
|| [[#t16:27:48|16:27]]
|- id="t16:28:07"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I suspect X might not be very easy
|| [[#t16:28:07|16:28]]
|- id="t16:28:30"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | anyhow ... unless any other thoughts there ... let's jump back to FTBFS
|| [[#t16:28:30|16:28]]
|- id="t16:28:37"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Milos Jakubicek suggestion on FTBFS bugs
|| [[#t16:28:37|16:28]]
|- id="t16:28:41"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: you want to take it away?
|| [[#t16:28:41|16:28]]
|- id="t16:29:02"
! style="background-color: #854685" | adamw
| style="color: #854685" | well it's milos' idea, but I can explain what he told me
|| [[#t16:29:02|16:29]]
|- id="t16:29:09"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | go for it
|| [[#t16:29:09|16:29]]
|- id="t16:29:16"
! style="background-color: #854685" | adamw
| style="color: #854685" | #link http://mjakubicek.fedorapeople.org/need-rebuild.html
|| [[#t16:29:16|16:29]]
|- id="t16:29:36"
! style="background-color: #854685" | adamw
| style="color: #854685" | that's a list of remaining packages that did not rebuild in the f12 mass rebuild, with most false positives taken out (there's still a couple in there)
|| [[#t16:29:36|16:29]]
|- id="t16:30:07"
! style="background-color: #854685" | adamw
| style="color: #854685" | milos' suggestion is that we make sure FTBFS (fails-to-build-from-scratch, it's a debian term) bugs are filed for each one
|| [[#t16:30:07|16:30]]
|- id="t16:30:36"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | aha ... was trying to parse that acronym ... thx
|| [[#t16:30:36|16:30]]
|- id="t16:30:54"
! style="background-color: #854685" | adamw
| style="color: #854685" | we didn't get into any details of how exactly to arrange it, but it seemed like a decent idea to me
|| [[#t16:30:54|16:30]]
|- id="t16:31:04"
! style="background-color: #854685" | adamw
| style="color: #854685" | i suggested he come to the meeting to discuss it but obviously couldn't make it
|| [[#t16:31:04|16:31]]
|- id="t16:31:30"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I saw him earlier in #fedora-qa ... but he dropped off
|| [[#t16:31:30|16:31]]
|- id="t16:32:10"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | here now.
|| [[#t16:32:10|16:32]]
|- id="t16:32:34"
! style="background-color: #854685" | adamw
| style="color: #854685" | hi oxf13
|| [[#t16:32:34|16:32]]
|- id="t16:32:42"
! style="background-color: #854685" | adamw
| style="color: #854685" | so, that's the idea, pretty much. if anyone has any thoughts go ahead
|| [[#t16:32:42|16:32]]
|- id="t16:32:58"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | are these things that should be lined up prior to F-12 GA?
|| [[#t16:32:58|16:32]]
|- id="t16:33:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | if they weren't rebuilt ... what's the fallout (packages that contain .fc11 in the name)?
|| [[#t16:33:25|16:33]]
|- id="t16:33:52"
! style="background-color: #854685" | adamw
| style="color: #854685" | there's no terrible fallout, but making sure all packages build is good policy
|| [[#t16:33:52|16:33]]
|- id="t16:34:15"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | esp given a recent self-hosting blog post
|| [[#t16:34:15|16:34]]
|- id="t16:34:19"
! style="background-color: #854685" | adamw
| style="color: #854685" | it's possible some of them won't work any more till they get rebuilt, and if you leave it too long you wind up with a giant backlog of crusty packages (i speak from experience)
|| [[#t16:34:19|16:34]]
|- id="t16:34:35"
| colspan="2" | * Viking-Ice ready now :)
|| [[#t16:34:35|16:34]]
|- id="t16:34:42"
! style="background-color: #854685" | adamw
| style="color: #854685" | doing it before f12 ga would be nice but not essential, they can always be pushed as updates and anyway it'd be good for future releases too
|| [[#t16:34:42|16:34]]
|- id="t16:34:56"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I'd be curious for Oxf13's take ... I know Jesse was closely involved with the mass rebuild
|| [[#t16:34:56|16:34]]
|- id="t16:35:18"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | if they're non crit-path packages, I have no issue with tagging them up until we hit RC
|| [[#t16:35:18|16:35]]
|- id="t16:35:45"
| colspan="2" | * jlaska wonders if python-bugzilla can help here
|| [[#t16:35:45|16:35]]
|- id="t16:35:48"
! style="background-color: #854685" | adamw
| style="color: #854685" | i think they all are, looking at the list, they're mostly pretty obscure
|| [[#t16:35:48|16:35]]
|- id="t16:35:53"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | yeah
|| [[#t16:35:53|16:35]]
|- id="t16:36:11"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I don't see anything wrong with filing bugs to track this stuff, that's the suggestion right?
|| [[#t16:36:11|16:36]]
|- id="t16:36:27"
! style="background-color: #854685" | adamw
| style="color: #854685" | jlaska: it may, except it's useful to provide a note of the build failure message in ftbfs bugs, which wouldn't be straightforward to automate.
|| [[#t16:36:27|16:36]]
|- id="t16:36:27"
! style="background-color: #854685" | adamw
| style="color: #854685" | yes
|| [[#t16:36:27|16:36]]
|- id="t16:36:38"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: good point
|| [[#t16:36:38|16:36]]
|- id="t16:36:40"
! style="background-color: #4b904b" | mether
| style="color: #4b904b" | adamw, http://fedoraproject.org/wiki/FTBFS FYI
|| [[#t16:36:40|16:36]]
|- id="t16:37:01"
! style="background-color: #854685" | adamw
| style="color: #854685" | although the idea is specifically to do it as a 'project' within QA, not just to say 'filing these bugs is a good idea'. though I didn't get milos' thoughts on specifically how he wanted to arrange it.
|| [[#t16:37:01|16:37]]
|- id="t16:37:05"
! style="background-color: #854685" | adamw
| style="color: #854685" | mether: ah thanks
|| [[#t16:37:05|16:37]]
|- id="t16:37:28"
! style="background-color: #4b904b" | mether
| style="color: #4b904b" | Matt Domsch does a mass rebuild now and then as a QA measure
|| [[#t16:37:28|16:37]]
|- id="t16:37:32"
! style="background-color: #854685" | adamw
| style="color: #854685" | that seems to claim that bugs 'will' be filed, implying it happens automatically
|| [[#t16:37:32|16:37]]
|- id="t16:38:09"
! style="background-color: #4b904b" | mether
| style="color: #4b904b" | he has scripts that do that
|| [[#t16:38:09|16:38]]
|- id="t16:38:16"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | and he autofiles bugs for the failures.
|| [[#t16:38:16|16:38]]
|- id="t16:38:24"
! style="background-color: #854685" | adamw
| style="color: #854685" | oh, yeah, milos did point to that same F12FTBFS list, but noted that there are 39 bugs on it
|| [[#t16:38:24|16:38]]
|- id="t16:38:25"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | using python-bugizlla
|| [[#t16:38:25|16:38]]
|- id="t16:38:38"
! style="background-color: #854685" | adamw
| style="color: #854685" | whereas the list of packages he provided is rather longer than 39
|| [[#t16:38:38|16:38]]
|- id="t16:38:38"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | his pass happened a month or so before my pass
|| [[#t16:38:38|16:38]]
|- id="t16:38:52"
! style="background-color: #854685" | adamw
| style="color: #854685" | #link https://bugzilla.redhat.com/showdependencytree.cgi?id=511348&amp;hide_resolved=1
|| [[#t16:38:52|16:38]]
|- id="t16:39:22"
! style="background-color: #854685" | adamw
| style="color: #854685" | anyway, i'm sensing we need milos to explain his idea more fully either at next week's meeting or on the ml :)
|| [[#t16:39:22|16:39]]
|- id="t16:39:32"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | yeah, let's carry the topic fwd?
|| [[#t16:39:32|16:39]]
|- id="t16:39:52"
! style="background-color: #854685" | adamw
| style="color: #854685" | ok
|| [[#t16:39:52|16:39]]
|- id="t16:39:54"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | definitely open to the idea, but nothing tangible is coming to me other than one person walking down a list?
|| [[#t16:39:54|16:39]]
|- id="t16:40:57"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | yeah, I haven't read the email yet
|| [[#t16:40:57|16:40]]
|- id="t16:41:00"
! style="background-color: #854685" | adamw
| style="color: #854685" | it could be done as a group thing, but i think we should clarify whether it needs to happen and why his list is longer than the bugs filed by matt's thingy and so on
|| [[#t16:41:00|16:41]]
|- id="t16:41:17"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | his list is longer because more things failed in my pass
|| [[#t16:41:17|16:41]]
|- id="t16:41:19"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | and I didn't autofile bugs
|| [[#t16:41:19|16:41]]
|- id="t16:41:44"
! style="background-color: #854685" | adamw
| style="color: #854685" | ah, ok.
|| [[#t16:41:44|16:41]]
|- id="t16:42:11"
! style="background-color: #854685" | adamw
| style="color: #854685" | anyway, i'll take an action item to ask him to follow-up at next week's meeting or on the list
|| [[#t16:42:11|16:42]]
|- id="t16:42:38"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #action adamw will ask Milos to follow-up at next week's meeting or on the list on the FTBFS topic
|| [[#t16:42:38|16:42]]
|- id="t16:43:04"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay, shall we jump back to Viking-Ice's topic?
|| [[#t16:43:04|16:43]]
|- id="t16:43:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Viking_Ice locale test suggestion
|| [[#t16:43:20|16:43]]
|- id="t16:43:30"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://www.redhat.com/archives/fedora-test-list/2009-October/msg00503.html
|| [[#t16:43:30|16:43]]
|- id="t16:43:44"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | basically this is what I had in mind..
|| [[#t16:43:44|16:43]]
|- id="t16:43:45"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: take it away my good man
|| [[#t16:43:45|16:43]]
|- id="t16:43:54"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | http://fpaste.org/GuOk/
|| [[#t16:43:54|16:43]]
|- id="t16:44:14"
| colspan="2" | * adamw -&gt; biobreak
|| [[#t16:44:14|16:44]]
|- id="t16:44:23"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | A test case that checks if keyboard layout is correct after install reports if not
|| [[#t16:44:23|16:44]]
|- id="t16:44:56"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: would we then want to iterate over installing using different lang/keymap settings ... and run this script?
|| [[#t16:44:56|16:44]]
|- id="t16:45:17"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link http://fpaste.org/GuOk/
|| [[#t16:45:17|16:45]]
|- id="t16:45:36"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | I dont think we need to parse all of them
|| [[#t16:45:36|16:45]]
|- id="t16:46:04"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | a single test should suffice and we should be able to add this to a current installation test
|| [[#t16:46:04|16:46]]
|- id="t16:46:30"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: for this test to fail now, you need to install with a non US lang and keymap?
|| [[#t16:46:30|16:46]]
|- id="t16:47:17"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | in the ks file set the keyboard  to a none us layout ( keyboard is-latin1 )
|| [[#t16:47:17|16:47]]
|- id="t16:48:24"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | jlaska: it's the other way around it fails if it's not what we defined in keyboard
|| [[#t16:48:24|16:48]]
|- id="t16:48:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: seems like there is a enough to write a wiki Test_Case: for this
|| [[#t16:48:25|16:48]]
|- id="t16:48:41"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | why ?
|| [[#t16:48:41|16:48]]
|- id="t16:48:51"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | this should be automated
|| [[#t16:48:51|16:48]]
|- id="t16:48:51"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | gotta have a test before you automate
|| [[#t16:48:51|16:48]]
|- id="t16:49:02"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Seems like it should be yeah
|| [[#t16:49:02|16:49]]
|- id="t16:49:28"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | but if we just write automation with no background or indication of the steps required, it's not really clear for people outside the group why that test exists
|| [[#t16:49:28|16:49]]
|- id="t16:49:28"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | how do you wiki-fi for autoqa ?
|| [[#t16:49:28|16:49]]
|- id="t16:49:48"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | well, for israwhidebroken ... we have [[QA:Rawhide_Acceptance_Test_Plan]]
|| [[#t16:49:48|16:49]]
|- id="t16:50:07"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | once we have a test case, for me, the next step is determining where it's best to automate this
|| [[#t16:50:07|16:50]]
|- id="t16:50:28"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | guess it would be added here  [[QA:Anaconda_package_install_test_case]]
|| [[#t16:50:28|16:50]]
|- id="t16:50:33"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | whether it's a generally useful thing that affects how usable rawhide is - 'israwhidebroken'
|| [[#t16:50:33|16:50]]
|- id="t16:50:35"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | but ok
|| [[#t16:50:35|16:50]]
|- id="t16:50:50"
! style="background-color: #854685" | adamw
| style="color: #854685" | Viking-Ice: no, that's a different test case.
|| [[#t16:50:50|16:50]]
|- id="t16:51:02"
! style="background-color: #854685" | adamw
| style="color: #854685" | test cases should be single purpose, not a clump of different tests in one.
|| [[#t16:51:02|16:51]]
|- id="t16:51:10"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | lili and rhe are currently looking into automating the current test matrix ... I think your case would fit perfectly there
|| [[#t16:51:10|16:51]]
|- id="t16:51:19"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | Basic Functionality &lt;-- then ?
|| [[#t16:51:19|16:51]]
|- id="t16:51:31"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | No. RATS is supposed to be a super-simple basic test
|| [[#t16:51:31|16:51]]
|- id="t16:51:31"
! style="background-color: #854685" | adamw
| style="color: #854685" | it would be a new test case, with its own name.
|| [[#t16:51:31|16:51]]
|- id="t16:51:41"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | ah ok
|| [[#t16:51:41|16:51]]
|- id="t16:51:42"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | you're talking about something for a more exhaustive test plan
|| [[#t16:51:42|16:51]]
|- id="t16:52:06"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | yeah ... I'd see this case being added to the list here [[QA:Fedora_12_Install_Test_Plan]]
|| [[#t16:52:06|16:52]]
|- id="t16:52:11"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | it's called the Acceptance Test Plan because it sets out the criteria for judging whether we can even accept a rawhide tree for *real* testing
|| [[#t16:52:11|16:52]]
|- id="t16:52:19"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | you're talking about defining one of the cases for the *real* testing
|| [[#t16:52:19|16:52]]
|- id="t16:52:24"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | which is awesome and exciting
|| [[#t16:52:24|16:52]]
|- id="t16:52:46"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | but, yeah, falls outside of the rawhide acceptance test plan
|| [[#t16:52:46|16:52]]
|- id="t16:52:57"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: that test matrix you see floating aroudn is something that would come into play after wwoods's rats plan
|| [[#t16:52:57|16:52]]
|- id="t16:53:13"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | and it's light on validating any i18n tests ... it could use this
|| [[#t16:53:13|16:53]]
|- id="t16:53:25"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | ok what's usually done with the output from those test ( OK fail ) mailed etc..
|| [[#t16:53:25|16:53]]
|- id="t16:53:53"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | That's what they're investigating now ... very *early* stages
|| [[#t16:53:53|16:53]]
|- id="t16:53:55"
! style="background-color: #854685" | adamw
| style="color: #854685" | the tests in the test matrix are done manually, you see Liam Li send out mails every so often for that testing
|| [[#t16:53:55|16:53]]
|- id="t16:54:09"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | depends on how you write the test. right now it gets stuffed into the autotest UI; we have the RATS tests also sending email when they complete
|| [[#t16:54:09|16:54]]
|- id="t16:54:15"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | you can decide what you want it to do
|| [[#t16:54:15|16:54]]
|- id="t16:54:22"
! style="background-color: #854685" | adamw
| style="color: #854685" | autoqa tests are run regularly and results mailed to a special mailing list at present, but automating tests is more complex and hasn't been done for all tests yet
|| [[#t16:54:22|16:54]]
|- id="t16:54:55"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | and I think you've got a good test case here to cover recent non-US lang/keymap failures
|| [[#t16:54:55|16:54]]
|- id="t16:55:19"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so it'll be a bit before we have the full test matrix automated
|| [[#t16:55:19|16:55]]
|- id="t16:55:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so I'd start with getting the test case defined and added to the install test plan
|| [[#t16:55:31|16:55]]
|- id="t16:55:33"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | how do others feel?
|| [[#t16:55:33|16:55]]
|- id="t16:55:51"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | worksforme
|| [[#t16:55:51|16:55]]
|- id="t16:55:56"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | this checks for what is essentially what maintainer asked for on bug 530452
|| [[#t16:55:56|16:55]]
|- id="t16:55:58"
! style="background-color: #97974f" | buggbot
| style="color: #97974f" | Bug https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=530452 high, low, ---, jmccann, MODIFIED, Gnome sets the keyboard layout to USA after every log in
|| [[#t16:55:58|16:55]]
|- id="t16:56:35"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: yeah, we certainly need more testing there
|| [[#t16:56:35|16:56]]
|- id="t16:57:00"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | so what additional steps do we take from here..
|| [[#t16:57:00|16:57]]
|- id="t16:57:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | basically, create a wiki test case and propose adding it to the current install test matrix
|| [[#t16:57:20|16:57]]
|- id="t16:57:28"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | ok
|| [[#t16:57:28|16:57]]
|- id="t16:57:34"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I think that's the first step
|| [[#t16:57:34|16:57]]
|- id="t16:58:07"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | the follow-on steps will be around automating that large matrix ... I don't have any updates on that front, other than that's a topic Liam and Rui have started investigating
|| [[#t16:58:07|16:58]]
|- id="t16:58:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: but this way, if we've go tthe test case ... it won't get lost
|| [[#t16:58:20|16:58]]
|- id="t16:58:40"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | anyone want to take an action item to create the test case and request addition to the matrix?
|| [[#t16:58:40|16:58]]
|- id="t16:59:15"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | guess me I suppose with guided hand :)
|| [[#t16:59:15|16:59]]
|- id="t16:59:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | hehe ... thanks!
|| [[#t16:59:31|16:59]]
|- id="t16:59:35"
! style="background-color: #854685" | adamw
| style="color: #854685" | Viking-Ice: it's pretty straightforward to create a test case, it's just a wiki page based on a template; edit any existing test case to see how it's done
|| [[#t16:59:35|16:59]]
|- id="t16:59:35"
! style="background-color: #818144" | Viking-Ice
| style="color: #818144" | or review patients :)
|| [[#t16:59:35|16:59]]
|- id="t16:59:51"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link [[Template:QA/Test_Case]]
|| [[#t16:59:51|16:59]]
|- id="t16:59:54"
! style="background-color: #854685" | adamw
| style="color: #854685" | Viking-Ice: but feel free to ping me if you're having trouble
|| [[#t16:59:54|16:59]]
|- id="t17:00:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #action Viking-Ice investigating creating a test case for bug#530452 ... and adding to F12 install matrix
|| [[#t17:00:31|17:00]]
|- id="t17:00:33"
! style="background-color: #97974f" | buggbot
| style="color: #97974f" | Bug https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=530452 high, low, ---, jmccann, MODIFIED, Gnome sets the keyboard layout to USA after every log in
|| [[#t17:00:33|17:00]]
|- id="t17:00:50"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: fedora-qa tickets will come into play here soon
|| [[#t17:00:50|17:00]]
|- id="t17:01:00"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | once we have an idea on how to proceed on the matrix automation front
|| [[#t17:01:00|17:01]]
|- id="t17:01:22"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | alright, any other updates on this topic, or shall we jump to autoqa?
|| [[#t17:01:22|17:01]]
|- id="t17:02:11"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay ... autoqa time
|| [[#t17:02:11|17:02]]
|- id="t17:02:14"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic AutoQA Updates from wwoods and kparal
|| [[#t17:02:14|17:02]]
|- id="t17:02:27"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | wwoods: kparal: what's up in your realm?
|| [[#t17:02:27|17:02]]
|- id="t17:02:44"
! style="background-color: #488888" | kparal
| style="color: #488888" | ok, news from the rpmguard world:
|| [[#t17:02:44|17:02]]
|- id="t17:02:54"
! style="background-color: #488888" | kparal
| style="color: #488888" | I have posted a blog about rpmguard
|| [[#t17:02:54|17:02]]
|- id="t17:02:54"
! style="background-color: #488888" | kparal
| style="color: #488888" | http://kparal.wordpress.com/2009/10/21/rpmguard-print-important-differences-between-rpms/
|| [[#t17:02:54|17:02]]
|- id="t17:02:54"
! style="background-color: #488888" | kparal
| style="color: #488888" | and I also wrote to some mailing lists.
|| [[#t17:02:54|17:02]]
|- id="t17:02:59"
! style="background-color: #488888" | kparal
| style="color: #488888" | maybe you have noticed
|| [[#t17:02:59|17:02]]
|- id="t17:03:13"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link http://kparal.wordpress.com/2009/10/21/rpmguard-print-important-differences-between-rpms
|| [[#t17:03:13|17:03]]
|- id="t17:03:18"
! style="background-color: #488888" | kparal
| style="color: #488888" | there was some feedback, skvidal posted me a link to his mungingdiff
|| [[#t17:03:18|17:03]]
|- id="t17:03:18"
! style="background-color: #488888" | kparal
| style="color: #488888" | http://skvidal.fedorapeople.org/misc/mungingdiff.py
|| [[#t17:03:18|17:03]]
|- id="t17:03:18"
! style="background-color: #488888" | kparal
| style="color: #488888" | but I'm not sure if there are parts inside which I haven't already implemented in rpmguard
|| [[#t17:03:18|17:03]]
|- id="t17:03:41"
! style="background-color: #488888" | kparal
| style="color: #488888" | also alexey torkhov suggested to leverage rpmsodiff in my tool. I have created a ticket for that, because I have decided to look at it a little later:
|| [[#t17:03:41|17:03]]
|- id="t17:03:41"
! style="background-color: #488888" | kparal
| style="color: #488888" | https://fedorahosted.org/autoqa/ticket/75
|| [[#t17:03:41|17:03]]
|- id="t17:04:14"
! style="background-color: #488888" | kparal
| style="color: #488888" | the upcoming task is to look at the watcher wwoods is working on and integrate rpmguard into autoqa to have it up and running
|| [[#t17:04:14|17:04]]
|- id="t17:04:28"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info the upcoming task is to look at the watcher wwoods is working on and integrate rpmguard into autoqa to have it up and running
|| [[#t17:04:28|17:04]]
|- id="t17:04:34"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | so, yup - we've got a basic watcher for koji
|| [[#t17:04:34|17:04]]
|- id="t17:04:52"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | it's ready to be run and picks up every new build in a set of koji tags that we specify
|| [[#t17:04:52|17:04]]
|- id="t17:05:28"
! style="background-color: #488888" | kparal
| style="color: #488888" | so, for my script the important part would be to find out the version and the link of the previous package release. to have something to compare
|| [[#t17:05:28|17:05]]
|- id="t17:05:57"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | right - the tests for that hook will likely get a package NVR and/or package name as input
|| [[#t17:05:57|17:05]]
|- id="t17:06:13"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | but I'm writing a library to take e.g. a package NVR and tag and give you the previous released versions of that package
|| [[#t17:06:13|17:06]]
|- id="t17:06:26"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | or rather, I have written that tool
|| [[#t17:06:26|17:06]]
|- id="t17:06:30"
! style="background-color: #488888" | kparal
| style="color: #488888" | is it in the git atm?
|| [[#t17:06:30|17:06]]
|- id="t17:06:35"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | and it will be available for use in post-koji-build tests
|| [[#t17:06:35|17:06]]
|- id="t17:06:35"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | not yet
|| [[#t17:06:35|17:06]]
|- id="t17:06:40"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | sweet
|| [[#t17:06:40|17:06]]
|- id="t17:06:42"
! style="background-color: #488888" | kparal
| style="color: #488888" | looking forward to it
|| [[#t17:06:42|17:06]]
|- id="t17:06:48"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | hrm.
|| [[#t17:06:48|17:06]]
|- id="t17:06:57"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | I need to rearrange the autoqa library stuff a little bit so the tests can share code like this better
|| [[#t17:06:57|17:06]]
|- id="t17:06:58"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | it might make more sense to compare to the previous shipped package, rather than the previous built package
|| [[#t17:06:58|17:06]]
|- id="t17:07:09"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | Oxf13: I said "previously released"
|| [[#t17:07:09|17:07]]
|- id="t17:07:16"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | (would make it a lot easier to discover too)
|| [[#t17:07:16|17:07]]
|- id="t17:07:19"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | wwoods: oh sorry, missed that
|| [[#t17:07:19|17:07]]
|- id="t17:07:39"
! style="background-color: #488888" | kparal
| style="color: #488888" | very good point, nice
|| [[#t17:07:39|17:07]]
|- id="t17:07:44"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | to go into more detail: you give it a package name (e.g. "preupgrade") and a tag (e.g. "dist-f12-updates-candidate")
|| [[#t17:07:44|17:07]]
|- id="t17:07:54"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info basic watcher for koji in place.  picks up every new build in a set of koji tags that we specify
|| [[#t17:07:54|17:07]]
|- id="t17:08:05"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | we have some data that indicates which other tags to check for that
|| [[#t17:08:05|17:08]]
|- id="t17:08:21"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | i.e. "dist-f12-updates-candidate" -&gt; "dist-f12" and "dist-f12-updates" (iirc)
|| [[#t17:08:21|17:08]]
|- id="t17:08:23"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | wwoods: (not to distract, but wouldn't dist-f12-updates(-testing) be more appropriate?  not all -candidate builds get shipped)
|| [[#t17:08:23|17:08]]
|- id="t17:08:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info wwoods has a library soon to be added to git repo which takes a package NVR and tag and provides the previous released versions of that package
|| [[#t17:08:31|17:08]]
|- id="t17:08:31"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | wow, n/m.
|| [[#t17:08:31|17:08]]
|- id="t17:08:33"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | so then it asks koji for the NVR of the packages with those specific tags
|| [[#t17:08:33|17:08]]
|- id="t17:08:45"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | right, the point is that the watcher sees the build land in -candidate
|| [[#t17:08:45|17:08]]
|- id="t17:09:15"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | and the test can use this library call if it needs to know the corresponding version for -updates or -updates-testing or the GA
|| [[#t17:09:15|17:09]]
|- id="t17:09:22"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | wwoods: cool, so it walks the tag inheritance chain?
|| [[#t17:09:22|17:09]]
|- id="t17:09:32"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | not explicitly, no
|| [[#t17:09:32|17:09]]
|- id="t17:09:58"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | we have to keep a mapping in autoqa that tells us which "parent" tags to check for a given -candidate
|| [[#t17:09:58|17:09]]
|- id="t17:10:06"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | we already have a mapping like this in the other watchers
|| [[#t17:10:06|17:10]]
|- id="t17:10:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | wwoods - keepin' it simple
|| [[#t17:10:25|17:10]]
|- id="t17:10:25"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | e.g. https://fedorahosted.org/autoqa/browser/hooks/post-repo-update/watch-repos.py
|| [[#t17:10:25|17:10]]
|- id="t17:10:46"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | right on
|| [[#t17:10:46|17:10]]
|- id="t17:10:50"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | so I'm thinking we need to move the data from line 30-76
|| [[#t17:10:50|17:10]]
|- id="t17:11:00"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | which is also in https://fedorahosted.org/autoqa/browser/hooks/post-tree-compose/watch-composes.py
|| [[#t17:11:00|17:11]]
|- id="t17:11:26"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | and keep a shared autoqa.repoinfo data structure
|| [[#t17:11:26|17:11]]
|- id="t17:11:32"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | yeah, that sounds good
|| [[#t17:11:32|17:11]]
|- id="t17:11:42"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | +1
|| [[#t17:11:42|17:11]]
|- id="t17:11:42"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | we could make a watcher library
|| [[#t17:11:42|17:11]]
|- id="t17:11:48"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | which may be provided by a config file (so we don't have to update the package just to tweak the inheritance/URLs/etc)
|| [[#t17:11:48|17:11]]
|- id="t17:11:59"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | that includes the mapping, and any other common stuff, then each watcher script could import the library
|| [[#t17:11:59|17:11]]
|- id="t17:12:03"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | Oxf13: yep, that's the plan - gonna have an autoqa library for the server-side stuff (watchers etc)
|| [[#t17:12:03|17:12]]
|- id="t17:12:08"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | rock
|| [[#t17:12:08|17:12]]
|- id="t17:12:16"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | it's like... real software development
|| [[#t17:12:16|17:12]]
|- id="t17:12:17"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | and one for the test stuff (like the things in rats.py and virtguest.py)
|| [[#t17:12:17|17:12]]
|- id="t17:12:37"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | (and the proposed koji-interfacing stuff I mentioned for post-koji-build)
|| [[#t17:12:37|17:12]]
|- id="t17:12:45"
! style="background-color: #854685" | adamw
| style="color: #854685" | Oxf13: maybe we need something to automatically check whether there's any bugs in it =)
|| [[#t17:12:45|17:12]]
|- id="t17:12:56"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | adamw: crazy talk.
|| [[#t17:12:56|17:12]]
|- id="t17:13:04"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | I should roadmap out this plan but I was upgrading my workstation to F12B last week
|| [[#t17:13:04|17:13]]
|- id="t17:13:29"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | but yeah now that I think of it, I'm going to give myself an action to do that
|| [[#t17:13:29|17:13]]
|- id="t17:13:44"
| colspan="2" | * jlaska pulls out the meetbot action pen
|| [[#t17:13:44|17:13]]
|- id="t17:14:13"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | wwoods: are these post irb.com things?
|| [[#t17:14:13|17:14]]
|- id="t17:14:15"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | #action wwoods to add roadmap/tickets for reworking shared autoqa code (watchers, test helper methods, etc) into a proper library
|| [[#t17:14:15|17:14]]
|- id="t17:14:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | oh thanks ... u did it for me :)
|| [[#t17:14:25|17:14]]
|- id="t17:14:28"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | jlaska: yes, this is a different milestone in my opinion
|| [[#t17:14:28|17:14]]
|- id="t17:15:08"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info update from mmcgrath on hardware the hardware delivery ... looking at Nov 20
|| [[#t17:15:08|17:15]]
|- id="t17:15:18"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | oh also! I'd like to mention http://wwoods.fedorapeople.org/files/critical-path/critpath.py
|| [[#t17:15:18|17:15]]
|- id="t17:15:34"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | which was rewritten to be dead stupid simple to use
|| [[#t17:15:34|17:15]]
|- id="t17:15:45"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | you run that script, it solves critpath and writes critpath.txt
|| [[#t17:15:45|17:15]]
|- id="t17:16:06"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link http://wwoods.fedorapeople.org/files/critical-path/critpath.py
|| [[#t17:16:06|17:16]]
|- id="t17:16:07"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | I do believe jwb was going to integrate that with the rawhide compose
|| [[#t17:16:07|17:16]]
|- id="t17:16:14"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | Oxf13: excellent!
|| [[#t17:16:14|17:16]]
|- id="t17:16:20"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | so that we'd have a written out critpath just like we do the depsolve and repodiff
|| [[#t17:16:20|17:16]]
|- id="t17:16:26"
! style="background-color: #9b519b" | jwb
| style="color: #9b519b" | yes.  need to get back to that, but i've been sick
|| [[#t17:16:26|17:16]]
|- id="t17:16:30"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Oxf13: so that output would be in the mash log dir for each rawhide compose?
|| [[#t17:16:30|17:16]]
|- id="t17:16:42"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | which would give us a static url, http://kojipkgs.fedoraproject.org/mash/rawhide/logs/critpath.txt
|| [[#t17:16:42|17:16]]
|- id="t17:16:49"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | jlaska: yes
|| [[#t17:16:49|17:16]]
|- id="t17:16:52"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | delicious!
|| [[#t17:16:52|17:16]]
|- id="t17:16:55"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | after warren's confusion using the months-old deplist.txt I had sitting in my people.fp.o page I want to make sure everyone knows how this works
|| [[#t17:16:55|17:16]]
|- id="t17:17:00"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | "mash/rawhide" is a symlink that gets updated each compose
|| [[#t17:17:00|17:17]]
|- id="t17:17:01"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | oh man that would be totally aces
|| [[#t17:17:01|17:17]]
|- id="t17:17:11"
! style="background-color: #9b519b" | jwb
| style="color: #9b519b" | it will be dated, but yeah
|| [[#t17:17:11|17:17]]
|- id="t17:17:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | thanks jwb
|| [[#t17:17:25|17:17]]
|- id="t17:17:25"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | I'll do whatever I can to help get that integrated
|| [[#t17:17:25|17:17]]
|- id="t17:17:40"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | dated as in it'll have a date on it
|| [[#t17:17:40|17:17]]
|- id="t17:17:43"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | not "it'll be kind of old"
|| [[#t17:17:43|17:17]]
|- id="t17:17:44"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | right?
|| [[#t17:17:44|17:17]]
|- id="t17:17:59"
! style="background-color: #9b519b" | jwb
| style="color: #9b519b" | wwoods, you did a lot already.  i just need to take your script and add it to the releng git repo, etc.  yes, dated as in 'critpath-&lt;date&gt;.txt'
|| [[#t17:17:59|17:17]]
|- id="t17:18:17"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | jwb: dated?  What will be dated?
|| [[#t17:18:17|17:18]]
|- id="t17:18:20"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | hrm.
|| [[#t17:18:20|17:18]]
|- id="t17:18:29"
! style="background-color: #9b519b" | jwb
| style="color: #9b519b" | the file itself
|| [[#t17:18:29|17:18]]
|- id="t17:18:29"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | jwb: it might be better to not date it, so that we have a static URL
|| [[#t17:18:29|17:18]]
|- id="t17:18:38"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | it'll already be in a dated directory
|| [[#t17:18:38|17:18]]
|- id="t17:18:42"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | it'll be in a datestamped *directory*.. yeah
|| [[#t17:18:42|17:18]]
|- id="t17:18:43"
! style="background-color: #9b519b" | jwb
| style="color: #9b519b" | oh, true
|| [[#t17:18:43|17:18]]
|- id="t17:18:51"
! style="background-color: #9b519b" | jwb
| style="color: #9b519b" | ok, wfm
|| [[#t17:18:51|17:18]]
|- id="t17:19:04"
! style="background-color: #9b519b" | jwb
| style="color: #9b519b" | i was still going off of the 'will be on mirrors' idea
|| [[#t17:19:04|17:19]]
|- id="t17:19:08"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info jwb working to integrate critpath script into daily rawhide compose process
|| [[#t17:19:08|17:19]]
|- id="t17:19:59"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | wwoods: kparal: great updates thx ... anything else to note for the logs?
|| [[#t17:19:59|17:19]]
|- id="t17:20:33"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | oh
|| [[#t17:20:33|17:20]]
|- id="t17:20:38"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | autoqa-devel!
|| [[#t17:20:38|17:20]]
|- id="t17:20:45"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | ah yes
|| [[#t17:20:45|17:20]]
|- id="t17:20:54"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | https://fedorahosted.org/mailman/listinfo/autoqa-devel
|| [[#t17:20:54|17:20]]
|- id="t17:21:10"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | and atodorov gets points for being the first poster
|| [[#t17:21:10|17:21]]
|- id="t17:21:22"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I don't know if it needs this or not ...
|| [[#t17:21:22|17:21]]
|- id="t17:21:28"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://fedorahosted.org/mailman/listinfo/autoqa-devel
|| [[#t17:21:28|17:21]]
|- id="t17:21:31"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | blah, more lists I should probably be on
|| [[#t17:21:31|17:21]]
|- id="t17:22:07"
| colspan="2" | * jeff_hann here...sorry I'm late
|| [[#t17:22:07|17:22]]
|- id="t17:22:33"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | jeff_hann: thanks for joining ... just about to go to open floor
|| [[#t17:22:33|17:22]]
|- id="t17:22:35"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | yeah, Yet Another Mailing List, but honestly we avoided it as long as we possibly could
|| [[#t17:22:35|17:22]]
|- id="t17:22:50"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | and eventually determined that we really need a mailing list after all
|| [[#t17:22:50|17:22]]
|- id="t17:23:15"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Thanks for the updates wwoods and kparal ... lots of progress
|| [[#t17:23:15|17:23]]
|- id="t17:23:40"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so ... I'm going to skip ahead and jump back on the agenda
|| [[#t17:23:40|17:23]]
|- id="t17:23:55"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Upcoming QA events - 2009-10-29 - i18n Test Day
|| [[#t17:23:55|17:23]]
|- id="t17:23:59"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link [[Test_Day:2009-10-29]]
|| [[#t17:23:59|17:23]]
|- id="t17:24:08"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Looking for volunteers
|| [[#t17:24:08|17:24]]
|- id="t17:24:27"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Rui and Jens pulled together the test day wiki page.  I think it looks pretty good
|| [[#t17:24:27|17:24]]
|- id="t17:24:46"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | but we could use more volunteers to help with i18n testing this Thursday
|| [[#t17:24:46|17:24]]
|- id="t17:25:10"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | if you're interested, feel free to add a watch to the wiki page
|| [[#t17:25:10|17:25]]
|- id="t17:25:19"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | or add yourself to the cc list of the tracking ticket
|| [[#t17:25:19|17:25]]
|- id="t17:25:24"
! style="background-color: #854685" | adamw
| style="color: #854685" | also poke any chinese/japanese/korean speakers you know :)
|| [[#t17:25:24|17:25]]
|- id="t17:25:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://fedorahosted.org/fedora-qa/ticket/25
|| [[#t17:25:31|17:25]]
|- id="t17:25:37"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: yes please!
|| [[#t17:25:37|17:25]]
|- id="t17:26:03"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I'm personallyn not well versed in i18n verification ... so more eyes are needed to review the plan and propose changes
|| [[#t17:26:03|17:26]]
|- id="t17:26:06"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | and of course ... help test :)
|| [[#t17:26:06|17:26]]
|- id="t17:26:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Upcoming QA events - 2009-10-30 - Blocker Bug Day #2
|| [[#t17:26:25|17:26]]
|- id="t17:26:50"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Kudos to adamw and Oxf13 for walking through the list not once, but twice last week
|| [[#t17:26:50|17:26]]
|- id="t17:26:54"
! style="background-color: #854685" | adamw
| style="color: #854685" | we are shooting for this blocker bug meeting to end slightly before the heat death of the universe
|| [[#t17:26:54|17:26]]
|- id="t17:27:02"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://bugzilla.redhat.com/showdependencytree.cgi?id=473303&amp;hide_resolved=1
|| [[#t17:27:02|17:27]]
|- id="t17:27:10"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: ouch, no kidding :)
|| [[#t17:27:10|17:27]]
|- id="t17:27:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | recap from last meeting ...
|| [[#t17:27:25|17:27]]
|- id="t17:27:28"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://www.redhat.com/archives/fedora-test-list/2009-October/msg00579.html
|| [[#t17:27:28|17:27]]
|- id="t17:27:42"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Under the column ... how can I help  ...
|| [[#t17:27:42|17:27]]
|- id="t17:28:13"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | add block:F12Blocker for issues you feel affect a fair number of users, or are just plain embarrasing
|| [[#t17:28:13|17:28]]
|- id="t17:28:35"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | If you are assigned or on the cc list of a blocker list bug ... you can help in advance by ensuring the bug is up-to-date
|| [[#t17:28:35|17:28]]
|- id="t17:28:40"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: anything else you can think of?
|| [[#t17:28:40|17:28]]
|- id="t17:29:09"
! style="background-color: #854685" | adamw
| style="color: #854685" | not really - more people coming to the meeting to help review the bugs is always welcome
|| [[#t17:29:09|17:29]]
|- id="t17:29:34"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | agreed!
|| [[#t17:29:34|17:29]]
|- id="t17:29:48"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: something about more eyes right? :)
|| [[#t17:29:48|17:29]]
|- id="t17:30:00"
! style="background-color: #854685" | adamw
| style="color: #854685" | more eyes make all arguments longer, yes
|| [[#t17:30:00|17:30]]
|- id="t17:30:11"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | bingo!
|| [[#t17:30:11|17:30]]
|- id="t17:30:16"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay, moving along ...
|| [[#t17:30:16|17:30]]
|- id="t17:30:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #Topic Open discussion - &lt;Your topic here&gt;
|| [[#t17:30:25|17:30]]
|- id="t17:31:10"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | anything else not covered that is of interest?
|| [[#t17:31:10|17:31]]
|- id="t17:31:23"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | concerns, questions, complaints ... favorite color?
|| [[#t17:31:23|17:31]]
|- id="t17:31:44"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | Who all is going to FUDCon ?
|| [[#t17:31:44|17:31]]
|- id="t17:31:55"
! style="background-color: #539e9e" | jeff_hann
| style="color: #539e9e" | just for information value, I have several kernel bugs I'm working on
|| [[#t17:31:55|17:31]]
|- id="t17:32:02"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | I'll be at FUDCon
|| [[#t17:32:02|17:32]]
|- id="t17:32:34"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | wwoods: good, I want to get people talking about the message bus, and what kind of data you'd need from it for autoqa et al
|| [[#t17:32:34|17:32]]
|- id="t17:32:36"
! style="background-color: #854685" | adamw
| style="color: #854685" | I am
|| [[#t17:32:36|17:32]]
|- id="t17:32:53"
! style="background-color: #854685" | adamw
| style="color: #854685" | Jeff_S: wrong meeting, but did you get in touch with rjune regarding kernel triage in the end?
|| [[#t17:32:53|17:32]]
|- id="t17:32:55"
! style="background-color: #854685" | adamw
| style="color: #854685" | grr
|| [[#t17:32:55|17:32]]
|- id="t17:33:00"
! style="background-color: #854685" | adamw
| style="color: #854685" | jeff_hann: ^^^
|| [[#t17:33:00|17:33]]
|- id="t17:33:00"
! style="background-color: #a25555" | Jeff_S
| style="color: #a25555" | adamw: no :)
|| [[#t17:33:00|17:33]]
|- id="t17:33:12"
! style="background-color: #854685" | adamw
| style="color: #854685" | Jeff_S: go away, WrongJeff =)
|| [[#t17:33:12|17:33]]
|- id="t17:33:16"
! style="background-color: #a25555" | Jeff_S
| style="color: #a25555" | lol
|| [[#t17:33:16|17:33]]
|- id="t17:33:18"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | heh
|| [[#t17:33:18|17:33]]
|- id="t17:33:34"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | so I signed up to do an update on AutoQA, but since wwoods will be there, perhaps wwoods should take over that pitch?
|| [[#t17:33:34|17:33]]
|- id="t17:33:44"
! style="background-color: #539e9e" | jeff_hann
| style="color: #539e9e" | :)
|| [[#t17:33:44|17:33]]
|- id="t17:33:48"
! style="background-color: #539e9e" | jeff_hann
| style="color: #539e9e" | will do that
|| [[#t17:33:48|17:33]]
|- id="t17:34:08"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | Oxf13: sure, I can do that
|| [[#t17:34:08|17:34]]
|- id="t17:34:26"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Oxf13: we're planning for a blitzkrieg of autoqa information for the FUDCon
|| [[#t17:34:26|17:34]]
|- id="t17:34:40"
! style="background-color: #4d4d93" | wwoods
| style="color: #4d4d93" | we're hoping to be able to give a status update and demonstrate a prototype for how maintainers can add post-build tests right in pkgcvs
|| [[#t17:34:40|17:34]]
|- id="t17:34:45"
! style="background-color: #8c4a4a" | Oxf13
| style="color: #8c4a4a" | rock
|| [[#t17:34:45|17:34]]
|- id="t17:35:26"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay gang ... I think we can put a fork in this meeting
|| [[#t17:35:26|17:35]]
|- id="t17:35:52"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | thanks everyone for joining and providing your $0.02
|| [[#t17:35:52|17:35]]
|- id="t17:36:11"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | As usual, minutes will be on the mailing list soon
|| [[#t17:36:11|17:36]]
|- id="t17:36:26"
! style="background-color: #854685" | adamw
| style="color: #854685" | thanks jlaska
|| [[#t17:36:26|17:36]]
|- id="t17:36:39"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #endmeeting
|| [[#t17:36:39|17:36]]
|}
 
Generated by irclog2html.py 2.7 by [mailto:marius@pov.lt Marius Gedminas] - find it at [http://mg.pov.lt/irclog2html mg.pov.lt]!

Latest revision as of 08:59, 18 September 2016

Attendees

People present (lines said)

  • jlaska (160)
  • wwoods (58)
  • adamw (46)
  • Oxf13 (35)
  • Viking-Ice (24)
  • kparal (17)
  • jwb (7)
  • jeff_hann (4)
  • mether (3)
  • zodbot (3)
  • buggbot (2)
  • Jeff_S (2)
  • skvidal (1)


Regrets:

Agenda


Previous meeting follow-up

See QA/Meetings/20091019#Action_items

  • jlaska to rename other debug pages (see to be consistent with "How to debug <component> problems". Update back-links also

I believe this task is complete. See Category:Debugging for feedback. I've also organized the pages by the component name.

Remaining Question - What do folks want to do with ... KernelBugTriage? Should this change to How to debug kernel problems

Viking_Ice locale test suggestion

Background - https://www.redhat.com/archives/fedora-test-list/2009-October/msg00503.html

Viking-Ice posted a sample script to demonstrate what an automated test should do (see http://pastie.org/671497). Some discussion followed on where best to implement this additional automated test in AutoQA. The group felt that adding the test to Israwhidebroken.com_Proposal was not appropriate. Jlaska felt that this test would be best suited for the QA:Fedora_12_Install_Test_Plan, is it currently is light on i18n verification. Viking-Ice took an action item to create a test case and propose adding it to the test plan. Once added, that test can be included in upcoming automation efforts User:Liam and User:Rhe are investigating.

Milos Jakubicek suggestion on FTBFS bugs

Background - Milos Jakubicek suggested a day/project to work on filing FTBFS(fails-to-build-from-scratch) bugs for all remaining packages that failed to build in F12 mass rebuild (see http://mjakubicek.fedorapeople.org/need-rebuild.html). Some discussion followed on what a QA effort around this might look like. F13 indicated he would have no problems tagging FTBFS rebuilds for F12. Mether provided a link to an existing effort (see FTBFS).

Unfortunately, Milos was not available during the meeting. Adamw took an action item to follow-up with Milos for next weeks meeting (or on fedora-test-list).

Marcela Maslanova test day proposal

Marcela Maslanova sent a test day proposal for including all tests in a package (see http://jvcelak.fedorapeople.org/testday-091022/testday-pm-0.6-1.fc12.src.rpm). Marcela was not present for the meeting, and Jlaska indicated further power management test day feedback was expected from Phil Knirsch soon. Jlaska wanted to highlight that this was the first test day that included a test day rpm which provided scripts to automate test cases and test results collection.

Some outstanding questions for the group:

  1. Is there anything we need to be thinking or doing to support this type of work in the future?
  2. Where should the test scripts used to in test day packages live?

AutoQA Updates from wwoods and kparal

autoqa-devel list now active Wwoods reminded the group that the autoqa development mailing list for patch review, autoqa progress and test development. Join the autoqa-devel list and contribute today!.

RpmGuard update Kparal directed the group to a blog post detailing his current status on the rpmguard effort. Kparal received some feedback from the post, including:

The next task for Kparal is to investigate the koji-build watcher wwoods is working on and integrate rpmguard into autoqa to have it up and running.

Post-koji-build watcher Wwoods provided a brief update on the post-koji-build which picks up every new build in a set of koji tags specified by autoqa. Some discussion followed on between kparal and wwoods on how to pass data between the tests and the watcher script. Wwoods indicated his current post-koji-build watcher would be landing in autoqa.git soon.

AutoQA library Wwoods indicated a library would also be landing in git soon that takes a package NVR and a koji tag, and returns the previous released versions of that package. Wwoods also noted a plan to create a general purpose autoqa library for use by all tests with helpers for koji interaction and virt guest creation.

Critical Path Package List Due to recent questions around the current critical path package list, wwoods reminded the group about the script http://wwoods.fedorapeople.org/files/critical-path/critpath.py. This script will solve the critical path package set and write output to critpath.txt. Jwb notified the group that he would be incorporating this script into the rawhide compose process. Future rawhide composes will include a critpath.txt file (e.g. http://kojipkgs.fedoraproject.org/mash/rawhide-20091027/logs/critpath.txt).

Open discussion - <Your topic here>

FUDCon Attendees

F13 asked who was planning to attend FUDCon. Since wwoods was planning for an AutoQA talk on how maintainers could add tests into PkgCVS, F13 would focus on the messagebus talk.

Upcoming QA events

Template:Admon/hint

  • 2009-10-30 - Blocker Bug Day (F12Blocker) #2

Action items

  • adamw will ask Milos to follow-up at next week's meeting or on the list on the FTBFS topic
  • Viking-Ice investigating creating a test case for bug#530452 ... and adding to F12 install matrix
  • wwoods to add roadmap/tickets for reworking shared autoqa code (watchers, test helper methods, etc) into a proper library

IRC Transcript

jlaska #startmeeting Fedora QA Meeting - QA/Meetings/20091026 16:08
zodbot Meeting started Mon Oct 26 16:08:23 2009 UTC. The chair is jlaska. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:08
zodbot Useful Commands: #action #agreed #halp #info #idea #link #topic. 16:08
jlaska #chair adamw 16:08
zodbot Current chairs: adamw jlaska 16:08
jlaska #topic Gathering 16:08
jlaska hey gang, show of $limb ... who do we have joining today? 16:09
* jlaska notes ... Oxf13 indicated he would arrive late 16:09
* skvidal worries about this $limb thing 16:10
* kparal here 16:10
jlaska kparal: howdy 16:10
jlaska Viking-Ice: adamw: wwoods: and anyone else I'm forgetting 16:11
* Viking-Ice here.. 16:11
* wwoods is here 16:11
jlaska greetings gents 16:11
jlaska adamw might be running late, so just going to kick things off and he run things when he returns 16:12
jlaska skvidal: don't be afraid :) 16:12
jlaska I put adamw's proposed agenda on the wiki, and plan to just walk the list (see QA/Meetings/20091026) 16:12
jlaska starting with ... 16:12
jlaska #topic Previous meeting follow-up 16:12
jlaska I took an action item to rename the existing debug pages to the new format "How to debug <component> problems" 16:13
jlaska so I think we're good there 16:13
jlaska 16:13
jlaska there was 1 page left that I was unclear how folks wanted that 16:13
jlaska #info So the only open item on my list is ... should KernelBugTriage be renamed to How to debug kernel problems? 16:14
jlaska I'll follow up with cebbert before renaming that page 16:14
jlaska besides, I think that page is more about traiging and not so much debugging, but could be wrong 16:15
jlaska that's all I had recorded for last week, any other items before we dive into the agenda? 16:15
jlaska Okay ... then first topic up ... 16:16
jlaska #topic Viking_Ice locale test suggestion 16:16
jlaska #link https://www.redhat.com/archives/fedora-test-list/2009-October/msg00503.html 16:16
jlaska Viking-Ice: you raised this on f-t-list this past week, sounds like you felt this is something that could be automated? 16:17
Viking-Ice yup give me sec.. 16:17
jlaska sure 16:17
jlaska Viking-Ice: want us to come back to this topic? 16:20
Viking-Ice yup 16:20
jlaska alright ... I'll move that to the end 16:21
jlaska the next topic is around a discussion that milos Jakubicek and adamw had ... I'll save that for when Adamw returns 16:21
jlaska #topic Marcela Maslanova test day proposal 16:22
adamw morning - sorry, I overslept 16:22
jlaska adamw: welcome morning ... 16:22
jlaska you need a few minutes? Or should we jump back to the FTBFS topic? 16:22
adamw go for it 16:23
jlaska okay ... just a quick update on the current topic 16:23
jlaska pknirsch is will be providing a formal summary of last weeks power management test day 16:23
jlaska but I also received some updates from Marcela Maslanova around his experiences creating a test day rpm with automated scripts 16:24
jlaska not sure if everyone had a chance to participate in this last event ... there's always time to jump in 16:24
jlaska #link Test_Day:2009-10-22 16:24
kparal *her* experience :) 16:25
jlaska kparal: doh, thank you :) 16:25
jlaska Just a summary for me ... the test day was awesome from a preparation stand-point 16:26
jlaska you download a test day rpm ... and each of the tests was a script provided by the package 16:26
jlaska so, the only thing I wanted to raise here was just around building on this process 16:26
jlaska I know that not all test day topics are as easily automated 16:26
jlaska but certainly need help from folks in identifying ways to automate future test days in much the same format that Marcela and team have 16:27
jlaska installer might be one of those easy topics (w/ virt) 16:27
jlaska I suspect X might not be very easy 16:28
jlaska anyhow ... unless any other thoughts there ... let's jump back to FTBFS 16:28
jlaska #topic Milos Jakubicek suggestion on FTBFS bugs 16:28
jlaska adamw: you want to take it away? 16:28
adamw well it's milos' idea, but I can explain what he told me 16:29
jlaska go for it 16:29
adamw #link http://mjakubicek.fedorapeople.org/need-rebuild.html 16:29
adamw that's a list of remaining packages that did not rebuild in the f12 mass rebuild, with most false positives taken out (there's still a couple in there) 16:29
adamw milos' suggestion is that we make sure FTBFS (fails-to-build-from-scratch, it's a debian term) bugs are filed for each one 16:30
jlaska aha ... was trying to parse that acronym ... thx 16:30
adamw we didn't get into any details of how exactly to arrange it, but it seemed like a decent idea to me 16:30
adamw i suggested he come to the meeting to discuss it but obviously couldn't make it 16:31
jlaska I saw him earlier in #fedora-qa ... but he dropped off 16:31
Oxf13 here now. 16:32
adamw hi oxf13 16:32
adamw so, that's the idea, pretty much. if anyone has any thoughts go ahead 16:32
jlaska are these things that should be lined up prior to F-12 GA? 16:32
jlaska if they weren't rebuilt ... what's the fallout (packages that contain .fc11 in the name)? 16:33
adamw there's no terrible fallout, but making sure all packages build is good policy 16:33
jlaska esp given a recent self-hosting blog post 16:34
adamw it's possible some of them won't work any more till they get rebuilt, and if you leave it too long you wind up with a giant backlog of crusty packages (i speak from experience) 16:34
* Viking-Ice ready now :) 16:34
adamw doing it before f12 ga would be nice but not essential, they can always be pushed as updates and anyway it'd be good for future releases too 16:34
jlaska I'd be curious for Oxf13's take ... I know Jesse was closely involved with the mass rebuild 16:34
Oxf13 if they're non crit-path packages, I have no issue with tagging them up until we hit RC 16:35
* jlaska wonders if python-bugzilla can help here 16:35
adamw i think they all are, looking at the list, they're mostly pretty obscure 16:35
jlaska yeah 16:35
jlaska I don't see anything wrong with filing bugs to track this stuff, that's the suggestion right? 16:36
adamw jlaska: it may, except it's useful to provide a note of the build failure message in ftbfs bugs, which wouldn't be straightforward to automate. 16:36
adamw yes 16:36
jlaska adamw: good point 16:36
mether adamw, http://fedoraproject.org/wiki/FTBFS FYI 16:36
adamw although the idea is specifically to do it as a 'project' within QA, not just to say 'filing these bugs is a good idea'. though I didn't get milos' thoughts on specifically how he wanted to arrange it. 16:37
adamw mether: ah thanks 16:37
mether Matt Domsch does a mass rebuild now and then as a QA measure 16:37
adamw that seems to claim that bugs 'will' be filed, implying it happens automatically 16:37
mether he has scripts that do that 16:38
Oxf13 and he autofiles bugs for the failures. 16:38
adamw oh, yeah, milos did point to that same F12FTBFS list, but noted that there are 39 bugs on it 16:38
Oxf13 using python-bugizlla 16:38
adamw whereas the list of packages he provided is rather longer than 39 16:38
Oxf13 his pass happened a month or so before my pass 16:38
adamw #link https://bugzilla.redhat.com/showdependencytree.cgi?id=511348&hide_resolved=1 16:38
adamw anyway, i'm sensing we need milos to explain his idea more fully either at next week's meeting or on the ml :) 16:39
jlaska yeah, let's carry the topic fwd? 16:39
adamw ok 16:39
jlaska definitely open to the idea, but nothing tangible is coming to me other than one person walking down a list? 16:39
Oxf13 yeah, I haven't read the email yet 16:40
adamw it could be done as a group thing, but i think we should clarify whether it needs to happen and why his list is longer than the bugs filed by matt's thingy and so on 16:41
Oxf13 his list is longer because more things failed in my pass 16:41
Oxf13 and I didn't autofile bugs 16:41
adamw ah, ok. 16:41
adamw anyway, i'll take an action item to ask him to follow-up at next week's meeting or on the list 16:42
jlaska #action adamw will ask Milos to follow-up at next week's meeting or on the list on the FTBFS topic 16:42
jlaska okay, shall we jump back to Viking-Ice's topic? 16:43
jlaska #topic Viking_Ice locale test suggestion 16:43
jlaska #link https://www.redhat.com/archives/fedora-test-list/2009-October/msg00503.html 16:43
Viking-Ice basically this is what I had in mind.. 16:43
jlaska Viking-Ice: take it away my good man 16:43
Viking-Ice http://fpaste.org/GuOk/ 16:43
* adamw -> biobreak 16:44
Viking-Ice A test case that checks if keyboard layout is correct after install reports if not 16:44
jlaska Viking-Ice: would we then want to iterate over installing using different lang/keymap settings ... and run this script? 16:44
jlaska #link http://fpaste.org/GuOk/ 16:45
Viking-Ice I dont think we need to parse all of them 16:45
Viking-Ice a single test should suffice and we should be able to add this to a current installation test 16:46
jlaska Viking-Ice: for this test to fail now, you need to install with a non US lang and keymap? 16:46
Viking-Ice in the ks file set the keyboard to a none us layout ( keyboard is-latin1 ) 16:47
Viking-Ice jlaska: it's the other way around it fails if it's not what we defined in keyboard 16:48
jlaska Viking-Ice: seems like there is a enough to write a wiki Test_Case: for this 16:48
Viking-Ice why ? 16:48
Viking-Ice this should be automated 16:48
jlaska gotta have a test before you automate 16:48
jlaska Seems like it should be yeah 16:49
jlaska but if we just write automation with no background or indication of the steps required, it's not really clear for people outside the group why that test exists 16:49
Viking-Ice how do you wiki-fi for autoqa ? 16:49
jlaska well, for israwhidebroken ... we have QA:Rawhide_Acceptance_Test_Plan 16:49
jlaska once we have a test case, for me, the next step is determining where it's best to automate this 16:50
Viking-Ice guess it would be added here QA:Anaconda_package_install_test_case 16:50
jlaska whether it's a generally useful thing that affects how usable rawhide is - 'israwhidebroken' 16:50
Viking-Ice but ok 16:50
adamw Viking-Ice: no, that's a different test case. 16:50
adamw test cases should be single purpose, not a clump of different tests in one. 16:51
jlaska lili and rhe are currently looking into automating the current test matrix ... I think your case would fit perfectly there 16:51
Viking-Ice Basic Functionality <-- then ? 16:51
wwoods No. RATS is supposed to be a super-simple basic test 16:51
adamw it would be a new test case, with its own name. 16:51
Viking-Ice ah ok 16:51
wwoods you're talking about something for a more exhaustive test plan 16:51
jlaska yeah ... I'd see this case being added to the list here QA:Fedora_12_Install_Test_Plan 16:52
wwoods it's called the Acceptance Test Plan because it sets out the criteria for judging whether we can even accept a rawhide tree for *real* testing 16:52
wwoods you're talking about defining one of the cases for the *real* testing 16:52
wwoods which is awesome and exciting 16:52
wwoods but, yeah, falls outside of the rawhide acceptance test plan 16:52
jlaska Viking-Ice: that test matrix you see floating aroudn is something that would come into play after wwoods's rats plan 16:52
jlaska and it's light on validating any i18n tests ... it could use this 16:53
Viking-Ice ok what's usually done with the output from those test ( OK fail ) mailed etc.. 16:53
jlaska That's what they're investigating now ... very *early* stages 16:53
adamw the tests in the test matrix are done manually, you see Liam Li send out mails every so often for that testing 16:53
wwoods depends on how you write the test. right now it gets stuffed into the autotest UI; we have the RATS tests also sending email when they complete 16:54
wwoods you can decide what you want it to do 16:54
adamw autoqa tests are run regularly and results mailed to a special mailing list at present, but automating tests is more complex and hasn't been done for all tests yet 16:54
jlaska and I think you've got a good test case here to cover recent non-US lang/keymap failures 16:54
jlaska so it'll be a bit before we have the full test matrix automated 16:55
jlaska so I'd start with getting the test case defined and added to the install test plan 16:55
jlaska how do others feel? 16:55
Oxf13 worksforme 16:55
Viking-Ice this checks for what is essentially what maintainer asked for on bug 530452 16:55
buggbot Bug https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=530452 high, low, ---, jmccann, MODIFIED, Gnome sets the keyboard layout to USA after every log in 16:55
jlaska Viking-Ice: yeah, we certainly need more testing there 16:56
Viking-Ice so what additional steps do we take from here.. 16:57
jlaska basically, create a wiki test case and propose adding it to the current install test matrix 16:57
Viking-Ice ok 16:57
jlaska I think that's the first step 16:57
jlaska the follow-on steps will be around automating that large matrix ... I don't have any updates on that front, other than that's a topic Liam and Rui have started investigating 16:58
jlaska Viking-Ice: but this way, if we've go tthe test case ... it won't get lost 16:58
jlaska anyone want to take an action item to create the test case and request addition to the matrix? 16:58
Viking-Ice guess me I suppose with guided hand :) 16:59
jlaska hehe ... thanks! 16:59
adamw Viking-Ice: it's pretty straightforward to create a test case, it's just a wiki page based on a template; edit any existing test case to see how it's done 16:59
Viking-Ice or review patients :) 16:59
jlaska #link Template:QA/Test_Case 16:59
adamw Viking-Ice: but feel free to ping me if you're having trouble 16:59
jlaska #action Viking-Ice investigating creating a test case for bug#530452 ... and adding to F12 install matrix 17:00
buggbot Bug https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=530452 high, low, ---, jmccann, MODIFIED, Gnome sets the keyboard layout to USA after every log in 17:00
jlaska Viking-Ice: fedora-qa tickets will come into play here soon 17:00
jlaska once we have an idea on how to proceed on the matrix automation front 17:01
jlaska alright, any other updates on this topic, or shall we jump to autoqa? 17:01
jlaska okay ... autoqa time 17:02
jlaska #topic AutoQA Updates from wwoods and kparal 17:02
jlaska wwoods: kparal: what's up in your realm? 17:02
kparal ok, news from the rpmguard world: 17:02
kparal I have posted a blog about rpmguard 17:02
kparal http://kparal.wordpress.com/2009/10/21/rpmguard-print-important-differences-between-rpms/ 17:02
kparal and I also wrote to some mailing lists. 17:02
kparal maybe you have noticed 17:02
jlaska #link http://kparal.wordpress.com/2009/10/21/rpmguard-print-important-differences-between-rpms 17:03
kparal there was some feedback, skvidal posted me a link to his mungingdiff 17:03
kparal http://skvidal.fedorapeople.org/misc/mungingdiff.py 17:03
kparal but I'm not sure if there are parts inside which I haven't already implemented in rpmguard 17:03
kparal also alexey torkhov suggested to leverage rpmsodiff in my tool. I have created a ticket for that, because I have decided to look at it a little later: 17:03
kparal https://fedorahosted.org/autoqa/ticket/75 17:03
kparal the upcoming task is to look at the watcher wwoods is working on and integrate rpmguard into autoqa to have it up and running 17:04
jlaska #info the upcoming task is to look at the watcher wwoods is working on and integrate rpmguard into autoqa to have it up and running 17:04
wwoods so, yup - we've got a basic watcher for koji 17:04
wwoods it's ready to be run and picks up every new build in a set of koji tags that we specify 17:04
kparal so, for my script the important part would be to find out the version and the link of the previous package release. to have something to compare 17:05
wwoods right - the tests for that hook will likely get a package NVR and/or package name as input 17:05
wwoods but I'm writing a library to take e.g. a package NVR and tag and give you the previous released versions of that package 17:06
wwoods or rather, I have written that tool 17:06
kparal is it in the git atm? 17:06
wwoods and it will be available for use in post-koji-build tests 17:06
wwoods not yet 17:06
jlaska sweet 17:06
kparal looking forward to it 17:06
Oxf13 hrm. 17:06
wwoods I need to rearrange the autoqa library stuff a little bit so the tests can share code like this better 17:06
Oxf13 it might make more sense to compare to the previous shipped package, rather than the previous built package 17:06
wwoods Oxf13: I said "previously released" 17:07
Oxf13 (would make it a lot easier to discover too) 17:07
Oxf13 wwoods: oh sorry, missed that 17:07
kparal very good point, nice 17:07
wwoods to go into more detail: you give it a package name (e.g. "preupgrade") and a tag (e.g. "dist-f12-updates-candidate") 17:07
jlaska #info basic watcher for koji in place. picks up every new build in a set of koji tags that we specify 17:07
wwoods we have some data that indicates which other tags to check for that 17:08
wwoods i.e. "dist-f12-updates-candidate" -> "dist-f12" and "dist-f12-updates" (iirc) 17:08
Oxf13 wwoods: (not to distract, but wouldn't dist-f12-updates(-testing) be more appropriate? not all -candidate builds get shipped) 17:08
jlaska #info wwoods has a library soon to be added to git repo which takes a package NVR and tag and provides the previous released versions of that package 17:08
Oxf13 wow, n/m. 17:08
wwoods so then it asks koji for the NVR of the packages with those specific tags 17:08
wwoods right, the point is that the watcher sees the build land in -candidate 17:08
wwoods and the test can use this library call if it needs to know the corresponding version for -updates or -updates-testing or the GA 17:09
jlaska wwoods: cool, so it walks the tag inheritance chain? 17:09
wwoods not explicitly, no 17:09
wwoods we have to keep a mapping in autoqa that tells us which "parent" tags to check for a given -candidate 17:09
wwoods we already have a mapping like this in the other watchers 17:10
jlaska wwoods - keepin' it simple 17:10
wwoods e.g. https://fedorahosted.org/autoqa/browser/hooks/post-repo-update/watch-repos.py 17:10
jlaska right on 17:10
wwoods so I'm thinking we need to move the data from line 30-76 17:10
wwoods which is also in https://fedorahosted.org/autoqa/browser/hooks/post-tree-compose/watch-composes.py 17:11
wwoods and keep a shared autoqa.repoinfo data structure 17:11
Oxf13 yeah, that sounds good 17:11
jlaska +1 17:11
Oxf13 we could make a watcher library 17:11
wwoods which may be provided by a config file (so we don't have to update the package just to tweak the inheritance/URLs/etc) 17:11
Oxf13 that includes the mapping, and any other common stuff, then each watcher script could import the library 17:11
wwoods Oxf13: yep, that's the plan - gonna have an autoqa library for the server-side stuff (watchers etc) 17:12
Oxf13 rock 17:12
Oxf13 it's like... real software development 17:12
wwoods and one for the test stuff (like the things in rats.py and virtguest.py) 17:12
wwoods (and the proposed koji-interfacing stuff I mentioned for post-koji-build) 17:12
adamw Oxf13: maybe we need something to automatically check whether there's any bugs in it =) 17:12
Oxf13 adamw: crazy talk. 17:12
wwoods I should roadmap out this plan but I was upgrading my workstation to F12B last week 17:13
wwoods but yeah now that I think of it, I'm going to give myself an action to do that 17:13
* jlaska pulls out the meetbot action pen 17:13
jlaska wwoods: are these post irb.com things? 17:14
wwoods #action wwoods to add roadmap/tickets for reworking shared autoqa code (watchers, test helper methods, etc) into a proper library 17:14
jlaska oh thanks ... u did it for me :) 17:14
wwoods jlaska: yes, this is a different milestone in my opinion 17:14
jlaska #info update from mmcgrath on hardware the hardware delivery ... looking at Nov 20 17:15
wwoods oh also! I'd like to mention http://wwoods.fedorapeople.org/files/critical-path/critpath.py 17:15
wwoods which was rewritten to be dead stupid simple to use 17:15
wwoods you run that script, it solves critpath and writes critpath.txt 17:15
jlaska #link http://wwoods.fedorapeople.org/files/critical-path/critpath.py 17:16
Oxf13 I do believe jwb was going to integrate that with the rawhide compose 17:16
wwoods Oxf13: excellent! 17:16
Oxf13 so that we'd have a written out critpath just like we do the depsolve and repodiff 17:16
jwb yes. need to get back to that, but i've been sick 17:16
jlaska Oxf13: so that output would be in the mash log dir for each rawhide compose? 17:16
Oxf13 which would give us a static url, http://kojipkgs.fedoraproject.org/mash/rawhide/logs/critpath.txt 17:16
Oxf13 jlaska: yes 17:16
jlaska delicious! 17:16
wwoods after warren's confusion using the months-old deplist.txt I had sitting in my people.fp.o page I want to make sure everyone knows how this works 17:16
Oxf13 "mash/rawhide" is a symlink that gets updated each compose 17:17
wwoods oh man that would be totally aces 17:17
jwb it will be dated, but yeah 17:17
jlaska thanks jwb 17:17
wwoods I'll do whatever I can to help get that integrated 17:17
wwoods dated as in it'll have a date on it 17:17
wwoods not "it'll be kind of old" 17:17
wwoods right? 17:17
jwb wwoods, you did a lot already. i just need to take your script and add it to the releng git repo, etc. yes, dated as in 'critpath-<date>.txt' 17:17
Oxf13 jwb: dated? What will be dated? 17:18
Oxf13 hrm. 17:18
jwb the file itself 17:18
Oxf13 jwb: it might be better to not date it, so that we have a static URL 17:18
Oxf13 it'll already be in a dated directory 17:18
wwoods it'll be in a datestamped *directory*.. yeah 17:18
jwb oh, true 17:18
jwb ok, wfm 17:18
jwb i was still going off of the 'will be on mirrors' idea 17:19
jlaska #info jwb working to integrate critpath script into daily rawhide compose process 17:19
jlaska wwoods: kparal: great updates thx ... anything else to note for the logs? 17:19
wwoods oh 17:20
wwoods autoqa-devel! 17:20
jlaska ah yes 17:20
wwoods https://fedorahosted.org/mailman/listinfo/autoqa-devel 17:20
jlaska and atodorov gets points for being the first poster 17:21
jlaska I don't know if it needs this or not ... 17:21
jlaska #link https://fedorahosted.org/mailman/listinfo/autoqa-devel 17:21
Oxf13 blah, more lists I should probably be on 17:21
* jeff_hann here...sorry I'm late 17:22
jlaska jeff_hann: thanks for joining ... just about to go to open floor 17:22
wwoods yeah, Yet Another Mailing List, but honestly we avoided it as long as we possibly could 17:22
wwoods and eventually determined that we really need a mailing list after all 17:22
jlaska Thanks for the updates wwoods and kparal ... lots of progress 17:23
jlaska so ... I'm going to skip ahead and jump back on the agenda 17:23
jlaska #topic Upcoming QA events - 2009-10-29 - i18n Test Day 17:23
jlaska #link Test_Day:2009-10-29 17:23
jlaska #info Looking for volunteers 17:24
jlaska Rui and Jens pulled together the test day wiki page. I think it looks pretty good 17:24
jlaska but we could use more volunteers to help with i18n testing this Thursday 17:24
jlaska if you're interested, feel free to add a watch to the wiki page 17:25
jlaska or add yourself to the cc list of the tracking ticket 17:25
adamw also poke any chinese/japanese/korean speakers you know :) 17:25
jlaska #link https://fedorahosted.org/fedora-qa/ticket/25 17:25
jlaska adamw: yes please! 17:25
jlaska I'm personallyn not well versed in i18n verification ... so more eyes are needed to review the plan and propose changes 17:26
jlaska and of course ... help test :) 17:26
jlaska #topic Upcoming QA events - 2009-10-30 - Blocker Bug Day #2 17:26
jlaska Kudos to adamw and Oxf13 for walking through the list not once, but twice last week 17:26
adamw we are shooting for this blocker bug meeting to end slightly before the heat death of the universe 17:26
jlaska #link https://bugzilla.redhat.com/showdependencytree.cgi?id=473303&hide_resolved=1 17:27
jlaska adamw: ouch, no kidding :) 17:27
jlaska recap from last meeting ... 17:27
jlaska #link https://www.redhat.com/archives/fedora-test-list/2009-October/msg00579.html 17:27
jlaska Under the column ... how can I help ... 17:27
jlaska add block:F12Blocker for issues you feel affect a fair number of users, or are just plain embarrasing 17:28
jlaska If you are assigned or on the cc list of a blocker list bug ... you can help in advance by ensuring the bug is up-to-date 17:28
jlaska adamw: anything else you can think of? 17:28
adamw not really - more people coming to the meeting to help review the bugs is always welcome 17:29
jlaska agreed! 17:29
jlaska adamw: something about more eyes right? :) 17:29
adamw more eyes make all arguments longer, yes 17:30
jlaska bingo! 17:30
jlaska okay, moving along ... 17:30
jlaska #Topic Open discussion - <Your topic here> 17:30
jlaska anything else not covered that is of interest? 17:31
jlaska concerns, questions, complaints ... favorite color? 17:31
Oxf13 Who all is going to FUDCon ? 17:31
jeff_hann just for information value, I have several kernel bugs I'm working on 17:31
wwoods I'll be at FUDCon 17:32
Oxf13 wwoods: good, I want to get people talking about the message bus, and what kind of data you'd need from it for autoqa et al 17:32
adamw I am 17:32
adamw Jeff_S: wrong meeting, but did you get in touch with rjune regarding kernel triage in the end? 17:32
adamw grr 17:32
adamw jeff_hann: ^^^ 17:33
Jeff_S adamw: no :) 17:33
adamw Jeff_S: go away, WrongJeff =) 17:33
Jeff_S lol 17:33
jlaska heh 17:33
Oxf13 so I signed up to do an update on AutoQA, but since wwoods will be there, perhaps wwoods should take over that pitch? 17:33
jeff_hann :) 17:33
jeff_hann will do that 17:33
wwoods Oxf13: sure, I can do that 17:34
jlaska Oxf13: we're planning for a blitzkrieg of autoqa information for the FUDCon 17:34
wwoods we're hoping to be able to give a status update and demonstrate a prototype for how maintainers can add post-build tests right in pkgcvs 17:34
Oxf13 rock 17:34
jlaska okay gang ... I think we can put a fork in this meeting 17:35
jlaska thanks everyone for joining and providing your $0.02 17:35
jlaska As usual, minutes will be on the mailing list soon 17:36
adamw thanks jlaska 17:36
jlaska #endmeeting 17:36

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!