QA/Meetings/20090401

From FedoraProject

Jump to: navigation, search

Contents

Attendees

  • Will Woods (wwoods)
  • Adam Williamson (adamw)
  • James Laska (jlaska)
  • Jóhann Guðmundsson (viking_ice)
  • Jesse Keating (f13)

Previous meeting follow-up

  • [jlaska+adamw] mediawiki semantic update (packaging and hosting)
    • REVIEWED - 490001 - Review Request: mediawiki-semantic - The semantic extension to mediawiki
    • UNDER REVIEW - 490171 - Review Request: mediawiki-semantic-forms - An extension to MediaWiki that adds support for web-based forms
      • User:tibbs posted some additional concerns for mediawiki-semantic-forms around licensing which I haven't followed up on yet
      • request infrastructure hosting
  • [f13+wwoods] - autoqa status update
    • wwoods checked in an initial verifytree test case
    • f13 hoping to make a watcher for post-tree-compose
    • Next steps ...
      1. focus on the tree based tests
      2. figuring out better reporting for the existing tests
  • [wwoods] - to add some upgrade test cases to the beta results page (and template)
    • No upgrade cases added yet
  • [wwoods] - document any upgrade issues in the Beta release notes
    • Bug#492516 added to release notes

F-11-Beta - who/what/when/where/why?

The beta was released! See announcement from Jesse Keating - https://www.redhat.com/archives/fedora-test-list/2009-March/msg01262.html

Open discussion

F10 syslinux package

Adamw noted that livecd-iso-to-disk is failing on F10 systems when trying to create F11 live images. A lot of Test Day testers are writing their live images only to find the systems are not bootable due to a bug in the F10 syslinux package.

Schedule Change proposal

Wwoods provided an update on the initial schedule proposal raised in the previous meeting. After discussion and research, concluded this effort is not worth continuing. Instead, time should be spent on better tools for testing and reporting, so we can do more efficient testing.

Communication of Beta Known Issues

  • jlaska asked how well we are holding up with our conclusion from the previous week.
  • Adamw suggested that while the announcement links to the release notes, it doesn't specify the Known issues. Perhaps this could change for future milestones (check-in with Rahul)?
  • Wwoods reminded us about Warren Togami's rawhide status blog - http://rawhidewatch.wordpress.com/

Fedora Calendaring System

Adamw noted that the infrastructure team is moving closer to infrastructure hosted calendaring system. More details on fedora-infrastructure-list (https://www.redhat.com/archives/fedora-infrastructure-list/2009-March/msg00266.html).

Upcoming QA events

Action items

  • [wwoods] - autoqa: work on better (clearer) reporting from existing tests
  • [f13] - autoqa: work on monitor for post-tree-compose
  • [adamw] - will file a F10 bug for the syslinux issue, initiate discussion with pjones or jeremy for building a updated F10 package
  • [jlaska] - check-in with Warren Togami on the rawhidewatch blog ... can Fedora QA help ... what is his vision?
  • [jlaska+wwoods] - discuss integration between lab-in-a-box and autoqa

Next QA meeting

The next meeting will be held on 2009-04-08 16:00 UTC

IRC Transcript

--- | jlaska has changed the topic to: Fedora QA meeting | gathering people Apr 01 12:00
jlaska | Fedora QA meeting starting shortly, we'll get things moving shortly ... Apr 01 12:01
jlaska | show of hands if you're around Apr 01 12:02
jlaska | ping adamw: wwoods: f13: viking_ice ... and any other QA meeting attendees I've missed :) Apr 01 12:04
viking_ice | hellú.. Apr 01 12:04
jlaska | viking_ice: Ahoj :) Apr 01 12:05
adamw | yo Apr 01 12:05
jlaska | adamw: heyo! Apr 01 12:05
jlaska | wwoods: is back! Apr 01 12:06
wwoods | WITH A VENGEANCE Apr 01 12:06
wwoods | wait, no, just back Apr 01 12:06
wwoods | jlaska: you logging? Apr 01 12:06
jlaska | heh, no bruce willis please :) Apr 01 12:06
jlaska | wwoods: indeed ... go for it Apr 01 12:06
jlaska | we've got viking_ice, adamw and myself so far Apr 01 12:06
wwoods | well, first things - review last week's minutes/actions Apr 01 12:07
--- | wwoods has changed the topic to: Fedora QA Meeting | review Apr 01 12:07
* | wwoods trying to find the log Apr 01 12:08
jlaska | https://www.redhat.com/archives/fedora-test-list/2009-March/msg01142.html Apr 01 12:09
* | viking_ice does yet another manual install test of beta.. Apr 01 12:09
wwoods | https://fedoraproject.org/wiki/QA/Meetings/20090325 Apr 01 12:09
wwoods | first - mediawiki plugin fun. any updates? Apr 01 12:09
jlaska | wwoods: no updates there I'm afraid. tibbs|h posted an update in the mediawiki-semantic-forms review with some additional licensing concerns Apr 01 12:10
jlaska | I need to follow-up on that and then continue with the review for that package Apr 01 12:10
jlaska | I'll follow-up with the infrastructure guys to get a live dump of the database ... it was requested that we hold off on that until post-beta Apr 01 12:11
wwoods | 'kay Apr 01 12:12
adamw | nothing further from me there either Apr 01 12:12
f13 | I'm here, sorry for the delay Apr 01 12:12
wwoods | f13: no worries Apr 01 12:12
wwoods | next, radeon test day. it's happening RIGHT NOW OMG Apr 01 12:12
wwoods | next, open installer bugs -> F11Beta. Well, Beta's out, so we don't need to worry about maintaining that as much Apr 01 12:13
wwoods | we *do* need to be sure that F11Beta blocks F11Blocker so we get those weeded out for Final. Apr 01 12:13
--- | stickster is now known as stickster_afk Apr 01 12:14
jlaska | we spent some time on that Friday ... and a few more additions this week Apr 01 12:14
<-- | mcepl [n=mcepl@49-117-207-85.strcechy.adsl-llu.static.bluetone.cz] has left #fedora-meeting ( ) Apr 01 12:14
jlaska | specifically ... https://fedoraproject.org/wiki/Fedora_11_Beta_release_notes#Anaconda_installer_issues Apr 01 12:14
wwoods | next was adding stuff to the test result template Apr 01 12:14
wwoods | I haven't added upgrade cases. jlaska, anything from the Beta page you need to add back to the template? Apr 01 12:15
jlaska | I took that action item from last week ... but with help from wwoods, I've carried my changes from the Beta wiki into the template Apr 01 12:15
wwoods | next was adding known install/upgrade issues to the release notes Apr 01 12:16
wwoods | jlaska already covered that Apr 01 12:16
adamw | how about the thing about live CD -> usb creation Apr 01 12:16
viking_ice | that should really be fixed.. Apr 01 12:16
viking_ice | asap Apr 01 12:16
wwoods | everything I'm aware of wrt. upgrades is already in the release notes Apr 01 12:17
jlaska | wwoods: we have the blurb about preupgrade iirc Apr 01 12:17
wwoods | yeah, someone should add a release note about doing livecd-iso-to-disk Apr 01 12:17
wwoods | jlaska: right Apr 01 12:17
wwoods | "Upgrading to Fedora 11 Beta from Fedora 10 using preupgrade will fail" Apr 01 12:17
wwoods | pretty clear Apr 01 12:17
jlaska | what's the release note around livecd-iso-to-disk ... the syslinux issue? Apr 01 12:17
wwoods | yeah - it won't boot if you create it in F10 or earlier Apr 01 12:18
adamw | yep Apr 01 12:18
wwoods | installing new syslinux is a workaround Apr 01 12:18
adamw | for now a note to upgrade syslinux from rawhide Apr 01 12:18
adamw | probably we should ship a syslinux upgrade for f10 or something Apr 01 12:18
wwoods | indeed Apr 01 12:18
jlaska | is there a bz on this against F10? Apr 01 12:18
adamw | not sure, i can file one if needed Apr 01 12:19
jlaska | looks like spot, f13, and jeremy are the most recent folks to touch syslinux in f11 Apr 01 12:20
f13 | only by accident (: Apr 01 12:21
jlaska | f13: do you know what would be in the way of buildinga new syslinux package for F10 that lets testers use F10 livecd-iso-to-disk with Rawhide images? Apr 01 12:21
jlaska | f13: heh, yeah I know what you mean ;) Apr 01 12:21
f13 | I don't now of anything standing in the way Apr 01 12:22
jlaska | okay Apr 01 12:23
f13 | but I'm not really familiar with the package itself. Apr 01 12:23
jlaska | f13: would spot or jeremy be good contacts? Apr 01 12:23
f13 | more like peter or jeremy Apr 01 12:23
jlaska | okay Apr 01 12:23
jlaska | adamw: would you mind getting a bz in for that? Apr 01 12:24
adamw | will do Apr 01 12:24
wwoods | we'll get that bug id into the release notes, document the workaround, and talk to pjones/jeremy about updating F10 (and F9?) syslinux to fix the bug Apr 01 12:24
wwoods | that should cover it Apr 01 12:24
wwoods | finally, the review meeting happened and we pushed the big green button Apr 01 12:25
wwoods | Beta went out, hurrah. Apr 01 12:25
jlaska | wwoods/f13: did you guys also want to do an update on autoqa? Apr 01 12:25
* | jlaska looking over previous minutes Apr 01 12:26
wwoods | oh, sure Apr 01 12:26
wwoods | let's do that Apr 01 12:26
f13 | I haven't touched it since the beta rush, looking forward to touching it today Apr 01 12:26
--- | wwoods has changed the topic to: Fedora QA Meeting | autoqa Apr 01 12:26
wwoods | yeah, I poked at it yesterday Apr 01 12:26
wwoods | and checked in an initial verifytree test case Apr 01 12:26
wwoods | we don't have a watcher for post-tree-compose, but we have one test case for it Apr 01 12:26
wwoods | heh Apr 01 12:26
jlaska | is this something one can run manually now? Apr 01 12:27
wwoods | I'm going to need to work on making tests interdependent, so we can stop testing if verifytree fails Apr 01 12:27
wwoods | but the next thing to do would be some qemu-based boot smoketest Apr 01 12:27
f13 | I'm hoping to make a watcher for post-tree-compose Apr 01 12:27
wwoods | (i.e. the lab-in-a-box stuff we talked about at FUDCon) Apr 01 12:27
wwoods | jlaska: sure, but you need to install autoqa and have a tree available at a local path Apr 01 12:28
jlaska | "install" ... from a git checkout? Apr 01 12:28
wwoods | yeah. git clone and make install Apr 01 12:28
jlaska | cool, what are the tests that you guys have now? Apr 01 12:29
wwoods | at the moment there's two hooks - post-repo-update and post-tree-compose Apr 01 12:30
wwoods | each has one test - repoclosure and verifytree, respectively Apr 01 12:30
jlaska | very nice Apr 01 12:30
jlaska | okay, is there anything you guys want to check-in on next week wrt autoqa ... or should we just leave as a general update again? Apr 01 12:31
wwoods | general update should be fine - with a little luck we should able to be running both hooks regularly by next week Apr 01 12:31
wwoods | but don't hold me to that Apr 01 12:31
jlaska | what if we just focus on repoclosure? Apr 01 12:32
jlaska | getting feature parity with the emails that go out now? Apr 01 12:32
jlaska | is that easier/harder/interesting? Apr 01 12:32
wwoods | f13: didn't we have that running on a host somewhere? Apr 01 12:32
f13 | qa1 Apr 01 12:32
f13 | its a tad... verbose Apr 01 12:33
jlaska | would it be easier to focus on ironing out the quirks with tests that don't require installs just yet Apr 01 12:33
f13 | we may want to re-think how it works. Apr 01 12:33
f13 | combining output into single mails or not Apr 01 12:33
f13 | yeah, I think willl and I could focus on the tree based tests Apr 01 12:34
* | jlaska suspects that adding cobbler/kvm/lab-in-a-box to the mix won't make things tremendously easier Apr 01 12:34
wwoods | right Apr 01 12:34
f13 | in parallel with lab-in-a-box work Apr 01 12:34
jlaska | I'd really like to plug in the lab-in-a-box stuff to what you guys are doing ... but there are a few "missing links" for me right now Apr 01 12:34
wwoods | well, we're designing the test system around the tests we have available Apr 01 12:34
wwoods | so you can't design the tests around the test system Apr 01 12:35
wwoods | or else: infinite recursion Apr 01 12:35
* | jlaska is convinced life is about infinite recursion Apr 01 12:35
jlaska | wwoods: yeah I see what you're saying ... I'll try to get in the loop with you guys to see how I can wedge what I've got into your framework Apr 01 12:36
wwoods | yeah, I'm joking, that'll work fine Apr 01 12:36
wwoods | but I'll need to talk to you about how we can make sure the autoqa stuff can launch (and process the results of) lab-in-a-box tests Apr 01 12:36
wwoods | we don't need to set that up, just need to make sure the framework can handle it Apr 01 12:36
jlaska | wwoods: okay, I see a sync-up with us in the week :) Apr 01 12:36
jlaska | yeah Apr 01 12:36
jlaska | cool, nice work guys! Apr 01 12:37
wwoods | but figuring out better reporting for the existing tests is the first thing on the agenda for me Apr 01 12:37
wwoods | and I think f13 will be assisting with that and working on a monitor script for post-tree-compose Apr 01 12:37
* | wwoods worries about re-inventing gridtrees.py Apr 01 12:37
jlaska | meh, if it works ... who cares what it looks like for now :) Apr 01 12:38
jlaska | just call it gridtrees2.py Apr 01 12:38
jlaska | :D Apr 01 12:38
wwoods | yeah, but we have to learn from our (old, non-public) mistakes Apr 01 12:38
jlaska | definitely! Apr 01 12:38
viking_ice | for the record the lab-in-the-box some thing that the end user execute or is the plan to being able to remotely execute the tests Apr 01 12:39
viking_ice | ( basically just leaving the end user up to supplying hw ) Apr 01 12:39
f13 | we won't be watching a .py file to be updated, we'll watch a path (: Apr 01 12:39
jlaska | viking_ice: wwoods or f13 can correct me, but my thinking was the same stuff we'd run in an automated fashion, could be installed and run by users Apr 01 12:39
wwoods | viking_ice: the idea is that the lab-in-a-box stuff should allow automated install testing on any machine capable of virtualization Apr 01 12:40
jlaska | f13: haha :) Apr 01 12:40
viking_ice | and the test que.. setup.. Apr 01 12:40
wwoods | right - so users could run it, but we'll be most interested in having it running somewhere inside the fedora infrastructure - or at someone's desk Apr 01 12:40
wwoods | whatever, so long as we get testing Apr 01 12:40
viking_ice | as in the user fetches test cases ( kickstarts file etc ) and executes them.. Apr 01 12:40
jlaska | viking_ice: that's a great plan for the future Apr 01 12:41
wwoods | we're not there yet, though Apr 01 12:41
wwoods | but yeah, that's a good plan for the future stuff Apr 01 12:42
wwoods | the only other thing I had on my mind was the schedule proposal I mentioned last week Apr 01 12:42
wwoods | I did some research and talked to people and did some planning and whatnot and decided.. it's probably not worth the effort Apr 01 12:43
wwoods | It'd be much better spent on the stuff we've already got planned - better tools for testing and reporting, so we can do more efficient testing Apr 01 12:43
wwoods | at least that's how I see it for the near future. Apr 01 12:44
wwoods | so that idea is on Indefinite Hold. Apr 01 12:44
wwoods | okay. what else do we need to discuss? Apr 01 12:45
jlaska | can I touch on something adamw raised last week? Apr 01 12:45
jlaska | we're sort of discussed it already, so I don't want to spend a lot of time ... but adamw hilighted that we might not be communicating the known issues effectively Apr 01 12:45
jlaska | from ... https://fedoraproject.org/wiki/QA/Meetings/20090325#Building_the_Beta_Known_issues Apr 01 12:46
jlaska | we spent some time building out the known issues list ... are we happy with the result? Apr 01 12:46
adamw | linky? Apr 01 12:46
--- | wwoods has changed the topic to: Fedora QA Meeting | Known issues Apr 01 12:46
jlaska | does the consensus from last week still hold? Apr 01 12:46
jlaska | known issues - https://fedoraproject.org/wiki/Fedora_11_Beta_release_notes#Anaconda_installer_issues Apr 01 12:46
wwoods | https://fedoraproject.org/wiki/Fedora_11_Beta_release_notes#Known_Issues Apr 01 12:47
jlaska | out consensus from last week - https://fedoraproject.org/wiki/QA/Meetings/20090325#Building_the_Beta_Known_issues Apr 01 12:47
jlaska | Consensus was ... "# Result - QA team must internally reference the Beta release notes known issues in all IRC and email communication. " Apr 01 12:47
--- | dwmw2 is now known as dwmw2_gone Apr 01 12:47
jlaska | it's early still ... but "how's our driving"? Apr 01 12:47
wwoods | seems pretty good, anecdotally at least - everyone I've asked about bugs has said things like "I didn't see that in the release notes, so ..." Apr 01 12:48
wwoods | i.e. it seems like people are reading 'em Apr 01 12:48
jlaska | how much longer do we spend adding issues to the list ... a few things came up today Apr 01 12:48
adamw | the public announcements i've seen at least referenced the release notes Apr 01 12:48
jlaska | mainly syslinux I guess Apr 01 12:48
adamw | e.g. http://www.osnews.com/story/21232/Fedora_11_Beta_Released Apr 01 12:48
adamw | it doesn't specifically link to the known issues as we discussed, though Apr 01 12:49
adamw | perhaps i could poke rahul and suggest that to him for future release announcements Apr 01 12:49
wwoods | also on this topic: so warren started up a blog for rawhide issues: http://rawhidewatch.wordpress.com/ Apr 01 12:49
adamw | oh, yes, that's an AWESOME idea Apr 01 12:49
jlaska | ++ Apr 01 12:49
f13 | I've lost my right click... Apr 01 12:50
wwoods | we should coordinate with him - either send him updates, or see if he needs/wants help maintaining it Apr 01 12:50
wwoods | it's already on fedora planet, which is great Apr 01 12:50
wwoods | we might want to get it into the default bookmarks, at least for prereleases Apr 01 12:50
wwoods | (he's not on IRC right now or I'd just bring him in so we can talk about it) Apr 01 12:51
jlaska | that's a really good idea, perhaps checking in with him on how we can add issues to his list? Apr 01 12:51
wwoods | yeah, the first post sez "Please submit notable news to Warren Togami and it may appear here." Apr 01 12:53
jlaska | and there we have it Apr 01 12:53
wwoods | for the moment let's try to ping him on IRC (or, failing that, email him) with notable rawhide stuff Apr 01 12:53
wwoods | I'll talk to him about whether he wants/needs help from QA maintaining that page Apr 01 12:53
skvidal | or ask him if he can add poster to it Apr 01 12:53
jlaska | skvidal: so others can contribute you mean? Apr 01 12:54
wwoods | skvidal: right. also I hear rumors that the infrastructure team might be thinking about setting up wordpress for fedora Apr 01 12:54
skvidal | jlaska: yes Apr 01 12:54
jlaska | skvidal: roger Apr 01 12:54
skvidal | wwoods: yah - not sure of the last status on that, though Apr 01 12:54
wwoods | so we might want a plan to migrate over.. so it might be prudent to figure that out before we go putting this link all over the place Apr 01 12:54
skvidal | which is why having it on the planet is fine Apr 01 12:55
skvidal | or ask infrastructure to setup a redirect Apr 01 12:55
skvidal | rawhidebabyeating.fedoraproject.org Apr 01 12:55
skvidal | nomnombabies.fedoraproject.org Apr 01 12:55
skvidal | then you can give out that address Apr 01 12:55
jlaska | does someone want to checkin with warren before next meeting just to see what his plans were and if/how we can engage? Apr 01 12:55
skvidal | and when/if it moves... Apr 01 12:56
jlaska | I don't mind chatting with Warren if there are no takers Apr 01 12:57
jlaska | and he arrives! Apr 01 12:58
jlaska | wwoods: adamw: viking_ice: f13: any other discussion topics ... or should we start wrapping up? Apr 01 12:59
adamw | just to note that infrastructure is working on my calendaring proposal Apr 01 12:59
f13 | not much, just a lot of catch up to do post-bet arush Apr 01 12:59
adamw | sounds like they're about to come up with a system that would do the job right Apr 01 12:59
viking_ice | sorry was away speaking to the dbadmin Apr 01 12:59
adamw | keep an eye on posts from susmit on infrastructure-list if you're interested Apr 01 12:59
jlaska | adamw: I saw that ... sounds like 2 candidates being reviewed? Apr 01 12:59
adamw | jlaska: it's moved on from there, neither of those did caldav, but susmit now says he's thought up a system which would work out Apr 01 13:00
adamw | combination of zicula and phpical Apr 01 13:00
jlaska | adamw: very nice, thank you for following that Apr 01 13:00
jlaska | wwoods: any other topics on your end? Apr 01 13:01
wwoods | none from me. jlaska, if you want to be the official Warren Liason then we'll review that next week Apr 01 13:02
wwoods | so let's try to sum up the actions planned: Apr 01 13:02
jlaska | wwoods: will do Apr 01 13:02
warren | huh? Apr 01 13:03
wwoods | [wwoods] autoqa: work on better (clearer) reporting from existing tests Apr 01 13:03
wwoods | (test, really: just repoclosure atm) Apr 01 13:03
wwoods | err, oops Apr 01 13:03
jlaska | warren: I'll catch up with you later with some questions on your rawhidewatch blog Apr 01 13:03
--- | wwoods has changed the topic to: Fedora QA | Action summary! Apr 01 13:03
wwoods | [f13] autoqa: work on monitor for post-tree-compose Apr 01 13:03
wwoods | [wwoods, jlaska] autoqa: discuss lab-in-a-box integration Apr 01 13:04
wwoods | [jlaska] talk to warren and see if he needs/wants help with http://rawhidewatch.wordpress.com/ Apr 01 13:05
wwoods | that's all I can remember off the top of me head Apr 01 13:05
jlaska | [adamw] - will file a F10 bug for the syslinux issue, initiate discussion with pjones or jeremy for building a updated F10 package Apr 01 13:05
wwoods | what else? Apr 01 13:05
warren | syslinux issue? Apr 01 13:05
adamw | warren: you can't build a usb image of the f11 beta live CDs without an updated syslinux Apr 01 13:05
viking_ice | so I guess if fedora is going to put up an wp instance we wont need the announcement one right? Apr 01 13:06
jlaska | should we take the action out of meeting for syslinux? Apr 01 13:06
wwoods | jlaska: not sure what you mean Apr 01 13:08
wwoods | if that's all the actions we got from this meeting, let's call it done and get to work on that syslinux thing Apr 01 13:08
jlaska | yeah that's what I wanted :) Apr 01 13:08
adamw | i'll do the bug Apr 01 13:08
jlaska | thanks ;) Apr 01 13:09
jlaska | thanks wwoods, I'll post minutes to the list shortly Apr 01 13:10
wwoods | cool. thanks, all Apr 01 13:10
--- | wwoods has changed the topic to: Channel is used by various Fedora groups and committees for their regular meetings | Note that meetings often get logged | For questions about using Fedora please ask in #fedora | See http://fedoraproject.org/wiki/Meeting_channel for meeting schedule Apr 01 13:10

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!