From Fedora Project Wiki
m (Updated link) |
(Updated minutes) |
||
(2 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
= Attendees = | = Attendees = | ||
People present (lines said) | |||
# jlaska (101) | |||
# kparal (42) | |||
# adamw (24) | |||
# jskladan (10) | |||
# zodbot (4) | |||
# jsmith (4) | |||
# saccia (2) | |||
# tk009 (1) | |||
Unable to attend: | Unable to attend: | ||
# [[User:Rhe|Rhe]] | # [[User:Rhe|Rhe]] | ||
# [[User:Newgle1|Newgle1]] | # [[User:Newgle1|Newgle1]] | ||
# [[User:wwoods|wwoods]] | |||
# [[User:mkrizek|mkrizek]] | |||
= Agenda = | = Agenda = | ||
Line 10: | Line 22: | ||
== Previous meeting follow-up == | == Previous meeting follow-up == | ||
* No items | |||
== F14 Test status == | == F14 Test status == | ||
Line 26: | Line 39: | ||
: Continue testing and identifying potential [https://bugzilla.redhat.com/showdependencytree.cgi?id=F14Blocker&hide_resolved=1 F14Blocker bugs] | : Continue testing and identifying potential [https://bugzilla.redhat.com/showdependencytree.cgi?id=F14Blocker&hide_resolved=1 F14Blocker bugs] | ||
: [[User:Newgle1|Newgle1]] will be assisting with the acceptance run this week ... should we test more than just acceptance? | : [[User:Newgle1|Newgle1]] will be assisting with the acceptance run this week ... should we test more than just acceptance? | ||
: Jlaska will ask Hurry whether adding some amount of installer validation or installer bug verification is possible | |||
== F14 QA Activities == | == F14 QA Activities == | ||
Line 36: | Line 50: | ||
: Thursday, Sep 30 - [[Test_Day:2010-09-30_Intel|Intel]] | : Thursday, Sep 30 - [[Test_Day:2010-09-30_Intel|Intel]] | ||
; Next steps... | ; Next steps... | ||
: | : Summary - Test day well attended, but not as busy as previous events. AdamW will note any concerns/ideas on [[Fedora_14_QA_Retrospective]] | ||
: AdamW plans to send recap soon | |||
=== Oct 07 - Open slot === | === Oct 07 - Open slot === | ||
Line 43: | Line 58: | ||
: No planned test day | : No planned test day | ||
; Next steps... | ; Next steps... | ||
: | : Possible use this test day slot for F-14 installer validation, or ON_QA verification | ||
=== Oct 14 - OpenLDAP and nss === | === Oct 14 - OpenLDAP and nss === | ||
; Owner - [[User:jzeleny|jzeleny]], [[User:jvcelak|jvcelak]], [[User:rmeggins|rmeggins]], [[User:omoris|omoris]] | ; Owner - [[User:jzeleny|jzeleny]], [[User:jvcelak|jvcelak]], [[User:rmeggins|rmeggins]], [[User:omoris|omoris]] | ||
; Summary | ; Summary | ||
: [[Test_Day:2010-10-14_OpenLDAP/NSS]] | : Wiki page available - [[Test_Day:2010-10-14_OpenLDAP/NSS]] | ||
: Kparal notes the devel+qe folks are very active for this event | |||
; Next steps... | ; Next steps... | ||
: | : kparal will monitor whether custom test day live images are needed, and request help if needed | ||
: Announce event (test-announce@, planet, lwn etc...) | : Announce event (test-announce@, planet, lwn etc...) | ||
Line 57: | Line 73: | ||
; Owner - [[User:kparal]] | ; Owner - [[User:kparal]] | ||
; Summary | ; Summary | ||
: wwoods will also add an rpm test transaction to depcheck to catch file conflicts | : wwoods will also add an rpm test transaction to depcheck to catch file conflicts -- moved to new ticket {{ticket|autoqa|229}} | ||
: jskladan and wwoods investigating mash integration | : jskladan and wwoods investigating mash integration | ||
: kparal - we stopped checking ''updates-testing'' repos in the upgradepath test, because we're not sure how to do that properly - we need to consult FESCo (see {{ticket|fesco|474}}) | |||
: kparal started a thread about timing-sensitive tests - upgradepath and depcheck - how and when to correctly execute them | |||
: jskladan resultsdb patches for autoqa are waiting to be pushed to master | |||
: jskladan investigating a way for us to create ''generic testplan frontend'' | |||
; Next steps... | ; Next steps... | ||
: | : Monitor and discuss ''upgradepath'' topic during next FESCO meeting (see {{ticket|fesco|474}}) | ||
: Review resultsdb patchset for ''master'' | |||
: Wwoods integrating mash into depcheck test | |||
== F-14 Nice-to-have Proposal == | == F-14 Nice-to-have Proposal == | ||
Line 66: | Line 88: | ||
; Owner - [[User:adamwill|AdamW]] | ; Owner - [[User:adamwill|AdamW]] | ||
; Summary | ; Summary | ||
: Adam sent a ''nice-to-have'' proposal to the list for feedback | : Adam sent a ''nice-to-have'' proposal to the list for feedback (see http://lists.fedoraproject.org/pipermail/test/2010-September/093833.html) | ||
: It seems to be working out fine so far, we reviewed and accepted several NTH bugs at the blocker review meeting | |||
; Next steps... | ; Next steps... | ||
: | : Continue to monitor for feedback | ||
: Will activate the policy soon if no additional feedback | |||
= Open discussion - <Your topic here> = | = Open discussion - <Your topic here> = | ||
= Action items = | = Action items = | ||
# Jlaska will ask Hurry whether adding some amount of installer validation or installer bug verification is possible | |||
= IRC Transcript = | = IRC Transcript = | ||
{| | |||
|- id="t15:00:16" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #startmeeting Fedora QA Meeting | |||
|| [[#t15:00:16|15:00]] | |||
|- id="t15:00:16" | |||
! style="background-color: #42427e" | zodbot | |||
| style="color: #42427e" | Meeting started Mon Oct 4 15:00:16 2010 UTC. The chair is jlaska. Information about MeetBot at http://wiki.debian.org/MeetBot. | |||
|| [[#t15:00:16|15:00]] | |||
|- id="t15:00:16" | |||
! style="background-color: #42427e" | zodbot | |||
| style="color: #42427e" | Useful Commands: #action #agreed #halp #info #idea #link #topic. | |||
|| [[#t15:00:16|15:00]] | |||
|- id="t15:00:18" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #meetingname fedora-qa | |||
|| [[#t15:00:18|15:00]] | |||
|- id="t15:00:18" | |||
! style="background-color: #42427e" | zodbot | |||
| style="color: #42427e" | The meeting name has been set to 'fedora-qa' | |||
|| [[#t15:00:18|15:00]] | |||
|- id="t15:00:30" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #topic Waiting for attendees | |||
|| [[#t15:00:30|15:00]] | |||
|- id="t15:00:41" | |||
| colspan="2" | * kparal me me me! | |||
|| [[#t15:00:41|15:00]] | |||
|- id="t15:00:46" | |||
| colspan="2" | * saccia waves to jlaska | |||
|| [[#t15:00:46|15:00]] | |||
|- id="t15:00:48" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal for the win | |||
|| [[#t15:00:48|15:00]] | |||
|- id="t15:00:53" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | saccia: hello there | |||
|| [[#t15:00:53|15:00]] | |||
|- id="t15:01:09" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | yo | |||
|| [[#t15:01:09|15:01]] | |||
|- id="t15:01:14" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: hey hey | |||
|| [[#t15:01:14|15:01]] | |||
|- id="t15:01:24" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal: can I appoint you #chair for the tail end of the meeting today? | |||
|| [[#t15:01:24|15:01]] | |||
|- id="t15:01:27" | |||
| colspan="2" | * jskladan here :) | |||
|| [[#t15:01:27|15:01]] | |||
|- id="t15:01:31" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | jskladan: greetings | |||
|| [[#t15:01:31|15:01]] | |||
|- id="t15:01:40" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | jlaska: sure | |||
|| [[#t15:01:40|15:01]] | |||
|- id="t15:01:47" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal: thank you | |||
|| [[#t15:01:47|15:01]] | |||
|- id="t15:01:50" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #chair kparal | |||
|| [[#t15:01:50|15:01]] | |||
|- id="t15:01:50" | |||
! style="background-color: #42427e" | zodbot | |||
| style="color: #42427e" | Current chairs: jlaska kparal | |||
|| [[#t15:01:50|15:01]] | |||
|- id="t15:02:13" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | note ... wwoods will be out today | |||
|| [[#t15:02:13|15:02]] | |||
|- id="t15:02:24" | |||
| colspan="2" | * jsmith lurks | |||
|| [[#t15:02:24|15:02]] | |||
|- id="t15:02:26" | |||
! style="background-color: #488888" | tk009 | |||
| style="color: #488888" | so the rest of us have to stand? no its ok I see how it is | |||
|| [[#t15:02:26|15:02]] | |||
|- id="t15:02:27" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | lurker! | |||
|| [[#t15:02:27|15:02]] | |||
|- id="t15:02:38" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | tk009: hah | |||
|| [[#t15:02:38|15:02]] | |||
|- id="t15:02:41" | |||
! style="background-color: #8c4a4a" | jsmith | |||
| style="color: #8c4a4a" | jlaska: I know... 'nother meeting in 30 minutes :-/ | |||
|| [[#t15:02:41|15:02]] | |||
|- id="t15:02:51" | |||
! style="background-color: #8c4a4a" | jsmith | |||
| style="color: #8c4a4a" | jlaska: C'est la vie on Mondays for me | |||
|| [[#t15:02:51|15:02]] | |||
|- id="t15:03:12" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | alright, we'll get started in 30 seconds | |||
|| [[#t15:03:12|15:03]] | |||
|- id="t15:03:26" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal: is Martin available today? | |||
|| [[#t15:03:26|15:03]] | |||
|- id="t15:03:46" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | jlaska: nope, he will come only tomorrow | |||
|| [[#t15:03:46|15:03]] | |||
|- id="t15:04:46" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #topic Previous meeting follow-up | |||
|| [[#t15:04:46|15:04]] | |||
|- id="t15:05:07" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | Shame on me, I never sent wiki versions of the minutes from last week | |||
|| [[#t15:05:07|15:05]] | |||
|- id="t15:05:18" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | However, I had no follow-up items listed | |||
|| [[#t15:05:18|15:05]] | |||
|- id="t15:05:33" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | So unless there is anything specific folks would like to call out ... we'll continue | |||
|| [[#t15:05:33|15:05]] | |||
|- id="t15:06:06" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | alrighty ... | |||
|| [[#t15:06:06|15:06]] | |||
|- id="t15:06:16" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #topic F-14 Testing | |||
|| [[#t15:06:16|15:06]] | |||
|- id="t15:06:30" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | Okay all, prepare to increase the pantscon level | |||
|| [[#t15:06:30|15:06]] | |||
|- id="t15:06:49" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | I've listed the upcoming F-14 testing milestones on the meeting wiki page (I'll list here as well) | |||
|| [[#t15:06:49|15:06]] | |||
|- id="t15:07:10" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #info Oct 07 - Fedora 14 acceptance test run planned (see rel-eng ticket#4140) | |||
|| [[#t15:07:10|15:07]] | |||
|- id="t15:07:21" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | this friday ... | |||
|| [[#t15:07:21|15:07]] | |||
|- id="t15:07:26" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #info Oct 08 - F14Blocker review meeting #2 planned | |||
|| [[#t15:07:26|15:07]] | |||
|- id="t15:07:37" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | followed by next week ... | |||
|| [[#t15:07:37|15:07]] | |||
|- id="t15:07:47" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #info Oct 14 - F14Blocker TC1 test run planned (no rel-eng ticket available yet) | |||
|| [[#t15:07:47|15:07]] | |||
|- id="t15:07:58" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #info Oct 21 - F14Blocker RC1 test run planned (no rel-eng ticket available yet) | |||
|| [[#t15:07:58|15:07]] | |||
|- id="t15:08:12" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | and lastly ... | |||
|| [[#t15:08:12|15:08]] | |||
|- id="t15:08:20" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #info Oct 26 - F-14 Go/No Go meeting (see https://fedoraproject.org/wiki/Go_No_Go_Meeting) | |||
|| [[#t15:08:20|15:08]] | |||
|- id="t15:08:52" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | so this means we have less than 3 weeks to have all F14 blocker bugs closed | |||
|| [[#t15:08:52|15:08]] | |||
|- id="t15:09:21" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | yay fun | |||
|| [[#t15:09:21|15:09]] | |||
|- id="t15:09:24" | |||
! style="background-color: #8c4a4a" | jsmith | |||
| style="color: #8c4a4a" | w00t! | |||
|| [[#t15:09:24|15:09]] | |||
|- id="t15:09:29" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | We hosted the first of the F-14-Final blocker review meetings last Friday (http://meetbot.fedoraproject.org/fedora-bugzappers/2010-10-01/f-14-blocker-review.2010-10-01-16.00.log.html) | |||
|| [[#t15:09:29|15:09]] | |||
|- id="t15:09:41" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | I suspect adamw is still in pain from that one | |||
|| [[#t15:09:41|15:09]] | |||
|- id="t15:09:45" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | it was a *long* meeting | |||
|| [[#t15:09:45|15:09]] | |||
|- id="t15:09:57" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | meetings that require an intermission ... ouch! | |||
|| [[#t15:09:57|15:09]] | |||
|- id="t15:10:18" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | one question I have regarding this weeks planned acceptance test run ... | |||
|| [[#t15:10:18|15:10]] | |||
|- id="t15:10:42" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | previously, we use these checkpoints to run the rawhide acceptance test plan (https://fedoraproject.org/wiki/QA:Rawhide_Acceptance_Test_Plan) | |||
|| [[#t15:10:42|15:10]] | |||
|- id="t15:11:03" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | this was mainly intended to identify any big gotchas with doing a basic install, boot and login to the desktop | |||
|| [[#t15:11:03|15:11]] | |||
|- id="t15:11:23" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | do we want to continue with this plan ... or should we consider additional installer or desktop testing? | |||
|| [[#t15:11:23|15:11]] | |||
|- id="t15:11:30" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | or perhaps, just bug verification? | |||
|| [[#t15:11:30|15:11]] | |||
|- id="t15:11:35" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | any suggestions / ideas ? | |||
|| [[#t15:11:35|15:11]] | |||
|- id="t15:11:49" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | we can't easily change this, can we? | |||
|| [[#t15:11:49|15:11]] | |||
|- id="t15:11:55" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | since it requires Code | |||
|| [[#t15:11:55|15:11]] | |||
|- id="t15:12:20" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: sorry, change what? | |||
|| [[#t15:12:20|15:12]] | |||
|- id="t15:12:32" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | the automation used to run the acceptance plan? | |||
|| [[#t15:12:32|15:12]] | |||
|- id="t15:12:37" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | what the parameters for automated testing are | |||
|| [[#t15:12:37|15:12]] | |||
|- id="t15:12:40" | |||
! style="background-color: #4b904b" | saccia | |||
| style="color: #4b904b" | I say we make sure we add something in that relates to dual hard drive setups... that's been nipping at us recently | |||
|| [[#t15:12:40|15:12]] | |||
|- id="t15:13:13" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: yeah, I don't imagine we'll be able to adjust the automated testing very quickly for this week | |||
|| [[#t15:13:13|15:13]] | |||
|- id="t15:14:15" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | saccia: let's continue to test the scenario you, Southern_Gentlem and I were discussing in #fedora-qa earlier. That's a tough challenging test scenario in that the 'expected results' aren't very explicit in most cases. | |||
|| [[#t15:14:15|15:14]] | |||
|- id="t15:14:21" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | i mean, i thought it was generally understood the long-term goal was simply to automate as many of the validation tests as we can, and what we have implemented so far is simply what we've managed | |||
|| [[#t15:14:21|15:14]] | |||
|- id="t15:14:32" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: yes certainly | |||
|| [[#t15:14:32|15:14]] | |||
|- id="t15:14:54" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: for the milestone this week, my question wasn't so much ... how do we want to change the automation we run this week | |||
|| [[#t15:14:54|15:14]] | |||
|- id="t15:15:10" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | more ... do we want to include _other_ tests/activities during this event | |||
|| [[#t15:15:10|15:15]] | |||
|- id="t15:15:26" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | to help identify issues earlier, or verify MODIFIED/ON_QA issues etc... | |||
|| [[#t15:15:26|15:15]] | |||
|- id="t15:15:43" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | oh. like, manual testing? | |||
|| [[#t15:15:43|15:15]] | |||
|- id="t15:15:56" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | yeah, that could be one thing | |||
|| [[#t15:15:56|15:15]] | |||
|- id="t15:16:14" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | "manual", that sounds awful :P | |||
|| [[#t15:16:14|15:16]] | |||
|- id="t15:16:21" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | it sure does! | |||
|| [[#t15:16:21|15:16]] | |||
|- id="t15:16:39" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | awfully fun you meant, right? :P | |||
|| [[#t15:16:39|15:16]] | |||
|- id="t15:17:11" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | i dunno, i'm not sure it's sensible to load other stuff into the rawhide acceptance testing system | |||
|| [[#t15:17:11|15:17]] | |||
|- id="t15:17:20" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | reviewing blocker issues isn't really part of that is it? | |||
|| [[#t15:17:20|15:17]] | |||
|- id="t15:17:25" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: I wouldn't suggest that either | |||
|| [[#t15:17:25|15:17]] | |||
|- id="t15:17:28" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | what did you have in mind? | |||
|| [[#t15:17:28|15:17]] | |||
|- id="t15:17:38" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | I'm asking for ideas/suggestions in _addition_ to the planned acceptance run | |||
|| [[#t15:17:38|15:17]] | |||
|- id="t15:17:48" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | sorry if that wasn't clear | |||
|| [[#t15:17:48|15:17]] | |||
|- id="t15:18:09" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | I'm just worried that we only have about 5 days to find and fix bugs against TC1 | |||
|| [[#t15:18:09|15:18]] | |||
|- id="t15:18:15" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | in order for them to land in RC1 | |||
|| [[#t15:18:15|15:18]] | |||
|- id="t15:18:25" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | for Beta ... TC1 landed late | |||
|| [[#t15:18:25|15:18]] | |||
|- id="t15:18:28" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | leaving less time | |||
|| [[#t15:18:28|15:18]] | |||
|- id="t15:18:46" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | we can do standard installation matrix even for that acceptance compose | |||
|| [[#t15:18:46|15:18]] | |||
|- id="t15:19:24" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: do we have a lot of ON_QA or MODIFIED bugs on the blocker list? | |||
|| [[#t15:19:24|15:19]] | |||
|- id="t15:19:43" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal: I was wondering about that too, whether we had cycles to support additional installer tests | |||
|| [[#t15:19:43|15:19]] | |||
|- id="t15:20:07" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | 7 | |||
|| [[#t15:20:07|15:20]] | |||
|- id="t15:20:29" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | kparal's idea isn't a bad one, though that effectively turns the acceptance compose into TC1 | |||
|| [[#t15:20:29|15:20]] | |||
|- id="t15:20:38" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: true, is that bad? | |||
|| [[#t15:20:38|15:20]] | |||
|- id="t15:21:15" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | not necessarily, just it would mean that we're not happy with the current process and we should probably change it formally rather than re-purposing things | |||
|| [[#t15:21:15|15:21]] | |||
|- id="t15:21:46" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | actually, repurposing is just what I had in mind | |||
|| [[#t15:21:46|15:21]] | |||
|- id="t15:21:54" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | I think that's what kparal's suggesting | |||
|| [[#t15:21:54|15:21]] | |||
|- id="t15:22:15" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | okay, I'll take this offline ... I want to run kparal's idea by Hurry and Newgle too | |||
|| [[#t15:22:15|15:22]] | |||
|- id="t15:22:30" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | either way, we're going to continue with the planned acceptance run this week | |||
|| [[#t15:22:30|15:22]] | |||
|- id="t15:22:53" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | any ideas to help front-load any of the TC1 or RC1 firestorm ... please don't hesitate | |||
|| [[#t15:22:53|15:22]] | |||
|- id="t15:24:04" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #idea potentially add some of the validation matrix testing to the planned acceptance run? | |||
|| [[#t15:24:04|15:24]] | |||
|- id="t15:24:30" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #action jlaska to check-in with rhe for thoughts on doing a limited test run of validation matrix this week | |||
|| [[#t15:24:30|15:24]] | |||
|- id="t15:24:43" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #topic F14 Test Days | |||
|| [[#t15:24:43|15:24]] | |||
|- id="t15:24:50" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | alright, so this is another FYI topic | |||
|| [[#t15:24:50|15:24]] | |||
|- id="t15:25:10" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | Unless you were on another planet last week ... Adam and company hosted the always popular X test week | |||
|| [[#t15:25:10|15:25]] | |||
|- id="t15:25:15" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #info Sep 28-30 - Graphics test week | |||
|| [[#t15:25:15|15:25]] | |||
|- id="t15:25:28" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | i haven't done a summary yet, planning that for today | |||
|| [[#t15:25:28|15:25]] | |||
|- id="t15:25:36" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | From what I can tell, the event rocked? | |||
|| [[#t15:25:36|15:25]] | |||
|- id="t15:25:46" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: okay, sweet | |||
|| [[#t15:25:46|15:25]] | |||
|- id="t15:26:19" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: any issues or highlights to note here? | |||
|| [[#t15:26:19|15:26]] | |||
|- id="t15:26:48" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | and the 'most unsatisfied tester prize' wins... kparal. 5 bugs! :o) | |||
|| [[#t15:26:48|15:26]] | |||
|- id="t15:26:58" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | all went ahead fine | |||
|| [[#t15:26:58|15:26]] | |||
|- id="t15:27:01" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | (meaning Intel test day) | |||
|| [[#t15:27:01|15:27]] | |||
|- id="t15:27:09" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | haha, I like that prize :) | |||
|| [[#t15:27:09|15:27]] | |||
|- id="t15:27:10" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | it wasn't as busy as the last few, my fault for not promoting more ahead of time; it kind snuck up on me | |||
|| [[#t15:27:10|15:27]] | |||
|- id="t15:27:13" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | thanks a lot kparal | |||
|| [[#t15:27:13|15:27]] | |||
|- id="t15:27:47" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | adamw: cool, feel free to log that or any other thoughts to https://fedoraproject.org/wiki/Fedora_14_QA_Retrospective | |||
|| [[#t15:27:47|15:27]] | |||
|- id="t15:28:01" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | I've got a bullet there for the virt test day as well | |||
|| [[#t15:28:01|15:28]] | |||
|- id="t15:28:06" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #info Oct 07 - Open slot | |||
|| [[#t15:28:06|15:28]] | |||
|- id="t15:28:11" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | so no test day planned this week | |||
|| [[#t15:28:11|15:28]] | |||
|- id="t15:28:40" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | which is partly why I was thinking about taking our typicaly test day time, and devoting it in some way to working on F-14-Final tests/bugs/$something | |||
|| [[#t15:28:40|15:28]] | |||
|- id="t15:28:49" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #info Oct 14 - OpenLDAP and nss | |||
|| [[#t15:28:49|15:28]] | |||
|- id="t15:29:07" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | The wiki appears to be well underway - https://fedoraproject.org/wiki/Test_Day:2010-10-14_OpenLDAP/NSS | |||
|| [[#t15:29:07|15:29]] | |||
|- id="t15:29:10" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | I help with that | |||
|| [[#t15:29:10|15:29]] | |||
|- id="t15:29:17" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | those guys are pretty active | |||
|| [[#t15:29:17|15:29]] | |||
|- id="t15:29:24" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | I think all should be prepared well in time | |||
|| [[#t15:29:24|15:29]] | |||
|- id="t15:29:30" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal: awesome! Any next steps you want to note? | |||
|| [[#t15:29:30|15:29]] | |||
|- id="t15:29:49" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | Are they planning to test-announce and planet.fedoraproject.org the event? | |||
|| [[#t15:29:49|15:29]] | |||
|- id="t15:29:54" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | I just need to ensure LiveCD can be built and sent out announcements | |||
|| [[#t15:29:54|15:29]] | |||
|- id="t15:29:55" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | or should one of us handle that | |||
|| [[#t15:29:55|15:29]] | |||
|- id="t15:30:06" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal: oh, it needs a custom live image? | |||
|| [[#t15:30:06|15:30]] | |||
|- id="t15:30:15" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | may be | |||
|| [[#t15:30:15|15:30]] | |||
|- id="t15:30:27" | |||
| colspan="2" | * kparal needs to check out :) | |||
|| [[#t15:30:27|15:30]] | |||
|- id="t15:30:28" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | I actually can build live images now, unlike previously when adamw asked for live image creation help | |||
|| [[#t15:30:28|15:30]] | |||
|- id="t15:30:38" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | heh | |||
|| [[#t15:30:38|15:30]] | |||
|- id="t15:30:49" | |||
| colspan="2" | * adamw can build 32-bit ones now too, whatever the bug was with that, it's fixed | |||
|| [[#t15:30:49|15:30]] | |||
|- id="t15:30:57" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | alright, I think that covers test days | |||
|| [[#t15:30:57|15:30]] | |||
|- id="t15:31:12" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | anything else before moving on? (moving in 30 seconds) | |||
|| [[#t15:31:12|15:31]] | |||
|- id="t15:31:46" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | alrighty ... | |||
|| [[#t15:31:46|15:31]] | |||
|- id="t15:32:02" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | two more topics before open-discussion (autoqa and NTH update) | |||
|| [[#t15:32:02|15:32]] | |||
|- id="t15:32:09" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | #topic AutoQA Package Acceptance Update | |||
|| [[#t15:32:09|15:32]] | |||
|- id="t15:32:25" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal: I have 2 follow-up items on the list from last week ... do you want to take it away? | |||
|| [[#t15:32:25|15:32]] | |||
|- id="t15:32:37" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | sure, what are they? | |||
|| [[#t15:32:37|15:32]] | |||
|- id="t15:33:03" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | wwoods will also add an rpm test transaction to depcheck to catch file conflicts | |||
|| [[#t15:33:03|15:33]] | |||
|- id="t15:33:07" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | jskladan and wwoods investigating mash integration | |||
|| [[#t15:33:07|15:33]] | |||
|- id="t15:33:43" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | wwoods is out right now, I don't think I have any news about that | |||
|| [[#t15:33:43|15:33]] | |||
|- id="t15:34:10" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | let's keep it to next time | |||
|| [[#t15:34:10|15:34]] | |||
|- id="t15:34:16" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | sounds good | |||
|| [[#t15:34:16|15:34]] | |||
|- id="t15:34:25" | |||
| colspan="2" | * jlaska will leave those on the wiki for next week | |||
|| [[#t15:34:25|15:34]] | |||
|- id="t15:34:44" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | apart from that, the last week was mainly involved around upgradepath | |||
|| [[#t15:34:44|15:34]] | |||
|- id="t15:34:53" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | so, we have received some new patches | |||
|| [[#t15:34:53|15:34]] | |||
|- id="t15:35:12" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | we stopped checking -testing repos, because we're not sure how to do that properly | |||
|| [[#t15:35:12|15:35]] | |||
|- id="t15:35:22" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | we need to consult with FESCo about it | |||
|| [[#t15:35:22|15:35]] | |||
|- id="t15:35:47" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | also there were some small fixes and cleanups in upgradepath code | |||
|| [[#t15:35:47|15:35]] | |||
|- id="t15:36:23" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | I have started a thread about timing-sensitive tests, that will be a main topic soon when we plan to actually use it in production | |||
|| [[#t15:36:23|15:36]] | |||
|- id="t15:36:37" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | upgradepath is one of them, the other is depcheck | |||
|| [[#t15:36:37|15:36]] | |||
|- id="t15:37:09" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | as for other new, jlaska posted a few fixes and we received a huge resultsdb patch from jskladan | |||
|| [[#t15:37:09|15:37]] | |||
|- id="t15:37:42" | |||
! style="background-color: #4d4d93" | jskladan | |||
| style="color: #4d4d93" | eh, it was not a patch :-D more of recapitulation of the current state :) | |||
|| [[#t15:37:42|15:37]] | |||
|- id="t15:37:54" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #info we stopped checking -testing repos in upgradepath test, because we're not sure how to do that properly - we need to consult FESCo | |||
|| [[#t15:37:54|15:37]] | |||
|- id="t15:38:20" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #info we started a thread about timing-sensitive tests - upgradepath and depcheck - how and when to correctly execute them | |||
|| [[#t15:38:20|15:38]] | |||
|- id="t15:38:30" | |||
! style="background-color: #4d4d93" | jskladan | |||
| style="color: #4d4d93" | but sure - currently resultsdb patches for autoqa are waiting to be pushed to master, so we can start storing some test results (together with sending emails to the -results list) | |||
|| [[#t15:38:30|15:38]] | |||
|- id="t15:38:59" | |||
! style="background-color: #4d4d93" | jskladan | |||
| style="color: #4d4d93" | so once there is some reasonable dataset, we can hop into creating frontends | |||
|| [[#t15:38:59|15:38]] | |||
|- id="t15:39:42" | |||
! style="background-color: #4d4d93" | jskladan | |||
| style="color: #4d4d93" | the aforementioned email <https://fedorahosted.org/pipermail/autoqa-devel/2010-September/001187.html> | |||
|| [[#t15:39:42|15:39]] | |||
|- id="t15:40:05" | |||
! style="background-color: #4d4d93" | jskladan | |||
| style="color: #4d4d93" | also describes a 'metadata' proposal | |||
|| [[#t15:40:05|15:40]] | |||
|- id="t15:40:09" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #info resultsdb patches for autoqa are waiting to be pushed to master | |||
|| [[#t15:40:09|15:40]] | |||
|- id="t15:40:48" | |||
! style="background-color: #4d4d93" | jskladan | |||
| style="color: #4d4d93" | which can be used to describe testplans in a unanimous way, so we can create a "generic testplan frontend" | |||
|| [[#t15:40:48|15:40]] | |||
|- id="t15:41:16" | |||
! style="background-color: #4d4d93" | jskladan | |||
| style="color: #4d4d93" | which will visualize testplans using the structure defined in the provided metadata | |||
|| [[#t15:41:16|15:41]] | |||
|- id="t15:41:33" | |||
! style="background-color: #4d4d93" | jskladan | |||
| style="color: #4d4d93" | (but that is kind of 'happy future' for now :) ) | |||
|| [[#t15:41:33|15:41]] | |||
|- id="t15:41:47" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #info jskladan prepares a way for us to be able to create "generic testplan frontend" | |||
|| [[#t15:41:47|15:41]] | |||
|- id="t15:41:56" | |||
| colspan="2" | * jskladan ends the boring monologue | |||
|| [[#t15:41:56|15:41]] | |||
|- id="t15:42:03" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | as a side note, in autoqa-devel there is also an ongoing discussion with atodorov how to handle whitelisting of particular lines in rpmlint test case. feel free to join in. | |||
|| [[#t15:42:03|15:42]] | |||
|- id="t15:42:19" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | that should be all of autoqa I think | |||
|| [[#t15:42:19|15:42]] | |||
|- id="t15:42:46" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #topic F-14-NTH (Nice to have) proposal status | |||
|| [[#t15:42:46|15:42]] | |||
|- id="t15:42:58" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | adamw: you want to say a few words about this? | |||
|| [[#t15:42:58|15:42]] | |||
|- id="t15:43:25" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | sure | |||
|| [[#t15:43:25|15:43]] | |||
|- id="t15:43:35" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | not much to say beyond the proposal on the ml, which we've been acting on provisionally | |||
|| [[#t15:43:35|15:43]] | |||
|- id="t15:43:53" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | if i don't get any more feedback to the mail i'll just go ahead and push the policy, so be warned =) | |||
|| [[#t15:43:53|15:43]] | |||
|- id="t15:43:59" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #link http://lists.fedoraproject.org/pipermail/test/2010-September/093833.html | |||
|| [[#t15:43:59|15:43]] | |||
|- id="t15:44:07" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | it seems to be working out fine so far, we reviewed and accepted several NTH bugs at the blocker review meetin | |||
|| [[#t15:44:07|15:44]] | |||
|- id="t15:44:40" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #info adamw threatens to push the policy, hurry with comments :) | |||
|| [[#t15:44:40|15:44]] | |||
|- id="t15:45:37" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | ok, thanks adamw | |||
|| [[#t15:45:37|15:45]] | |||
|- id="t15:45:47" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #topic Open discussion <your topic here> | |||
|| [[#t15:45:47|15:45]] | |||
|- id="t15:45:57" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | any proposals for discussion? | |||
|| [[#t15:45:57|15:45]] | |||
|- id="t15:47:11" | |||
! style="background-color: #818144" | adamw | |||
| style="color: #818144" | nothing from me | |||
|| [[#t15:47:11|15:47]] | |||
|- id="t15:47:25" | |||
| colspan="2" | * kparal declares this monday as the Sleepy Monday | |||
|| [[#t15:47:25|15:47]] | |||
|- id="t15:47:45" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | closing in 1 minute if no other topics | |||
|| [[#t15:47:45|15:47]] | |||
|- id="t15:48:37" | |||
! style="background-color: #407a40" | jlaska | |||
| style="color: #407a40" | kparal: thanks for driving :) | |||
|| [[#t15:48:37|15:48]] | |||
|- id="t15:48:45" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | jlaska: you're welcome | |||
|| [[#t15:48:45|15:48]] | |||
|- id="t15:48:57" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | have a nice day everyone | |||
|| [[#t15:48:57|15:48]] | |||
|- id="t15:49:02" | |||
! style="background-color: #854685" | kparal | |||
| style="color: #854685" | #endmeeting | |||
|| [[#t15:49:02|15:49]] | |||
|} | |||
Generated by irclog2html.py 2.7 by [mailto:marius@pov.lt Marius Gedminas] - find it at [http://mg.pov.lt/irclog2html mg.pov.lt]! |
Latest revision as of 18:35, 5 October 2010
Attendees
People present (lines said)
- jlaska (101)
- kparal (42)
- adamw (24)
- jskladan (10)
- zodbot (4)
- jsmith (4)
- saccia (2)
- tk009 (1)
Unable to attend:
Agenda
Previous meeting follow-up
- No items
F14 Test status
Consult schedule for remaining QA tasks
- Owner - AdamW, Hurry
- Summary
- Oct 01 - Hosted first F14Blocker review meeting last week - http://meetbot.fedoraproject.org/fedora-bugzappers/2010-10-01/f-14-blocker-review.2010-10-01-16.00.log.html
- Oct 07 - Fedora 14 acceptance test run planned (see
rel-eng ticket#4140
) - Oct 08 - F14Blocker review meeting planned (see
Create rel-eng ticket
) - Oct 14 - F14Blocker TC1 test run planned (see
Create rel-eng ticket
) - Oct 21 - F14Blocker RC1 test run planned (see
Create rel-eng ticket
) - Oct 26 - F-14 Go/No Go meeting (see Go_No_Go_Meeting)
- Next steps...
- Continue testing and identifying potential F14Blocker bugs
- Newgle1 will be assisting with the acceptance run this week ... should we test more than just acceptance?
- Jlaska will ask Hurry whether adding some amount of installer validation or installer bug verification is possible
F14 QA Activities
Sep 28-30 - Graphics test week
- Owner - AdamW
- Summary
- Tuesday, Sep 28 - Nouveau
- Wednesday, Sep 29 - Radeon
- Thursday, Sep 30 - Intel
- Next steps...
- Summary - Test day well attended, but not as busy as previous events. AdamW will note any concerns/ideas on Fedora_14_QA_Retrospective
- AdamW plans to send recap soon
Oct 07 - Open slot
- Owner - nobody
- Summary
- No planned test day
- Next steps...
- Possible use this test day slot for F-14 installer validation, or ON_QA verification
Oct 14 - OpenLDAP and nss
- Owner - jzeleny, jvcelak, rmeggins, omoris
- Summary
- Wiki page available - Test_Day:2010-10-14_OpenLDAP/NSS
- Kparal notes the devel+qe folks are very active for this event
- Next steps...
- kparal will monitor whether custom test day live images are needed, and request help if needed
- Announce event (test-announce@, planet, lwn etc...)
AutoQA update
- Owner - User:kparal
- Summary
- wwoods will also add an rpm test transaction to depcheck to catch file conflicts -- moved to new ticket
autoqa ticket#229
- jskladan and wwoods investigating mash integration
- kparal - we stopped checking updates-testing repos in the upgradepath test, because we're not sure how to do that properly - we need to consult FESCo (see
fesco ticket#474
) - kparal started a thread about timing-sensitive tests - upgradepath and depcheck - how and when to correctly execute them
- jskladan resultsdb patches for autoqa are waiting to be pushed to master
- jskladan investigating a way for us to create generic testplan frontend
- Next steps...
- Monitor and discuss upgradepath topic during next FESCO meeting (see
fesco ticket#474
) - Review resultsdb patchset for master
- Wwoods integrating mash into depcheck test
F-14 Nice-to-have Proposal
- Owner - AdamW
- Summary
- Adam sent a nice-to-have proposal to the list for feedback (see http://lists.fedoraproject.org/pipermail/test/2010-September/093833.html)
- It seems to be working out fine so far, we reviewed and accepted several NTH bugs at the blocker review meeting
- Next steps...
- Continue to monitor for feedback
- Will activate the policy soon if no additional feedback
Open discussion - <Your topic here>
Action items
- Jlaska will ask Hurry whether adding some amount of installer validation or installer bug verification is possible
IRC Transcript
jlaska | #startmeeting Fedora QA Meeting | 15:00 |
---|---|---|
zodbot | Meeting started Mon Oct 4 15:00:16 2010 UTC. The chair is jlaska. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
zodbot | Useful Commands: #action #agreed #halp #info #idea #link #topic. | 15:00 |
jlaska | #meetingname fedora-qa | 15:00 |
zodbot | The meeting name has been set to 'fedora-qa' | 15:00 |
jlaska | #topic Waiting for attendees | 15:00 |
* kparal me me me! | 15:00 | |
* saccia waves to jlaska | 15:00 | |
jlaska | kparal for the win | 15:00 |
jlaska | saccia: hello there | 15:00 |
adamw | yo | 15:01 |
jlaska | adamw: hey hey | 15:01 |
jlaska | kparal: can I appoint you #chair for the tail end of the meeting today? | 15:01 |
* jskladan here :) | 15:01 | |
jlaska | jskladan: greetings | 15:01 |
kparal | jlaska: sure | 15:01 |
jlaska | kparal: thank you | 15:01 |
jlaska | #chair kparal | 15:01 |
zodbot | Current chairs: jlaska kparal | 15:01 |
jlaska | note ... wwoods will be out today | 15:02 |
* jsmith lurks | 15:02 | |
tk009 | so the rest of us have to stand? no its ok I see how it is | 15:02 |
jlaska | lurker! | 15:02 |
jlaska | tk009: hah | 15:02 |
jsmith | jlaska: I know... 'nother meeting in 30 minutes :-/ | 15:02 |
jsmith | jlaska: C'est la vie on Mondays for me | 15:02 |
jlaska | alright, we'll get started in 30 seconds | 15:03 |
jlaska | kparal: is Martin available today? | 15:03 |
kparal | jlaska: nope, he will come only tomorrow | 15:03 |
jlaska | #topic Previous meeting follow-up | 15:04 |
jlaska | Shame on me, I never sent wiki versions of the minutes from last week | 15:05 |
jlaska | However, I had no follow-up items listed | 15:05 |
jlaska | So unless there is anything specific folks would like to call out ... we'll continue | 15:05 |
jlaska | alrighty ... | 15:06 |
jlaska | #topic F-14 Testing | 15:06 |
jlaska | Okay all, prepare to increase the pantscon level | 15:06 |
jlaska | I've listed the upcoming F-14 testing milestones on the meeting wiki page (I'll list here as well) | 15:06 |
jlaska | #info Oct 07 - Fedora 14 acceptance test run planned (see rel-eng ticket#4140) | 15:07 |
jlaska | this friday ... | 15:07 |
jlaska | #info Oct 08 - F14Blocker review meeting #2 planned | 15:07 |
jlaska | followed by next week ... | 15:07 |
jlaska | #info Oct 14 - F14Blocker TC1 test run planned (no rel-eng ticket available yet) | 15:07 |
jlaska | #info Oct 21 - F14Blocker RC1 test run planned (no rel-eng ticket available yet) | 15:07 |
jlaska | and lastly ... | 15:08 |
jlaska | #info Oct 26 - F-14 Go/No Go meeting (see https://fedoraproject.org/wiki/Go_No_Go_Meeting) | 15:08 |
jlaska | so this means we have less than 3 weeks to have all F14 blocker bugs closed | 15:08 |
adamw | yay fun | 15:09 |
jsmith | w00t! | 15:09 |
jlaska | We hosted the first of the F-14-Final blocker review meetings last Friday (http://meetbot.fedoraproject.org/fedora-bugzappers/2010-10-01/f-14-blocker-review.2010-10-01-16.00.log.html) | 15:09 |
jlaska | I suspect adamw is still in pain from that one | 15:09 |
jlaska | it was a *long* meeting | 15:09 |
jlaska | meetings that require an intermission ... ouch! | 15:09 |
jlaska | one question I have regarding this weeks planned acceptance test run ... | 15:10 |
jlaska | previously, we use these checkpoints to run the rawhide acceptance test plan (https://fedoraproject.org/wiki/QA:Rawhide_Acceptance_Test_Plan) | 15:10 |
jlaska | this was mainly intended to identify any big gotchas with doing a basic install, boot and login to the desktop | 15:11 |
jlaska | do we want to continue with this plan ... or should we consider additional installer or desktop testing? | 15:11 |
jlaska | or perhaps, just bug verification? | 15:11 |
jlaska | any suggestions / ideas ? | 15:11 |
adamw | we can't easily change this, can we? | 15:11 |
adamw | since it requires Code | 15:11 |
jlaska | adamw: sorry, change what? | 15:12 |
jlaska | the automation used to run the acceptance plan? | 15:12 |
adamw | what the parameters for automated testing are | 15:12 |
saccia | I say we make sure we add something in that relates to dual hard drive setups... that's been nipping at us recently | 15:12 |
jlaska | adamw: yeah, I don't imagine we'll be able to adjust the automated testing very quickly for this week | 15:13 |
jlaska | saccia: let's continue to test the scenario you, Southern_Gentlem and I were discussing in #fedora-qa earlier. That's a tough challenging test scenario in that the 'expected results' aren't very explicit in most cases. | 15:14 |
adamw | i mean, i thought it was generally understood the long-term goal was simply to automate as many of the validation tests as we can, and what we have implemented so far is simply what we've managed | 15:14 |
jlaska | adamw: yes certainly | 15:14 |
jlaska | adamw: for the milestone this week, my question wasn't so much ... how do we want to change the automation we run this week | 15:14 |
jlaska | more ... do we want to include _other_ tests/activities during this event | 15:15 |
jlaska | to help identify issues earlier, or verify MODIFIED/ON_QA issues etc... | 15:15 |
adamw | oh. like, manual testing? | 15:15 |
jlaska | yeah, that could be one thing | 15:15 |
kparal | "manual", that sounds awful :P | 15:16 |
jlaska | it sure does! | 15:16 |
jlaska | awfully fun you meant, right? :P | 15:16 |
adamw | i dunno, i'm not sure it's sensible to load other stuff into the rawhide acceptance testing system | 15:17 |
adamw | reviewing blocker issues isn't really part of that is it? | 15:17 |
jlaska | adamw: I wouldn't suggest that either | 15:17 |
adamw | what did you have in mind? | 15:17 |
jlaska | I'm asking for ideas/suggestions in _addition_ to the planned acceptance run | 15:17 |
jlaska | sorry if that wasn't clear | 15:17 |
jlaska | I'm just worried that we only have about 5 days to find and fix bugs against TC1 | 15:18 |
jlaska | in order for them to land in RC1 | 15:18 |
jlaska | for Beta ... TC1 landed late | 15:18 |
jlaska | leaving less time | 15:18 |
kparal | we can do standard installation matrix even for that acceptance compose | 15:18 |
jlaska | adamw: do we have a lot of ON_QA or MODIFIED bugs on the blocker list? | 15:19 |
jlaska | kparal: I was wondering about that too, whether we had cycles to support additional installer tests | 15:19 |
adamw | 7 | 15:20 |
adamw | kparal's idea isn't a bad one, though that effectively turns the acceptance compose into TC1 | 15:20 |
jlaska | adamw: true, is that bad? | 15:20 |
adamw | not necessarily, just it would mean that we're not happy with the current process and we should probably change it formally rather than re-purposing things | 15:21 |
jlaska | actually, repurposing is just what I had in mind | 15:21 |
jlaska | I think that's what kparal's suggesting | 15:21 |
jlaska | okay, I'll take this offline ... I want to run kparal's idea by Hurry and Newgle too | 15:22 |
jlaska | either way, we're going to continue with the planned acceptance run this week | 15:22 |
jlaska | any ideas to help front-load any of the TC1 or RC1 firestorm ... please don't hesitate | 15:22 |
jlaska | #idea potentially add some of the validation matrix testing to the planned acceptance run? | 15:24 |
jlaska | #action jlaska to check-in with rhe for thoughts on doing a limited test run of validation matrix this week | 15:24 |
jlaska | #topic F14 Test Days | 15:24 |
jlaska | alright, so this is another FYI topic | 15:24 |
jlaska | Unless you were on another planet last week ... Adam and company hosted the always popular X test week | 15:25 |
jlaska | #info Sep 28-30 - Graphics test week | 15:25 |
adamw | i haven't done a summary yet, planning that for today | 15:25 |
jlaska | From what I can tell, the event rocked? | 15:25 |
jlaska | adamw: okay, sweet | 15:25 |
jlaska | adamw: any issues or highlights to note here? | 15:26 |
kparal | and the 'most unsatisfied tester prize' wins... kparal. 5 bugs! :o) | 15:26 |
adamw | all went ahead fine | 15:26 |
kparal | (meaning Intel test day) | 15:27 |
jlaska | haha, I like that prize :) | 15:27 |
adamw | it wasn't as busy as the last few, my fault for not promoting more ahead of time; it kind snuck up on me | 15:27 |
adamw | thanks a lot kparal | 15:27 |
jlaska | adamw: cool, feel free to log that or any other thoughts to https://fedoraproject.org/wiki/Fedora_14_QA_Retrospective | 15:27 |
jlaska | I've got a bullet there for the virt test day as well | 15:28 |
jlaska | #info Oct 07 - Open slot | 15:28 |
jlaska | so no test day planned this week | 15:28 |
jlaska | which is partly why I was thinking about taking our typicaly test day time, and devoting it in some way to working on F-14-Final tests/bugs/$something | 15:28 |
jlaska | #info Oct 14 - OpenLDAP and nss | 15:28 |
jlaska | The wiki appears to be well underway - https://fedoraproject.org/wiki/Test_Day:2010-10-14_OpenLDAP/NSS | 15:29 |
kparal | I help with that | 15:29 |
kparal | those guys are pretty active | 15:29 |
kparal | I think all should be prepared well in time | 15:29 |
jlaska | kparal: awesome! Any next steps you want to note? | 15:29 |
jlaska | Are they planning to test-announce and planet.fedoraproject.org the event? | 15:29 |
kparal | I just need to ensure LiveCD can be built and sent out announcements | 15:29 |
jlaska | or should one of us handle that | 15:29 |
jlaska | kparal: oh, it needs a custom live image? | 15:30 |
kparal | may be | 15:30 |
* kparal needs to check out :) | 15:30 | |
jlaska | I actually can build live images now, unlike previously when adamw asked for live image creation help | 15:30 |
adamw | heh | 15:30 |
* adamw can build 32-bit ones now too, whatever the bug was with that, it's fixed | 15:30 | |
jlaska | alright, I think that covers test days | 15:30 |
jlaska | anything else before moving on? (moving in 30 seconds) | 15:31 |
jlaska | alrighty ... | 15:31 |
jlaska | two more topics before open-discussion (autoqa and NTH update) | 15:32 |
jlaska | #topic AutoQA Package Acceptance Update | 15:32 |
jlaska | kparal: I have 2 follow-up items on the list from last week ... do you want to take it away? | 15:32 |
kparal | sure, what are they? | 15:32 |
jlaska | wwoods will also add an rpm test transaction to depcheck to catch file conflicts | 15:33 |
jlaska | jskladan and wwoods investigating mash integration | 15:33 |
kparal | wwoods is out right now, I don't think I have any news about that | 15:33 |
kparal | let's keep it to next time | 15:34 |
jlaska | sounds good | 15:34 |
* jlaska will leave those on the wiki for next week | 15:34 | |
kparal | apart from that, the last week was mainly involved around upgradepath | 15:34 |
kparal | so, we have received some new patches | 15:34 |
kparal | we stopped checking -testing repos, because we're not sure how to do that properly | 15:35 |
kparal | we need to consult with FESCo about it | 15:35 |
kparal | also there were some small fixes and cleanups in upgradepath code | 15:35 |
kparal | I have started a thread about timing-sensitive tests, that will be a main topic soon when we plan to actually use it in production | 15:36 |
kparal | upgradepath is one of them, the other is depcheck | 15:36 |
kparal | as for other new, jlaska posted a few fixes and we received a huge resultsdb patch from jskladan | 15:37 |
jskladan | eh, it was not a patch :-D more of recapitulation of the current state :) | 15:37 |
kparal | #info we stopped checking -testing repos in upgradepath test, because we're not sure how to do that properly - we need to consult FESCo | 15:37 |
kparal | #info we started a thread about timing-sensitive tests - upgradepath and depcheck - how and when to correctly execute them | 15:38 |
jskladan | but sure - currently resultsdb patches for autoqa are waiting to be pushed to master, so we can start storing some test results (together with sending emails to the -results list) | 15:38 |
jskladan | so once there is some reasonable dataset, we can hop into creating frontends | 15:38 |
jskladan | the aforementioned email <https://fedorahosted.org/pipermail/autoqa-devel/2010-September/001187.html> | 15:39 |
jskladan | also describes a 'metadata' proposal | 15:40 |
kparal | #info resultsdb patches for autoqa are waiting to be pushed to master | 15:40 |
jskladan | which can be used to describe testplans in a unanimous way, so we can create a "generic testplan frontend" | 15:40 |
jskladan | which will visualize testplans using the structure defined in the provided metadata | 15:41 |
jskladan | (but that is kind of 'happy future' for now :) ) | 15:41 |
kparal | #info jskladan prepares a way for us to be able to create "generic testplan frontend" | 15:41 |
* jskladan ends the boring monologue | 15:41 | |
kparal | as a side note, in autoqa-devel there is also an ongoing discussion with atodorov how to handle whitelisting of particular lines in rpmlint test case. feel free to join in. | 15:42 |
kparal | that should be all of autoqa I think | 15:42 |
kparal | #topic F-14-NTH (Nice to have) proposal status | 15:42 |
kparal | adamw: you want to say a few words about this? | 15:42 |
adamw | sure | 15:43 |
adamw | not much to say beyond the proposal on the ml, which we've been acting on provisionally | 15:43 |
adamw | if i don't get any more feedback to the mail i'll just go ahead and push the policy, so be warned =) | 15:43 |
kparal | #link http://lists.fedoraproject.org/pipermail/test/2010-September/093833.html | 15:43 |
adamw | it seems to be working out fine so far, we reviewed and accepted several NTH bugs at the blocker review meetin | 15:44 |
kparal | #info adamw threatens to push the policy, hurry with comments :) | 15:44 |
kparal | ok, thanks adamw | 15:45 |
kparal | #topic Open discussion <your topic here> | 15:45 |
kparal | any proposals for discussion? | 15:45 |
adamw | nothing from me | 15:47 |
* kparal declares this monday as the Sleepy Monday | 15:47 | |
kparal | closing in 1 minute if no other topics | 15:47 |
jlaska | kparal: thanks for driving :) | 15:48 |
kparal | jlaska: you're welcome | 15:48 |
kparal | have a nice day everyone | 15:48 |
kparal | #endmeeting | 15:49 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!