FedoraCommunity/UsabilityTestingRound1/UsabilityTester3

= FEDORA COMMUNITY USABILITY TEST: Usability Tester 3 =


 * Date/Time: Friday, 16 October 2009 / 3 PM
 * Video Files:
 * Part A:
 * Direct Link to File
 * 
 * Part B
 * Direct Link to File
 * 
 * FAS Account: (withheld for privacy for now)
 * Browser used: firefox-3.0.1-1.fc9.i386
 * Computer used: Mo's T41 laptop (Fedora 9)
 * Package maintainership: 3 packages, new maintainer

Introduction / First Impressions

 * 1) Have you seen this site before?  If so, where did you hear about it? 
 * 2) * Yes, found out about it on fedora-announce I think; also see banner ad on front page of fedoraproject.og
 * 3) Have you used this site before? If so, what have you used it for? How did that go? How often have you used this site? 
 * 4) * Yes, I've used it to find out who owns a package. It went well. It was useful because it showed just how many packages that person owned, which made it clear they were overloaded. Used infrequently - maybe only 2 times since it launched.
 * 5) (On front page) What are your first impressions, looking at this site now? 
 * 6) * When I first saw it, I was confused about what it was. It's not clear from the name. I didn't know what any of this stuff was 3 months ago before I became a maintainer - the lingo was not accessibl. It seems aimed more towards people already involved in Fedora, and doesn't seem to have a path for newbies to learn more about it and get started.
 * 7) (On front page) What do you think this site is? 
 * 8) * First thoughts: Why do we need a community? What more do we need? A forum? We already have one. It didn't seem associated with package management.
 * 9) (On front page) Any other comments you'd like to make about this site? 
 * 10) * Does people search work without login? It should tell me it would if I was logged in.
 * 11) (On front page) What do you think of this page? Where would you click first? 
 * 12) * Not sure, there's a few paths I might take:
 * 13) ** log in
 * 14) *** first reaction - do i have an account here?
 * 15) *** if i dont have a log in - I go to sign up. dumps me to the FAS page, which looks really different. what am i really signing up for here? This doesn't look the same.
 * 16) ** take the tour
 * 17) ** search, try my user name. it didn't work!

People

 * 1) View your profile on this site. What do you think about it? Is the information accurate? Do your group memberships seem accurate? Do your package affiliations seem accurate?
 * 2) * click on my profile in left bar (my first instinct is to click my name in the upper right. both work!)
 * 3) * IRC/email/Timezone look right
 * 4) * I really like that my blog is here! And showing this for other users gives you a feel for how active they are
 * 5) * 'go to users packagers' for *my* packages <= typo/messup in right sidebar
 * 6) * in-progress builds are not so useful for me since i only own 3 packages.
 * 7) * i would like to see my trac tickets here, but they're not.
 * 8) You've just spoken with Dennis Gilmore and he's asked you to open a ticket for him in a fedorahosted.org trac instance. In order to cc Dennis on the ticket, you'll need to figure out his FAS account name. Where would you go to look it up?
 * 9) * FC isn't where i would start. I'd ask in IRC or i'd ak FAS bot.
 * 10) * search for dennis gilmore at search box up top
 * 11) * no luck, tries gilmore
 * 12) * no luck, tries dgilmore
 * 13) * no luck, tries dennis
 * 14) ** people search works only if logged in, if not you need to advertise it better
 * 15) * goes to google
 * 16) * searches for dennis' wiki user page
 * 17) * finds a package dennis owns
 * 18) * looks up package in fcomm - oh there's his FA name - ausil
 * 19) * TASK COULD ONLY BE COMPLETED WITH RIDICULOUS AMOUNT OF EFFORT

Packages

 * 1) Do you have any unpushed updates? Where would you go to look this up?
 * 2) * clicks on name in upper right
 * 3) * goes to 'packages i own'
 * 4) * looks under updates => unpushed
 * 5) * no unpushed updates!
 * 6) How are your builds doing? Where would you go to look this up? 
 * 7) * goes to 'alerts' in lower right of profile
 * 8) * there's counts here
 * 9) * i alo see links under 'builds' - do these provide additional information, or are they redundant to what this alerts app just told me?
 * 10) Let's say you have a friend who is a little bit behind the times - she is running Fedora 9. There's an annoying Inkscape bug that bothers her - after searching the internet for a bit you found out the bug is fixed in Inkscape version 0.47. 
 * 11) * Is Inkscape version 0.47 available in Fedora 9 for your friend? 
 * 12) ** my first instinct would be to look in pkgdb but i'll try this
 * 13) ** search for inkscape, clicks on it
 * 14) ** looks at details
 * 15) ** doesn't look like f9 is in active releases
 * 16) ** looks at builds from right sidebar
 * 17) ** doesn't help. no help.
 * 18) ** i'm not 100% sure but i don't think it is.
 * 19) * If Inkscape version 0.47 is not available for Fedora 9, can you download an SRPM here to build it for her? 
 * 20) ** clicks on 'source' link out to viewcvs in the middle of the screen
 * 21) ** dumps out to viewcvs
 * 22) ** confusing. wait there's f9 stuff here?
 * 23) ** that's .46, need .47
 * 24) ** look at one of the later versions
 * 25) ** F11 hass .47, click on sources, grab spec file
 * 26) * TASK COULD ONLY BE COMPLETED WITH RIDICULOUS AMOUNT OF EFFORT

People

 * 1) You need help with yelp. Who's the package maintainer? 
 * 2) * searches for yelp up top
 * 3) * okay it's mbarnes
 * 4) * difference between owners and maintainers???
 * 5) Luke Macken is going away on vacation for a couple of weeks and he's asked you to look over his packages while he's gone. How many packages does he have, and do any of them need attention? Where would you go to look this up? 
 * 6) * searches for lmacken, there he is, clicks
 * 7) * i assume i'm just looking for packages he owns, not maintains - he didn't specify
 * 8) * wow he owns a lot
 * 9) * looks at his package alerts - 1 build suceeded
 * 10) * BUG! lmacken's alerts for packages on his profile, when she clicks on them, instead dump her to those pages on *her* profile not luke's.

Packages

 * 1) How would you file a bug against NetworkManager using this system?
 * 2) * do i have to use this?
 * 3) * network manager comes up in search in lowercase, great, cap don't matter
 * 4) * clicks bugs link out to bz, goes out to bz, report (in main content area)
 * 5) * shown an alternative - clicks maintenance tools, then bugs in right sidebar.
 * 6) ** rename s/maintenance tools/help with this package? maybe? for bugs dashboard?
 * 7) What has changed in the 'ruby' package over the last few updates? Where would you go to look this up? 
 * 8) * searches for 'ruby' - but i wonder about people named 'ruby'?
 * 9) * goes to maint tools > updates > doesn't tell me what changed here
 * 10) * goes back to details page for ruby, looks at changelog at bottom, there you go
 * 11) * i don't see any way to get a diff here
 * 12) How's the karma of your current testing updates doing? How would you check up on this in Fedora Community?
 * 13) * what's karma?
 * 14) * what's a releae?
 * 15) * package details doesn't show karma anywhere on the screen
 * 16) * go to my profile
 * 17) * search for karma using firefox search, nothing
 * 18) * go to user's packages, not sure how to look outside of fcomm
 * 19) * would ask in IRC, i've only heard of karma once before
 * 20) * search for karma in searchbar at top - nothing
 * 21) * search google for karma fedora....
 * 22) * FAIL

CLOSING

 * 1) How well does Fedora Community support your package maintenance workflow?
 * 2) * I have a package owrkflow?
 * 3) * I don't know, i'm new, have a small number of packages, and learned how to do stuff outside of fedora community
 * 4) * I learned through IRC and was taught the old workflow
 * 5) * i could see it being useful though, a screenshot tutorial geared towards new packagers, step-by-step, would be useful
 * 6) Would you use Fedora Community to help maintain your packages? Which parts? 
 * 7) * yeh i would want to use everything you walked me thru here except karma
 * 8) * i don't understand karma
 * 9) * package deps - i could use this to research the packages my packages depend on
 * 10) * i wouldn't use this to look up updates i made myself, maybe other packages though
 * 11) * finding out who owns a package
 * 12) * finding out who maintains a package
 * 13) * what does their workload look like? are they a red hat person and do this as a day job? are they MIA? (can tell they are not MIA if they have recent blog posts)
 * 14) Is there any essential functionality missing from Fedora Community that would help you maintain your packages more easily?
 * 15) * documentation on how to use
 * 16) * need docs on 'how to use workflow' - workflow oriented rather than feature oriented
 * 17) * good for existing old timers, but need to set this up to get new package maintainers involved and on board
 * 18) * be a package maint pro - do you want to get started being a package? you can be a packager too! here's some examples.
 * 19) * for old timers - that's great but i already do this!
 * 20) Did you learn anything about Fedora Community's functionality through this test?
 * 21) * yes
 * 22) What do you think is the most useful function of Fedora Community?
 * 23) * search for finding maintainers and other stuff they maintain
 * 24) * for some reason people are more helpful for me to look up here than packages
 * 25) What are the least useful functions of Fedora Community?
 * 26) * karma