FedoraCommunity/UsabilityTestingRound1/UsabilityTester4

= FEDORA COMMUNITY USABILITY TEST: Usability Tester 4 =


 * Date/Time: Wednesday 6 December 2009
 * Video Files:
 * Part A: TBA
 * Part B: TBA
 * FAS Account: (withheld for privacy for now)
 * Browser used: firefox-3.5.6-1.fc12.x86_64
 * Computer used: Mo's x61 laptop (Fedora 12)
 * Package maintainership: ?

Introduction / First Impressions

 * 1) Have you seen this site before?  If so, where did you hear about it? 
 * 2) * Yes, I found out about it from Luke Macken
 * 3) Have you used this site before? If so, what have you used it for? How did that go? How often have you used this site? 
 * 4) * I've only visited it a handful of times to see if it was up and running; I've not tried it for the workflows.
 * 5) (On front page) What are your first impressions, looking at this site now? 
 * 6) * looking at Kyle's photo
 * 7) * I see packages built, but they're not mine
 * 8) * It takes a long time to load this page
 * 9) * This seems packager-centric
 * 10) (On front page) What do you think this site is? 
 * 11) * It looks like a way to look at things going on in Fedora - planet and builds
 * 12) (On front page) Any other comments you'd like to make about this site? 
 * 13) * Not really
 * 14) (On front page) What do you think of this page? Where would you click first? 
 * 15) * log in

People

 * 1) View your profile on this site. What do you think about it? Is the information accurate? Do your group memberships seem accurate? Do your package affiliations seem accurate?
 * 2) * the alerts widget is broken
 * 3) * clicks on 'my profile' in the left nav
 * 4) * looks right
 * 5) * only some of my groups are shown here. The ones in the preview don't matter to me - I care a lot more about the groups I've sponsored people in, the ones I'm a team lead for
 * 6) * for example, the admin group I care about? cla_done is useless to me
 * 7) * the memberships tab shows 10 of them - it seems accurate though
 * 8) * package affiliations - confusing - package maintenance tab just shows a list of packages, not what i can do with them
 * 9) You've just spoken with Dennis Gilmore and he's asked you to open a ticket for him in a fedorahosted.org trac instance. In order to cc Dennis on the ticket, you'll need to figure out his FAS account name. Where would you go to look it up?
 * 10) * search box at top, types 'gilmore'
 * 11) * no luck, tries 'dgilmore'
 * 12) * unchecks 'packages' checkbox on search and tries again, no luck
 * 13) * types 'ansil' there it is
 * 14) * TASK COULD ONLY BE COMPLETED IF YOU ALREADY KNEW THE ANSWER

Packages

 * 1) Do you have any unpushed updates? Where would you go to look this up?
 * 2) * clicks 'my profile' in left nav
 * 3) * clicks 'package maintenance' top tab
 * 4) * clicks 'cacti'
 * 5) * takes a very long time to load 'active releases' for cacti
 * 6) * clicks 'maintenance tools' top tab in cacti details page. not loading, very slow===
 * 7) * not sure where to go
 * 8) * goes back to 'my profile' in left nav, clicks on top 'package maintenance' tab
 * 9) * looks at right sidebar... sees 'unpushed updates'.... there's none
 * 10) * success
 * 11) How are your builds doing? Where would you go to look this up? 
 * 12) * looks at right sidebar of his profile
 * 13) * looks at builds - nothing building
 * 14) * success
 * 15) Let's say you have a friend who is a little bit behind the times - she is running Fedora 10. There's an annoying Inkscape bug that bothers her - after searching the internet for a bit you found out the bug is fixed in Inkscape version 0.47. 
 * 16) * Is Inkscape version 0.47 available in Fedora 9 for your friend? 
 * 17) * I would never go here to find that out
 * 18) * I know that our website lags behind the mirrors, I would use yum to hit the repo directly
 * 19) * I rarely use the web to get packages, yum security plugin writes to website
 * 20) * searches for 'Inkscape 0.47'
 * 21) ** clicks on inkscape
 * 22) ** sees it is available
 * 23) ** in F10, it's not in the official repos
 * 24) ** it's in testing rather than released
 * 25) * If Inkscape version 0.47 is not available for Fedora 10, can you download an SRPM here to build it for her? 
 * 26) ** I would not use this
 * 27) ** I would shell out and look in cvs
 * 28) ** clicks source, sees 'view cvs'
 * 29) ** clicks version in active releases table. goes out to bodhi
 * 30) ** clicks on version in active releases table under testing
 * 31) ** clicks overview in right sidebar
 * 32) ** finds sources in right sidebar and clicks
 * 33) ** i never look for stuff on web

People

 * 1) You need help with yelp. Who's the package maintainer? 
 * 2) * I would ask zodbot in IRC normally, but.... using this:
 * 3) * searches for 'yelp'
 * 4) * checks 'owners' table on the right side of the page
 * 5) * 'mbarnes'
 * 6) Luke Macken is going away on vacation for a couple of weeks and he's asked you to look over his packages while he's gone. How many packages does he have, and do any of them need attention? Where would you go to look this up? 
 * 7) * tries to search, but search will not work, it's broken right now

Packages

 * 1) How would you file a bug against NetworkManager using this system?
 * 2) * goes to searchbox up top
 * 3) * searches for 'Network Manager'
 * 4) * 'bugs' item is listed in right sidebar, finds right away
 * 5) What has changed in the 'ruby' package over the last few updates? Where would you go to look this up? 
 * 6) * goes to searchbox up top
 * 7) * searches for 'ruby'
 * 8) * scrolls down and sees changelog right in the package details screen
 * 9) How's the karma of your current testing updates doing? How would you check up on this in Fedora Community?
 * 10) * clicks on 'my profile'
 * 11) * BUG 'my tasks' is cut off in the lower right corner
 * 12) * checks 'updates testing' in the right sidebar (found it)

CLOSING

 * 1) How well does Fedora Community support your package maintenance workflow?
 * 2) * It's a drastic change from the CLI way I do things.
 * 3) * I use 'make update' to do them across multiple shells
 * 4) * My hands hardly ever leave the homerow of the keyboard the way I do things today
 * 5) * I can't do testing updates in the CLI though
 * 6) * what is an 'unpushed update'?
 * 7) ** Can I see non-updated builds? I don't see that here
 * 8) ** As long as I can push several updates at once it would support my workflow
 * 9) Would you use Fedora Community to help maintain your packages? Which parts? 
 * 10) * This isn't compelling enough.
 * 11) * I'm used to my way
 * 12) * This doesn't seem overly better.
 * 13) * I would recommend this to newbies and casual users
 * 14) Is there any essential functionality missing from Fedora Community that would help you maintain your packages more easily?
 * 15) * Knowing what it's all about
 * 16) * Overview idea is good but the info here on the overview goes beyond overview (e.g. planet.fpo)
 * 17) * Latest stable updates - rare for me to care about - latest builds is more useful
 * 18) * Latest testing updates - not useful
 * 19) * fedora planet not so useful. should be more developer-focused
 * 20) * would be neat to have something that indicates if rawhide is working or not
 * 21) * would be neat to have something that indicates if koji is down or not
 * 22) Did you learn anything about Fedora Community's functionality through this test?
 * 23) * I did. I didn't know about the features we went through.
 * 24) * My profile > package maintenance has hidden goodies
 * 25) What do you think is the most useful function of Fedora Community?
 * 26) * i like how search works, i used it several times. It makes it easy for me to get to where I want to go
 * 27) What are the least useful functions of Fedora Community?
 * 28) * planet.fpo feed: a lot of stuff I don't care about is on the overview, needs to be pared down and re-thought
 * 29) * we want more news aggregation with release cycle timetables
 * 30) * make deadlines more visible? combine deadlines?
 * 31) * when i log out, the screen it gives me is weird
 * 32) * general package list under main 'packages' tab is not that useful