From Fedora Project Wiki
(Created page with '= FEDORA COMMUNITY USABILITY TEST: Usability Tester 7 = * '''Date/Time:''' Wednesday 6 December 2009 * '''Video Files:''' ** Part A: TBA ** Part B: TBA * '''FAS Account:''' (w...')
 
No edit summary
 
Line 36: Line 36:


# '''View your profile on this site. What do you think about it? Is the information accurate? Do your group memberships seem accurate? Do your package affiliations seem accurate?'''
# '''View your profile on this site. What do you think about it? Is the information accurate? Do your group memberships seem accurate? Do your package affiliations seem accurate?'''
#* slow: the spinners take a long time, even if a fast connection is in place
#* logs in
#* membership looked correct except one group was missing
#* clicks 'my profile' on the right
#* clicks on 'my profile' in the right sidebar
#* yes
#* it's nice to see my FAS account right here
#* many missing groups - this shows 5 but i'm in 20
#* alerts widget is broken
#* clicks membership top tab => sees more but not all
#* my packages are there - click view all (would like it to expand without page load)
#* pacakges: looks at right sidebar => clicks to view more => packages owned looks right
#* packages look accurate
# '''You've just spoken with Dennis Gilmore and he's asked you to open a ticket for him in a fedorahosted.org trac instance. In order to cc Dennis on the ticket, you'll need to figure out his FAS account name. Where would you go to look it up?'''
# '''You've just spoken with Dennis Gilmore and he's asked you to open a ticket for him in a fedorahosted.org trac instance. In order to cc Dennis on the ticket, you'll need to figure out his FAS account name. Where would you go to look it up?'''
#* goes to 'people' in the left bar... no, maybe search
#* top search, types 'dennis gilmore'
#* tries search. tries 'gilmore'. doesn't show up
#* but he's not there
#* searching packages and people is cool, even though it didn't work here
#* tries 'luya' - finds him


=== Packages ===
=== Packages ===


# '''Do you have any unpushed updates? Where would you go to look this up?'''  
# '''Do you have any unpushed updates? Where would you go to look this up?'''  
#* i know I do
#* i think i do
#* clicks 'package maintenance'
#* clicks package maintenance in the left sidebar
#* on my profile page, I would have clicked 'packages' there
#* clicks updates top tab
#* see updates tab up top
#* looks like I can push to stable, right?
#* Right sidebar => packages I own => unpushed updates (but it doesn't give me a count!)
#* broken.
#* found them
#* takes forever to load!
# '''How are your builds doing? Where would you go to look this up? '''
# '''How are your builds doing? Where would you go to look this up? '''
#* clicks builds tab up top
#* clicks 'builds' top tab
#* does not load at first
#* logs have been purged
#* failed builds depressing and it's been 3 months
#* i like the hover menu to branch out to other apps
#* if the build has been fixed sinced then, don't display those old failures
#* so many errors, i didn't realize this was builds failing. I thought fedora community was failing.
#* hudson weather report idea
#* oh i can create an update here.
# '''Let's say you have a friend who is a little bit behind the times - she is running Fedora 10. There's an annoying Inkscape bug that bothers her - after searching the internet for a bit you found out the bug is fixed in Inkscape version 0.47. '''
# '''Let's say you have a friend who is a little bit behind the times - she is running Fedora 10. There's an annoying Inkscape bug that bothers her - after searching the internet for a bit you found out the bug is fixed in Inkscape version 0.47. '''
#* '''Is Inkscape version 0.47 available in Fedora 10 for your friend? '''
#* '''Is Inkscape version 0.47 available in Fedora 10 for your friend? '''
#** goes to search => 'inkscape'
#** clicks 'search' in left navbar
#** clicks 'inkscape' in results
#** searches for 'inkscape'
#** F10 updates testing yes, not sure what the karma face means
#** clicks on inkscape search result
#** yes it's available in testing
#* '''If Inkscape version 0.47 is not available for Fedora 10, can you download an SRPM here to build it for her? '''
#* '''If Inkscape version 0.47 is not available for Fedora 10, can you download an SRPM here to build it for her? '''
#** see that it's in F11. click on that - oh, that brings me to bodhi.
#** clicked on 'builds' link in the 'package links' grey box - no
#** see the source button, but that will bring me to view cvs
#** scrolls down details page for inkscape, sees changelog, looks at the right sidebar, see all packages => updates
#** scrolls page
#** keeps scrolling details page and clicks out to package DB
#** many tools on the right side of page. clicks 'sources'
#** sees 'source' link in package links => confused
#** things on the right confusing
#** right sidebar? no
#** found it
#*** fail


== TASK SET II ==
== TASK SET II ==
Line 81: Line 79:
=== People ===
=== People ===
# '''You need help with yelp. Who's the package maintainer? '''
# '''You need help with yelp. Who's the package maintainer? '''
#* searches for 'yelp'
#* goes to top search
#* clicks 'yelp' in reuslts
#* types 'yelp' clicks on the yelp search result
#* 'mbarnes'
#* 'mbarnes'  
#* success
#* bug in details page
# '''Luke Macken is going away on vacation for a couple of weeks and he's asked you to look over his packages while he's gone. How many packages does he have, and do any of them need attention? Where would you go to look this up? '''
# '''Luke Macken is going away on vacation for a couple of weeks and he's asked you to look over his packages while he's gone. How many packages does he have, and do any of them need attention? Where would you go to look this up? '''
#* we skipped this one because user profiles stopped loading completely
#* we skipped this one because user profiles stopped loading completely
Line 90: Line 88:
=== Packages ===
=== Packages ===
# '''How would you file a bug against NetworkManager using this system?'''
# '''How would you file a bug against NetworkManager using this system?'''
#* searches for 'network manager'
#* goes to the top searchbox
#* sees 'bugs' icon in the center links bar
#* searches for 'Network Manager'
#* didn't click on it
#* clicks to view network manager details
#* goes to the right sidebar => maintenance tools => bugs
#* sees 'bugs' in right sidebar
#* it's broken, bugs page won't load
# '''What has changed in the 'ruby' package over the last few updates? Where would you go to look this up? '''
# '''What has changed in the 'ruby' package over the last few updates? Where would you go to look this up? '''
#* search for ruby (would like to jump to it by changing url rather than having to search)
#* types 'ruby' in the top search bar
#* scrolls down - there it is on the package details overview
#* scrolls down details page and sees changelog
# '''How's the karma of your current testing updates doing? How would you check up on this in Fedora Community?'''  
# '''How's the karma of your current testing updates doing? How would you check up on this in Fedora Community?'''  
#* right sidebar => package maintenance => unpushed updates
#* clicks on 'package maintenance' left tab
#* there are none
#* clicks on 'updates' top tab
#* confused about testing updates now
#* scrolls down to 'testing updates' section


== CLOSING ==
== CLOSING ==


# '''How well does Fedora Community support your package maintenance workflow?'''  
# '''How well does Fedora Community support your package maintenance workflow?'''  
#* not well. it's too slow compared to my tools.
#* it would very well without the bugs we hit in it
#* I would have used rpm -qi --changelog to get the changelog, for example
#* i would have looked at my cvs log.
#* bodhi is hard, though. this makes it easy.
#* I avoid updating too frequently because they are large for my packages (?)
# '''Would you use Fedora Community to help maintain your packages? Which parts? '''
# '''Would you use Fedora Community to help maintain your packages? Which parts? '''
#* nice to see the builds and updates in one place
#* sure
#* if this had a bug cache that was faster than bugzilla... I would definitely use it
#* pushing updates to stable would be useful
#* would be nice to see a list of bugs that are open against my packages in one view
#* seeing build status in one place is useful
# '''Is there any essential functionality missing from Fedora Community that would help you maintain your packages more easily?'''  
# '''Is there any essential functionality missing from Fedora Community that would help you maintain your packages more easily?'''  
#* bug dashboard
#* one missing thing - I want to update a bunch at the same time - to submit them as one update
#* speed
#* a web-based editor for spec files to commit them
#* maybe a cvs url for the package to grab it
# '''Did you learn anything about Fedora Community's functionality through this test?'''
# '''Did you learn anything about Fedora Community's functionality through this test?'''
#* didn't know if supported updates
#* i had only looked at the front page
#* blog posts
#* i don't trust it totally because my group memberships were listed wrong
#* nice to see my memberships, i never know where to go to see that
#* having builds and updates in one spot is valuable
#* own vs. maintain
#* i didn't know i could file BZs with it
# '''What do you think is the most useful function of Fedora Community?'''  
# '''What do you think is the most useful function of Fedora Community?'''  
#* high-level view of everything
#* pulls everything together into one unifed portal
# '''What are the least useful functions of Fedora Community?'''
# '''What are the least useful functions of Fedora Community?'''
#* group membership information not in the main profile page
#* most difficult was downloading an SRPM or binary - couldn't find it

Latest revision as of 18:39, 8 March 2010

FEDORA COMMUNITY USABILITY TEST: Usability Tester 7

  • Date/Time: Wednesday 6 December 2009
  • Video Files:
    • Part A: TBA
    • Part B: TBA
  • FAS Account: (withheld for privacy for now)
  • Browser used: firefox-3.5.6-1.fc12.x86_64
  • Computer used: Mo's x61 laptop (Fedora 12)
  • Package maintainership: Own 18, maintain 2

Introduction / First Impressions

  1. Have you seen this site before? If so, where did you hear about it?
    • yes, but i haven't seen it fully
    • I think I heard about it on IRC or on a mailing list
  2. Have you used this site before? If so, what have you used it for? How did that go? How often have you used this site?
    • i've looked through it, browsing
    • it looked ok but it didn't seem to provide much functinoality
    • I haven't used it often. Once or twice.
  3. (On front page) What are your first impressions, looking at this site now?
    • great login space
    • shows latest builds
    • widget on the right side is broken
  4. (On front page) What do you think this site is?
    • a site to maintain packages
    • stuff related to maintaining packages
    • a way to unite all the package maintenance apps
  5. (On front page) Any other comments you'd like to make about this site?
    • not really
  6. (On front page) What do you think of this page? Where would you click first?
    • login

TASK SET I

People

  1. View your profile on this site. What do you think about it? Is the information accurate? Do your group memberships seem accurate? Do your package affiliations seem accurate?
    • logs in
    • clicks 'my profile' on the right
    • yes
    • many missing groups - this shows 5 but i'm in 20
    • clicks membership top tab => sees more but not all
    • pacakges: looks at right sidebar => clicks to view more => packages owned looks right
  2. You've just spoken with Dennis Gilmore and he's asked you to open a ticket for him in a fedorahosted.org trac instance. In order to cc Dennis on the ticket, you'll need to figure out his FAS account name. Where would you go to look it up?
    • top search, types 'dennis gilmore'
    • but he's not there
    • tries 'luya' - finds him

Packages

  1. Do you have any unpushed updates? Where would you go to look this up?
    • i think i do
    • clicks package maintenance in the left sidebar
    • clicks updates top tab
    • looks like I can push to stable, right?
    • broken.
  2. How are your builds doing? Where would you go to look this up?
    • clicks 'builds' top tab
    • logs have been purged
    • i like the hover menu to branch out to other apps
    • so many errors, i didn't realize this was builds failing. I thought fedora community was failing.
    • oh i can create an update here.
  3. Let's say you have a friend who is a little bit behind the times - she is running Fedora 10. There's an annoying Inkscape bug that bothers her - after searching the internet for a bit you found out the bug is fixed in Inkscape version 0.47.
    • Is Inkscape version 0.47 available in Fedora 10 for your friend?
      • clicks 'search' in left navbar
      • searches for 'inkscape'
      • clicks on inkscape search result
      • yes it's available in testing
    • If Inkscape version 0.47 is not available for Fedora 10, can you download an SRPM here to build it for her?
      • clicked on 'builds' link in the 'package links' grey box - no
      • scrolls down details page for inkscape, sees changelog, looks at the right sidebar, see all packages => updates
      • keeps scrolling details page and clicks out to package DB
      • sees 'source' link in package links => confused
      • right sidebar? no
        • fail

TASK SET II

People

  1. You need help with yelp. Who's the package maintainer?
    • goes to top search
    • types 'yelp' clicks on the yelp search result
    • 'mbarnes'
    • bug in details page
  2. Luke Macken is going away on vacation for a couple of weeks and he's asked you to look over his packages while he's gone. How many packages does he have, and do any of them need attention? Where would you go to look this up?
    • we skipped this one because user profiles stopped loading completely

Packages

  1. How would you file a bug against NetworkManager using this system?
    • goes to the top searchbox
    • searches for 'Network Manager'
    • clicks to view network manager details
    • sees 'bugs' in right sidebar
    • it's broken, bugs page won't load
  2. What has changed in the 'ruby' package over the last few updates? Where would you go to look this up?
    • types 'ruby' in the top search bar
    • scrolls down details page and sees changelog
  3. How's the karma of your current testing updates doing? How would you check up on this in Fedora Community?
    • clicks on 'package maintenance' left tab
    • clicks on 'updates' top tab
    • scrolls down to 'testing updates' section

CLOSING

  1. How well does Fedora Community support your package maintenance workflow?
    • it would very well without the bugs we hit in it
  2. Would you use Fedora Community to help maintain your packages? Which parts?
    • sure
    • pushing updates to stable would be useful
    • seeing build status in one place is useful
  3. Is there any essential functionality missing from Fedora Community that would help you maintain your packages more easily?
    • one missing thing - I want to update a bunch at the same time - to submit them as one update
  4. Did you learn anything about Fedora Community's functionality through this test?
    • i had only looked at the front page
    • i don't trust it totally because my group memberships were listed wrong
    • having builds and updates in one spot is valuable
    • i didn't know i could file BZs with it
  5. What do you think is the most useful function of Fedora Community?
    • pulls everything together into one unifed portal
  6. What are the least useful functions of Fedora Community?
    • most difficult was downloading an SRPM or binary - couldn't find it