From Fedora Project Wiki

(Updated)
(Moved metrics data / discussion to BugZappers/Metrics)
 
(3 intermediate revisions by 2 users not shown)
Line 1: Line 1:
I am currently working to create some basic metrics to report on the activities on the [[BugZappers]]. My approach is to use the [https://fedorahosted.org/python-bugzilla/ python-bugzilla] package as much as possible.
+
If you are looking for the BugZappers/Triage Metrics, they have been moved to [[BugZappers/Metrics]].
  
== Tools You Will Need==
+
The discussion regarding those metrics and how how to generate them has been moved to [[Talk:BugZappers/Metrics]].
* The [https://fedorahosted.org/python-bugzilla/ python-bugzilla] package.  (Try 'yum install python-bugzilla'
 
* [http://therabers.com/fedora/python-bugzilla/bzilla The modified bugzilla CLI] to add the --summary option.  I suggest saving this as ~/bin/bzilla (only because that is what I have done) 
 
 
 
== Proposed Metrics ==
 
{|
 
! Description !! Status !! Comments/Notes/Reference
 
|-
 
|# of Bugs 'Triaged' in the last xx days || DONE || See: [https://bugzilla.redhat.com/buglist.cgi?cmdtype=runnamed&namedcmd=BugsTriaged-Last30Day]
 
|-
 
|# of Bugs 'Triaged' in the last xx days by Current Status || DONE || bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?chfieldto=Now&query_format=advanced&chfield=keywords&chfieldfrom=-90d&chfieldvalue=Triaged&classification=Fedora&product=Fedora' --summary bug_status
 
|-
 
|# of Bugs 'Triaged' in the last xx days by Component || DONE || bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?chfieldto=Now&query_format=advanced&chfield=keywords&chfieldfrom=-90d&chfieldvalue=Triaged&classification=Fedora&product=Fedora' --summary component
 
|-
 
|# of Bugs 'Triaged' in the last xx days by Triager || In Process || I am working on a patch to add the ability to query/display the bug history data via XMLRPC to the python-bugzilla package.  This metric will provide the list of known active BugZappers.
 
|-
 
|# of 'Triaged' bugs CLOSED in last xx Days || DONE || See: [https://bugzilla.redhat.com/buglist.cgi?keywords=Triaged&chfieldto=Now&query_format=advanced&chfield=bug_status&keywords_type=allwords&chfieldfrom=-90d&chfieldvalue=CLOSED&bug_status=CLOSED&classification=Fedora&product=Fedora]
 
|-
 
|# of 'Triaged' bugs CLOSED in last xx Days by Resolution || DONE || bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?keywords=Triaged&chfieldto=Now&query_format=advanced&chfield=bug_status&keywords_type=allwords&chfieldfrom=-90d&chfieldvalue=CLOSED&bug_status=CLOSED&classification=Fedora&product=Fedora' --summary resolution
 
|-
 
|# of 'Triaged' bugs CLOSED in last xx Days by # of days since Triaged flag was set || PENDING || To know if/how 'Triaging' is impacting the life expectancy of bugs. (Need a better definition.  How about 'Average number of days from Triaged to CLOSED by resolution for 'Triaged' bugs CLOSED in last xx days')
 
|-
 
|List of 'Triaged' bugs currently marked as NEEDINFO || PENDING || This should generally be an empty list.  Bugs showing up here could be an indicator of  poor Triaging. See: [https://bugzilla.redhat.com/buglist.cgi?type0-1-0=allwords&field0-1-0=flagtypes.name&field0-0-0=flagtypes.name&classification=Fedora&query_format=advanced&value0-1-0=Triaged&bug_status=NEW&bug_status=ASSIGNED&bug_status=MODIFIED&bug_status=ON_DEV&type0-0-0=allwords&value0-0-0=NEEDINFO&product=Fedora]  (Is this useful.  Remove?)
 
|-
 
|# of bugs CLOSED by BugZappers in last xx days || PENDING || Need a list of BugZappers
 
|-
 
|# of bugs CLOSED by BugZappers in last xx days by BugZapper|| PENDING ||Need a list of BugZappers
 
|-
 
|# of bugs CLOSED by BugZappers in last xx days by Resolution|| PENDING ||Need a list of BugZappers
 
|}
 
== Additional Thoughts/Questions ==
 
* Q:Who are the BugZappers? A:BugZappers = Members of he Triagers group in FAS.  But since this is not easy to scrape (and may included inactive persons) I am going to use the following definition.  BugZappers = BugZilla users that have used the 'Triaged' flag in the previous 90 days.
 
* Eventually, these metrics should probably come from a SQL query.  Pulling all this data via XMLRPC could be slow.
 
* Pretty graphs could be created showing how these metrics change (or don't) over time.
 
* What other metrics should we be tracking?
 
* Should these metric be limited to bugs where Product=Fedora & Classification=Fedora?
 
 
 
== Current Metrics as of  June 28, 2010==
 
  Bugs 'Triaged' in the last 60 Days: 229
 
 
 
  Summary of Bugs 'Triaged' in the last 60 days by Current Status:
 
      ASSIGNED - 54
 
      CLOSED - 40
 
      MODIFIED - 1
 
      NEW - 132
 
      ON_QA - 2
 
 
 
  Summary of Bugs 'Triaged' in the last 60 days by Component:
 
      PackageKit - 19
 
      amarok - 2
 
      anaconda - 1
 
      banshee - 1
 
      compiz - 2
 
      compiz-fusion - 1
 
      digikam - 1
 
      epiphany - 1
 
      evince - 1
 
      evolution - 3
 
      fedora-bookmarks - 1
 
      firefox - 30
 
      gcc - 1
 
      glib2 - 1
 
      glob2 - 1
 
      gnome-desktop - 1
 
      gnome-panel - 1
 
      gnome-session - 1
 
      initscripts - 4
 
      java-1.6.0-openjdk - 1
 
      k3b - 1
 
      kcm-gtk - 1
 
      kde-plasma-networkmanagement - 2
 
      kdeaccessibility - 1
 
      kdebase - 1
 
      kdebase-workspace - 1
 
      kdegraphics - 1
 
      kdenetwork - 1
 
      kdepim - 3
 
      kdeutils - 1
 
      kernel - 2
 
      knetworkmanager - 2
 
      libX11 - 2
 
      libXfixes - 1
 
      libdrm - 1
 
      libtiff - 2
 
      livecd-tools - 1
 
      me-tv - 1
 
      mesa - 2
 
      phonon - 1
 
      pixman - 1
 
      preupgrade - 1
 
      seamonkey - 4
 
      strigi - 6
 
      sugar - 1
 
      system-config-display - 1
 
      system-config-users - 1
 
      thunderbird - 5
 
      xine-lib - 2
 
      xine-ui - 1
 
      xorg-x11-drv-ati - 26
 
      xorg-x11-drv-evdev - 1
 
      xorg-x11-drv-intel - 22
 
      xorg-x11-drv-nouveau - 24
 
      xorg-x11-drv-radeonhd - 1
 
      xorg-x11-drv-sis - 1
 
      xorg-x11-drv-synaptics - 1
 
      xorg-x11-drv-vmmouse - 3
 
      xorg-x11-drv-vmware - 1
 
      xorg-x11-drv-wacom - 6
 
      xorg-x11-server - 12
 
      xulrunner - 1
 
      yum - 1
 
      zlib - 4
 
 
 
  # of 'Triaged' bugs CLOSED in last 60 Days: 476
 
 
 
  Summary of 'Triaged' bugs CLOSED in last 60 Days by Resolution:
 
      CANTFIX - 4
 
      CURRENTRELEASE - 21
 
      DEFERRED - 1
 
      DUPLICATE - 23
 
      ERRATA - 71
 
      INSUFFICIENT_DATA - 53
 
      NEXTRELEASE - 15
 
      NOTABUG - 13
 
      RAWHIDE - 147
 
      UPSTREAM - 5
 
      WONTFIX - 101
 
      WORKSFORME - 22
 

Latest revision as of 04:30, 19 July 2010

If you are looking for the BugZappers/Triage Metrics, they have been moved to BugZappers/Metrics.

The discussion regarding those metrics and how how to generate them has been moved to Talk:BugZappers/Metrics.