From Fedora Project Wiki

mNo edit summary
(Drop direct Test Days category membership)
 
(59 intermediate revisions by 11 users not shown)
Line 3: Line 3:
| DATE || TIME || WHERE
| DATE || TIME || WHERE
|-
|-
| '''2010-04-01''' || From ''11:00'' to ''21:00'' UTC (7am -> 5pm EDT) || [irc://irc.freenode.net/fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| '''2010-04-01''' || ALL DAY || [irc://irc.freenode.net/fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
|-
|-
|}
|}
Line 34: Line 34:
<pre>yum upgrade</pre>
<pre>yum upgrade</pre>


4. Restart computer or close abrt-gui (if you have it opened) and run as standard user:
4. Check that you have ABRT version 1.0.9 installed.
<pre>killall abrt-applet
<pre>rpm -qa 'abrt*'</pre>
abrt-applet &</pre>
 
5. Log out and log in again (this is important).


==== ABRT live image ====
==== ABRT live image ====
Line 44: Line 45:
! Architecture !! SHA256  
! Architecture !! SHA256  
|-
|-
| [http://fixme i686] || fixme
| [http://kparal.fedorapeople.org/testdays/2010-04-01_ABRT/testday-20100401_i686.iso i686] || c2337879c3b6bc0d69e8bc89ca5f20839dfb1e9c4647b118f0f7df1516ed5ceb
|-
|-
| [http://fixme x86_64] || 70bb2f38dff1ffd0b625a0889d81cde0dffe1c7461012bf7aec435f5355ceeea
| [http://kparal.fedorapeople.org/testdays/2010-04-01_ABRT/testday-20100401_x86_64.iso x86_64] || 70bb2f38dff1ffd0b625a0889d81cde0dffe1c7461012bf7aec435f5355ceeea
|}
|}


Line 54: Line 55:
# [[QA:Testcase ABRT CCPP addon]] - C/C++ tracebacks
# [[QA:Testcase ABRT CCPP addon]] - C/C++ tracebacks
# [[QA:Testcase ABRT python]] - python tracebacks
# [[QA:Testcase ABRT python]] - python tracebacks
# [[QA:Testcase ABRT python better debugging]] - tests how [[Features/EasierPythonDebugging|EasierPythonDebugging]] works with python (see [[Features/EasierPythonDebugging#How_To_Test|How to test]] for more info)
# [[QA:Testcase ABRT kernel]] - kernel oops
# [[QA:Testcase ABRT kernel]] - kernel oops
# [[QA:TestCase ABRT BlackList]] - package blacklist
# [[QA:TestCase ABRT BlackList]] - package blacklist
Line 68: Line 70:
# [[QA:Testcase ABRT GUI MAIN]] - testing the GUI (probably already during the previous steps, so just to sum it up)
# [[QA:Testcase ABRT GUI MAIN]] - testing the GUI (probably already during the previous steps, so just to sum it up)
# [[QA:Testcase ABRT CLI]] - CLI interface
# [[QA:Testcase ABRT CLI]] - CLI interface
'''FIXME - update test cases above! sort them in some meaningful order!'''
'''FIXME - add Improved Python Debugging test case according to [https://fedorahosted.org/fedora-qa/ticket/55#comment:3 jmoskovc's comment].'''


{{admon/important|Close all fake bugs you create!|During certain test cases you will be required to simulate application crashes and report these crashes into Bugzilla. It is '''very important''' that after every such fake report you open the link provided by ABRT and '''close that bug''' as NOTABUG with comment like ''"ABRT testing bug"''. Otherwise you would overload package developers with fake bug reports. Thank you.}}
{{admon/important|Close all fake bugs you create!|During certain test cases you will be required to simulate application crashes and report these crashes into Bugzilla. It is '''very important''' that after every such fake report you open the link provided by ABRT and '''close that bug''' as NOTABUG with comment like ''"ABRT testing bug"''. Otherwise you would overload package developers with fake bug reports. Thank you.}}
Line 79: Line 77:
=== Test Results ===
=== Test Results ===
Please report all bugs into [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=abrt Bugzilla] against the '''abrt''' component.
Please report all bugs into [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=abrt Bugzilla] against the '''abrt''' component.
''' FIXME - update column count and their headers according to final test case list.'''


{|
{|
! User
! User
! [[QA:Testcase_ABRT_Logger|Logger]]
! [[QA:Testcase ABRT CCPP addon|CCPP]]
! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]]
! [[QA:Testcase ABRT python|python]]
! [[QA:Testcase_ABRT_Mailx|Mailx]]
! [[QA:Testcase ABRT python better debugging | pydebug ]]
! [[QA:Testcase ABRT kernel|kernel]]
! [[QA:TestCase ABRT BlackList|Blacklist]]
! [[QA:TestCase ABRT BlackList|Blacklist]]
! [[QA:Testcase ABRT GPG check|GPG check]]
! [[QA:Testcase ABRT GPG check|GPG check]]
! [[QA:TestCase ABRT GPG Keys|GPG keys]]
! [[QA:TestCase ABRT GPG Keys|GPG keys]]
! [[QA:Testcase ABRT quota|quota]]
! [[QA:Testcase ABRT Plugins|Plugins]]
! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]]
! [[QA:Testcase_ABRT_Logger|Logger]]
! [[QA:Testcase_ABRT_Mailx|Mailx]]
! [[QA:Testcase ABRT Actions and Reporters|Act&Rep]]
! [[QA:Testcase ABRT Actions and Reporters|Act&Rep]]
! [[QA:Testcase ABRT SOSreport plugin|SOSreport]]
! [[QA:Testcase ABRT Cron|Cron]]
! [[QA:Testcase ABRT Cron|Cron]]
! [[QA:Testcase ABRT Plugins|Plugins]]
! [[QA:Testcase ABRT GUI MAIN|GUI]]
! [[QA:Testcase ABRT CLI|CLI]]
! [[QA:Testcase ABRT CLI|CLI]]
! [[QA:Testcase ABRT kernel|kernel]]
! [[QA:Testcase ABRT python|python]]
! [[QA:Testcase ABRT CCPP addon|CCPP]]
! References
! References
|-
|-
Line 104: Line 104:
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 112: Line 113:
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| <references/>
| <references/>
|-
|-
| [[User:mnowak|Michal Nowak]]
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|fail||578877|578875}}
| {{result|pass}}
| {{result|pass||578878}}
| {{result|pass}}
| <references/>
|-
| [[User:kparal|Kamil Páral]]
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|warn||578840}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:rnovacek|Radek Nováček]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| <references/>
|-
| [[User:bertux|Bertrand Juglas]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[DaveMalcolm|Dave Malcolm]]
| {{result|pass}}
| {{result|fail||578969}}
| {{result|fail||578976}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:yxd|Xudong Yang]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:dramsey|dramsey]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| <references/>
|}
|}


[[Category:Fedora 13 Test Days]]
[[Category:Fedora 13 Test Days]]

Latest revision as of 21:20, 26 June 2015

DATE TIME WHERE
2010-04-01 ALL DAY #fedora-test-day (webirc)

What to test?[edit]

Today's installment of Fedora Test Day will focus on Automated Bug Reporting Tool (ABRT). This tool should help non-power users with bug reporting, making it as easy as a few mouse clicks. ABRT is a daemon that watches for application crashes. When a crash occurs, it collects the crash data (core file, application's command line etc.) and takes action according to the type of application that crashed and according to the configuration in the abrt.conf configuration file.

Bottom line: do not hunt the bugs with a pitchforks, rather use bugzappers/big light source to draw them from the dark and kill them easily at close range.

ABRT should be easy for users and very useful for developers and admins. Ease of crash/bug reporting and quick response from maintainers based on info from ABRT should make Fedora more stable and thus more attractive for users.

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

  • Development - Jiří Moskovčák (jmoskovc), Nikola Pajkovsky (npajkovs), Denys Vlasenko (dvlasenk), Karel Klíč (kklic)
  • Quality Assurance - Kamil Páral (kparal), Michal Nowak (mnowak), Adam Williamson (adamw)

Prerequisite for Test Day[edit]

You will need either fully updated Fedora 13 system or a custom live image for ABRT.

Fedora 13 installation[edit]

1. If you don't already have existing Fedora 13 installation, you may install from Fedora 13 Beta RC3.

2. Then add ABRT development repository:

wget 'http://jmoskovc.fedorapeople.org/abrt.repo' -O /etc/yum.repos.d/abrt.repo

3. Fully upgrade:

yum upgrade

4. Check that you have ABRT version 1.0.9 installed.

rpm -qa 'abrt*'

5. Log out and log in again (this is important).

ABRT live image[edit]

This is a non-destructive live image that you just download, burn to CD/DVD and boot from it. You can also make a bootable USB stick from it by using liveusb-creator.

Architecture SHA256
i686 c2337879c3b6bc0d69e8bc89ca5f20839dfb1e9c4647b118f0f7df1516ed5ceb
x86_64 70bb2f38dff1ffd0b625a0889d81cde0dffe1c7461012bf7aec435f5355ceeea

How to test?[edit]

Please follow each of following ABRT Test Cases and sum up the results in the table below:

  1. QA:Testcase ABRT CCPP addon - C/C++ tracebacks
  2. QA:Testcase ABRT python - python tracebacks
  3. QA:Testcase ABRT python better debugging - tests how EasierPythonDebugging works with python (see How to test for more info)
  4. QA:Testcase ABRT kernel - kernel oops
  5. QA:TestCase ABRT BlackList - package blacklist
  6. QA:Testcase ABRT GPG check - reporting crashes of signed packages only
  7. QA:TestCase ABRT GPG Keys - additional keys for signing packages
  8. QA:Testcase ABRT quota - limiting the space occupied by ABRT's cache
  9. QA:Testcase ABRT Plugins - configuring plugins
  10. QA:Testcase_ABRT_Bugzilla - Bugzilla plugin
  11. QA:Testcase_ABRT_Logger - Logger plugin
  12. QA:Testcase_ABRT_Mailx - Mailx plugin
  13. QA:Testcase ABRT Actions and Reporters - testing of action/reporting plugins
  14. QA:Testcase ABRT SOSreport plugin - SOSreport action plugin
  15. QA:Testcase ABRT Cron - periodical plugins using Cron
  16. QA:Testcase ABRT GUI MAIN - testing the GUI (probably already during the previous steps, so just to sum it up)
  17. QA:Testcase ABRT CLI - CLI interface
Important.png
Close all fake bugs you create!
During certain test cases you will be required to simulate application crashes and report these crashes into Bugzilla. It is very important that after every such fake report you open the link provided by ABRT and close that bug as NOTABUG with comment like "ABRT testing bug". Otherwise you would overload package developers with fake bug reports. Thank you.
Note.png
Report SELinux denials against ABRT
If you encounter some SELinux (AVC) denials during testing, please report them against the abrt package, not selinux package. Thanks.

Test Results[edit]

Please report all bugs into Bugzilla against the abrt component.

User CCPP python pydebug kernel Blacklist GPG check GPG keys quota Plugins Bugzilla Logger Mailx Act&Rep SOSreport Cron GUI CLI References
Sample User
none
Pass pass
Warning warn
[1]
Fail fail
[2]
none
none
none
Pass pass
none
none
Pass pass
Pass pass
none
none
none
Pass pass
none
  1. Test pass, but also encountered RHBZ #54321
  2. RHBZ #12345
Michal Nowak
none
Pass pass
Pass pass
Pass pass
Pass pass
none
none
Pass pass
Pass pass
none
Pass pass
Pass pass
none
Fail fail [1] [2]
Pass pass
Pass pass [3]
Pass pass
  1. RHBZ #578877
  2. RHBZ #578875
  3. RHBZ #578878
Kamil Páral
Pass pass
Pass pass
none
Pass pass
Pass pass
none
none
Warning warn [1]
none
none
none
none
none
none
none
none
none
  1. RHBZ #578840
Radek Nováček
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
none
Pass pass
Pass pass
Pass pass
Pass pass
none
none
none
Pass pass
Pass pass
none
Bertrand Juglas
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
none
none
none
none
none
none
none
none
none
none
none
Dave Malcolm
Pass pass
Fail fail [1]
Fail fail [2]
none
none
none
none
none
none
none
none
none
none
none
none
none
none
  1. RHBZ #578969
  2. RHBZ #578976
Xudong Yang
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
none
none
none
none
none
none
none
none
none
none
none
dramsey
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
none
Pass pass
Pass pass
Pass pass
Pass pass
none
none
none
Pass pass
Pass pass
none