From Fedora Project Wiki
(Drop direct Test Days category membership)
 
(78 intermediate revisions by 12 users not shown)
Line 3: Line 3:
| DATE || TIME || WHERE
| DATE || TIME || WHERE
|-
|-
| '''2010-04-01''' || From ''12:00'' to ''21:00'' UTC (8am -> 5pm EDT) || [irc://irc.freenode.net/fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| '''2010-04-01''' || ALL DAY || [irc://irc.freenode.net/fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
|-
|-
|}
|}
'''DELETE-ME''': [[Test Day:2009-08-20 ABRT|Last test day page]] for inspiration.


=== What to test? ===
=== What to test? ===
Line 20: Line 18:


The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
* Development - Jiří Moskovčák (IRC: jmoskovc)
* Development - Jiří Moskovčák (jmoskovc), Nikola Pajkovsky (npajkovs), Denys Vlasenko (dvlasenk), Karel Klíč (kklic)
* Quality Assurance - [[User:Kparal|Kparal]] (IRC: kparal), [[User:mnowak|Michal Nowak]] (IRC: mnowak)
* Quality Assurance - [[User:Kparal|Kamil Páral]] (kparal), [[User:mnowak|Michal Nowak]] (mnowak), [[User:adamwill|Adam Williamson]] (adamw)


=== Prerequisite for Test Day ===  
=== Prerequisite for Test Day ===  


You will need one of the following:
You will need either fully updated Fedora 13 system or a custom live image for ABRT.
 
==== Fedora 13 installation ====
1. If you don't already have existing Fedora 13 installation, you may install from [http://serverbeach1.fedoraproject.org/pub/alt/stage/13-Beta.RC3/ Fedora 13 Beta RC3].
 
2. Then add ABRT development repository:
<pre>wget 'http://jmoskovc.fedorapeople.org/abrt.repo' -O /etc/yum.repos.d/abrt.repo</pre>


* Fully updated Fedora 13 system.
3. Fully upgrade:
* A custom live image for ABRT.
<pre>yum upgrade</pre>


==== Fedora 13 installation ====
4. Check that you have ABRT version 1.0.9 installed.
If you already have existing Fedora 13 installation, just fully upgrade. If you don't, install [http://serverbeach1.fedoraproject.org/pub/alt/stage/13-Beta.RC2/ Fedora 13 Beta RC2] and fully upgrade.
<pre>rpm -qa 'abrt*'</pre>
 
5. Log out and log in again (this is important).


==== ABRT live image ====
==== ABRT live image ====
Line 39: Line 45:
! Architecture !! SHA256  
! Architecture !! SHA256  
|-
|-
| [http://fixme i686] || fixme
| [http://kparal.fedorapeople.org/testdays/2010-04-01_ABRT/testday-20100401_i686.iso i686] || c2337879c3b6bc0d69e8bc89ca5f20839dfb1e9c4647b118f0f7df1516ed5ceb
|-
|-
| [http://fixme x86_64] || fixme
| [http://kparal.fedorapeople.org/testdays/2010-04-01_ABRT/testday-20100401_x86_64.iso x86_64] || 70bb2f38dff1ffd0b625a0889d81cde0dffe1c7461012bf7aec435f5355ceeea
|}
|}


=== How to test? ===
=== How to test? ===
Please follow each of following [[:Category:ABRT_Test_Cases|ABRT Test Cases]] and sum up the results in the table below:


High level details on how a contributor can get involved.  This can include (but not limited to):
# [[QA:Testcase ABRT CCPP addon]] - C/C++ tracebacks
# [[QA:Testcase ABRT python]] - python tracebacks
# [[QA:Testcase ABRT python better debugging]] - tests how [[Features/EasierPythonDebugging|EasierPythonDebugging]] works with python (see [[Features/EasierPythonDebugging#How_To_Test|How to test]] for more info)
# [[QA:Testcase ABRT kernel]] - kernel oops
# [[QA:TestCase ABRT BlackList]] - package blacklist
# [[QA:Testcase ABRT GPG check]] - reporting crashes of signed packages only
# [[QA:TestCase ABRT GPG Keys]] - additional keys for signing packages
# [[QA:Testcase ABRT quota]] - limiting the space occupied by ABRT's cache
# [[QA:Testcase ABRT Plugins]] - configuring plugins
# [[QA:Testcase_ABRT_Bugzilla]] - Bugzilla plugin
# [[QA:Testcase_ABRT_Logger]] - Logger plugin
# [[QA:Testcase_ABRT_Mailx]] - Mailx plugin
# [[QA:Testcase ABRT Actions and Reporters]] - testing of action/reporting plugins
# [[QA:Testcase ABRT SOSreport plugin]] - SOSreport action plugin
# [[QA:Testcase ABRT Cron]] - periodical plugins using Cron
# [[QA:Testcase ABRT GUI MAIN]] - testing the GUI (probably already during the previous steps, so just to sum it up)
# [[QA:Testcase ABRT CLI]] - CLI interface


* Areas to target with exploratory testing
{{admon/important|Close all fake bugs you create!|During certain test cases you will be required to simulate application crashes and report these crashes into Bugzilla. It is '''very important''' that after every such fake report you open the link provided by ABRT and '''close that bug''' as NOTABUG with comment like ''"ABRT testing bug"''. Otherwise you would overload package developers with fake bug reports. Thank you.}}
* A list of pre-defined test cases to execute
* How to report back results


=== Test Cases ===
{{admon/note|Report SELinux denials against ABRT|If you encounter some SELinux (AVC) denials during testing, please report them against the '''abrt''' package, not '''selinux''' package. Thanks.}}
 
Provide a list of test areas or test cases that you'd like contributors to execute. See [[:Category:ABRT Test Cases]].


=== Test Results ===
=== Test Results ===
Please report all bugs into [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=abrt Bugzilla] against the '''abrt''' component.


Construct a table or list to allow testers to post results.  Each column should be a test case or configuration, and each row should consist of test results. Include a link where to report bugs. For example:
Please report all bugs into [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora Bugzilla] against the '''abrt''' component.
{|
{|
! User
! User
! Smolt Profile
! [[QA:Testcase ABRT CCPP addon|CCPP]]
! [[QA:Testcase_sample_1|Sample test 1]]
! [[QA:Testcase ABRT python|python]]
! [[QA:Testcase_sample_2|Sample test 2]]
! [[QA:Testcase ABRT python better debugging | pydebug ]]
! [[QA:Testcase_sample_3|Sample test 3]]
! [[QA:Testcase ABRT kernel|kernel]]
! [[QA:Testcase_sample_4|Sample test 4]]
! [[QA:TestCase ABRT BlackList|Blacklist]]
! [[QA:Testcase ABRT GPG check|GPG check]]
! [[QA:TestCase ABRT GPG Keys|GPG keys]]
! [[QA:Testcase ABRT quota|quota]]
! [[QA:Testcase ABRT Plugins|Plugins]]
! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]]
! [[QA:Testcase_ABRT_Logger|Logger]]
! [[QA:Testcase_ABRT_Mailx|Mailx]]
! [[QA:Testcase ABRT Actions and Reporters|Act&Rep]]
! [[QA:Testcase ABRT SOSreport plugin|SOSreport]]
! [[QA:Testcase ABRT Cron|Cron]]
! [[QA:Testcase ABRT GUI MAIN|GUI]]
! [[QA:Testcase ABRT CLI|CLI]]
! References
! References
|-
|-
| [[User:FasUser]]  
| [[User:Sample User|Sample User]]
| [http://www.smolts.org/client/show/pub_84465125-1350-4f83-87b9-5f16f7430eb8 HW]
| {{result|none}}
| PASS
| {{result|pass}}
| PASS
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| FAIL <ref>See {{bz|12345}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| PASS
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| <references/>
| <references/>
|-
|-
| [[User:mnowak|Michal Nowak]]
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|fail||578877|578875}}
| {{result|pass}}
| {{result|pass||578878}}
| {{result|pass}}
| <references/>
|-
| [[User:kparal|Kamil Páral]]
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|warn||578840}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:rnovacek|Radek Nováček]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| <references/>
|-
| [[User:bertux|Bertrand Juglas]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[DaveMalcolm|Dave Malcolm]]
| {{result|pass}}
| {{result|fail||578969}}
| {{result|fail||578976}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:yxd|Xudong Yang]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:dramsey|dramsey]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| <references/>
|}
|}


[[Category:Fedora 13 Test Days]]
[[Category:Fedora 13 Test Days]]

Latest revision as of 21:20, 26 June 2015

DATE TIME WHERE
2010-04-01 ALL DAY #fedora-test-day (webirc)

What to test?[edit]

Today's installment of Fedora Test Day will focus on Automated Bug Reporting Tool (ABRT). This tool should help non-power users with bug reporting, making it as easy as a few mouse clicks. ABRT is a daemon that watches for application crashes. When a crash occurs, it collects the crash data (core file, application's command line etc.) and takes action according to the type of application that crashed and according to the configuration in the abrt.conf configuration file.

Bottom line: do not hunt the bugs with a pitchforks, rather use bugzappers/big light source to draw them from the dark and kill them easily at close range.

ABRT should be easy for users and very useful for developers and admins. Ease of crash/bug reporting and quick response from maintainers based on info from ABRT should make Fedora more stable and thus more attractive for users.

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

  • Development - Jiří Moskovčák (jmoskovc), Nikola Pajkovsky (npajkovs), Denys Vlasenko (dvlasenk), Karel Klíč (kklic)
  • Quality Assurance - Kamil Páral (kparal), Michal Nowak (mnowak), Adam Williamson (adamw)

Prerequisite for Test Day[edit]

You will need either fully updated Fedora 13 system or a custom live image for ABRT.

Fedora 13 installation[edit]

1. If you don't already have existing Fedora 13 installation, you may install from Fedora 13 Beta RC3.

2. Then add ABRT development repository: 

wget 'http://jmoskovc.fedorapeople.org/abrt.repo' -O /etc/yum.repos.d/abrt.repo

3. Fully upgrade: 

yum upgrade

4. Check that you have ABRT version 1.0.9 installed. 

rpm -qa 'abrt*'

5. Log out and log in again (this is important).

ABRT live image[edit]

This is a non-destructive live image that you just download, burn to CD/DVD and boot from it. You can also make a bootable USB stick from it by using liveusb-creator.

Architecture SHA256
i686 c2337879c3b6bc0d69e8bc89ca5f20839dfb1e9c4647b118f0f7df1516ed5ceb
x86_64 70bb2f38dff1ffd0b625a0889d81cde0dffe1c7461012bf7aec435f5355ceeea

How to test?[edit]

Please follow each of following ABRT Test Cases and sum up the results in the table below:

  1. QA:Testcase ABRT CCPP addon - C/C++ tracebacks
  2. QA:Testcase ABRT python - python tracebacks
  3. QA:Testcase ABRT python better debugging - tests how EasierPythonDebugging works with python (see How to test for more info)
  4. QA:Testcase ABRT kernel - kernel oops
  5. QA:TestCase ABRT BlackList - package blacklist
  6. QA:Testcase ABRT GPG check - reporting crashes of signed packages only
  7. QA:TestCase ABRT GPG Keys - additional keys for signing packages
  8. QA:Testcase ABRT quota - limiting the space occupied by ABRT's cache
  9. QA:Testcase ABRT Plugins - configuring plugins
  10. QA:Testcase_ABRT_Bugzilla - Bugzilla plugin
  11. QA:Testcase_ABRT_Logger - Logger plugin
  12. QA:Testcase_ABRT_Mailx - Mailx plugin
  13. QA:Testcase ABRT Actions and Reporters - testing of action/reporting plugins
  14. QA:Testcase ABRT SOSreport plugin - SOSreport action plugin
  15. QA:Testcase ABRT Cron - periodical plugins using Cron
  16. QA:Testcase ABRT GUI MAIN - testing the GUI (probably already during the previous steps, so just to sum it up)
  17. QA:Testcase ABRT CLI - CLI interface
Important.png
Close all fake bugs you create!
During certain test cases you will be required to simulate application crashes and report these crashes into Bugzilla. It is very important that after every such fake report you open the link provided by ABRT and close that bug as NOTABUG with comment like "ABRT testing bug". Otherwise you would overload package developers with fake bug reports. Thank you.
Note.png
Report SELinux denials against ABRT
If you encounter some SELinux (AVC) denials during testing, please report them against the abrt package, not selinux package. Thanks.

Test Results[edit]

Please report all bugs into Bugzilla against the abrt component.

User CCPP python pydebug kernel Blacklist GPG check GPG keys quota Plugins Bugzilla Logger Mailx Act&Rep SOSreport Cron GUI CLI References
Sample User
none
Pass pass
Warning warn
[1]
Fail fail
[2]
none
none
none
Pass pass
none
none
Pass pass
Pass pass
none
none
none
Pass pass
none
  1. ↑ Test pass, but also encountered RHBZ #54321
  2. ↑ RHBZ #12345
Michal Nowak
none
Pass pass
Pass pass
Pass pass
Pass pass
none
none
Pass pass
Pass pass
none
Pass pass
Pass pass
none
Fail fail [1] [2]
Pass pass
Pass pass [3]
Pass pass
  1. ↑ RHBZ #578877
  2. ↑ RHBZ #578875
  3. ↑ RHBZ #578878
Kamil Páral
Pass pass
Pass pass
none
Pass pass
Pass pass
none
none
Warning warn [1]
none
none
none
none
none
none
none
none
none
  1. ↑ RHBZ #578840
Radek Nováček
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
none
Pass pass
Pass pass
Pass pass
Pass pass
none
none
none
Pass pass
Pass pass
none
Bertrand Juglas
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
none
none
none
none
none
none
none
none
none
none
none
Dave Malcolm
Pass pass
Fail fail [1]
Fail fail [2]
none
none
none
none
none
none
none
none
none
none
none
none
none
none
  1. ↑ RHBZ #578969
  2. ↑ RHBZ #578976
Xudong Yang
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
none
none
none
none
none
none
none
none
none
none
none
dramsey
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
none
Pass pass
Pass pass
Pass pass
Pass pass
none
none
none
Pass pass
Pass pass
none
Retrieved from "https://fedoraproject.org/w/index.php?title=Test_Day:2010-04-01_ABRT&oldid=416760"