From Fedora Project Wiki

< QA‎ | Test Days

(Use new infobox)
(add a nice logo provided by fedora magazine)
(17 intermediate revisions by 6 users not shown)
Line 1: Line 1:
{{Infobox_group
{{Infobox_group
| name = Fedora Test Days
| name = <<TEST DAY NAME>>
| image = [[File:Echo-testing-48px.png|link=QA/Fedora_15_test_days]]
| image = [[File:test-days-banner.svg|300px|link=QA/Test Days]]
| caption = [[FIXME|FIXME]]
| date = <<FIXME>>
| date = <<FIXME>>
| time = all day
| time = all day
| website = [[QA/Fedora_15_test_days]]
| website = [[QA/Test Days]]
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| fedora_mailing_list = test
| fedora_mailing_list = test
Line 14: Line 13:
== What to test? ==
== What to test? ==


Today's installment of Fedora Test Day will focus on '''<<FIXME>>'''
Today's instalment of Fedora Test Day will focus on '''<<FIXME>>'''


== Who's available ==
== Who's available ==
Line 20: Line 19:
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
* Development - [[User:Developer1|Developer1]] (irc_nick1), [[User:Developer2|Developer2]] (irc_nick2)
* Development - [[User:Developer1|Developer1]] (irc_nick1), [[User:Developer2|Developer2]] (irc_nick2)
* Quality Assurance - [[User:Tester1|Tester1]] (irc_nick3), [[User:Tester2|Tester2]] (irc_nick4), [[User:Tester3|Tester3]] (irc_nick5)
* Quality Assurance - [[User:Tester1|Tester1]] (irc_nick3), [[User:Tester2|Tester2]] (irc_nick4)


== Prerequisite for Test Day ==  
== Prerequisite for Test Day ==  
Line 33: Line 32:
Here's a chunk which is commonly used for most Test Days. Replace XX with whatever Fedora release is pending:
Here's a chunk which is commonly used for most Test Days. Replace XX with whatever Fedora release is pending:


* An updated [http://fedoraproject.org/get-prerelease Fedora XX pre-release], [[Releases/Rawhide|Rawhide]] (tips on installing Rawhide below), or a [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ nightly live image]
* An updated [https://getfedora.org/workstation/prerelease Fedora XX pre-release], or a [https://www.happyassassin.net/nightlies.html Fedora XX nightly image]
* Your hardware profile uploaded to [http://www.smolts.org Smolt] according to [http://smolts.org/smolt-wiki/Main_Page#Usage these instructions]


== How to test? ==
== How to test? ==
Line 52: Line 50:
=== '''Live image''' ===
=== '''Live image''' ===


Optionally, you may download a non-destructive Rawhide live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]]. Live images can be found [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ here].
Instead of testing with an installed system, you may download a non-destructive nightly live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]]. Live image links can be found [https://www.happyassassin.net/nightlies.html here]: please be sure to download one for the correct release.


== Test Cases ==
=== Run the tests ===


Provide a list of test areas or test cases that you'd like contributors to execute. For other examples, see [[:Category:Test_Cases]].
If not using the Test Day app, provide a list of test areas or test cases that you'd like contributors to execute. For examples, see [[:Category:Test_Cases]]. If using the Test Day app, link to it here, with some explanation, e.g.:
 
Visit the [http://testdays.fedorainfracloud.org/events/NUMBER result page] and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the ''Enter result'' button for the test.
 
== Reporting bugs ==
 
Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:
 
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=udisks udisks], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=gnome-disk-utility gnome-disk-utility] for bugs in the Palimpsest graphical front end itself. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.


== Test Results ==
== Test Results ==


Construct a table or list to allow testers to post results. Each column should be a test case or configuration, and each row should consist of test results. Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:
If you use the [http://testdays.fedorainfracloud.org/events Test Days app], just explain that users should enter results there and they will be transferred to the page later. For e.g.:


If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=udisks udisks], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=gnome-disk-utility gnome-disk-utility] for bugs in the Palimpsest graphical front end itself. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one, and the second should be a link to the Smolt profile of the system you tested. For each test case, if your system worked correctly, simply enter the word '''PASS'''. If you had trouble, enter the word '''FAIL''', with a footnote indicator, and put a link to the bug report in the References column (as in the example line). For tests you could not perform, enter a dash.
Please enter your results on the [http://testdays.fedorainfracloud.org/events/NUMBER result page]. The results will be transferred here after the Test Day is finished.


Otherwise, construct a table or list to allow testers to post results.  Each column should be a test case or configuration, and each row should consist of test results. Include some text to explain reporting. Here is a common setup:
Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
{|
{|
! User
! User
! Smolt Profile
! [[QA:Testcase_sample_1|Sample test 1]]
! [[QA:Testcase_sample_1|Sample test 1]]
! [[QA:Testcase_sample_2|Sample test 2]]
! [[QA:Testcase_sample_2|Sample test 2]]
Line 74: Line 82:
|-
|-
| [[User:SampleUser|Sample User]]
| [[User:SampleUser|Sample User]]
| [http://www.smolts.org/client/show/pub_84465125-1350-4f83-87b9-5f16f7430eb8 HW]
| {{result|none}}  
| {{result|none}}  
| {{result|pass}}
| {{result|pass}}
Line 83: Line 90:
|}
|}


[[Category:Test Days]]
<!-- remove this comment block when creating a real Test Day
[[Category:Fedora 24 Test Days]]
-->
 
<!-- remove this category when creating a test day page -->
[[Category:QA Templates]]
[[Category:QA Templates]]

Revision as of 12:46, 17 May 2016

<<TEST DAY NAME>>
Test-days-banner.svg

Date <<FIXME>>
Time all day

Website QA/Test Days
IRC #fedora-test-day (webirc)
Mailing list test


Note.png
Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?

Today's instalment of Fedora Test Day will focus on <<FIXME>>

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day

List any prerequisite needs for the test event. A fresh system, virtualized guest, a blank DVD ... a desire to break software?

  • Usb key
  • Usb externally connected HD IDE/SATA
  • Empty HD IDE/SATA/SCSI
  • Free space on HD

Here's a chunk which is commonly used for most Test Days. Replace XX with whatever Fedora release is pending:

How to test?

High level details on how a contributor can get involved. This can include (but not limited to):

  • Areas to target with exploratory testing
  • A list of pre-defined test cases to execute
  • How to report back results

Here's another common chunk (again, replace XX as above):

Update your machine

If you're running Fedora XX, make sure you have all the current updates for it installed, using the update manager. If you want to try Rawhide, see the instructions on the Rawhide page on the various ways in which you can install or update to Rawhide. Or:

Live image

Instead of testing with an installed system, you may download a non-destructive nightly live image for your architecture. Tips on using a live image are available at FedoraLiveCD. Live image links can be found here: please be sure to download one for the correct release.

Run the tests

If not using the Test Day app, provide a list of test areas or test cases that you'd like contributors to execute. For examples, see Category:Test_Cases. If using the Test Day app, link to it here, with some explanation, e.g.:

Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.

Reporting bugs

Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:

If you have problems with any of the tests, report a bug to Bugzilla usually for the component udisks, or gnome-disk-utility for bugs in the Palimpsest graphical front end itself. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

Test Results

If you use the Test Days app, just explain that users should enter results there and they will be transferred to the page later. For e.g.:

Please enter your results on the result page. The results will be transferred here after the Test Day is finished.

Otherwise, construct a table or list to allow testers to post results. Each column should be a test case or configuration, and each row should consist of test results. Include some text to explain reporting. Here is a common setup:

Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

User Sample test 1 Sample test 2 Sample test 3 Sample test 4 References
Sample User
none
Pass pass
Warning warn
[1]
Fail fail
[2]
  1. Test pass, but also encountered RHBZ #54321
  2. RHBZ #12345