From Fedora Project Wiki

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 1: Line 1:
{{Infobox_group
{{Infobox_group
| name = Fedora Test Days
| name = Fedora Test Days
| image = [[File:Echo-testing-48px.png|link=http://apps.fedoraproject.org/calendar/list/QA/?subject=Test+Day]]
| image = [[File:Echo-testing-48px.png|link=QA/Fedora_19_test_days]]
| caption = [[Changes/Jenkins|Jenkins]]
| caption = [[FIXME|FIXME]]
| date = 2014-09-30
| date = <<FIXME>>
| time = all day
| time = all day
| website = [http://apps.fedoraproject.org/calendar/list/QA/?subject=Test+Day Fedora Calendar ]
| website = [[QA/Fedora_19_test_days]]
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| fedora_mailing_list = test
| fedora_mailing_list = test
Line 14: Line 14:
== What to test? ==
== What to test? ==


Today's instalment of Fedora Test Day will focus on Jenkins. [https://wiki.jenkins-ci.org/display/JENKINS/Meet+Jenkins Read more]
Today's instalment of Fedora Test Day will focus on '''<<FIXME>>'''


== Who's available ==
== Who's available ==


The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
* [[User:msrb|Michal Srb]] (msrb)
* Development - [[User:Developer1|Developer1]] (irc_nick1), [[User:Developer2|Developer2]] (irc_nick2)
* Quality Assurance - [[User:Tester1|Tester1]] (irc_nick3), [[User:Tester2|Tester2]] (irc_nick4), [[User:Tester3|Tester3]] (irc_nick5)


== Prerequisite for Test Day ==
== Prerequisite for Test Day ==  


Either of following:
List any prerequisite needs for the test event.  A fresh system, virtualized guest, a blank DVD ... a desire to break software?


* bootable USB key or CD/DVD disk with latest Fedora 21 live image
* Usb key
* machine or VM with updated Fedora 21
* Usb externally connected HD IDE/SATA
* Empty HD IDE/SATA/SCSI
* Free space on HD


== Known issues ==
Here's a chunk which is commonly used for most Test Days. Replace XX with whatever Fedora release is pending:
# Fedora doesn't yet have all core plugins which come by default with upstream Jenkins ([https://bugzilla.redhat.com/show_bug.cgi?id=1147838 rhbz#1147838])
 
# Attempt to download jenkins-cli.jar or slaves.jar from http://localhost:8080/jnlpJars/jenkins-cli.jar ends with "ERROR 500: Server Error" ([https://bugzilla.redhat.com/show_bug.cgi?id=1147831 rhbz#1147831])
* An updated [http://fedoraproject.org/get-prerelease Fedora XX pre-release], [[Releases/Rawhide|Rawhide]] (tips on installing Rawhide below), or a [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ nightly live image]
# /var/log/jenkins/jenkins.log contains error message "SEVERE: Failed Inspecting plugin /var/lib/jenkins/plugins/jenkins-icon-shim.jpi due to bug in jenkins-icon-shim package ([https://bugzilla.redhat.com/show_bug.cgi?id=1147821 rhbz#1147821])
# JENKINS_HOME is owned by root ([https://bugzilla.redhat.com/show_bug.cgi?id=1147846 rhbz#1147846])
# Building of "Maven project" always ends with exception ([https://bugzilla.redhat.com/show_bug.cgi?id=1147899 rhbz#1147899])
# Jenkins doesn't handle plugins from RPM very well ([https://bugzilla.redhat.com/show_bug.cgi?id=1147902 rhbz#1147902], [https://bugzilla.redhat.com/show_bug.cgi?id=1147908 rhbz#1147908])


== How to test? ==
== How to test? ==


There are two options. Either you can stick with prepared test cases (below), or you can simply try to use Jenkins and experiment. The second option is probably better for people already familiar with Jenkins. In either case, please report all bugs in https://bugzilla.redhat.com/, component "jenkins". Please always attach Jenkins log file <code>/var/log/jenkins/jenkins.log</code>, if possible. Thanks.
High level details on how a contributor can get involved. This can include (but not limited to):


=== Update your machine ===
* Areas to target with exploratory testing
* A list of pre-defined test cases to execute
* How to report back results


If you're running Fedora 21, make sure you have all the current updates for it installed, using the update manager.
Here's another common chunk (again, replace XX as above):
Also please make sure that you have latest Jenkins and its dependencies installed. Latest version in Fedora repositories is 1.581:


<pre>
=== '''Update your machine''' ===
su -c 'yum update --enablerepo=updates-testing jenkins-javadoc-plugin-1.2-1.fc21 jenkins-junit-plugin-1.1-1.fc21 jenkins-external-monitor-job-plugin-1.2-1.fc21 jenkins-ant-plugin-1.2-1.fc21 jenkins-executable-war-1.29-3.fc21 jenkins-mailer-plugin-1.11-1.fc21 js-yui2-2.9.0-6.fc21 stapler-adjunct-timeline-1.4-3.fc21 jenkins-1.581-2.fc21'
</pre>


=== Live image ===
If you're running Fedora XX, make sure you have all the current updates for it installed, using the update manager. If you want to try Rawhide, see the instructions on the [[Releases/Rawhide|Rawhide]] page on the various ways in which you can install or update to Rawhide. Or:


The live images are suitable for writing to a USB stick or to a DVD media. They can be used for installing Fedora from scratch, and may also be used to test Fedora directly from the USB stick / DVD media without writing anything to your hard drive. More information on how to use the images is available at [[FedoraLiveCD]].
=== '''Live image''' ===


Optionally, you may download a non-destructive Rawhide live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]]. Live images can be found [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ here].


{|
== Test Cases ==
! Architecture !! SHA256SUM
|-
| | [https://fedorapeople.org/groups/qa/20140930-Jenkins-Test-Day-Live-x86_64.iso 64bit] || 37e85e9dff9c38aaa4acd7ef938ec7f7349de45baea581707849eb18da4f0b5a
|}


== Test Cases ==
Provide a list of test areas or test cases that you'd like contributors to execute.  For other examples, see [[:Category:Test_Cases]].


== Test Results ==


* [[Msrb:TestDay/Test_1|Jenkins start/stop]]
Construct a table or list to allow testers to post results. Each column should be a test case or configuration, and each row should consist of test results. Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:
* [[Msrb:TestDay/Test_2|Freestyle project]]
* [[Msrb:TestDay/Test_3|Command-line interface]]
* [[Msrb:TestDay/Test_4|Script console]]
* [[Msrb:TestDay/Test_5|Plugins]]
* <strike>[[Msrb:TestDay/Test_6|Maven project]]</strike> see [https://bugzilla.redhat.com/show_bug.cgi?id=1147899 1147899]
* [[Msrb:TestDay/Test_7|Security]]
* <strike>[[Msrb:TestDay/Test_8|Slave machines]]</strike> see [https://bugzilla.redhat.com/show_bug.cgi?id=1147978 1147978] [https://bugzilla.redhat.com/show_bug.cgi?id=1147831 1147831]


== Test Results ==
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=udisks udisks], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=gnome-disk-utility gnome-disk-utility] for bugs in the Palimpsest graphical front end itself. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.


{|
{|
! User
! User
! [[Msrb:TestDay/Test_1|start/stop]]
! [[QA:Testcase_sample_1|Sample test 1]]
! [[Msrb:TestDay/Test_2|freestyle project]]
! [[QA:Testcase_sample_2|Sample test 2]]
! [[Msrb:TestDay/Test_3|cmd-line interface]]
! [[QA:Testcase_sample_3|Sample test 3]]
! [[Msrb:TestDay/Test_4|script console]]
! [[QA:Testcase_sample_4|Sample test 4]]
! [[Msrb:TestDay/Test_5|plugins]]
! [[Msrb:TestDay/Test_6|maven project]]
! [[Msrb:TestDay/Test_7|security]]
! [[Msrb:TestDay/Test_8|slave machines]]
! References
! References
|-
|-
| [[User:SampleUser|Sample User]]
| [[User:SampleUser|Sample User]]
| {{result|none}}  
| {{result|none}}  
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| <references/>
|-
| [[User:amsharma|Amita]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|warn}}[https://bugzilla.redhat.com/show_bug.cgi?id=1147963 1]
| {{result|pass}}
| {{result|fail}}[https://bugzilla.redhat.com/show_bug.cgi?id=1147821 1]
| {{result|pass}}
| {{result|fail}}[https://bugzilla.redhat.com/show_bug.cgi?id=1147978 1]
| <references/>
|-
| [[User:Mizdebsk|mizdebsk]]
| {{result|fail}} <ref>{{bz|1147846}}, {{bz|1147875}}, {{bz|1147879}}, {{bz|1147894}}, {{bz|1147897}}, {{bz|1147821}}</ref>
| {{result|warn||1147955}}
| {{result|pass}}
| {{result|pass}}
| {{result|warn}} <ref>{{bz|1147902}}, {{bz|1147908}}</ref>
| {{result|fail||1147899}}
| {{result|pass}}
| {{result|none}}
| <references/>
|-
| [[User:Mmaslano|mmaslano]]
| {{result|pass}}
| {{result|none}} <ref group="long">Fail to continue, because TestDay virtual froze. I wasn't able to figure out, which component is responsible, but definitely unrelated to Jenkins.</ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:jkejda|jkejda (32bit)]]
| {{result|fail||1147979}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:jkejda|jkejda (64bit)]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|warn}}
| {{result|pass}}
| {{result|warn}}
| <references/>
|-
| [[User:Vjuranek|vjuranek]]
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
| <references/>
|-
|-
|}
|}


== Long comments ==
[[Category:Test Days]]
<references group="long" />
[[Category:QA Templates]]
 
  [[Category:Fedora 21 Test Days]]
Please note that all contributions to Fedora Project Wiki are considered to be released under the Attribution-Share Alike 4.0 International (see Fedora Project Wiki:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To edit this page, please solve the following task below and enter the answer in the box (more info):

Cancel Editing help (opens in new window)