Latest revision |
Your text |
Line 21: |
Line 21: |
| * [[User:msrb|Michal Srb]] (msrb) | | * [[User:msrb|Michal Srb]] (msrb) |
|
| |
|
| == Prerequisite for Test Day == | | == Prerequisite for Test Day == |
|
| |
|
| Either of following:
| | * bootable USB key or CD/DVD disk with latest Fedora 21 live image or: |
| | |
| * bootable USB key or CD/DVD disk with latest Fedora 21 live image | |
| * machine or VM with updated Fedora 21 | | * machine or VM with updated Fedora 21 |
|
| |
|
| == Known issues == | | == Known issues == |
| # Fedora doesn't yet have all core plugins which come by default with upstream Jenkins ([https://bugzilla.redhat.com/show_bug.cgi?id=1147838 rhbz#1147838])
| | |
| # Attempt to download jenkins-cli.jar or slaves.jar from http://localhost:8080/jnlpJars/jenkins-cli.jar ends with "ERROR 500: Server Error" ([https://bugzilla.redhat.com/show_bug.cgi?id=1147831 rhbz#1147831])
| | TODO |
| # /var/log/jenkins/jenkins.log contains error message "SEVERE: Failed Inspecting plugin /var/lib/jenkins/plugins/jenkins-icon-shim.jpi due to bug in jenkins-icon-shim package ([https://bugzilla.redhat.com/show_bug.cgi?id=1147821 rhbz#1147821])
| |
| # JENKINS_HOME is owned by root ([https://bugzilla.redhat.com/show_bug.cgi?id=1147846 rhbz#1147846])
| |
| # Building of "Maven project" always ends with exception ([https://bugzilla.redhat.com/show_bug.cgi?id=1147899 rhbz#1147899])
| |
| # Jenkins doesn't handle plugins from RPM very well ([https://bugzilla.redhat.com/show_bug.cgi?id=1147902 rhbz#1147902], [https://bugzilla.redhat.com/show_bug.cgi?id=1147908 rhbz#1147908])
| |
|
| |
|
| == How to test? == | | == How to test? == |
|
| |
|
| There are two options. Either you can stick with prepared test cases (below), or you can simply try to use Jenkins and experiment. The second option is probably better for people already familiar with Jenkins. In either case, please report all bugs in https://bugzilla.redhat.com/, component "jenkins". Please always attach Jenkins log file <code>/var/log/jenkins/jenkins.log</code>, if possible. Thanks.
| | High level details on how a contributor can get involved. This can include (but not limited to): |
| | |
| | * Areas to target with exploratory testing |
| | * A list of pre-defined test cases to execute |
| | * How to report back results |
| | |
| | Here's another common chunk (again, replace XX as above): |
|
| |
|
| === Update your machine === | | === Update your machine === |
|
| |
|
| If you're running Fedora 21, make sure you have all the current updates for it installed, using the update manager. | | If you're running Fedora 21, make sure you have all the current updates for it installed, using the update manager. |
| Also please make sure that you have latest Jenkins and its dependencies installed. Latest version in Fedora repositories is 1.581:
| |
|
| |
| <pre>
| |
| su -c 'yum update --enablerepo=updates-testing jenkins-javadoc-plugin-1.2-1.fc21 jenkins-junit-plugin-1.1-1.fc21 jenkins-external-monitor-job-plugin-1.2-1.fc21 jenkins-ant-plugin-1.2-1.fc21 jenkins-executable-war-1.29-3.fc21 jenkins-mailer-plugin-1.11-1.fc21 js-yui2-2.9.0-6.fc21 stapler-adjunct-timeline-1.4-3.fc21 jenkins-1.581-2.fc21'
| |
| </pre>
| |
|
| |
|
| === Live image === | | === Live image === |
Line 53: |
Line 48: |
| The live images are suitable for writing to a USB stick or to a DVD media. They can be used for installing Fedora from scratch, and may also be used to test Fedora directly from the USB stick / DVD media without writing anything to your hard drive. More information on how to use the images is available at [[FedoraLiveCD]]. | | The live images are suitable for writing to a USB stick or to a DVD media. They can be used for installing Fedora from scratch, and may also be used to test Fedora directly from the USB stick / DVD media without writing anything to your hard drive. More information on how to use the images is available at [[FedoraLiveCD]]. |
|
| |
|
| | | TODO - fix the links |
| {| | | {| |
| ! Architecture !! SHA256SUM | | ! Architecture !! SHA256SUM |
| |- | | |- |
| | | [https://fedorapeople.org/groups/qa/20140930-Jenkins-Test-Day-Live-x86_64.iso 64bit] || 37e85e9dff9c38aaa4acd7ef938ec7f7349de45baea581707849eb18da4f0b5a | | | [https://kojipkgs.fedoraproject.org//work/tasks/6453/7466453/Fedora-Live-Workstation-x86_64-21-20140827.iso 64 bit] || 8fce11269a8b1ea4283a3d4e3ecc78606d357f26de9efed248685c8c5be6c90d |
| | |- |
| | | [https://kojipkgs.fedoraproject.org//work/tasks/6450/7466450/Fedora-Live-Workstation-i686-21-20140827.iso 32 bit] || 8200c257514f0d302d62b54f68aae38179b83674c2e2dab4be9ba10090ce1ae3 |
| |} | | |} |
|
| |
|
| == Test Cases == | | == Test Cases == |
| | |
| | * '''Basic''' |
| | ** [[Msrb:Testcase Jenkins start/stop|Jenkins start/stop]] |
|
| |
|
|
| |
|
| * [[Msrb:TestDay/Test_1|Jenkins start/stop]]
| |
| * [[Msrb:TestDay/Test_2|Freestyle project]]
| |
| * [[Msrb:TestDay/Test_3|Command-line interface]]
| |
| * [[Msrb:TestDay/Test_4|Script console]]
| |
| * [[Msrb:TestDay/Test_5|Plugins]]
| |
| * <strike>[[Msrb:TestDay/Test_6|Maven project]]</strike> see [https://bugzilla.redhat.com/show_bug.cgi?id=1147899 1147899]
| |
| * [[Msrb:TestDay/Test_7|Security]]
| |
| * <strike>[[Msrb:TestDay/Test_8|Slave machines]]</strike> see [https://bugzilla.redhat.com/show_bug.cgi?id=1147978 1147978] [https://bugzilla.redhat.com/show_bug.cgi?id=1147831 1147831]
| |
|
| |
|
| == Test Results == | | == Test Results == |
| | |
|
| |
|
| {| | | {| |
| ! User | | ! User |
| ! [[Msrb:TestDay/Test_1|start/stop]] | | ! [[QA:Testcase_sample_1|Sample test 1]] |
| ! [[Msrb:TestDay/Test_2|freestyle project]] | | ! [[QA:Testcase_sample_2|Sample test 2]] |
| ! [[Msrb:TestDay/Test_3|cmd-line interface]] | | ! [[QA:Testcase_sample_3|Sample test 3]] |
| ! [[Msrb:TestDay/Test_4|script console]] | | ! [[QA:Testcase_sample_4|Sample test 4]] |
| ! [[Msrb:TestDay/Test_5|plugins]]
| |
| ! [[Msrb:TestDay/Test_6|maven project]]
| |
| ! [[Msrb:TestDay/Test_7|security]]
| |
| ! [[Msrb:TestDay/Test_8|slave machines]]
| |
| ! References | | ! References |
| |- | | |- |
| | [[User:SampleUser|Sample User]] | | | [[User:SampleUser|Sample User]] |
| | {{result|none}} | | | {{result|none}} |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}} | | | {{result|pass}} |
| | {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref> | | | {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref> |
| | {{result|fail}} <ref>{{bz|12345}}</ref> | | | {{result|fail}} <ref>{{bz|12345}}</ref> |
| | <references/>
| |
| |-
| |
| | [[User:amsharma|Amita]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|warn}}[https://bugzilla.redhat.com/show_bug.cgi?id=1147963 1]
| |
| | {{result|pass}}
| |
| | {{result|fail}}[https://bugzilla.redhat.com/show_bug.cgi?id=1147821 1]
| |
| | {{result|pass}}
| |
| | {{result|fail}}[https://bugzilla.redhat.com/show_bug.cgi?id=1147978 1]
| |
| | <references/>
| |
| |-
| |
| | [[User:Mizdebsk|mizdebsk]]
| |
| | {{result|fail}} <ref>{{bz|1147846}}, {{bz|1147875}}, {{bz|1147879}}, {{bz|1147894}}, {{bz|1147897}}, {{bz|1147821}}</ref>
| |
| | {{result|warn||1147955}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|warn}} <ref>{{bz|1147902}}, {{bz|1147908}}</ref>
| |
| | {{result|fail||1147899}}
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | <references/>
| |
| |-
| |
| | [[User:Mmaslano|mmaslano]]
| |
| | {{result|pass}}
| |
| | {{result|none}} <ref group="long">Fail to continue, because TestDay virtual froze. I wasn't able to figure out, which component is responsible, but definitely unrelated to Jenkins.</ref>
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | <references/>
| |
| |-
| |
| | [[User:jkejda|jkejda (32bit)]]
| |
| | {{result|fail||1147979}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | <references/>
| |
| |-
| |
| | [[User:jkejda|jkejda (64bit)]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|warn}}
| |
| | {{result|pass}}
| |
| | {{result|warn}}
| |
| | <references/>
| |
| |-
| |
| | [[User:Vjuranek|vjuranek]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | {{result|none}}
| |
| | <references/> | | | <references/> |
| |- | | |- |
| |} | | |} |
|
| |
|
| == Long comments ==
| | [[Category:Test Days]] |
| <references group="long" />
| | [[Category:QA Templates]] |
| | |
| [[Category:Fedora 21 Test Days]]
| |