From Fedora Project Wiki

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 18: Line 18:


The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
* Development - [[User:dustymabe|Dustymabe]] (irc dustymabe)
* Development - [[User:Developer|Developer1]] (irc_nick1), [[User:Developer2|Developer2]] (irc_nick2)
* Quality Assurance - [[User:Roshi|Roshi]] (irc roshi)
* Quality Assurance - [[User:Tester1|Tester1]] (irc_nick3), [[User:Tester2|Tester2]] (irc_nick4)


== Prerequisite for Test Day ==  
== Prerequisite for Test Day ==  


A fresh system (for Fedora Atomic Host), [https://github.com/Rorosha/testcloud testcloud] to test qcow images locally, or access to a cloud provider like OpenStack or AWS ... a desire to break software?
List any prerequisite needs for the test event.  A fresh system, virtualized guest, a blank DVD ... a desire to break software?


=== Fedora Atomic Host (FAH) ===
* Usb key
* Usb externally connected HD IDE/SATA
* Empty HD IDE/SATA/SCSI
* Free space on HD


FAH can be run as a traditional cloud image, or installed to bare metal. If you have a spare machine you can install FAH to, please test this '''[https://kojipkgs.fedoraproject.org/compose/branched/Fedora-26-20170619.n.0/compose/Atomic/x86_64/iso/Fedora-Atomic-ostree-x86_64-26-20170619.n.0.iso image]'''. Download the image, write it to a USB stick and install like any other Fedora deliverable. If you need help, please ping in IRC.
Here's a chunk which is commonly used for most Test Days. Replace XX with whatever Fedora release is pending:


=== Qcow2 images ===
* An updated [https://getfedora.org/workstation/prerelease Fedora XX pre-release], or a [https://www.happyassassin.net/nightlies.html Fedora XX nightly image]


The Fedora Cloud [https://kojipkgs.fedoraproject.org/compose/branched/Fedora-26-20170619.n.0/compose/CloudImages/x86_64/images/Fedora-Cloud-Base-26-20170619.n.0.x86_64.qcow2 base image] and Atomic images are also delivered as qcow2 images. You can use [https://github.com/Rorosha/testcloud testcloud] to locally boot and test either of these images. You can run testcloud from a git checkout, or use dnf to install it:
== How to test? ==
 
 
<code>
sudo dnf install testcloud
</code>


Once it's installed, you can run testcloud like so:
High level details on how a contributor can get involved.  This can include (but not limited to):


<code>
* Areas to target with exploratory testing
testcloud instance create <name of instance> -u https://kojipkgs.fedoraproject.org/compose/branched/Fedora-26-20170619.n.0/compose/CloudImages/x86_64/images/Fedora-Cloud-Base-26-20170619.n.0.x86_64.qcow2
* A list of pre-defined test cases to execute
</code>
* How to report back results


== How to test? ==
Here's another common chunk (again, replace XX as above):


This testday is more general, so attempt to do anything and everything with these images :) Specifically though, we'd like to take a look at the following scenarios:
=== '''Update your machine''' ===


'''Atomic:'''
If you're running Fedora XX, make sure you have all the current updates for it installed, using the update manager. If you want to try Rawhide, see the instructions on the [[Releases/Rawhide|Rawhide]] page on the various ways in which you can install or update to Rawhide. Or:
* Deploy applications on top of Atomic
* Upgrades and downgrades of existing Atomic Hosts (preferably with applications running)
* Package layering with on top of the base Atomic OSTree


'''Cloud:'''
=== '''Live image''' ===
* Test different cloud-init configs
* Deploy and run some applications in the cloud


'''EC2'''
Instead of testing with an installed system, you may download a non-destructive nightly live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]]. Live image links can be found [https://www.happyassassin.net/nightlies.html here]: please be sure to download one for the correct release.
If you have access to Amazon EC2, you can use one of the AMIs listed [https://lists.fedoraproject.org/archives/list/cloud@lists.fedoraproject.org/thread/EEOYK5MJQX7UWAP63RPBO6AQH75CK7O4/ here] for testing.


=== Run the tests ===
=== Run the tests ===


Visit the [http://testdays.fedorainfracloud.org/events/22 result page] and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the ''Enter result'' button for the test.
If not using the Test Day app, provide a list of test areas or test cases that you'd like contributors to execute. For examples, see [[:Category:Test_Cases]]. If using the Test Day app, link to it here, with some explanation, e.g.:


This testday is also meant to be exploratory, so the list on the testday app is not at all comprehensive!
Visit the [http://testdays.fedorainfracloud.org/events/NUMBER result page] and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the ''Enter result'' button for the test.


== Reporting bugs ==
== Reporting bugs ==


If you find anything that seems wrong or off, please report a bug on [https://bugzilla.redhat.com Bugzilla]. The affected component should be clear from whatever error message you happen to find, but if you aren't sure what component to file against, please file it against '''FIXME'''. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.
Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:
 
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=udisks udisks], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=gnome-disk-utility gnome-disk-utility] for bugs in the Palimpsest graphical front end itself. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.


== Test Results ==
== Test Results ==


=== Basic tests ===
If you use the [http://testdays.fedorainfracloud.org/events Test Days app], just explain that users should enter results there and they will be transferred to the page later. For e.g.:
{|
 
! User
Please enter your results on the [http://testdays.fedorainfracloud.org/events/NUMBER result page]. The results will be transferred here after the Test Day is finished.
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_base_startup Boot]
! [http://fedoraproject.org/wiki/QA:Testcase_base_system_logging Logging]
! [http://fedoraproject.org/wiki/QA:Testcase_Services_start Services Start]
! [http://fedoraproject.org/wiki/QA:Testcase_base_selinux SELinux]
! [http://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation Service Manipulation]
! References
|-
| [[User:cialu|cialu]]
| Fedora Cloud base image x86
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:mrniranjan|mrniranjan]]
|  fedora 26 beta atomic qcow2 image
| {{result|pass}}
|
|
|
|
| <references/>
|-
| [[User:roshi|roshi]]
| testcloud x86 Base image
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}{{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:sinnykumari|sinnykumari]]
| Atomic ISO on bare metal
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:sinnykumari|sinnykumari]]
| Atomic qcow2 image using testcloud
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:sumantrom|sumantrom]]
| F26  beta qcow2
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
|
| <references/>
|-
| [[User:tenk|tenk]]
|  testcloud on F25 -> fedora 26 beta atomic qcow2 image
| {{result|pass}}
|
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>use docker service for the test</ref>
| <references/>
|-
| [[User:tenk|tenk]]
| estcloud on F25 -> fedora 26 beta atomic qcow2 image
|
| {{result|pass}}
|
|
|
| <references/>


|-
Otherwise, construct a table or list to allow testers to post results.  Each column should be a test case or configuration, and each row should consist of test results. Include some text to explain reporting. Here is a common setup:
|}


=== Atomic ===
Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
{|
{|
! User
! User
! Profile
! [[QA:Testcase_sample_1|Sample test 1]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Docker_Storage_Setup Docker Storage Setup]
! [[QA:Testcase_sample_2|Sample test 2]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Docker_Lifecycle Docker Lifecycle]
! [[QA:Testcase_sample_3|Sample test 3]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Upgrade Atomic Upgrade]
! [[QA:Testcase_sample_4|Sample test 4]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Rollback Atomic Downgrade]
! [http://github.com/projectatomic/rpm-ostree/blob/master/docs/manual/administrator-handbook.md rpm-ostree package overlay]
! References
! References
|-
|-
| [[User:roshi|roshi]]
| [[User:SampleUser|Sample User]]
| testcloud
| {{result|none}}  
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:sinnykumari|sinnykumari]]
| Atomic ISO on bare metal
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}{{result|pass}}
| <references/>
|-
| [[User:sinnykumari|sinnykumari]]
| Atomic qcow2 image using testcloud
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:tenk|tenk]]
|  testcloud on F25 -> fedora 26 beta atomic qcow2 image
| {{result|pass}}
|
| {{result|pass}}
|
|
| <references/>
|-
| [[User:tenk|tenk]]
| testcloud on F25 -> fedora 26 beta atomic qcow2 image
|
|
|
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| <references/>
| <references/>
|-
|}
=== Exploratory ===
{|
! User
! Profile
! [http://fedoraproject.org/wiki/Test_Day:2017-06-20_Cloud-Atomic_Testday Launch app on Cloud Base image]
! [http://fedoraproject.org/wiki/Test_Day:2017-06-20_Cloud-Atomic_Testday Launch app on FAH]
! [http://fedoraproject.org/wiki/Test_Day:2017-06-20_Cloud-Atomic_Testday Custom (write in comment what you did)]
! References
|-
| [[User:roshi|roshi]]
| testcloud x86 Base image
| {{result|pass}}<ref>Launched a couple web applications via git. They seemed to run fine.</ref>
| {{result|pass}}<ref>Launched a couple web applications via git. They seemed to run fine.</ref>
| {{result|pass}}<ref>Launched a couple web applications via git. They seemed to run fine.</ref>
| <references/>
|-
|}
=== Cloud Providers ===
{|
! User
! Profile
! [http://docs.aws.amazon.com/elasticbeanstalk/latest/dg/using-features.customenv.html Launch on AWS]
! [http://docs.openstack.org/user-guide/dashboard-manage-images.html Launch on OpenStack (requires openstack instance)]
! References
|-
|-
|}
|}
Please note that all contributions to Fedora Project Wiki are considered to be released under the Attribution-Share Alike 4.0 International (see Fedora Project Wiki:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To edit this page, please solve the following task below and enter the answer in the box (more info):

Cancel Editing help (opens in new window)