From Fedora Project Wiki

 
Line 72: Line 72:
 
== Test Results ==
 
== Test Results ==
  
Please enter your results on the [http://testdays.fedorainfracloud.org/events/22 result page]. The results will be transferred here after the Test Day is finished.
+
=== Basic tests ===
 +
{|
 +
! User
 +
! Profile
 +
! [http://fedoraproject.org/wiki/QA:Testcase_base_startup Boot]
 +
! [http://fedoraproject.org/wiki/QA:Testcase_base_system_logging Logging]
 +
! [http://fedoraproject.org/wiki/QA:Testcase_Services_start Services Start]
 +
! [http://fedoraproject.org/wiki/QA:Testcase_base_selinux SELinux]
 +
! [http://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation Service Manipulation]
 +
! References
 +
|-
 +
| [[User:cialu|cialu]]
 +
| Fedora Cloud base image x86
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
| [[User:mrniranjan|mrniranjan]]
 +
|  fedora 26 beta atomic qcow2 image
 +
| {{result|pass}}
 +
|
 +
|
 +
|
 +
|
 +
| <references/>
 +
|-
 +
| [[User:roshi|roshi]]
 +
| testcloud x86 Base image
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}{{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
| [[User:sinnykumari|sinnykumari]]
 +
| Atomic ISO on bare metal
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
| [[User:sinnykumari|sinnykumari]]
 +
| Atomic qcow2 image using testcloud
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
| [[User:sumantrom|sumantrom]]
 +
| F26  beta qcow2
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
|
 +
|
 +
| <references/>
 +
|-
 +
| [[User:tenk|tenk]]
 +
|  testcloud on F25 -> fedora 26 beta atomic qcow2 image
 +
| {{result|pass}}
 +
|
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}<ref>use docker service for the test</ref>
 +
| <references/>
 +
|-
 +
| [[User:tenk|tenk]]
 +
| estcloud on F25 -> fedora 26 beta atomic qcow2 image
 +
|
 +
| {{result|pass}}
 +
|
 +
|
 +
|
 +
| <references/>
 +
 
 +
|-
 +
|}
 +
 
 +
=== Atomic ===
 +
{|
 +
! User
 +
! Profile
 +
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Docker_Storage_Setup Docker Storage Setup]
 +
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Docker_Lifecycle Docker Lifecycle]
 +
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Upgrade Atomic Upgrade]
 +
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Rollback Atomic Downgrade]
 +
! [http://github.com/projectatomic/rpm-ostree/blob/master/docs/manual/administrator-handbook.md rpm-ostree package overlay]
 +
! References
 +
|-
 +
| [[User:roshi|roshi]]
 +
| testcloud
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
| [[User:sinnykumari|sinnykumari]]
 +
| Atomic ISO on bare metal
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}{{result|pass}}
 +
| <references/>
 +
|-
 +
| [[User:sinnykumari|sinnykumari]]
 +
| Atomic qcow2 image using testcloud
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
| [[User:tenk|tenk]]
 +
|  testcloud on F25 -> fedora 26 beta atomic qcow2 image
 +
| {{result|pass}}
 +
|
 +
| {{result|pass}}
 +
|
 +
|
 +
| <references/>
 +
|-
 +
| [[User:tenk|tenk]]
 +
| testcloud on F25 -> fedora 26 beta atomic qcow2 image
 +
|
 +
|
 +
|
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
 
 +
|-
 +
|}
 +
 
 +
=== Exploratory ===
 +
{|
 +
! User
 +
! Profile
 +
! [http://fedoraproject.org/wiki/Test_Day:2017-06-20_Cloud-Atomic_Testday Launch app on Cloud Base image]
 +
! [http://fedoraproject.org/wiki/Test_Day:2017-06-20_Cloud-Atomic_Testday Launch app on FAH]
 +
! [http://fedoraproject.org/wiki/Test_Day:2017-06-20_Cloud-Atomic_Testday Custom (write in comment what you did)]
 +
! References
 +
|-
 +
| [[User:roshi|roshi]]
 +
| testcloud x86 Base image
 +
| {{result|pass}}<ref>Launched a couple web applications via git. They seemed to run fine.</ref>
 +
| {{result|pass}}<ref>Launched a couple web applications via git. They seemed to run fine.</ref>
 +
| {{result|pass}}<ref>Launched a couple web applications via git. They seemed to run fine.</ref>
 +
| <references/>
 +
 
 +
|-
 +
|}
 +
 
 +
=== Cloud Providers ===
 +
{|
 +
! User
 +
! Profile
 +
! [http://docs.aws.amazon.com/elasticbeanstalk/latest/dg/using-features.customenv.html Launch on AWS]
 +
! [http://docs.openstack.org/user-guide/dashboard-manage-images.html Launch on OpenStack (requires openstack instance)]
 +
! References
 +
 
 +
|-
 +
|}

Latest revision as of 22:06, 25 February 2020

Cloud/Atomic Test Day
Test-days-banner.svg

Date 2017-06-20
Time all day

Website QA/Test Days
IRC #fedora-test-day (webirc)
Mailing list test


Note.png
Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

Today's instalment of Fedora Test Day will focus on Fedora Atomic and Cloud images

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

  • Development - Dustymabe (irc dustymabe)
  • Quality Assurance - Roshi (irc roshi)

Prerequisite for Test Day[edit]

A fresh system (for Fedora Atomic Host), testcloud to test qcow images locally, or access to a cloud provider like OpenStack or AWS ... a desire to break software?

Fedora Atomic Host (FAH)[edit]

FAH can be run as a traditional cloud image, or installed to bare metal. If you have a spare machine you can install FAH to, please test this image. Download the image, write it to a USB stick and install like any other Fedora deliverable. If you need help, please ping in IRC.

Qcow2 images[edit]

The Fedora Cloud base image and Atomic images are also delivered as qcow2 images. You can use testcloud to locally boot and test either of these images. You can run testcloud from a git checkout, or use dnf to install it:


sudo dnf install testcloud

Once it's installed, you can run testcloud like so:

testcloud instance create <name of instance> -u https://kojipkgs.fedoraproject.org/compose/branched/Fedora-26-20170619.n.0/compose/CloudImages/x86_64/images/Fedora-Cloud-Base-26-20170619.n.0.x86_64.qcow2

How to test?[edit]

This testday is more general, so attempt to do anything and everything with these images :) Specifically though, we'd like to take a look at the following scenarios:

Atomic:

  • Deploy applications on top of Atomic
  • Upgrades and downgrades of existing Atomic Hosts (preferably with applications running)
  • Package layering with on top of the base Atomic OSTree

Cloud:

  • Test different cloud-init configs
  • Deploy and run some applications in the cloud

EC2 If you have access to Amazon EC2, you can use one of the AMIs listed here for testing.

Run the tests[edit]

Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.

This testday is also meant to be exploratory, so the list on the testday app is not at all comprehensive!

Reporting bugs[edit]

If you find anything that seems wrong or off, please report a bug on Bugzilla. The affected component should be clear from whatever error message you happen to find, but if you aren't sure what component to file against, please file it against FIXME. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

Test Results[edit]

Basic tests[edit]

User Profile Boot Logging Services Start SELinux Service Manipulation References
cialu Fedora Cloud base image x86
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
mrniranjan fedora 26 beta atomic qcow2 image
Pass pass
roshi testcloud x86 Base image
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
sinnykumari Atomic ISO on bare metal
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
sinnykumari Atomic qcow2 image using testcloud
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
sumantrom F26 beta qcow2
Pass pass
Pass pass
Pass pass
tenk testcloud on F25 -> fedora 26 beta atomic qcow2 image
Pass pass
Pass pass
Pass pass
Pass pass
[1]
  1. use docker service for the test
tenk estcloud on F25 -> fedora 26 beta atomic qcow2 image
Pass pass

Atomic[edit]

User Profile Docker Storage Setup Docker Lifecycle Atomic Upgrade Atomic Downgrade rpm-ostree package overlay References
roshi testcloud
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
sinnykumari Atomic ISO on bare metal
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
sinnykumari Atomic qcow2 image using testcloud
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
tenk testcloud on F25 -> fedora 26 beta atomic qcow2 image
Pass pass
Pass pass
tenk testcloud on F25 -> fedora 26 beta atomic qcow2 image
Pass pass
Pass pass

Exploratory[edit]

User Profile Launch app on Cloud Base image Launch app on FAH Custom (write in comment what you did) References
roshi testcloud x86 Base image
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
  1. Launched a couple web applications via git. They seemed to run fine.
  2. Launched a couple web applications via git. They seemed to run fine.
  3. Launched a couple web applications via git. They seemed to run fine.

Cloud Providers[edit]

User Profile Launch on AWS Launch on OpenStack (requires openstack instance) References