m (internal link cleaning) |
|||
(28 intermediate revisions by 12 users not shown) | |||
Line 21: | Line 21: | ||
* Cloud SIG - [[user:dustymabe|Dusty Mabe]] (dustymabe), | * Cloud SIG - [[user:dustymabe|Dusty Mabe]] (dustymabe), | ||
* Quality Assurance - [[User:Roshi|Roshi]] (roshi) | * Quality Assurance - [[User:Roshi|Roshi]] (roshi) | ||
* Cloud / Infra - [[user:oddshocks|David Gay]] (oddshocks) | |||
== Prerequisite for Test Day == | == Prerequisite for Test Day == | ||
Line 96: | Line 96: | ||
For better worded test steps please refer to Mike's pages: [[User:Roshi/QA/AtomicTests]] | For better worded test steps please refer to Mike's pages: [[User:Roshi/QA/AtomicTests]] | ||
Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located [ | Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located [[Template:Cloud_test_matrix|here]]. If you don't know if the test applies to Atomic or not then feel free to ask in #fedora-cloud on freenode. | ||
== Test Results == | == Test Results == | ||
Line 108: | Line 108: | ||
! User | ! User | ||
! Hardware | ! Hardware | ||
! [ | ! [[QA:Testcase_base_startup|Startup]] | ||
! [ | ! [[QA:Testcase_base_system_logging|System Logging]] | ||
! [ | ! [[QA:Testcase_Services_start|Services Start]] | ||
! [ | ! [[QA:Testcase_base_selinux|SELinux]] | ||
! [ | ! [[QA:Testcase_base_service_manipulation|Service Manipulation]] | ||
! References | ! References | ||
|- | |- | ||
| [[User:dustymabe|dustymabe]] | | [[User:dustymabe|dustymabe]] | ||
| Openstack Juno on F21 | | Openstack Juno on F21 | ||
| {{result| | | {{result|pass|dustymabe}} | ||
| {{result| | | {{result|pass|dustymabe}} | ||
| {{result| | | {{result|fail|dustymabe}} <ref>Hit [https://bugzilla.redhat.com/show_bug.cgi?id=1216151 BZ#1216151]</ref> | ||
| {{result| | | {{result|pass|dustymabe}} | ||
| {{result| | | {{result|pass|dustymabe}} | ||
| <references/> | | <references/> | ||
|- | |- | ||
Line 134: | Line 134: | ||
|- | |- | ||
| [[User:maxamillion|maxamillion]] | | [[User:maxamillion|maxamillion]] | ||
| ThinkPad T440s with Fedora Rawhide | | ThinkPad T440s with Fedora Rawhide (KVM) | ||
| {{result|pass|maxamillion}} | | {{result|pass|maxamillion}} | ||
| {{result|pass|maxamillion}} | | {{result|pass|maxamillion}} | ||
Line 142: | Line 142: | ||
| <references/> | | <references/> | ||
|- | |- | ||
| [[User:rtnpro|rtnpro]] | |||
| ThinkPad T440p with Fedora 21 (Vagrant: libvirt/KVM) | |||
| {{result|pass|rtnpro}} | |||
| {{result|pass|rtnpro}} | |||
| {{result|pass|rtnpro}} | |||
| {{result|pass|rtnpro}} | |||
| {{result|pass|rtnpro}} | |||
| <references/> | |||
|- | |||
| [[User:caiqian|CAI Qian]] | |||
| ThinkPad T540p with Fedora 21 (KVM) | |||
| {{result|pass|caiqian}} | |||
| {{result|pass|caiqian}} | |||
| {{result|pass|caiqian}} | |||
| {{result|pass|caiqian}} | |||
| {{result|pass|caiqian}} | |||
| <references/> | |||
|- | |||
| [[User:oddshocks|oddshocks]] | |||
| AWS EC2 | |||
| {{result|pass|oddshocks}} | |||
| {{result|pass|oddshocks}} | |||
| {{result|fail|oddshocks}} <ref>Hit [https://bugzilla.redhat.com/show_bug.cgi?id=1216151 BZ#1210419]</ref> | |||
| {{result|pass|oddshocks}} | |||
| {{result|pass|oddshocks}} | |||
| <references/> | |||
|} | |} | ||
=== Atomic Host Tests === | === Atomic Host Tests === | ||
For the Atomic Tests, download the latest image from [http://download.fedoraproject.org/pub/fedora/linux/releases/test/22_Beta/Cloud/x86_64/Images/Fedora-Cloud-Atomic-22_Beta-20150415.x86_64.qcow2 here] | |||
{| | {| | ||
! User | ! User | ||
! Hardware | ! Hardware | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Image_Boots|Image Boots]] | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Upgrade|Upgrade Works]] | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Rollback|Rollback Works]] | ||
! References | ! References | ||
|- | |- | ||
| [[User:dustymabe|dustymabe]] | | [[User:dustymabe|dustymabe]] | ||
| Openstack Juno on F21 | | Openstack Juno on F21 | ||
| {{result|-}} | | {{result|pass|dustymabe}} | ||
| {{result| | | {{result|pass|dustymabe}} | ||
| {{result| | | {{result|pass|dustymabe}} | ||
| <references/> | |||
|- | |||
| [[User:rtnpro|rtnpro]] | |||
| ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM) | |||
| {{result|pass|rtnpro}} | |||
| {{result|pass|rtnpro}} | |||
| {{result|pass|rtnpro}} | |||
| <references/> | | <references/> | ||
|- | |- | ||
Line 169: | Line 204: | ||
|- | |- | ||
| [[User:maxamillion|maxamillion]] | | [[User:maxamillion|maxamillion]] | ||
| ThinkPad T440s with Fedora Rawhide | | ThinkPad T440s with Fedora Rawhide (KVM) | ||
| {{result|pass|maxamillion}} | | {{result|pass|maxamillion}} | ||
| {{result|pass|maxamillion}} | | {{result|pass|maxamillion}} | ||
Line 182: | Line 217: | ||
| <references/> | | <references/> | ||
|- | |- | ||
| [[User:oystercatcher|oystercatcher]] | |||
| Intel dual core desktop fc22 kvm | |||
| {{result|pass|oystercatcher}} | |||
| {{result|pass|oystercatcher}} | |||
| {{result|pass|oystercatcher}} | |||
| <references/> | |||
|- | |||
| [[User:royboy626|royboy626]] | |||
| ...Atomic-20141203-21 on Fedora 21 | |||
| {{result|pass|royboy626}} <ref>See references Atomic Docker Tests</ref> | |||
| {{result|pass|royboy626}} <ref>All listed User Roshi tests passed</ref> | |||
| {{result|pass|royboy626}} | |||
| <references/> | |||
|- | |||
| [[User:caiqian|CAI Qian]] | |||
| ThinkPad T540p with Fedora 21 (KVM) | |||
| {{result|pass|caiqian}} | |||
| {{result|pass|caiqian}} <ref>That docker run command could hang like forever until I interrupted it, it might because of slow network here. Other time it could run successfully.</ref> | |||
| {{result|pass|caiqian}} | |||
| <references/> | |||
|} | |} | ||
=== Docker Tests === | === Atomic Docker Tests === | ||
For the | For the Atomic Tests, download the latest image from [http://download.fedoraproject.org/pub/fedora/linux/releases/test/22_Beta/Cloud/x86_64/Images/Fedora-Cloud-Atomic-22_Beta-20150415.x86_64.qcow2 here] | ||
{| | {| | ||
! User | ! User | ||
! Hardware | ! Hardware | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Docker_Storage_Setup|docker-storage-setup]] | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Docker_Lifecycle|Docker Lifecycle]] | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Docker_ImageTest|Docker Image Test]] | ||
! References | ! References | ||
|- | |- | ||
| [[User:dustymabe|dustymabe]] | | [[User:dustymabe|dustymabe]] | ||
| Openstack Juno on F21 | | Openstack Juno on F21 | ||
| {{result| | | {{result|pass|dustymabe}} | ||
| {{result| | | {{result|warn|dustymabe}} <ref>Hit [https://bugzilla.redhat.com/show_bug.cgi?id=1205454 BZ#1205454]</ref> | ||
| {{result|pass|dustymabe}} | | {{result|pass|dustymabe}} | ||
| <references/> | | <references/> | ||
|- | |- | ||
| [[User:maxamillion|maxamillion]] | | [[User:maxamillion|maxamillion]] | ||
| ThinkPad T440s with Fedora Rawhide | | ThinkPad T440s with Fedora Rawhide (KVM) | ||
| {{result|pass|maxamillion}} | | {{result|pass|maxamillion}} | ||
| {{result|pass|maxamillion}} | | {{result|pass|maxamillion}} | ||
| {{result|pass|maxamillion}} | | {{result|pass|maxamillion}} | ||
| <references/> | |||
|- | |||
| [[User:mmicene|mmicene]] | |||
| Dell Latitude E6440 with Fedora 21 KVM | |||
| {{result|pass|mmicene}} | |||
| {{result|pass|mmicene}} | |||
| {{result|pass|mmicene}} | |||
| <references/> | |||
|- | |||
| [[User:oystercatcher|oystercatcher]] | |||
| Intel dual core desktop fc22 kvm | |||
| {{result|pass|oystercatcher}} | |||
| {{result|pass|oystercatcher}} | |||
| {{result|pass|oystercatcher}} | |||
| <references/> | |||
|- | |||
| [[User:rtnpro|rtnpro]] | |||
| ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM) | |||
| {{result|pass|rtnpro}} | |||
| {{result|pass|rtnpro}} | |||
| {{result|pass|rtnpro}} | |||
| <references/> | |||
|- | |||
| [[User:royboy626|royboy626]] | |||
| ...Atomic-20141203-21 on Fedora 21 | |||
| {{result|pass|royboy626}} <ref> Got here too early, downloaded file was 20141203-21</ref> | |||
| {{result|pass|royboy626}} <ref> SeLinux caused virt net problem. is preventing /usr/bin/qemu-system-x86_64 from using the execmem \ | |||
Boot base metal host with selinux=0 on linux line cured.</ref> | |||
| {{result|pass|royboy626}} | |||
| <references/> | |||
|- | |||
| [[User:caiqian|CAI Qian]] | |||
| ThinkPad T540p with Fedora 21 (KVM) | |||
| {{result|pass|caiqian}} | |||
| {{result|pass|caiqian}} | |||
| {{result|pass|caiqian}} | |||
| <references/> | | <references/> | ||
|} | |} | ||
=== Bugs filled during Test Day (7th May 2015) === | === Bugs filled during Test Day (7th May 2015) === | ||
[https://bugzilla.redhat.com/show_bug.cgi?id=1219700 BZ#1219700] | |||
=== Other Common Bugs === | === Other Common Bugs === | ||
[https://bugzilla.redhat.com/show_bug.cgi?id=1216151 BZ#1216151] | * [https://bugzilla.redhat.com/show_bug.cgi?id=1216151 BZ#1216151] | ||
* [https://bugzilla.redhat.com/show_bug.cgi?id=1205454 BZ#1205454] Workaround: Use "docker run -it --rm busybox sleep 15" or another longer running command instead of "docker run -it --rm busybox true" for testing | |||
== Long comments == | == Long comments == | ||
<references group="long" /> | <references group="long" /> | ||
[[Category:Fedora 22 Test Days]] | [[Category:Fedora 22 Test Days]] |
Latest revision as of 21:43, 19 September 2016
Fedora Test Days | |
---|---|
![]() | |
Easily deploy and manage your Docker containers | |
Date | 07 May 2015 |
Time | all day |
Website | QA/Fedora_22_test_days |
IRC | #atomic (webirc) |
Mailing list | cloud |
What to test?[edit]
Today's installment of Fedora Test Day will focus on Fedora Atomic Host
Who's available[edit]
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
- Cloud SIG - Dusty Mabe (dustymabe),
- Quality Assurance - Roshi (roshi)
- Cloud / Infra - David Gay (oddshocks)
Prerequisite for Test Day[edit]
You'll need to either have an AWS account or a system that's capable of running one of the Atomic images for KVM/OpenStack.
- OpenStack installation [outside the scope of test day to set up!]
- Virt-Manager or KVM setup to run the qcow2 image.
- Run testCloud locally
Links for "how to setup" for the Test Day[edit]
- Refer quickstart guide for setup Atomic with Virt-manager or KVM
- Don't know how to create cloud init iso? refer running-cloud-images-locally
AMIs for Test Day[edit]
Region | AMI name |
---|---|
us-east-1 | ami-76cef41e |
us-west-1 | ami-6919fb2d |
us-west-2 | ami-2580aa15 |
eu-west-1 | ami-817b1bf6 |
eu-central-1 | ami-82c7fb9f |
ap-southeast-1 | ami-a6714cf4 |
ap-northeast-1 | ami-f6a164f6 |
ap-southeast-2 | ami-a97a0793 |
sa-east-1 | ami-b79a1faa |
How to test?[edit]
We need to test several things on the Fedora Atomic release before Fedora 22 Final.
- Test with a variety of Docker images. We do want to test the Fedora images in particular, but also we need to test a wide variety of images to see if there are any hidden bugs or problems we might not have noticed yet.
- Test Cockpit to make sure that managing Docker images and connecting multiple hosts works.
- Try out Kubernetes and make sure those packages are working.
- Test out the rpm-ostree/atomic update/rollback commands and other functions.
- Try out docker-storage-config.
- What is the image/package set missing? What is unnecessary?
Grab the Image[edit]
To test Fedora Atomic, we're going to use a beta image located here: [3]. You can also use one of the AMIs if you would prefer to do your testing on Amazon Web Services.
Test Cases[edit]
Fedora Cloud Working Group member Dusty Mabe has quite a few tests on this Gist. For other examples, see Category:Test_Cases.
For better worded test steps please refer to Mike's pages: User:Roshi/QA/AtomicTests
Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located here. If you don't know if the test applies to Atomic or not then feel free to ask in #fedora-cloud on freenode.
Test Results[edit]
If you are unsure about exactly how to file a bug report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the appropriate table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.
Atomic Basic Cloud Tests[edit]
User | Hardware | Startup | System Logging | Services Start | SELinux | Service Manipulation | References |
---|---|---|---|---|---|---|---|
dustymabe | Openstack Juno on F21 | [1] |
| ||||
guohua | HP workstation with Fedora 22 | ||||||
maxamillion | ThinkPad T440s with Fedora Rawhide (KVM) | ||||||
rtnpro | ThinkPad T440p with Fedora 21 (Vagrant: libvirt/KVM) | ||||||
CAI Qian | ThinkPad T540p with Fedora 21 (KVM) | ||||||
oddshocks | AWS EC2 | [1] |
|
Atomic Host Tests[edit]
For the Atomic Tests, download the latest image from here
User | Hardware | Image Boots | Upgrade Works | Rollback Works | References |
---|---|---|---|---|---|
dustymabe | Openstack Juno on F21 | ||||
rtnpro | ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM) | ||||
guohua | HP workstation with Fedora 22 | ||||
maxamillion | ThinkPad T440s with Fedora Rawhide (KVM) | ||||
mmicene | Dell Latitude E6440 with Fedora 21 KVM | ||||
oystercatcher | Intel dual core desktop fc22 kvm | ![]() |
![]() |
![]() |
|
royboy626 | ...Atomic-20141203-21 on Fedora 21 | ![]() |
![]() |
![]() |
|
CAI Qian | ThinkPad T540p with Fedora 21 (KVM) | [1] |
|
Atomic Docker Tests[edit]
For the Atomic Tests, download the latest image from here
User | Hardware | docker-storage-setup | Docker Lifecycle | Docker Image Test | References |
---|---|---|---|---|---|
dustymabe | Openstack Juno on F21 | [1] |
| ||
maxamillion | ThinkPad T440s with Fedora Rawhide (KVM) | ||||
mmicene | Dell Latitude E6440 with Fedora 21 KVM | ||||
oystercatcher | Intel dual core desktop fc22 kvm | ![]() |
![]() |
![]() |
|
rtnpro | ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM) | ||||
royboy626 | ...Atomic-20141203-21 on Fedora 21 | ![]() |
![]() |
![]() |
|
CAI Qian | ThinkPad T540p with Fedora 21 (KVM) |
Bugs filled during Test Day (7th May 2015)[edit]
Other Common Bugs[edit]
- BZ#1216151
- BZ#1205454 Workaround: Use "docker run -it --rm busybox sleep 15" or another longer running command instead of "docker run -it --rm busybox true" for testing