From Fedora Project Wiki

(Test Results)
(Drop direct Test Days category membership)
 
(64 intermediate revisions by 16 users not shown)
Line 6: Line 6:
 
| time = all day
 
| time = all day
 
| website = [[QA/Fedora_17_test_days]]
 
| website = [[QA/Fedora_17_test_days]]
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
+
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc]) - [http://meetbot.fedoraproject.org/fedora-test-day/2012-03-08/openstack_test_day.2012-03-08-13.08.html IRC Log]
 
| fedora_mailing_list = cloud
 
| fedora_mailing_list = cloud
 
}}
 
}}
Line 29: Line 29:
 
* [[User:crobinso|Cole Robinson]] (crobinso)
 
* [[User:crobinso|Cole Robinson]] (crobinso)
 
* [[User:derekh|Derek Higgins]] (derekh)
 
* [[User:derekh|Derek Higgins]] (derekh)
 
+
* [[User:sdake|Steven Dake]] (sdake)
  
 
== Prerequisite for Test Day ==  
 
== Prerequisite for Test Day ==  
Line 97: Line 97:
 
# [[QA:Testcase_start_OpenStack_Glance_services|Start glance services]]
 
# [[QA:Testcase_start_OpenStack_Glance_services|Start glance services]]
 
# [[QA:Testcase_start_OpenStack_Nova_services|Start nova services]]
 
# [[QA:Testcase_start_OpenStack_Nova_services|Start nova services]]
# [[QA:Testcase_create_OpenStack_user_project_and_network|Create user, project and network]]
 
 
# [[QA:Testcase_add_SSH_keypair_to_OpenStack|Add SSH keypair]]
 
# [[QA:Testcase_add_SSH_keypair_to_OpenStack|Add SSH keypair]]
# [[QA:Testcase_download_and_register_guest_images_with_OpenStack|Register guest images]]
+
# [[QA:Testcase_register_images_with_OpenStack|Register guest images]]
 +
# [[QA:Testcase_create_OpenStack_nova_network|Create nova network]]
  
 
Core functionality:
 
Core functionality:
Line 136: Line 136:
 
! [[QA:Testcase_start_OpenStack_Glance_services|Start glance services]]
 
! [[QA:Testcase_start_OpenStack_Glance_services|Start glance services]]
 
! [[QA:Testcase_start_OpenStack_Nova_services|Start nova services]]
 
! [[QA:Testcase_start_OpenStack_Nova_services|Start nova services]]
! [[QA:Testcase_create_OpenStack_user_project_and_network|Create user, project and network]]
 
 
! [[QA:Testcase_add_SSH_keypair_to_OpenStack|Add SSH keypair]]
 
! [[QA:Testcase_add_SSH_keypair_to_OpenStack|Add SSH keypair]]
! [[QA:Testcase_download_and_register_tty_images_with_OpenStack|Register tty images]]
+
! [[QA:Testcase_register_images_with_OpenStack|Register images]]
 +
! [[QA:Testcase_create_OpenStack_nova_network|Create nova network]]
 
! References
 
! References
 
|-
 
|-
Line 155: Line 155:
 
|-
 
|-
 
-->
 
-->
 +
 
| [[User:Zaitcev|zaitcev]]
 
| [[User:Zaitcev|zaitcev]]
 
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|warn}} <ref>needs fixups per [[Getting_started_with_OpenStack_on_Fedora_17]]</ref>
 
| {{result|warn}} <ref>needs fixups per [[Getting_started_with_OpenStack_on_Fedora_17]]</ref>
| {{result|warn}} <ref>side issue {{bz|800704}}</ref>
+
| {{result|pass}}
| {{result|fail}}
+
| {{result|pass}}
| {{result|none}}
+
| {{result|pass}}
| {{result|none}}
+
| {{result|pass}}
| {{result|none}}
+
| {{result|pass}}
 
| <references/>
 
| <references/>
 
|-
 
|-
  
 
| [[User:Vaneldik|vaneldik]]
 
| [[User:Vaneldik|vaneldik]]
| {{result|warn||801054}}
+
| {{result|pass||801054}}
 
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|warn}} <ref>needs fixups per [[Getting_started_with_OpenStack_on_Fedora_17]]</ref>
 
| {{result|warn}} <ref>needs fixups per [[Getting_started_with_OpenStack_on_Fedora_17]]</ref>
 
| {{result|warn}} <ref>side issue {{bz|800704}}</ref>
 
| {{result|warn}} <ref>side issue {{bz|800704}}</ref>
| {{result|fail|801366}} <ref>API server requires X-Auth-Token in order to get response</ref>   
+
| {{result|warn}} <ref>{{bz|801366}}API server requires X-Auth-Token in order to get response</ref>   
 
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|pass}}
Line 179: Line 180:
 
|-
 
|-
  
| [[User:Sergio|sergio]]
+
| [[User:TripleDES|TripleDES]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|pass}}
| {{result|warn}} <ref>needs fixups per [[Getting_started_with_OpenStack_on_Fedora_17]]</ref>
 
| {{result|warn}} <ref>side issue {{bz|800704}}</ref>
 
| {{result|fail}}
 
| {{result|none}}
 
| {{result|none}}
 
| {{result|none}}
 
 
| <references/>
 
| <references/>
 
|-
 
|-
Line 197: Line 198:
 
| {{result|pass}} <ref>glance AVC denials {{bz|801330}}</ref>
 
| {{result|pass}} <ref>glance AVC denials {{bz|801330}}</ref>
 
| {{result|pass}} <ref>need SELinux policy for nova-cert {{bz|801352}}</ref>
 
| {{result|pass}} <ref>need SELinux policy for nova-cert {{bz|801352}}</ref>
| {{result|none}}
+
| {{result|pass}} <ref>we need to figure out a way to replace old 'nova-manage project zipfile'</ref>
| {{result|none}}
+
| {{result|pass}}
| {{result|none}}
+
| {{result|pass}}
 
| <references/>
 
| <references/>
 
|-
 
|-
Line 207: Line 208:
 
| {{result|pass}} <ref>I didn't change libvirt_type to qemu</ref>
 
| {{result|pass}} <ref>I didn't change libvirt_type to qemu</ref>
 
| {{result|pass}}  
 
| {{result|pass}}  
| {{result|pass}} <ref>sudo setenforce 0 # required to run glance index</ref>
+
| {{result|pass}} <ref>sudo setenforce 0 # required to run glance index {{bz|801330#c1}}</ref>
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}} <ref>only created network (per new instructions)</ref>
 +
| <references/>
 +
|-
 +
 
 +
| [[User:eglynn|eglynn]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
 
 +
| [[User:pbrady|pbrady]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
 
 +
| [[User:gkotton|gkotton]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
 
 +
| [[User:swabe|swabe]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 
| {{result|pass}}
 
| {{result|pass}}
| {{result|none}}
 
| {{result|none}}
 
| {{result|none}}
 
 
| <references/>
 
| <references/>
 
|-
 
|-
  
-->
+
| [[User:russellb|russellb]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
  
 
|}
 
|}
Line 229: Line 288:
 
! References
 
! References
 
|-
 
|-
 +
 +
| [[User:eglynn|eglynn]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|none}}
 +
| <references/>
 +
|-
 +
 +
| [[User:gkotton|gkotton]]
 +
| {{result|pass}} <ref> problem with libvirt </ref>
 +
| {{result|pass}}
 +
| {{result|none}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
 +
| [[User:derekh|derekh]]
 +
| {{result|pass}} <ref>instance ip address not displayed by euca-describe-instances</ref>
 +
| {{result|pass}} <ref>this appeared in the logs, not sure it is connected [https://bugs.launchpad.net/nova/+bug/934276 lp934276]</ref>
 +
| {{result|pass}}
 +
| {{result|none}}
 +
| <references/>
 +
|-
 +
 +
| [[User:Markmc|markmc]]
 +
| {{result|pass}} <ref>issue with euca-describe-instances not showing IP addresses {{bz|801452}}</ref> <ref>[https://bugs.launchpad.net/nova/+bug/934276 'dict' object has no attribute 'state'] in logs but that's fixed upstream</ref>
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| <references/>
 +
|-
 +
 +
| [[User:TripleDES|TripleDES]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|none}}
 +
| <references/>
 +
|-
 +
 +
| [[User:Zaitcev|zaitcev]]
 +
| {{result|fail}}
 +
| {{result|none}}
 +
| {{result|none}}
 +
| {{result|none}}
 +
|-
 +
 +
| [[User:russellb|russellb]]
 +
| {{result|pass}}
 +
| {{result|pass}}
 +
| {{result|none}}
 +
| {{result|none}}
 +
|-
 +
 
<!--
 
<!--
 
| [[User:SampleUser|Sample User]]
 
| [[User:SampleUser|Sample User]]
Line 238: Line 352:
 
|-
 
|-
 
-->
 
-->
 +
|}
 +
 +
Dashboard functionality:
 +
 +
{|
 +
! User
 +
! [[QA:Testcase_OpenStack_dashboard_setup|Dashboard setup]]
 +
! [[QA:Testcase_OpenStack_dashboard_launch_instance|Launch instance]]
 +
! [[QA:Testcase_OpenStack_dashboard_add_users|Managing users]]
 +
! References
 +
 +
|-
 +
| [[User:crobinso|crobinso]]
 +
| {{result|pass}} <ref>tenant chooser doesn't work {{bz|801208}}</ref>
 +
| {{result|none}}
 +
| {{result|none}}
 +
| <references/>
 +
|-
 +
 +
|-
 +
| [[User:derekh|derekh]]
 +
| {{result|pass}} <ref>Tracebacks in apache error log and keystone.log, maybe related to {{bz|801208}} </ref>
 +
| {{result|pass}}
 +
| {{result|warn}} <ref> Error: Unable to delete project: testproject </ref>
 +
| <references/>
 +
|-
 +
 +
|-
 +
| [[User:markmc|markmc]]
 +
| {{result|pass}}
 +
| {{result|pass}} <ref>broken action dropdowns {{bz|801684}}</ref> <ref>no VNC console {{bz|801685}}</ref> <ref>detach/delete volume doesn't work {{bz|801686}}</ref>
 +
| {{result|pass}} <ref>cannot delete user or project {{bz|801688}}</ref> <ref>failed to download ec2 credentials {{bz|801690}}</ref>
 +
| <references/>
 +
|-
 +
 +
|-
 +
| [[User:pbrady|pbrady]]
 +
| {{result|pass}} <ref>intermittent db connection errors {{bz|801745}}</ref> <ref>SELinux AVC denial {{bz|801746}}</ref>
 +
| {{result}}
 +
| {{result}}
 +
| <references/>
 +
|-
 +
 +
 
|}
 
|}
  
Line 246: Line 404:
 
! [[QA:Testcase_run_Tempest_tests|Tempest tests]]
 
! [[QA:Testcase_run_Tempest_tests|Tempest tests]]
 
! [[QA:Testcase_build_an_OpenStack_guest_image_with_Oz|Build an image with Oz]]
 
! [[QA:Testcase_build_an_OpenStack_guest_image_with_Oz|Build an image with Oz]]
 +
! [[QA:Testcase_run_Nova_with_Quantum|Run Nova with Quantum]]
 
! [[QA:Testcase_run_the_OpenStack_smoke_tests|Smoke tests]]
 
! [[QA:Testcase_run_the_OpenStack_smoke_tests|Smoke tests]]
 
! References
 
! References
 +
 +
|-
 +
| [[User:eglynn|eglynn]]
 +
| {{result|pass}}
 +
| {{result|fail}} <ref group="long">libvirt.libvirtError: internal error process exited while connecting to monitor: qemu-system-x86_64: -netdev tap,fd=28,id=hostnet0,vhost=on,vhostfd=29: vhost-net support is not compiled in</ref>
 +
| {{result|none}}
 +
| {{result|pass}} <ref>volume tests failed due to insufficient diskspace, created nova-volumes with only 2Gb</ref>
 +
| <references/>
 +
|-
 +
 +
|-
 +
| [[User:derekh|derekh]]
 +
| {{result|pass}} <ref> 5 tests failed (expected) </ref>
 +
| {{result|fail}} <ref> problem with oz version/config, will retry with more uptodate oz</ref>
 +
| {{result|none}}
 +
| {{result|pass}} <ref> needed to create certs for euca-bundle-image</ref>
 +
| <references/>
 +
|-
 +
 +
|-
 +
| [[User:gkotton|gkotton]]
 +
| {{result|none}}
 +
| {{result|none}}
 +
| {{result|pass}} <ref> Using the openvswitch plugin </ref>
 +
| {{result|none}}
 +
| <references/>
 +
|-
 +
 +
| [[User:Markmc|markmc]]
 +
| {{result|pass}} <ref>5 tests failed for me too</ref>
 +
| {{result|none}}
 +
| {{result|none}}
 +
| {{result|none}}
 +
| <references/>
 
|-
 
|-
 +
 +
 
<!--
 
<!--
 
| [[User:SampleUser|Sample User]]
 
| [[User:SampleUser|Sample User]]
Line 258: Line 453:
 
|}
 
|}
  
[[Category:Test Days]]
+
== Long comments ==
[[Category:Cloud SIG]]
+
<references group="long" />
 +
 
 +
 
 +
[[Category:OpenStack]]
 +
[[Category:Fedora 17 Test Days|s]]

Latest revision as of 21:32, 26 June 2015

Fedora Test Days
Echo-testing-48px.png
OpenStack Test Day

Date 2012-03-08
Time all day

Website QA/Fedora_17_test_days
IRC #fedora-test-day (webirc) - IRC Log

Mailing list
MailSubscribeArchives


Note.png
Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

This day is for testing the Essex release of OpenStack in Fedora. Check out the OpenStack Essex feature page for more details on what's new.

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day[edit]

Note.png
Hardware Requirements
You can do basic testing of OpenStack in a virtual machine, with specific config noted below

How to test?[edit]

Follow the steps below to prepare the machine, then follow each of the test cases in order.

Configure sudo[edit]

Add your account to sudoers, which can be done from a root prompt like:

 #> (umask 337; name=markmc; echo "$name ALL = (ALL) NOPASSWD: ALL" > /etc/sudoers.d/testday)

Update your machine[edit]

Make sure you have all the current updates for it installed:

 $> sudo yum --enablerepo=updates-testing clean all
 $> sudo yum update -y

Enable the Qpid Broker[edit]

$> sudo yum install --enablerepo=updates-testing -y qpid-cpp-server
$> sudo systemctl start qpidd.service
$> sudo systemctl enable qpidd.service

Enable libvirt[edit]

$> sudo yum install --enablerepo=updates-testing -y @virtualization
$> sudo systemctl start libvirtd.service
$> sudo systemctl enable libvirtd.service

Optionally Load nbd[edit]

If you don't perform this optional step, then libguestfs will be used to inject files into qcow2 images. Note however that is slower, especially if testing openstack within a VM

$> sudo modprobe nbd
$> echo nbd | sudo tee -a /etc/modules-load.d/nbd.conf

Put SELinux into Permissive Mode[edit]

Since we currently have a number of blocking AVC denials (e.g. in glance), we need to disable SELinux enforcing:

$> sudo sed -i 's/^SELINUX=.*/SELINUX=permissive/' /etc/selinux/config
$> sudo setenforce permissive

Please do note any AVC denials you see and file them in bugzilla if they have not already been reported.

Test Cases[edit]

When ready, follow the instructions provided in each of the test cases:

Basic setup:

  1. Install the packages
  2. Setup Nova
  3. Setup Keystone
  4. Start glance services
  5. Start nova services
  6. Add SSH keypair
  7. Register guest images
  8. Create nova network

Core functionality:

  1. Launch an instance
  2. Attach a volume
  3. Floating IPs
  4. Separate compute node

Dashboard functionality:

  1. Basic dashboard setup and login
  2. Launch/terminate an instance with the dashboard
  3. Managing projects and users with the dashboard

Extra credit:

  1. Tempest tests
  2. Build an image with Oz
  3. Run Nova with Quantum
  4. Smoke tests

Test Results[edit]

If you have problems with any of the tests, report a bug to Bugzilla usually for one of the openstack-nova, openstack-glance, openstack-keystone or openstack-swift components. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

Basic setup:

User Install the packages Setup Nova Setup Keystone Start glance services Start nova services Add SSH keypair Register images Create nova network References
zaitcev
Pass pass
Pass pass
Warning warn
[1]
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
vaneldik
Pass pass [1]
Pass pass
Warning warn
[2]
Warning warn
[3]
Warning warn
[4]
Pass pass
Pass pass
Pass pass
  1. RHBZ #801054
  2. needs fixups per Getting_started_with_OpenStack_on_Fedora_17
  3. side issue RHBZ #800704
  4. RHBZ #801366API server requires X-Auth-Token in order to get response
TripleDES
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
markmc
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
Pass pass
Pass pass
  1. newer keystone available in koji; latest glance didn't get pushed to updates-testing
  2. mysql AVC denials RHBZ #801299 and sqlalchemy deprecated warnings RHBZ #801302
  3. webob deprecation warnings RHBZ #801312
  4. glance AVC denials RHBZ #801330
  5. need SELinux policy for nova-cert RHBZ #801352
  6. we need to figure out a way to replace old 'nova-manage project zipfile'
derekh
Pass pass
[1]
Pass pass
[2]
Pass pass
Pass pass
[3]
Pass pass
Pass pass
Pass pass
Pass pass
[4]
  1. newer keystone now available in updates-testing
  2. I didn't change libvirt_type to qemu
  3. sudo setenforce 0 # required to run glance index RHBZ #801330#c1
  4. only created network (per new instructions)
eglynn
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
pbrady
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
gkotton
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
swabe
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
russellb
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass

Core functionality:

User Launch an instance Attach a volume Floating IPs Separate compute node References
eglynn
Pass pass
Pass pass
Pass pass
none
gkotton
Pass pass
[1]
Pass pass
none
Pass pass
  1. problem with libvirt
derekh
Pass pass
[1]
Pass pass
[2]
Pass pass
none
  1. instance ip address not displayed by euca-describe-instances
  2. this appeared in the logs, not sure it is connected lp934276
markmc
Pass pass
[1] [2]
Pass pass
Pass pass
Pass pass
  1. issue with euca-describe-instances not showing IP addresses RHBZ #801452
  2. 'dict' object has no attribute 'state' in logs but that's fixed upstream
TripleDES
Pass pass
Pass pass
Pass pass
none
zaitcev
Fail fail
none
none
none
russellb
Pass pass
Pass pass
none
none

Dashboard functionality:

User Dashboard setup Launch instance Managing users References
crobinso
Pass pass
[1]
none
none
  1. tenant chooser doesn't work RHBZ #801208
derekh
Pass pass
[1]
Pass pass
Warning warn
[2]
  1. Tracebacks in apache error log and keystone.log, maybe related to RHBZ #801208
  2. Error: Unable to delete project: testproject
markmc
Pass pass
Pass pass
[1] [2] [3]
Pass pass
[4] [5]
  1. broken action dropdowns RHBZ #801684
  2. no VNC console RHBZ #801685
  3. detach/delete volume doesn't work RHBZ #801686
  4. cannot delete user or project RHBZ #801688
  5. failed to download ec2 credentials RHBZ #801690
pbrady
Pass pass
[1] [2]
{{{1}}}
{{{1}}}
  1. intermittent db connection errors RHBZ #801745
  2. SELinux AVC denial RHBZ #801746

Extra credit:

User Tempest tests Build an image with Oz Run Nova with Quantum Smoke tests References
eglynn
Pass pass
Fail fail
[long 1]
none
Pass pass
[1]
  1. volume tests failed due to insufficient diskspace, created nova-volumes with only 2Gb
derekh
Pass pass
[1]
Fail fail
[2]
none
Pass pass
[3]
  1. 5 tests failed (expected)
  2. problem with oz version/config, will retry with more uptodate oz
  3. needed to create certs for euca-bundle-image
gkotton
none
none
Pass pass
[1]
none
  1. Using the openvswitch plugin
markmc
Pass pass
[1]
none
none
none
  1. 5 tests failed for me too

Long comments[edit]

  1. libvirt.libvirtError: internal error process exited while connecting to monitor: qemu-system-x86_64: -netdev tap,fd=28,id=hostnet0,vhost=on,vhostfd=29: vhost-net support is not compiled in