From Fedora Project Wiki

This page is intended to record installation validation test results for Fedora 21 nightly builds in the month of August 2014.

Not mandatory testing
This testing is not in any way mandatory, but rather precautionary / exploratory. No Fedora release depends on this testing being performed. Due to the longer Fedora 21 release cycle, we think it is a good idea to keep an eye on the status of the release before we reach the first Alpha TC, however no-one should feel obliged in any way to participate in this testing, and certainly not to work excessively long, late or hard on it.

Instructions[edit]

This page tracks test results against August 2014 nightly Rawhide builds. Test results against other Fedora 21 milestones and builds can be found at Category:Fedora_21_Test_Results.

What To Test[edit]

  • Tests requiring physical media (e.g. DVD or CD images) -- download the required Fedora 21 nightly live image, x86_64 or i386 network install image, or ARM or Cloud disk image. If you use the network install image, enter the date on which you downloaded it as the 'build date' in your results (see #Key.)

Note that if generation of the boot.iso images fails for a given day, the file will not be present on the mirrors (the last successful compose is not retained). In this case, you just have to wait for a successful compose, or use one of the other images/methods described on this page. If the live image compose failed, you can find older composes through the Koji web interface, though you may have to click through several pages of results. Ensure you get a Fedora 21 image, not Rawhide.

Add or Remove a Test Case[edit]

  1. Please request review for your changes by publishing your test case for review to test list.
  2. Once reviewed, make your changes to this document
  3. Finally, update QA:Fedora_21_Install_Results_Template with the same changes.

Key[edit]

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result Explanation Code Entered
none
Untested - This test has not been run, and is available for anyone to contribute feedback. {{result|none}}
Pass pass robatino
20140715
Passed - The test has been run and the tester determine the test met the expected results. The date of the build tested (not the date the test was run) should be included. {{result|pass|robatino}} 20140715
Inprogress inprogress adamwill
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. {{result|inprogress|adamwill}}
Fail fail jlaska [1] [2]
20140715
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. The date of the build tested (not the date the test was run) should be included.
  1. RHBZ #XYZ
  2. RHBZ #ZXY
{{result|fail|jlaska|XYZ|ZXY}} 20140715
Warning warn rhe
[1] 20140415
Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention. The date of the build tested (not the date the test was run) should be included.
  1. Brief description about the warning status
{{result|warn|rhe}} <ref>Brief description about the warning status</ref> 20140715
Pass pass hongqing
20140715
Warning warn kparal
20140718
Multiple results - More people can easily provide results to a single test case. {{result|pass|hongqing}} 20140715 {{result|warn|kparal}} 20140718
Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix[edit]

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Image sanity[edit]

Image sanity tests
Release Level Test Case netinst x86[1] Live x86 ARM Cloud
Alpha / Final QA:Testcase_Mediakit_Checksums
none
none
none
none
Beta QA:Testcase_Mediakit_ISO_Size
none
none
none
none
  1. 'x86' means 'x86_64 or i386'

Netinst image[edit]

netinst.iso (boot.iso) tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Boot_Methods_Boot_Iso
none
Pass pass satellit
20140809 [1]
Fail fail satellit
20140809 [2]
Pass pass satellit
20140817 [3]
none
Pass pass satellit
20140810 [4]
Pass pass satellit
20140811 [5]
Pass pass satellit
20140822 [6]
  1. boot-f21-0809.iso (Soas) VirtualBox
  2. boot-f21-0809.iso (gnome) fail whale on boot VirtualBox
  3. boot-f21-0817.iso - KDE VirtualBox
  4. boot-f21-0810.iso (KDE) VirtualBox
  5. boot-f21-0811.iso (GNOME) VirtualBox
  6. boot-f21-0822.iso (soas) VirtualBox

Live image[edit]

Live.iso tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Live_Image_Boot
none
Pass pass satellit
20140808 [1]
none
none
Alpha Install Repository QA:Testcase_install_repository_Live_Image
none
Pass pass satellit
20140808 [2]
Pass pass dmossor
20140810 [3]
Pass pass satellit
20140814 [4]
Pass pass satellit
20140817 [5]
Warning warn satellit
20140818 [6]
none
Pass pass dmossor
20140810 [7]
Pass pass dmossor
20140810 [8]
Pass pass satellit
20140810 [9]
Pass pass satellit
20140813 [10]
Pass pass satellit
20140813 [11]
Warning warn satellit
20140819 [12]
Pass pass satellit
20140819 [13]
Pass pass satellit
20140819 [14]
Pass pass satellit
20140827 [15]
Pass pass satellit
20140829 TC5[16]
Pass pass satellit
20140829 TC5[17]
Fail fail satellit [18]
20140829 TC5[19]
Pass pass satellit
20140901 [20]
none
Pass pass satellit
20140810 [21]
Fail fail satellit
20140814 [22]
Pass pass satellit
20140901 [23]
  1. Fedora-Live-SoaS-i386-21-20140808 VirtualBox
  2. Fedora-Live-SoaS-i386-21-20140808 VirtualBox
  3. Fedora-Live-KDE-i686-21-20140810.iso QEMU/KVM
  4. Fedora-Live-SoaS-i686-21-20140814.iso VirtualBox
  5. Fedora-Live-KDE-i686-21-20140817.iso VirtualBox
  6. Fedora-Live-Workstation-i686-21-20140818.iso VirtualBox Oh No! Fail Whale
  7. Fedora-Live-Workstation-x86_64-21-20140810.iso QEMU/KVM
  8. Fedora-Live-KDE-x86_64-21-20140810.iso QEMU/KVM
  9. Fedora-Live-Workstation-x86_64-21-20140810.iso VirtualBox
  10. Fedora-Live-SoaS-x86_64-21-20140813.iso VirtualBox
  11. Fedora-Live-LXDE-x86_64-21-20140813.iso VirtualBox install with root and no user boots to Configure USER before finish install
  12. Fedora-Live-KDE-x86_64-21-20140819.iso BZ 1103496#c23 VirtualBox
  13. Fedora-Live-Workstation-x86_64-21-20140819.iso VirtualBox
  14. Fedora-Live-KDE-x86_64-21-20140819.iso * Bare Metal install from DVD *
  15. Fedora-Live-Workstation-x86_64-21-20140827.iso VirtualBox
  16. Fedora-Live-SoaS-x86_64-21-Alpha-TC5.iso VirtualBox
  17. Fedora-Live-Workstation-x86_64-21-Alpha-TC5.iso VirtualBox
  18. RHBZ #1134524
  19. Fedora-Workstation-netinst-x86_64-21-Alpha-TC5.iso "error setting up base repo"VirtualBox
  20. Fedora-Live-Workstation-x86_64-21-20140901.iso VirtualBox https://bugzilla.gnome.org/show_bug.cgi?id=735375
  21. Fedora-Live-KDE-x86_64-21-20140810.iso VirtualBox [x] Enable EFI - boots and installs
  22. Fedora-Live-SoaS-i686-21-20140814.iso VirtualBox [x] Enable EFI boots to EFI shell
  23. Fedora-Live-Workstation-x86_64-21-20140901 VirtualBox [x] Enable EFI - boots and installs

USB stick[edit]

USB stick tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_USB_stick_Live LiveUSB-creator
none
none
Pass pass satellit
20140811 [1]
none
Alpha Boot Methods QA:Testcase_USB_stick_Live Live-ISO-to-Disk
none
none
none
Alpha Boot Methods QA:Testcase_USB_stick_Live_dd
none
none
Pass pass satellit
20140901 [2]
none
  1. Fedora-Live-KDE-x86_64-21-20140811.iso (li-usb-cr f20) Booted USB no install
  2. Fedora-Live-Workstation-x86_64-21-20140901.iso (f21 gnome-disks) Booted USB no install

ARM disk images[edit]

In all of these tests, the test case used is QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.

ARM disk image functionality
Release Level Image Ext boot
Alpha Minimal
Pass pass pwhalen
20140808
Pass pass pwhalen
20140811
Pass pass pwhalen
20140825
Alpha KDE
Fail fail pwhalen
20140825 (needs updated xorg, in 20140827)
Optional Xfce
Fail fail pwhalen [1]
20140827
Optional Desktop
none
Optional LXDE
Fail fail pwhalen [1]
20140828
Optional MATE
none
Optional SoaS
none
  1. 1.0 1.1 RHBZ #1112387

Cloud images[edit]

Cloud images
Release Level Test Case i386 x86_64
Alpha QA:Testcase_EC2_AMI_Validation
none
none
Alpha QA:Testcase_OpenStack_Image_Validation
none
none


PXE images[edit]

PXE boot tests
Release Level Test Area Test Case i386 x86_64 ARM
Alpha Boot Methods QA:Testcase_Boot_Methods_Pxeboot
none
none
Pass pass pwhalen
20140825


Storage device tests[edit]

Release Level Test Case x86[1] ARM
Alpha QA:Testcase_install_to_SATA
none
none
Alpha QA:Testcase_install_to_PATA
none
none
Alpha QA:Testcase_install_to_SCSI
none
none
Alpha QA:Testcase_install_to_SAS
none
none
Beta QA:Testcase_install_to_firmware_RAID
none
none
Beta QA:Testcase_install_to_hardware_RAID
none
none
Beta QA:Testcase_install_to_VirtIO
none
none
Final QA:Testcase_install_to_iSCSI_no_authentication
none
none
Final QA:Testcase_install_to_multipath
none
none
Final QA:Testcase_install_to_FCoE_target
none
none
  1. 'x86' means 'x86_64 or i386'

Storage volume type tests[edit]

Guided installation[edit]

Release Level Test Case x86 BIOS[1] x86 UEFI ARM
Alpha QA:Testcase_partitioning_guided_empty
none
none
none
Alpha QA:Testcase_partitioning_guided_delete_all
none
none
none
Alpha QA:Testcase_partitioning_guided_multi_select
none
none
none
Beta QA:Testcase_partitioning_guided_delete_partial
none
none
none
Beta QA:Testcase_partitioning_guided_free_space
none
none
none
Beta QA:Testcase_partitioning_guided_encrypted
none
none
none
Beta QA:Testcase_partitioning_guided_multi_empty_all
none
none
none
  1. 'x86' means 'x86_64 or i386'

Guided shrinking[edit]

For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.

Release Level Test Case LVM ext4 NTFS BTRFS
Final QA:Testcase_partitioning_guided_shrink
none
none
none
none


General Tests[edit]

Install Variations & General Tests
Release Level Test Area Test Case i386 x86_64 EFI ARM
Alpha Package Set QA:Testcase_Package_Sets_Default_Package_Install
none
none
Alpha Package Set QA:Testcase_Package_Sets_KDE_Package_Install
none
none
Alpha Package Set QA:Testcase_Package_Sets_Minimal_Package_Install
none
none
Pass pass pwhalen
20140825
Beta Partitioning QA:Testcase_Anaconda_custom_partitioning
none
none
Pass pass pwhalen
20140825
Beta Partitioning QA:Testcase_Partitioning_On_Software_RAID
none
none
Final Partitioning QA:Testcase_dualboot_with_windows
none
none
none
Final Partitioning QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition
none
none
Final Partitioning QA:Testcase_anaconda_ext3_rootfs_on_disk_partition
none
none
Pass pass pwhalen
20140825
Final Partitioning QA:Testcase_anaconda_xfs_rootfs_on_disk_partition
none
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Graphical
none
none
Pass pass pwhalen
20140825
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver
none
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Text
none
none
Pass pass pwhalen
20140825
Alpha User Interface QA:Testcase_Anaconda_User_Interface_VNC
none
none
Pass pass pwhalen
20140825
Alpha User Interface QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect
none
none
Beta User Interface QA:Testcase_Anaconda_User_Interface_serial_console
none
none
Pass pass pwhalen
20140825
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_default
none
none
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_graphical
none
none
Alpha Install Repository QA:Testcase_install_repository_HTTP/FTP_graphical
none
none
Alpha Install Repository QA:Testcase_install_repository_HTTP/FTP_variation
none
none
Beta Install Repository QA:Testcase_install_repository_NFS_graphical
none
none
Beta Install Repository QA:Testcase_install_repository_NFS_variation
none
none
Final Install Repository QA:Testcase_install_repository_NFSISO_variation
none
none
Final Install Repository QA:Testcase_install_repository_Hard_drive_variation
none
none
Beta Storage Devices QA:Testcase_Install_to_Previous_KVM
none
none
Beta Storage Devices QA:Testcase_Install_to_Current_KVM
none
none
Final Storage Devices QA:Testcase_Boot_Methods_Xen_Para_Virt
none
none
Alpha Recovery QA:Testcase_Anaconda_save_traceback_to_bugzilla
none
none
Alpha Recovery QA:Testcase_Anaconda_rescue_mode
none
none
none
Alpha Recovery QA:Testcase_Anaconda_updates.img_via_URL
none
none
Final Recovery QA:Testcase_Anaconda_updates.img_via_installation_source
none
none
Final Recovery QA:Testcase_Anaconda_updates.img_via_local_media
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Http_Server_Ks_Cfg
none
none
Pass pass pwhalen
20140819
Pass pass pwhalen
20140825
Beta Kickstart Delivery QA:Testcase_Kickstart_File_Path_Ks_Cfg
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg
none
none
Pass pass pwhalen
20140825
Alpha User Creation QA:Testcase_Anaconda_user_creation
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_desktop
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_kde
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_minimal
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_desktop_encrypted
none
none
none
Optional Boot Methods QA:Testcase_Install_Image_Boot_Local
none
none
Optional Memory Test QA:Testcase_Memtest86
none
none
Optional Recovery QA:Testcase_Anaconda_traceback_debug_mode
none
none
Optional Partitioning QA:Testcase_Partitioning_No_Swap
none
none
Pass pass pwhalen
20140825