From Fedora Project Wiki

This page is intended to record installation validation test results for Rawhide nightly builds in the month of July 2014.

Idea.png
Not mandatory testing
This testing is not in any way mandatory, but rather precautionary / exploratory. No Fedora release depends on this testing being performed. Due to the longer Fedora 21 release cycle, we think it is a good idea to keep an eye on the status of Rawhide before we reach the Alpha milestone, however no-one should feel obliged in any way to participate in this testing, and certainly not to work excessively long, late or hard on it.

Instructions[edit]

This page tracks test results against July 2014 nightly Rawhide builds. Test results against other Fedora 21 milestones can be found at Category:Fedora_21_Test_Results.

What To Test[edit]

  • Tests requiring physical media (e.g. DVD or CD images) -- download the required Rawhide nightly live image, x86_64 or i386 network install image, or ARM or Cloud disk image. If you use the network install image, enter the date on which you downloaded it as the 'build date' in your results (see #Key.)

Note that if generation of the boot.iso images fails for a given day, the file will not be present on the mirrors (the last successful compose is not retained). In this case, you just have to wait for a successful compose, or use one of the other images/methods described on this page.

Add or Remove a Test Case[edit]

  1. Please request review for your changes by publishing your test case for review to test list.
  2. Once reviewed, make your changes to this document
  3. Finally, update QA:Fedora_21_Install_Results_Template with the same changes.

Key[edit]

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result Explanation Code Entered
none
Untested - This test has not been run, and is available for anyone to contribute feedback. {{result|none}}
Pass pass robatino
20140715
Passed - The test has been run and the tester determine the test met the expected results. The date of the build tested (not the date the test was run) should be included. {{result|pass|robatino}} 20140715
Inprogress inprogress adamwill
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. {{result|inprogress|adamwill}}
Fail fail jlaska [1] [2]
20140715
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. The date of the build tested (not the date the test was run) should be included.
  1. RHBZ #XYZ
  2. RHBZ #ZXY
{{result|fail|jlaska|XYZ|ZXY}} 20140715
Warning warn rhe
[1] 20140415
Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention. The date of the build tested (not the date the test was run) should be included.
  1. Brief description about the warning status
{{result|warn|rhe}} <ref>Brief description about the warning status</ref> 20140715
Pass pass hongqing
20140715
Warning warn kparal
20140718
Multiple results - More people can easily provide results to a single test case. {{result|pass|hongqing}} 20140715 {{result|warn|kparal}} 20140718
Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix[edit]

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Image sanity[edit]

Image sanity tests
Release Level Test Case netinst x86[1] Live x86 ARM Cloud
Alpha / Final QA:Testcase_Mediakit_Checksums
none
none
none
none
Beta QA:Testcase_Mediakit_ISO_Size
none
none
none
none
  1. 'x86' means 'x86_64 or i386'

Netinst image[edit]

netinst.iso (boot.iso) tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Boot_Methods_Boot_Iso
none
none
Fail fail satellit
20140701 unable to login to root or user(VirtualBox) [1]
Fail fail satellit
20140702 "Script Error with package brlapi (874/1374) (default gnome)" exiting installer(VirtualBox) [2]
Fail fail satellit
20140702 Soas installer completes but boot fails at "starting terminate plymouth boot screen" and resets.(VirtualBox) [3]
Fail fail satellit
20140703 starts; hangs after starting anaconda(VirtualBox) [4]
Fail fail satellit [5]
20140704; 20140705; 20140708- default gnome; unable to login to root or user(VirtualBox) [6]
  1. anaconda 21.45-1
  2. anaconda 21.45-1
  3. anaconda 21.45-1
  4. anaconda 21.46-1
  5. RHBZ #1116450
  6. anaconda 21.46-1

Live image[edit]

Live.iso tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Live_Image_Boot
none
none
Fail fail satellit [1]
workstation 20140702[2]
Pass pass satellit
workstation 20140703
Fail fail satellit
workstation 20140708 fails to start
none
Alpha Install Repository QA:Testcase_install_repository_Live_Image
none
none
Pass pass satellit
workstation 20140703 Bare-Metal(wireless is available) and Boxes SoaS(Rawhide)in the f21 install ; Virtualbox
none
  1. RHBZ #1071548
  2. Failed to start GNOME Display Manager

USB stick[edit]

USB stick tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_USB_stick_Live LiveUSB-creator
none
none
none
Alpha Boot Methods QA:Testcase_USB_stick_Live Live-ISO-to-Disk
none
none
none
Alpha Boot Methods QA:Testcase_USB_stick_Live_dd
none
none
none


ARM disk images[edit]

In all of these tests, the test case used is QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.

ARM disk image functionality
Release Level Image Ext boot
Alpha Minimal
Pass pass pwhalen
20140704
Pass pass pwhalen
20140721
Alpha KDE
none
Optional Xfce
none
Optional Desktop
none
Optional LXDE
none
Optional MATE
none
Optional SoaS
none


Cloud images[edit]

Cloud images
Release Level Test Case i386 x86_64
Alpha QA:Testcase_EC2_AMI_Validation
none
none
Alpha QA:Testcase_OpenStack_Image_Validation
none
none


PXE images[edit]

PXE boot tests
Release Level Test Area Test Case i386 x86_64 ARM
Alpha Boot Methods QA:Testcase_Boot_Methods_Pxeboot
none
none
none


Storage device tests[edit]

Release Level Test Case x86[1] ARM
Alpha QA:Testcase_install_to_SATA
none
none
Alpha QA:Testcase_install_to_PATA
none
none
Alpha QA:Testcase_install_to_SCSI
none
none
Alpha QA:Testcase_install_to_SAS
none
none
Beta QA:Testcase_install_to_firmware_RAID
none
none
Beta QA:Testcase_install_to_hardware_RAID
none
none
Beta QA:Testcase_install_to_VirtIO
none
none
Final QA:Testcase_install_to_iSCSI_no_authentication
none
none
Final QA:Testcase_install_to_multipath
none
none
Final QA:Testcase_install_to_FCoE_target
none
none
  1. 'x86' means 'x86_64 or i386'

Storage volume type tests[edit]

Guided installation[edit]

Release Level Test Case x86 BIOS[1] x86 UEFI ARM
Alpha QA:Testcase_partitioning_guided_empty
none
none
none
Alpha QA:Testcase_partitioning_guided_delete_all
none
none
none
Alpha QA:Testcase_partitioning_guided_multi_select
none
none
none
Beta QA:Testcase_partitioning_guided_delete_partial
none
none
none
Beta QA:Testcase_partitioning_guided_free_space
none
none
none
Beta QA:Testcase_partitioning_guided_encrypted
none
none
none
Beta QA:Testcase_partitioning_guided_multi_empty_all
none
none
none
  1. 'x86' means 'x86_64 or i386'

Guided shrinking[edit]

For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.

Release Level Test Case LVM ext4 NTFS BTRFS
Final QA:Testcase_partitioning_guided_shrink
none
none
none
none


General Tests[edit]

Install Variations & General Tests
Release Level Test Area Test Case i386 x86_64 EFI ARM
Alpha Package Set QA:Testcase_Package_Sets_Default_Package_Install
none
none
Alpha Package Set QA:Testcase_Package_Sets_KDE_Package_Install
none
none
Alpha Package Set QA:Testcase_Package_Sets_Minimal_Package_Install
none
none
none
Beta Partitioning QA:Testcase_Anaconda_custom_partitioning
none
none
none
Beta Partitioning QA:Testcase_Partitioning_On_Software_RAID
none
none
Final Partitioning QA:Testcase_dualboot_with_windows
none
none
none
Final Partitioning QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition
none
none
Final Partitioning QA:Testcase_anaconda_ext3_rootfs_on_disk_partition
none
none
none
Final Partitioning QA:Testcase_anaconda_xfs_rootfs_on_disk_partition
none
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Graphical
none
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver
none
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Text
none
none
Pass pass pwhalen
20140704
Alpha User Interface QA:Testcase_Anaconda_User_Interface_VNC
none
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect
none
none
Beta User Interface QA:Testcase_Anaconda_User_Interface_serial_console
none
none
Pass pass pwhalen
20140704
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_default
none
none
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_graphical
none
none
Alpha Install Repository QA:Testcase_install_repository_HTTP/FTP_graphical
none
none
Alpha Install Repository QA:Testcase_install_repository_HTTP/FTP_variation
none
none
Beta Install Repository QA:Testcase_install_repository_NFS_graphical
none
none
Beta Install Repository QA:Testcase_install_repository_NFS_variation
none
none
Final Install Repository QA:Testcase_install_repository_NFSISO_variation
none
none
Final Install Repository QA:Testcase_install_repository_Hard_drive_variation
none
none
Beta Storage Devices QA:Testcase_Install_to_Previous_KVM
none
none
Beta Storage Devices QA:Testcase_Install_to_Current_KVM
none
none
Final Storage Devices QA:Testcase_Boot_Methods_Xen_Para_Virt
none
none
Alpha Recovery QA:Testcase_Anaconda_save_traceback_to_bugzilla
none
none
Alpha Recovery QA:Testcase_Anaconda_rescue_mode
none
none
none
Alpha Recovery QA:Testcase_Anaconda_updates.img_via_URL
none
none
Final Recovery QA:Testcase_Anaconda_updates.img_via_installation_source
none
none
Final Recovery QA:Testcase_Anaconda_updates.img_via_local_media
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Http_Server_Ks_Cfg
none
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_File_Path_Ks_Cfg
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg
none
none
Pass pass pwhalen
20140703,20140704,20140709
Alpha User Creation QA:Testcase_Anaconda_user_creation
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_desktop
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_kde
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_minimal
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_desktop_encrypted
none
none
none
Optional Boot Methods QA:Testcase_Install_Image_Boot_Local
none
none
Optional Memory Test QA:Testcase_Memtest86
none
none
Optional Recovery QA:Testcase_Anaconda_traceback_debug_mode
none
none
Optional Partitioning QA:Testcase_Partitioning_No_Swap
none
none
none