Fedora 25 Branched 20160819.n.1 release validation summary. This page shows the results from all the individual result pages for this compose together. You can file results directly from this page and they will be saved into the correct individual result page.
Contents
- 1 Installation
- 1.1 Image sanity
- 1.2 Default boot and install
- 1.3 Default boot and install (i386)
- 1.4 ARM disk images
- 1.5 PXE boot
- 1.6 USB media
- 1.7 USB media (i386)
- 1.8 Virtualization
- 1.9 Storage devices
- 1.10 Guided storage configuration
- 1.11 Guided storage shrinking
- 1.12 Custom storage configuration
- 1.13 User interface
- 1.14 Installation repositories
- 1.15 Package sets
- 1.16 Kickstart
- 1.17 Upgrade
- 1.18 Internationalization and Localization
- 1.19 Miscellaneous
- 2 Base
- 3 Server
- 4 Cloud
- 5 Cloud Provider Setup
- 6 Desktop
- 7 Security Lab
Installation[edit]
Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.
Image sanity[edit]
Milestone | Test Case | Server | Workstation | Spins | ARM disks | Cloud |
---|---|---|---|---|---|---|
Alpha / Final | QA:Testcase_Mediakit_Checksums | |
|
|
|
|
Beta | QA:Testcase_Mediakit_ISO_Size | [1][2][3][4][5][6][7][8] | ||||
Alpha | QA:Testcase_Mediakit_Repoclosure | |
||||
Alpha | QA:Testcase_Mediakit_FileConflicts | |
- ↑ LXDE live, size 939524096, max 734003200
- ↑ KDE live, size 1481637888, max 1400000000
- ↑ LXDE live, size 1020264448, max 734003200
- ↑ Mate live, size 1540358144, max 1500000000
- ↑ LXDE live, size 939524096, max 734003200
- ↑ KDE live, size 1481637888, max 1400000000
- ↑ LXDE live, size 1020264448, max 734003200
- ↑ Mate live, size 1540358144, max 1500000000
Default boot and install[edit]
Milestone | Image | x86_64 | UEFI |
---|---|---|---|
Alpha | Workstation live | ||
Alpha | Workstation netinst | | |
Alpha | Everything netinst | ||
Alpha | Server netinst | ||
Alpha | Server dvd | ||
Alpha | KDE live | [1] | [2] |
Optional | Xfce live | |
|
Optional | LXDE live | [3] | |
Optional | MATE live | |
|
Optional | Cinnamon live | |
|
Optional | SoaS live | |
|
Default boot and install (i386)[edit]
Below is the table for i386 tests, collapsed by default (click 'show' in the Milestone column to show it). Since Fedora 24, i386 is no longer a release-blocking architecture, and these tests are all optional.
Milestone | Image | i386 |
---|---|---|
Optional | Workstation live | |
Optional | Workstation netinst | |
Optional | Everything netinst | |
Optional | Server netinst | |
Optional | Server dvd | |
Optional | KDE live | |
Optional | Xfce live | |
Optional | LXDE live | |
Optional | MATE live | |
Optional | Cinnamon live | |
Optional | SoaS live | |
ARM disk images[edit]
Milestone | Image | Ext boot |
---|---|---|
Alpha | Minimal | |
Alpha | Xfce | |
Optional | KDE | |
Optional | Desktop | |
Optional | LXDE | |
Optional | MATE | |
Optional | SoaS | |
PXE boot[edit]
Milestone | Test Case | x86_64 | ARM |
---|---|---|---|
Beta | QA:Testcase_Boot_Methods_Pxeboot | |
![]() |
- ↑ no installation tree in server or everything repos
USB media[edit]
Milestone | Test Case | x86_64 | UEFI |
---|---|---|---|
Alpha | QA:Testcase_USB_stick_Live LiveUSB-creator | |
|
Alpha | QA:Testcase_USB_stick_Live Live-ISO-to-Disk | | |
Alpha | QA:Testcase_USB_stick_Live_dd | |
![]() |
Alpha | QA:Testcase_USB_stick_DVD Live-ISO-to-Disk | |
|
Alpha | QA:Testcase_USB_stick_DVD_dd | |
|
Alpha | Win32Diskimager.exe Windows 10 | |
[2] |
USB media (i386)[edit]
Below is the table for i386 tests, collapsed by default (click 'show' in the Milestone column to show it). Since Fedora 24, i386 is no longer a release-blocking architecture, and these tests are all optional.
Milestone | Test Case | i386 |
---|---|---|
Optional | QA:Testcase_USB_stick_Live LiveUSB-creator | |
Optional | QA:Testcase_USB_stick_Live Live-ISO-to-Disk | |
Optional | QA:Testcase_USB_stick_Live_dd | |
Optional | QA:Testcase_USB_stick_DVD Live-ISO-to-Disk | |
Optional | QA:Testcase_USB_stick_DVD_dd | |
Virtualization[edit]
Milestone | Test Case | x86_64 BIOS | x86_64 UEFI | ARM |
---|---|---|---|---|
Beta | QA:Testcase_Install_to_Previous_KVM | ![]() |
![]() |
|
Beta | QA:Testcase_Install_to_Current_KVM | |
|
|
Final | QA:Testcase_Boot_Methods_Xen_Para_Virt | |
|
|
Storage devices[edit]
Milestone | Test Case | x86_64 | ARM |
---|---|---|---|
Alpha | QA:Testcase_install_to_SATA | |
|
Alpha | QA:Testcase_install_to_PATA | ||
Alpha | QA:Testcase_install_to_SCSI | | |
Alpha | QA:Testcase_install_to_SAS | |
|
Beta | QA:Testcase_install_to_firmware_RAID | |
|
Beta | QA:Testcase_install_to_hardware_RAID | |
|
Beta | QA:Testcase_install_to_VirtIO | | |
Final | QA:Testcase_install_to_iSCSI_no_authentication | |
|
Final | QA:Testcase_install_to_FCoE_target | |
|
Optional | QA:Testcase_install_to_multipath | |
Guided storage configuration[edit]
Milestone | Test Case | x86_64 BIOS | x86_64 UEFI | ARM |
---|---|---|---|---|
Alpha | QA:Testcase_partitioning_guided_empty | | ||
Alpha | QA:Testcase_partitioning_guided_delete_all | | ||
Alpha | QA:Testcase_partitioning_guided_multi_select | |||
Beta | QA:Testcase_partitioning_guided_delete_partial | |||
Beta | QA:Testcase_partitioning_guided_free_space | |||
Beta | QA:Testcase_partitioning_guided_encrypted | | ||
Beta | QA:Testcase_partitioning_guided_multi_empty_all |
Guided storage shrinking[edit]
Milestone | Test Case | ext4 | NTFS |
---|---|---|---|
Final | QA:Testcase_partitioning_guided_shrink |
Custom storage configuration[edit]
Milestone | Test Case | x86_64 BIOS | x86_64 UEFI | ARM |
---|---|---|---|---|
Beta | QA:Testcase_partitioning_custom_software_RAID | |||
Final | QA:Testcase_partitioning_custom_btrfs | | ||
Final | QA:Testcase_partitioning_custom_lvmthin | | ||
Final | QA:Testcase_partitioning_custom_standard_partition_ext3 | | ||
Final | QA:Testcase_partitioning_custom_standard_partition_xfs | | ||
Optional | QA:Testcase_partitioning_custom_no_swap | |
User interface[edit]
Milestone | Test Case | Result |
---|---|---|
Alpha | QA:Testcase_Anaconda_User_Interface_Graphical | |
Alpha | QA:Testcase_Anaconda_User_Interface_Text | |
Alpha | QA:Testcase_Anaconda_User_Interface_VNC | |
Alpha | QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect | |
Milestone | Test Case | x86_64 BIOS | x86_64 UEFI |
---|---|---|---|
Alpha | QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver | |
|
Milestone | Test Case | x86_64 | ARM |
---|---|---|---|
Beta | QA:Testcase_Anaconda_User_Interface_serial_console | |
|
Installation repositories[edit]
Package sets[edit]
Milestone | Test Case | Result |
---|---|---|
Beta | QA:Testcase_Package_Sets_Minimal_Package_Install | |
Optional | QA:Testcase_Package_Sets_KDE_Package_Install | |
Kickstart[edit]
Milestone | Test Case | Result |
---|---|---|
Alpha | QA:Testcase_kickstart_user_creation | |
Beta | QA:Testcase_Kickstart_Http_Server_Ks_Cfg | |
Beta | QA:Testcase_Kickstart_File_Path_Ks_Cfg | |
Beta | QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg | |
Beta | QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg |
Upgrade[edit]
Milestone | Test Case | x86_64 BIOS | x86_64 UEFI |
---|---|---|---|
Beta | QA:Testcase_upgrade_dnf_current_any | | |
Beta | QA:Testcase_upgrade_dnf_previous_any | |
Internationalization and Localization[edit]
Milestone | Test Case | Result |
---|---|---|
Final | QA:Testcase_Arabic_Language_Install | |
Final | QA:Testcase_Asian_Language_Install | |
Final | QA:Testcase_Cyrillic_Language_Install | |
Final | QA:Testcase_Non-English_European_Language_Install | |
Optional | QA:Testcase_i18n_default_fonts | |
Miscellaneous[edit]
Milestone | Test Case | x86_64 | ARM |
---|---|---|---|
Alpha | QA:Testcase_Anaconda_user_creation | |
Milestone | Test Case | Result |
---|---|---|
Alpha | QA:Testcase_Anaconda_save_traceback_to_bugzilla (GUI mode) | ![]() |
Alpha | QA:Testcase_Anaconda_save_traceback_to_bugzilla (text mode) | ![]() |
Alpha | QA:Testcase_Anaconda_updates.img_via_URL | |
Final | QA:Testcase_Anaconda_updates.img_via_installation_source | |
Final | QA:Testcase_Anaconda_updates.img_via_local_media | |
Final | QA:Testcase_Anaconda_help | |
Optional | QA:Testcase_Anaconda_traceback_debug_mode (GUI mode) | |
Optional | QA:Testcase_Anaconda_traceback_debug_mode (text mode) | |
Milestone | Test Case | x86_64 BIOS | x86_64 UEFI |
---|---|---|---|
Beta | QA:Testcase_Anaconda_rescue_mode | |
|
Final | QA:Testcase_dualboot_with_windows | |
|
Final | QA:Testcase_dualboot_with_OSX | | |
Optional | QA:Testcase_Install_Image_Boot_Local | |
|
Optional | QA:Testcase_Memtest86 | |
Base[edit]
Milestone | Test Case | Workstation | Server | KDE | ARM | Cloud |
---|---|---|---|---|---|---|
Alpha | QA:Testcase_base_initial_setup | |
||||
Alpha | QA:Testcase_base_startup | |
|
|||
Alpha | QA:Testcase_base_system_logging | |
|
|
| |
Alpha | QA:Testcase_base_update_cli | |
|
|
|
|
Final | QA:Testcase_Services_start | |
| |||
Final | QA:Testcase_base_selinux | |
| |||
Final | QA:Testcase_base_service_manipulation | |
|
|
Server[edit]
General tests[edit]
Milestone | Test Case | x86 | ARM |
---|---|---|---|
Alpha | QA:Testcase_kickstart_firewall_disabled | | |
Alpha | QA:Testcase_kickstart_firewall_configured | | |
Alpha | QA:Testcase_Server_firewall_default | | |
Alpha | QA:Testcase_Server_cockpit_default | | |
Beta | QA:Testcase_Server_cockpit_basic | |
|
Domain joining tests: FreeIPA[edit]
Milestone | Test Case | Result |
---|---|---|
Alpha | QA:Testcase_realmd_join_kickstart | |
Alpha | QA:Testcase_realmd_join_sssd | |
Beta | QA:Testcase_realmd_join_cockpit | |
Domain joining tests: Active Directory[edit]
Milestone | Test Case | Result |
---|---|---|
Alpha | QA:Testcase_realmd_join_kickstart | |
Alpha | QA:Testcase_realmd_join_sssd | |
Beta | QA:Testcase_realmd_join_cockpit | |
Domain client tests[edit]
Milestone | Test Case | Result |
---|---|---|
Beta | QA:Testcase_domain_client_authenticate (FreeIPA) | |
Final | QA:Testcase_FreeIPA_realmd_login | |
Optional | QA:Testcase_domain_client_authenticate (Active Directory) | |
Release-blocking roles[edit]
Milestone | Test Case | x86 | ARM |
---|---|---|---|
Alpha | Domain controller | |
|
Alpha | Database server | |
|
Domain controller role[edit]
Milestone | Test Case | Result |
---|---|---|
Beta | QA:Testcase_FreeIPA_web_ui | |
Beta | QA:Testcase_FreeIPA_password_change | |
Non-release-blocking roles[edit]
Milestone | Test Case | x86 | ARM |
---|
Cloud[edit]
Cloud Provider Setup[edit]
Expand one of the sections below for instructions on getting set up to run these testcases on a specific provider. More information can be found in the Fedora Cloud guide.
Amazon Web Services
- Get an AWS account (the approval process can take hours)
- Make sure that your security group allows for SSH (default tcp port 22)
- Log in to the AWS Management Console
- Obtain the AMI id of the newest Fedora image from http://cloud.fedoraproject.org/.
- Search for and select the desired AMI on the IMAGES/AMIs section of the EC2 console
- Launch an instance with the AMI under test
Openstack
- Use your own OpenStack deployment
- Provide or create an SSH keypair
- Make sure that your security group allows for SSH (default tcp port 22)
- Log in to the Horizon dashboard
- Find the image URL at http://cloud.fedoraproject.org/ or as provided in release candidate documents.
- Add the image to OpenStack, either using the OpenStack web dashboard (see step 4 here) or with glance image-create --name "Fedora version" --disk-format qcow2 --container-format bare --is-public true --copy-from url
- Launch the instance (in the dashboard, under the "Images" heading, click the "Launch" button for the appropriate image
Testcloud Local
- See Local Test Cloud Installation Guide for instructions on installing and running a testcloud virtual instance.
- Once SSH'ed into the virtual cloud instance, you can perform the tests below. NOTE: testcloud will work with both Fedora Cloud and Atomic images.
x86_64[edit]
Milestone | Test Case | Local | EC2 | Openstack |
---|---|---|---|---|
Alpha | QA:Testcase_base_startup | |
|
|
Alpha | QA:Testcase_base_system_logging | |
|
|
Final | QA:Testcase_Services_start | |
|
|
Final | QA:Testcase_base_selinux | |
|
|
Final | QA:Testcase_base_service_manipulation | |
|
|
i386[edit]
Milestone | Test Case | Local | EC2 | Openstack |
---|---|---|---|---|
Optional | QA:Testcase_base_startup | |
|
|
Optional | QA:Testcase_base_system_logging | |
|
|
Optional | QA:Testcase_Services_start | |
|
|
Optional | QA:Testcase_base_selinux | |
|
|
Optional | QA:Testcase_base_service_manipulation | |
|
|
Atomic[edit]
Milestone | Test Case | Local | EC2 | Openstack |
---|---|---|---|---|
Optional | QA:Testcase_base_startup | |
|
|
Optional | QA:Testcase_base_system_logging | |
|
|
Optional | QA:Testcase_Services_start | |
|
|
Optional | QA:Testcase_base_selinux | |
|
|
Optional | QA:Testcase_base_service_manipulation | |
|
|
Desktop[edit]
Release-blocking desktops: x86 / x86_64[edit]
Milestone | Test Case | Workstation | KDE |
---|---|---|---|
Alpha | QA:Testcase_desktop_browser | ||
Alpha | QA:Testcase_desktop_terminal | ||
Beta | QA:Testcase_desktop_update_graphical | |
|
Beta | QA:Testcase_desktop_login | |
|
Beta | QA:Testcase_audio_basic | |
|
Beta | QA:Testcase_desktop_panel_basic | |
|
Beta | QA:Testcase_desktop_automount | |
|
Beta | QA:Testcase_workstation_core_applications | |
|
Final | QA:Testcase_desktop_update_notification | |
|
Final | QA:Testcase_desktop_error_checks | |
|
Final | QA:Testcase_desktop_menus | |
|
Final | QA:Testcase_desktop_panel_advanced | |
|
Final | QA:Testcase_desktop_keyring | |
|
Optional | QA:Testcase_workstation_theming | |
Release-blocking desktops: ARM[edit]
Milestone | Test Case | Xfce |
---|---|---|
Alpha | QA:Testcase_desktop_browser | |
Alpha | QA:Testcase_desktop_terminal | |
Beta | QA:Testcase_desktop_update_graphical | |
Beta | QA:Testcase_desktop_login | |
Beta | QA:Testcase_audio_basic | |
Beta | QA:Testcase_desktop_panel_basic | |
Beta | QA:Testcase_desktop_automount | |
Final | QA:Testcase_desktop_update_notification | |
Final | QA:Testcase_desktop_error_checks | |
Final | QA:Testcase_desktop_menus | |
Final | QA:Testcase_desktop_panel_advanced | |
Final | QA:Testcase_desktop_keyring | |
Non release-blocking desktops: x86 / x86_64[edit]
Milestone | Test Case | Xfce | LXDE | MATE | Cinnamon | GNOME Classic |
---|---|---|---|---|---|---|
Alpha | QA:Testcase_desktop_browser | |
|
|
|
|
Alpha | QA:Testcase_desktop_terminal | |
|
|
| |
Beta | QA:Testcase_desktop_update_graphical | |
|
|
|
|
Beta | QA:Testcase_desktop_login | |
|
|
|
|
Beta | QA:Testcase_audio_basic | |
|
|
| |
Beta | QA:Testcase_desktop_panel_basic | |
|
|
| |
Beta | QA:Testcase_desktop_automount | |
|
|
| |
Final | QA:Testcase_desktop_update_notification | |
|
|
|
|
Final | QA:Testcase_desktop_error_checks | |
|
|
| |
Final | QA:Testcase_desktop_menus | |
|
|
|
|
Final | QA:Testcase_desktop_panel_advanced | |
|
|
| |
Final | QA:Testcase_desktop_keyring | |
|
|
|
|
Non release-blocking desktops: ARM[edit]
Milestone | Test Case | Workstation | KDE | LXDE | MATE | Cinnamon | GNOME Classic |
---|---|---|---|---|---|---|---|
Alpha | QA:Testcase_desktop_browser | |
|
|
|
|
|
Alpha | QA:Testcase_desktop_terminal | |
|
|
|
|
|
Beta | QA:Testcase_desktop_update_graphical | |
|
|
|
|
|
Beta | QA:Testcase_desktop_login | |
|
|
|
|
|
Beta | QA:Testcase_audio_basic | |
|
|
|
|
|
Beta | QA:Testcase_desktop_panel_basic | |
|
|
|
|
|
Beta | QA:Testcase_desktop_automount | |
|
|
|
|
|
Beta | QA:Testcase_workstation_core_applications | |
|||||
Final | QA:Testcase_desktop_update_notification | |
|
|
|
|
|
Final | QA:Testcase_desktop_error_checks | |
|
|
|
|
|
Final | QA:Testcase_desktop_menus | |
|
|
|
|
|
Final | QA:Testcase_desktop_panel_advanced | |
|
|
|
|
|
Final | QA:Testcase_desktop_keyring | |
|
|
|
|
|
Optional | QA:Testcase_workstation_theming | |
Sugar (non-blocking, all arches)[edit]
Test Case | x86 | ARM |
---|---|---|
QA:Testcase_SoaS boots to the (name) selection screen | |
|
QA:Testcase_SoaS installed to hard disk with liveinst from root terminal | |
|
QA:Testcase_Jabber.sugarlabs.org should connect and display XO "Buddies" | |
|
QA:Testcase_When a USB storage device is inserted, it should show up in the Frame | |
|
QA:Testcase_Functions in My Settings (Sugar control panel) | |
|
QA:Testcase_Applications in the Home Screen | |
|
QA:Testcase_Sugar-desktop installed in another Desktop | [1] | |
- ↑ KDE - freezes at "X" cursor
Security Lab[edit]
Milestone | Test Case | Security Lab |
---|---|---|
Beta | QA:Testcase_Mediakit_ISO_Size | |
Beta | QA:Testcase_Mediakit_ISO_Checksums | |
Beta | QA:TestCases/Install_Source_Live_Image | |
Beta | QA:Testcase_base_firstboot | |
Beta | QA:Testcase_base_startup | |
Beta | QA:Testcase_base_system_logging | |
Beta | QA:Testcase_desktop_browser | |
Beta | QA:Testcase_desktop_updates | |
Beta | QA:Testcase_desktop_login | |
Beta | QA:Testcase_desktop_panel_basic | |
Beta | QA:Testcase_desktop_error_checks | |
Beta | QA:Testcase_desktop_menus | |
Beta | QA:Testcase_Nmap | |
Beta | QA:Testcase_Wireshark | |
Beta | QA:Testcase_Nikto | |
Beta | QA:Testcase_OpenVAS | |
Beta | QA:Testcase_HTTPing | |
Beta | QA:Testcase_Rkhunter | |
Beta | QA:Testcase_OpenSSH | |