Test Matrix
Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.
Image sanity
Milestone |
Test Case |
Cloud qcow2 |
Cloud raw.xz |
Container tar.xz |
Container Minimal tar.xz
|
Basic / Final
|
QA:Testcase_Mediakit_Checksums
|
none
|
none
|
none
|
none
|
Default boot and install
Single test tableIn all of these tests, the test case used is
QA:Testcase_Boot_default_install. That is where the links point. The same test needs to be run for multiple images, target platforms, and install media. Note that the non-installer-based ARM disk images are covered by the later
#ARM disk images section. Please, precise
CD/DVD in the result if testing has been done on a real system with the image written to a real CD or DVD. Please, precise
USB in the result if testing has been done on a real system with the image written to a USB stick. If nothing is pressed in the results, this will be assumed as results are from testing in a virtual machine.
Expected coverageFor Beta, we expect a reasonable sampling of tests across the table, with at least some testing for VM and USB boot method, both firmware types, and each major class of deliverable (netinst, live and DVD). Optical boot testing is optional at this stage. For Final, we expect full coverage for
Basic / Final rows with VM and USB boot method. Optical boot testing in Final is mandatory for
supported images.
Milestone
|
Test Case
|
Bare Metal
|
PKVM
|
PVM LPAR
|
P8 |
P9
|
P8 |
P9
|
P8 |
P9 |
P10
|
Basic / Final
|
Workstation live
|
none
|
none
|
none
|
none
|
none
|
none
|
none
|
Basic / Final
|
Everything netinst
|
none
|
none
|
none
|
none
|
none
|
none
|
none
|
Basic / Final
|
Server netinst
|
none
|
none
|
none
|
none
|
none
|
pass F38 Beta-1.3 pass F38 20230323.n.0 pass F38 20230327.n.0 pass F38 20230401.n.1 pass F38 20230404.n.0 pass F38 20230407.n.0 pass F38 RC-1.1 pass F38 RC-1.4 pass F38 RC-1.5
|
pass F38 Beta-1.3 pass F38 20230323.n.0 pass F38 20230327.n.0 pass F38 20230401.n.1 pass F38 20230404.n.0 pass F38 20230407.n.0 pass F38 RC-1.1 pass F38 RC-1.4 pass F38 RC-1.5
|
Basic / Final
|
Server dvd
|
none
|
none
|
none
|
none
|
none
|
pass F38 Beta-1.3 pass F38 RC-1.5 pass F38 RC-1.6
|
pass F38 Beta-1.3 pass F38 RC-1.5 pass F38 RC-1.6
|
Optional
|
Silverblue dvd-ostree
|
none
|
none
|
none
|
none
|
none
|
none
|
none
|
Fedora Media Writer
Milestone
|
Test Case
|
Bare Metal
|
PKVM
|
PVM LPAR
|
P8 |
P9
|
P8 |
P9
|
P8 |
P9 |
P10
|
Beta / Optional
|
QA:Testcase_USB_fmw
|
none
|
none
|
none
|
none
|
none
|
none
|
none
|
PXE boot
Virtualization
Storage devices
Guided storage configuration
Guided storage shrinking
Environments
For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.
Custom storage configuration
Advanced custom storage configuration
User interface
Installation repositories
Package sets
Kickstart
Upgrade
Internationalization and Localization
Miscellaneous
Milestone
|
Test Case
|
Bare Metal
|
PKVM
|
PVM LPAR
|
P8 |
P9
|
P8 |
P9
|
P8 |
P9 |
P10
|
Basic
|
QA:Testcase_Anaconda_user_creation
|
none
|
none
|
none
|
none
|
none
|
pass F38 Beta-1.3 pass F38 20230323.n.0 pass F38 20230327.n.0 pass F38 20230401.n.1 pass F38 20230404.n.0 pass F38 20230407.n.0 pass F38 RC-1.1 pass F38 RC-1.4 pass F38 RC-1.5 pass F38 RC-1.6
|
pass F38 Beta-1.3 pass F38 20230323.n.0 pass F38 20230327.n.0 pass F38 20230401.n.1 pass F38 20230404.n.0 pass F38 20230407.n.0 pass F38 RC-1.1 pass F38 RC-1.4 pass F38 RC-1.5 pass F38 RC-1.6
|