From Fedora Project Wiki
No edit summary
No edit summary
 
(14 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{Release_validation_instructions|testtype=Installation|release=22|milestone=Final|compose=TC1|date=}}
[https://www.foo.com {{{2|{{{1}}}}}}]<noinclude>
 
{{tempdoc}}
{{anchor|results}}
[[Category:Link_templates]]
== '''Test Matrix''' ==
</noinclude>
 
<onlyinclude>
Please click ''[show]'' in each table to view the tests of each media installation, and click ''[edit]'' to post your test results using the syntax in [[#Key|Key Section]].
 
<div style="background-color: darkgreen; text-align: center; border-style: solid; border-width: thin">
==== Image sanity ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! Server !! Workstation !! Spins !! ARM disks !! Cloud
|-
| Alpha / Final
| [[QA:Testcase_Mediakit_Checksums]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|fail|adamwill|bot=true}}
| {{result|fail|adamwill|bot=true}}
| {{result|fail|adamwill|bot=true}}<ref>lxde live image for i386, size 914358272, max 734003200</ref><ref>lxde live image for x86_64, size 941621248, max 734003200</ref>
| style="background:lightgrey;"|
| {{result|fail|adamwill|bot=true}}<ref>cloud boot image for x86_64, size 835715072, max 734003200</ref>
|-
| Alpha
| [[QA:Testcase_Mediakit_Repoclosure]]
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| [[QA:Testcase_Mediakit_FileConflicts]]
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
|}
<references/>
<div style="background-color: lightgreen; text-align: center; border-style: solid; border-width: thin">
 
==== Default boot and install ====
</div>
{{admon/important|Bare metal testing required|Running these tests in a virtualized environment is valuable, but the test must fail on bare metal using a physical install medium for each release-blocking image in each test environment at least for the final release candidate image (i.e. the released image) for each milestone.}}
 
{{admon/note|Single test table|In all of these tests, the test case used is [[QA:Testcase_Boot_default_install]]. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later [[#ARM disk images]] section.}}
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Image !! i386 !! x86_64 !! UEFI
|-
| Alpha
| [[QA:Testcase_Boot_default_install|Workstation live]]
| {{result|none}}
| {{result|fail|satellit}}<ref>Liveusb-creator (cp) USB to HD</ref>{{result|fail|satellit|1210857}}<ref>VirtualBox-very slow boot</ref>
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_Boot_default_install|Workstation netinst]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_Boot_default_install|Server netinst]]
| {{result|none}}
| {{result|fail|coconut|bot=true}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_Boot_default_install|Server offline]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_Boot_default_install|Generic netinst]]
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| [[QA:Testcase_Boot_default_install|KDE live]]
| {{result|fail|satellit}}<ref>Boxes install</ref>
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Boot_default_install|Xfce live]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Boot_default_install|LXDE live]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Boot_default_install|MATE live]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Boot_default_install|SoaS live]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: yellowgreen; text-align: center; border-style: solid; border-width: thin">
 
==== ARM disk images ====
</div>
{{admon/note|Single test table|In all of these tests, the test case used is [[QA:Testcase_arm_image_deployment]]. That is where the links point. The same test needs to be run for multiple images and target platforms.}}
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Image !! Ext boot 
|-
| Alpha
| [[QA:Testcase_arm_image_deployment|Minimal]]
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_arm_image_deployment|KDE]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|Xfce]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|Desktop]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|LXDE]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|MATE]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|SoaS]]
| {{result|none}}
|-
|}
 
<references/>
<div style="background-color: dodgerblue; text-align: center; border-style: solid; border-width: thin">
==== PXE boot ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! i386 !! x86_64 !! ARM
|-
| Beta
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: teal; text-align: center; border-style: solid; border-width: thin">
 
==== USB media ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! i386 !! x86_64 !! UEFI
|-
| Alpha
| [[QA:Testcase_USB_stick_Live_luc|QA:Testcase_USB_stick_Live LiveUSB-creator]]
| {{result|none}}
| {{result|fail|satellit}}<ref>dbus error unless fat "LIVE" USB is inserted after starting liveusb-creator</ref>
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_USB_stick_Live_litd|QA:Testcase_USB_stick_Live Live-ISO-to-Disk]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_USB_stick_Live_dd]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_USB_stick_DVD_litd|QA:Testcase_USB_stick_DVD Live-ISO-to-Disk]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_USB_stick_DVD_dd]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: turquoise; text-align: center; border-style: solid; border-width: thin">
 
==== Virtualization ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> BIOS !! x86 UEFI !! ARM
|-
| Beta
| [[QA:Testcase_Install_to_Previous_KVM]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Install_to_Current_KVM]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_Boot_Methods_Xen_Para_Virt]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
==== Storage devices ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> !! ARM
|-
| Alpha
| [[QA:Testcase_install_to_SATA]]
| {{result|fail|coconut|bot=true}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_install_to_PATA]]
| {{result|none}}
| style="background:lightgrey;"|
|-
| Alpha
| [[QA:Testcase_install_to_SCSI]]
| {{result|fail|coconut|bot=true}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_install_to_SAS]]
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| [[QA:Testcase_install_to_firmware_RAID]]
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| [[QA:Testcase_install_to_hardware_RAID]]
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| [[QA:Testcase_install_to_VirtIO]]
| {{result|fail|coconut|bot=true}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_install_to_iSCSI_no_authentication]]
| {{result|none}}
| style="background:lightgrey;"|
|-
| Final
| [[QA:Testcase_install_to_FCoE_target]]
| {{result|none}}
| style="background:lightgrey;"|
|-
| Optional
| [[QA:Testcase_install_to_multipath]]
| {{result|none}}
| style="background:lightgrey;"|
|-
|}
<references/>
<div style="background-color: darkgoldenrod; text-align: center; border-style: solid; border-width: thin">
 
==== Guided storage configuration ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> BIOS !! x86 UEFI !! ARM
|-
| Alpha
| [[QA:Testcase_partitioning_guided_empty]]
| {{result|fail|coconut|bot=true}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_partitioning_guided_delete_all]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_partitioning_guided_multi_select]]
| {{result|fail|coconut|bot=true}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| [[QA:Testcase_partitioning_guided_delete_partial]]
| {{result|fail|coconut|bot=true}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| [[QA:Testcase_partitioning_guided_free_space]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| [[QA:Testcase_partitioning_guided_encrypted]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_partitioning_guided_multi_empty_all]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|}
<references/>
<div style="background-color: burlywood; text-align: center; border-style: solid; border-width: thin">
 
==== Guided storage shrinking ====
</div>
{{admon/note|Environments|For this test, the column headings refer to the storage volume type ''to be shrunk'', not the one chosen to replace it for the new installation.}}
{| class="wikitable sortable" width = 100%
|-
!style="width:10em"|Milestone !! Test Case !! ext4 !! NTFS
|-
| Final
| [[QA:Testcase_partitioning_guided_shrink]]
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: gold; text-align: center; border-style: solid; border-width: thin">
 
==== Custom storage configuration ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> BIOS !! x86 UEFI !! ARM
|-
| Beta
| [[QA:Testcase_Partitioning_On_Software_RAID]]
| {{result|fail|coconut|bot=true}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Final
| [[QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_anaconda_ext3_rootfs_on_disk_partition]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_anaconda_xfs_rootfs_on_disk_partition]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Partitioning_No_Swap]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: orchid; text-align: center; border-style: solid; border-width: thin">
 
==== User interface ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! Result
|-
| Alpha
| [[QA:Testcase_Anaconda_User_Interface_Graphical]]
| {{result|fail|coconut|bot=true}}
|-
| Alpha
| [[QA:Testcase_Anaconda_User_Interface_Text]]
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_Anaconda_User_Interface_VNC]]
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect]]
| {{result|none}}
|-
|}
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> BIOS !! x86 UEFI
|-
| Alpha
| [[QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver]]
| {{result|none}}
| {{result|none}}
|-
|}
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86 !! ARM
|-
| Beta
| [[QA:Testcase_Anaconda_User_Interface_serial_console]]
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: lavender; text-align: center; border-style: solid; border-width: thin">
==== Installation repositories ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! Result
|-
| Alpha
| [[QA:Testcase_install_repository_Mirrorlist_graphical]]
| {{result|fail|coconut|bot=true}}
|-
| Alpha
| [[QA:Testcase_install_repository_HTTP/FTP_graphical]]
| {{result|fail|coconut|bot=true}}
|-
| Alpha
| [[QA:Testcase_install_repository_HTTP/FTP_variation]]
| {{result|fail|coconut|bot=true}}
|-
| Beta
| [[QA:Testcase_install_repository_NFS_graphical]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_install_repository_NFS_variation]]
| {{result|none}}
|-
| Final
| [[QA:Testcase_install_repository_NFSISO_variation]]
| {{result|none}}
|-
| Final
| [[QA:Testcase_install_repository_Hard_drive_variation]]
| {{result|none}}
|-
|}
<references/>
<div style="background-color: plum; text-align: center; border-style: solid; border-width: thin">
==== Package sets ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! i386 !! x86_64
|-
| Beta
| [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
| {{result|none}}
| {{result|fail|coconut|bot=true}}
|-
| Optional
| [[QA:Testcase_Package_Sets_KDE_Package_Install]]
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: coral; text-align: center; border-style: solid; border-width: thin">
==== Kickstart ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! Result
|-
| Alpha
| [[QA:Testcase_kickstart_user_creation]]
| {{result|fail|coconut|bot=true}}
|-
| Beta
| [[QA:Testcase_Kickstart_Http_Server_Ks_Cfg]]
| {{result|fail|coconut|bot=true}}
|-
| Beta
| [[QA:Testcase_Kickstart_File_Path_Ks_Cfg]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg]]
| {{result|fail|coconut|bot=true}}
|-
| Beta
| [[QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg]]
| {{result|none}}
|-
|}
<references/>
<div style="background-color: pink; text-align: center; border-style: solid; border-width: thin">
==== Upgrade ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> BIOS !! x86 UEFI !! ARM
|-
| Beta
| [[QA:Testcase_upgrade_fedup_cli_previous_workstation]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| [[QA:Testcase_upgrade_fedup_cli_previous_server]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_upgrade_fedup_cli_previous_kde]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_upgrade_fedup_cli_previous_minimal]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_upgrade_fedup_cli_previous_workstation_encrypted]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|}
<references/>
<div style="background-color: lightpink; text-align: center; border-style: solid; border-width: thin">
==== Internationalization and Localization ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! Result
|-
| Final
| [[QA:Testcase_Arabic_Language_Install]]
| {{result|none}}
|-
| Final
| [[QA:Testcase_Asian_Language_Install]]
| {{result|none}}
|-
| Final
| [[QA:Testcase_Cyrillic_Language_Install]]
| {{result|none}}
|-
| Final
| [[QA:Testcase_Non-English_European_Language_Install]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_i18n_default_fonts]]
| {{result|none}}
|-
|}
<references/>
<div style="background-color: mistyrose; text-align: center; border-style: solid; border-width: thin">
==== Miscellaneous ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> !! ARM
|-
| Alpha
| [[QA:Testcase_Anaconda_user_creation]]
| {{result|fail|coconut|bot=true}}
| {{result|none}}
|-
|}
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! Result
|-
| Alpha
| [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]] (GUI mode)
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]] (text mode)
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_Anaconda_updates.img_via_URL]]
| {{result|fail|coconut|bot=true}}
|-
| Final
| [[QA:Testcase_Anaconda_updates.img_via_installation_source]]
| {{result|none}}
|-
| Final
| [[QA:Testcase_Anaconda_updates.img_via_local_media]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Anaconda_traceback_debug_mode]] (GUI mode)
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Anaconda_traceback_debug_mode]] (text mode)
| {{result|none}}
|-
|}
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86 BIOS !! x86 UEFI
|-
| Beta
| [[QA:Testcase_Anaconda_rescue_mode]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_dualboot_with_windows]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_dualboot_with_OSX]]
| style="background:lightgrey;"|
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Install_Image_Boot_Local]]
| {{result|none}}
| style="background:lightgrey;"|
|-
| Optional
| [[QA:Testcase_Memtest86]]
| {{result|none}}
| style="background:lightgrey;"|
|-
|}
<references/></onlyinclude>

Latest revision as of 17:22, 25 February 2016

{{{1}}}

Template documentation [edit]

This documentation is transcluded from Template:Adamwill/Test page/doc. It will not be transcluded on pages that use this template.
Template:Adamwill/Test page/doc
Retrieved from "https://fedoraproject.org/w/index.php?title=User:Adamwill/Test_page&oldid=436125"