Template:Base test matrix: Difference between revisions

Revision as of 18:31, 20 January 2022

Template documentation [edit]

This documentation is transcluded from Template:Base test matrix/doc. It will not be transcluded on pages that use this template.

Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.

This template contains the Base 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Base validation test case, though, don't worry about that stuff, and put it in here.

Cloud
The Cloud edition is not included on this page because all the same tests are present on the Cloud validation page.

Release-blocking environments (x86_64)

Milestone	Test Case	Workstation	Server	KDE
Basic/Final	QA:Testcase_base_initial_setup	none		none
Basic	QA:Testcase_base_startup	none	none	none
Basic	QA:Testcase_base_reboot_unmount	none	none	none
Basic	QA:Testcase_base_selinux	none	none	none
Basic	QA:Testcase_base_system_logging	none	none	none
Basic	QA:Testcase_base_update_cli	none	none	none
Basic / Beta	QA:Testcase_package_install_remove	none	none	none
Basic / Final	QA:Testcase_base_artwork_release_identification	none	none	none
Final	QA:Testcase_base_edition_self_identification	none	none	none
Final	QA:Testcase_base_services_start	none	none	none
Final	QA:Testcase_base_service_manipulation	none	none	none

Release-blocking environments (aarch64)

Milestone	Test Case	Workstation	Server	Minimal
Basic/Final	QA:Testcase_base_initial_setup	none	none	none
Basic	QA:Testcase_base_startup	none	none	none
Basic	QA:Testcase_base_reboot_unmount	none	none	none
Basic	QA:Testcase_base_selinux	none	none	none
Basic	QA:Testcase_base_system_logging	none	none	none
Basic	QA:Testcase_base_update_cli	none	none	none
Basic / Beta	QA:Testcase_package_install_remove	none	none	none
Basic / Final	QA:Testcase_base_artwork_release_identification	none	none	none
Final	QA:Testcase_base_edition_self_identification	none	none	none
Final	QA:Testcase_base_services_start	none	none	none
Final	QA:Testcase_base_service_manipulation	none	none	none

Release-blocking environments (armhfp)

Milestone	Test Case	Minimal
Basic/Final	QA:Testcase_base_initial_setup	none
Basic	QA:Testcase_base_startup	none
Basic	QA:Testcase_base_reboot_unmount	none
Basic	QA:Testcase_base_selinux	none
Basic	QA:Testcase_base_system_logging	none
Basic	QA:Testcase_base_update_cli	none
Basic / Beta	QA:Testcase_package_install_remove	none
Basic / Final	QA:Testcase_base_artwork_release_identification	none
Final	QA:Testcase_base_edition_self_identification	none
Final	QA:Testcase_base_services_start	none
Final	QA:Testcase_base_service_manipulation	none

Modularity

Milestone	Test Case	Result
Optional	QA:Testcase_Modularity_module_list	none
Optional	QA:Testcase_Modularity_enable-disable_module	none
Optional	QA:Testcase_Modularity_install_module	none
Optional	QA:Testcase_Modularity_update_without_repos	none
Optional	QA:Testcase_Modularity_update_module	none

Non-blocking environments (x86_64)

Milestone	Test Case	Xfce	Cinnamon	MATE	LXDE	LXqt	Sugar	Silverblue
Optional	QA:Testcase_base_initial_setup	none	none	none	none	none	none	none
Optional	QA:Testcase_base_startup	none	none	none	none	none	none	none
Optional	QA:Testcase_base_reboot_unmount	none	none	none	none	none	none	none
Optional	QA:Testcase_base_system_logging	none	none	none	none	none	none	none
Optional	QA:Testcase_base_update_cli	none	none	none	none	none	none	none
Optional	QA:Testcase_package_install_remove	none	none	none	none	none	none
Optional	QA:Testcase_base_artwork_release_identification	none	none	none	none	none	none	none
Optional	QA:Testcase_base_edition_self_identification	none	none	none	none	none	none	none
Optional	QA:Testcase_base_services_start	none	none	none	none	none	none	none
Optional	QA:Testcase_base_selinux	none	none	none	none	none	none	none
Optional	QA:Testcase_base_service_manipulation	none	none	none	none	none	none	none

Non-blocking environments (ARM)

Milestone	Test Case	KDE	Cinnamon	Xfce	Sugar
Optional	QA:Testcase_base_initial_setup	none	none	none	none
Optional	QA:Testcase_base_startup	none	none	none	none
Optional	QA:Testcase_base_reboot_unmount	none	none	none	none
Optional	QA:Testcase_base_system_logging	none	none	none	none
Optional	QA:Testcase_base_update_cli	none	none	none	none
Optional	QA:Testcase_package_install_remove	none	none	none	none
Optional	QA:Testcase_base_artwork_release_identification	none	none	none	none
Optional	QA:Testcase_base_edition_self_identification	none	none	none	none
Optional	QA:Testcase_base_services_start	none	none	none	none
Optional	QA:Testcase_base_selinux	none	none	none	none
Optional	QA:Testcase_base_service_manipulation	none	none	none	none

@@ Line 1: / Line 1: @@
 {{tempdoc}}<onlyinclude>
-== Release-blocking environments (x86_64) ==
+{{admon/note|Cloud|The Cloud edition is not included on this page because all the same tests are present on the Cloud validation page.}}
-{| class="wikitable sortable collapsible" width=100%
+==== Release-blocking environments (x86_64) ====
-! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! KDE
+{| class="wikitable sortable mw-collapsible" width=100%
+! Milestone !! Test Case  !! Workstation !! Server !! KDE
 |-
-| Basic
+| Basic/Final
 | [[QA:Testcase_base_initial_setup]]
 | {{result|none}}
-| style="background:lightgrey;"|
 | style="background:lightgrey;"|
 | {{result|none}}
@@ Line 15: / Line 15: @@
 | {{result|none}}
 | {{result|none}}
-| style="background:lightgrey;"|
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_reboot_unmount]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_selinux]]
+| {{result|none}}
+| {{result|none}}
 | {{result|none}}
 |-
 | Basic
 | [[QA:Testcase_base_system_logging]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 28: / Line 38: @@
 | [[QA:Testcase_base_update_cli]]
 | {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Basic / Beta
+| [[QA:Testcase_package_install_remove]]
 | {{result|none}}
 | {{result|none}}
@@ Line 34: / Line 49: @@
 | Basic / Final
 | [[QA:Testcase_base_artwork_release_identification]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 40: / Line 54: @@
 |-
 | Final
-| [[QA:Testcase_Services_start]]
+| [[QA:Testcase_base_edition_self_identification]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 47: / Line 60: @@
 |-
 | Final
-| [[QA:Testcase_base_selinux]]
+| [[QA:Testcase_base_services_start]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 55: / Line 67: @@
 | Final
 | [[QA:Testcase_base_service_manipulation]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 63: / Line 74: @@
 <references/>
-== Release-blocking environments (ARM) ==
+==== Release-blocking environments (aarch64) ====
-{| class="wikitable sortable collapsible" width=100%
+{| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case  !! Xfce !! Minimal
+! Milestone !! Test Case  !! Workstation !! Server !! Minimal
 |-
-| Basic
+| Basic/Final
 | [[QA:Testcase_base_initial_setup]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 74: / Line 86: @@
 | Basic
 | [[QA:Testcase_base_startup]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_reboot_unmount]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_selinux]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 79: / Line 104: @@
 | Basic
 | [[QA:Testcase_base_system_logging]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 84: / Line 110: @@
 | Basic
 | [[QA:Testcase_base_update_cli]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Basic / Beta
+| [[QA:Testcase_package_install_remove]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 89: / Line 122: @@
 | Basic / Final
 | [[QA:Testcase_base_artwork_release_identification]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Final
+| [[QA:Testcase_base_edition_self_identification]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
 |-
 | Final
-| [[QA:Testcase_Services_start]]
+| [[QA:Testcase_base_services_start]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
 |-
 | Final
+| [[QA:Testcase_base_service_manipulation]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+|}
+<references/>
+==== Release-blocking environments (armhfp) ====
+{| class="wikitable sortable mw-collapsible" width=100%
+! Milestone !! Test Case !! Minimal
+|-
+| Basic/Final
+| [[QA:Testcase_base_initial_setup]]
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_startup]]
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_reboot_unmount]]
+| {{result|none}}
+|-
+| Basic
 | [[QA:Testcase_base_selinux]]
 | {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_system_logging]]
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_update_cli]]
+| {{result|none}}
+|-
+| Basic / Beta
+| [[QA:Testcase_package_install_remove]]
+| {{result|none}}
+|-
+| Basic / Final
+| [[QA:Testcase_base_artwork_release_identification]]
+| {{result|none}}
+|-
+| Final
+| [[QA:Testcase_base_edition_self_identification]]
+| {{result|none}}
+|-
+| Final
+| [[QA:Testcase_base_services_start]]
 | {{result|none}}
 |-
@@ Line 105: / Line 194: @@
 | [[QA:Testcase_base_service_manipulation]]
 | {{result|none}}
+|-
+|}
+<references/>
+==== Modularity ====
+{| class="wikitable sortable mw-collapsible" width=100%
+|-
+!style="width:10em"|Milestone !! Test Case !! Result
+|-
+| Optional
+| [[QA:Testcase_Modularity_module_list]]
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_Modularity_enable-disable_module]]
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_Modularity_install_module]]
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_Modularity_update_without_repos]]
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_Modularity_update_module]]
 | {{result|none}}
 |-
 |}
 <references/>
-== Non-blocking environments (x86_64) ==
+==== Non-blocking environments (x86_64) ====
-{| class="wikitable sortable collapsible" width=100%
+{| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar !! Workstation Ostree
+! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar !! Silverblue
 |-
 | Optional
@@ Line 135: / Line 253: @@
 |-
 | Optional
-| [[QA:Testcase_base_system_logging]]
+| [[QA:Testcase_base_reboot_unmount]]
 | {{result|none}}
 | {{result|none}}
@@ Line 145: / Line 263: @@
 |-
 | Optional
-| [[QA:Testcase_base_update_cli]]
+| [[QA:Testcase_base_system_logging]]
 | {{result|none}}
 | {{result|none}}
@@ Line 155: / Line 273: @@
 |-
 | Optional
-| [[QA:Testcase_base_artwork_release_identification]]
+| [[QA:Testcase_base_update_cli]]
 | {{result|none}}
 | {{result|none}}
@@ Line 165: / Line 283: @@
 |-
 | Optional
-| [[QA:Testcase_Services_start]]
+| [[QA:Testcase_package_install_remove]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 173: / Line 290: @@
 | {{result|none}}
 | {{result|none}}
+| style="background:lightgrey;"|
 |-
 | Optional
-| [[QA:Testcase_base_selinux]]
+| [[QA:Testcase_base_artwork_release_identification]]
 | {{result|none}}
 | {{result|none}}
@@ Line 185: / Line 303: @@
 |-
 | Optional
-| [[QA:Testcase_base_service_manipulation]]
+| [[QA:Testcase_base_edition_self_identification]]
 | {{result|none}}
 | {{result|none}}
@@ Line 193: / Line 311: @@
 | {{result|none}}
 | {{result|none}}
-|-
-|}
-<references/>
-== Non-blocking environments (ARM) ==
-{| class="wikitable sortable collapsible" width=100%
-! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar
 |-
 | Optional
-| [[QA:Testcase_base_initial_setup]]
+| [[QA:Testcase_base_services_start]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 213: / Line 323: @@
 |-
 | Optional
-| [[QA:Testcase_base_startup]]
+| [[QA:Testcase_base_selinux]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 224: / Line 333: @@
 |-
 | Optional
-| [[QA:Testcase_base_system_logging]]
+| [[QA:Testcase_base_service_manipulation]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
+|-
+|}
+<references/>
+==== Non-blocking environments (ARM) ====
+{| class="wikitable sortable mw-collapsible" width=100%
+! Milestone !! Test Case !! KDE !! Cinnamon !! Xfce !! Sugar
+|-
+| Optional
+| [[QA:Testcase_base_initial_setup]]
 | {{result|none}}
 | {{result|none}}
@@ Line 235: / Line 357: @@
 |-
 | Optional
-| [[QA:Testcase_base_update_cli]]
+| [[QA:Testcase_base_startup]]
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_base_reboot_unmount]]
 | {{result|none}}
 | {{result|none}}
@@ Line 246: / Line 371: @@
 |-
 | Optional
-| [[QA:Testcase_base_artwork_release_identification]]
+| [[QA:Testcase_base_system_logging]]
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_base_update_cli]]
 | {{result|none}}
 | {{result|none}}
@@ Line 257: / Line 385: @@
 |-
 | Optional
-| [[QA:Testcase_Services_start]]
+| [[QA:Testcase_package_install_remove]]
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_base_artwork_release_identification]]
 | {{result|none}}
 | {{result|none}}
@@ Line 268: / Line 399: @@
 |-
 | Optional
-| [[QA:Testcase_base_selinux]]
+| [[QA:Testcase_base_edition_self_identification]]
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_base_services_start]]
 | {{result|none}}
 | {{result|none}}
@@ Line 279: / Line 413: @@
 |-
 | Optional
-| [[QA:Testcase_base_service_manipulation]]
+| [[QA:Testcase_base_selinux]]
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
 | {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_base_service_manipulation]]
 | {{result|none}}
 | {{result|none}}

Search