From Fedora Project Wiki

(revise for split of artwork test, cover more environments including non-blocking ones: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org/message/XGWYB3GS5JZW7XNMXQ3ZVVMGWJZKK35C/)
(ARM desktop environment flip: Workstation is blocking, Xfce isn't - https://pagure.io/fesco/issue/2339)
(16 intermediate revisions by 4 users not shown)
Line 1: Line 1:
{{tempdoc}}<onlyinclude>
{{tempdoc}}<onlyinclude>
== Release-blocking environments (x86_64) ==
==== Release-blocking environments (x86_64) ====
{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! KDE
! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! KDE
|-
|-
| Alpha
| Basic
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
Line 11: Line 11:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
Line 18: Line 18:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
Line 25: Line 32:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
Line 32: Line 39:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha / Final
| Basic / Beta
| [[QA:Testcase package install remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic / Final
| [[QA:Testcase_base_artwork_release_identification]]
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
Line 40: Line 54:
|-
|-
| Final
| Final
| [[QA:Testcase_Services_start]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 63: Line 84:
<references/>
<references/>


== Release-blocking environments (ARM) ==
==== Release-blocking environments (ARM) ====
{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Xfce !! Minimal
! Milestone !! Test Case  !! Workstation !! Minimal
|-
|-
| Alpha
| Basic
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha / Final
| Basic / Beta
| [[QA:Testcase package install remove]]
| {{result|none}}
| {{result|none}}
|-
| Basic / Final
| [[QA:Testcase_base_artwork_release_identification]]
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
Line 93: Line 124:
|-
|-
| Final
| Final
| [[QA:Testcase_Services_start]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 110: Line 146:
<references/>
<references/>


== Non-blocking environments (x86_64) ==
==== Modularity ====
{| class="wikitable sortable collapsible" width=100%
 
! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar
{{admon/note|Environment|These tests should be run using DNF, in any release-blocking environment, on any release-blocking arch.}}
 
{| class="wikitable sortable mw-collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! Result
|-
| Beta
| [[QA:Testcase_Modularity_module_list]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Modularity_enable-disable_module]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Modularity_install_module]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Modularity_update_without_repos]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Modularity_update_module]]
| {{result|none}}
|-
|}
 
<references/>
 
==== Non-blocking environments (x86_64) ====
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar !! Silverblue
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 125: Line 194:
| Optional
| Optional
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 134: Line 214:
| Optional
| Optional
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 149: Line 230:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase package install remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 160: Line 253:
|-
|-
| Optional
| Optional
| [[QA:Testcase_Services_start]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 170: Line 274:
| Optional
| Optional
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 179: Line 284:
| Optional
| Optional
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 189: Line 295:
<references/>
<references/>


== Non-blocking environments (ARM) ==
==== Non-blocking environments (ARM) ====
{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar
! Milestone !! Test Case  !! !! Server !! Cloud !! Cinnamon !! Xfce !! MATE !! LXDE !! LXqt !! Sugar
|-
|-
| Optional
| Optional
Line 206: Line 312:
| Optional
| Optional
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 228: Line 345:
| Optional
| Optional
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase package install remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 249: Line 377:
|-
|-
| Optional
| Optional
| [[QA:Testcase_Services_start]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}

Revision as of 01:39, 3 March 2020

Template documentation [edit]

This documentation is transcluded from Template:Base test matrix/doc. It will not be transcluded on pages that use this template.
Warning.png
Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.
This template contains the Base 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Base validation test case, though, don't worry about that stuff, and put it in here.

Release-blocking environments (x86_64)

Milestone Test Case Workstation Server Cloud KDE
Basic QA:Testcase_base_initial_setup
none
none
Basic QA:Testcase_base_startup
none
none
none
Basic QA:Testcase_base_reboot_unmount
none
none
none
none
Basic QA:Testcase_base_system_logging
none
none
none
none
Basic QA:Testcase_base_update_cli
none
none
none
none
Basic / Beta QA:Testcase package install remove
none
none
none
none
Basic / Final QA:Testcase_base_artwork_release_identification
none
none
none
none
Final QA:Testcase_base_edition_self_identification
none
none
none
none
Final QA:Testcase_base_services_start
none
none
none
none
Final QA:Testcase_base_selinux
none
none
none
none
Final QA:Testcase_base_service_manipulation
none
none
none
none


Release-blocking environments (ARM)

Milestone Test Case Workstation Minimal
Basic QA:Testcase_base_initial_setup
none
none
Basic QA:Testcase_base_startup
none
none
Basic QA:Testcase_base_reboot_unmount
none
none
Basic QA:Testcase_base_system_logging
none
none
Basic QA:Testcase_base_update_cli
none
none
Basic / Beta QA:Testcase package install remove
none
none
Basic / Final QA:Testcase_base_artwork_release_identification
none
none
Final QA:Testcase_base_edition_self_identification
none
none
Final QA:Testcase_base_services_start
none
none
Final QA:Testcase_base_selinux
none
none
Final QA:Testcase_base_service_manipulation
none
none


Modularity

Note.png
Environment
These tests should be run using DNF, in any release-blocking environment, on any release-blocking arch.
Milestone Test Case Result
Beta QA:Testcase_Modularity_module_list
none
Beta QA:Testcase_Modularity_enable-disable_module
none
Beta QA:Testcase_Modularity_install_module
none
Beta QA:Testcase_Modularity_update_without_repos
none
Optional QA:Testcase_Modularity_update_module
none


Non-blocking environments (x86_64)

Milestone Test Case Xfce Cinnamon MATE LXDE LXqt Sugar Silverblue
Optional QA:Testcase_base_initial_setup
none
none
none
none
none
none
none
Optional QA:Testcase_base_startup
none
none
none
none
none
none
none
Optional QA:Testcase_base_reboot_unmount
none
none
none
none
none
none
none
Optional QA:Testcase_base_system_logging
none
none
none
none
none
none
none
Optional QA:Testcase_base_update_cli
none
none
none
none
none
none
none
Optional QA:Testcase package install remove
none
none
none
none
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
none
none
none
none
none
Optional QA:Testcase_base_edition_self_identification
none
none
none
none
none
none
none
Optional QA:Testcase_base_services_start
none
none
none
none
none
none
none
Optional QA:Testcase_base_selinux
none
none
none
none
none
none
none
Optional QA:Testcase_base_service_manipulation
none
none
none
none
none
none
none


Non-blocking environments (ARM)

Milestone Test Case Server Cloud Cinnamon Xfce MATE LXDE LXqt Sugar
Optional QA:Testcase_base_initial_setup
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_startup
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_reboot_unmount
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_system_logging
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_update_cli
none
none
none
none
none
none
none
none
Optional QA:Testcase package install remove
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_edition_self_identification
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_services_start
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_selinux
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_service_manipulation
none
none
none
none
none
none
none
none
Retrieved from "https://fedoraproject.org/w/index.php?title=Template:Base_test_matrix&oldid=567340"