From Fedora Project Wiki

(update_cli is Alpha, not Final)
(revise for split of artwork test, cover more environments including non-blocking ones: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org/message/XGWYB3GS5JZW7XNMXQ3ZVVMGWJZKK35C/)
Line 1: Line 1:
{{tempdoc}}<onlyinclude>
{{tempdoc}}<onlyinclude>
== Release-blocking environments (x86_64) ==
{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable collapsible" width=100%
! Milestone !! Test Case  !! Workstation !! Server !! KDE !! ARM !! Cloud
! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! KDE
|-
|-
| Alpha
| Alpha
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha / Final
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_Services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
== Release-blocking environments (ARM) ==
{| class="wikitable sortable collapsible" width=100%
! Milestone !! Test Case  !! Xfce !! Minimal
|-
| Alpha
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Alpha
Line 15: Line 76:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|-
| Alpha
| Alpha
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
|-
| Alpha / Final
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_Services_start]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
== Non-blocking environments (x86_64) ==
{| class="wikitable sortable collapsible" width=100%
! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar
|-
| Optional
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 27: Line 141:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Optional
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
 
== Non-blocking environments (ARM) ==
{| class="wikitable sortable collapsible" width=100%
! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar
|-
| Optional
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 35: Line 248:
| {{result|none}}
| {{result|none}}
|-
|-
| Final
| Optional
| [[QA:Testcase_Services_start]]
| [[QA:Testcase_Services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 43: Line 259:
| {{result|none}}
| {{result|none}}
|-
|-
| Final
| Optional
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 51: Line 270:
| {{result|none}}
| {{result|none}}
|-
|-
| Final
| Optional
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}

Revision as of 20:02, 26 April 2017

Template documentation [edit]

This documentation is transcluded from Template:Base test matrix/doc. It will not be transcluded on pages that use this template.
Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.
This template contains the Base 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Base validation test case, though, don't worry about that stuff, and put it in here.

Release-blocking environments (x86_64)

Milestone Test Case Workstation Server Cloud KDE
Alpha QA:Testcase_base_initial_setup
none
none
Alpha QA:Testcase_base_startup
none
none
none
Alpha QA:Testcase_base_system_logging
none
none
none
none
Alpha QA:Testcase_base_update_cli
none
none
none
none
Alpha / Final QA:Testcase_base_artwork_release_identification
none
none
none
none
Final QA:Testcase_Services_start
none
none
none
none
Final QA:Testcase_base_selinux
none
none
none
none
Final QA:Testcase_base_service_manipulation
none
none
none
none


Release-blocking environments (ARM)

Milestone Test Case Xfce Minimal
Alpha QA:Testcase_base_initial_setup
none
none
Alpha QA:Testcase_base_startup
none
none
Alpha QA:Testcase_base_system_logging
none
none
Alpha QA:Testcase_base_update_cli
none
none
Alpha / Final QA:Testcase_base_artwork_release_identification
none
none
Final QA:Testcase_Services_start
none
none
Final QA:Testcase_base_selinux
none
none
Final QA:Testcase_base_service_manipulation
none
none


Non-blocking environments (x86_64)

Milestone Test Case Xfce Cinnamon MATE LXDE LXqt Sugar
Optional QA:Testcase_base_initial_setup
none
none
none
none
none
none
Optional QA:Testcase_base_startup
none
none
none
none
none
none
Optional QA:Testcase_base_system_logging
none
none
none
none
none
none
Optional QA:Testcase_base_update_cli
none
none
none
none
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
none
none
none
none
Optional QA:Testcase_Services_start
none
none
none
none
none
none
Optional QA:Testcase_base_selinux
none
none
none
none
none
none
Optional QA:Testcase_base_service_manipulation
none
none
none
none
none
none


Non-blocking environments (ARM)

Milestone Test Case Workstation Server Cloud Cinnamon MATE LXDE LXqt Sugar
Optional QA:Testcase_base_initial_setup
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_startup
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_system_logging
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_update_cli
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
none
none
none
none
none
none
Optional QA:Testcase_Services_start
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_selinux
none
none
none
none
none
none
none
none
Optional QA:Testcase_base_service_manipulation
none
none
none
none
none
none
none
none