From Fedora Project Wiki

(moving update notification to Final per blocker review meeting decision today)
(add workstation-specific tests for ARM workstation table)
(16 intermediate revisions by 3 users not shown)
Line 2: Line 2:
==== Release-blocking desktops: '''x86 / x86_64''' ====
==== Release-blocking desktops: '''x86 / x86_64''' ====


{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! [[Workstation]] !! [[KDE]]
! Milestone !! Test Case  !! [[Workstation]] !! [[KDE]]
|-
|-
| Alpha
| Basic
| [[QA:Testcase_desktop_browser]]
| [[QA:Testcase_desktop_browser]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_desktop_terminal]]
| [[QA:Testcase_desktop_terminal]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_desktop_updates]] (installation)
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 46: Line 41:
|-
|-
| Beta
| Beta
| [[QA:Testcase_workstation_theming]]
| [[QA:Testcase_desktop_update_graphical]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Printing_New_Printer|QA:Testcase_Printing_New_Printer (real printer)]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Printing_New_Printer|QA:Testcase_Printing_New_Printer (virtual printer)]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|-
| Final
| Final
| [[QA:Testcase_desktop_updates]] (notification)
| [[QA:Testcase_desktop_update_notification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 74: Line 79:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_workstation_theming]]
| {{result|none}}
| style="background:lightgrey;"|
|-
|-
|}
|}
Line 80: Line 90:
==== Release-blocking desktops: '''ARM''' ====
==== Release-blocking desktops: '''ARM''' ====


{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! [[KDE]]
! Milestone !! Test Case  !! [[Workstation]]
|-
|-
| Alpha
| Basic
| [[QA:Testcase_desktop_browser]]
| [[QA:Testcase_desktop_browser]]
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_desktop_terminal]]
| [[QA:Testcase_desktop_terminal]]
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_desktop_updates]] (installation)
| {{result|none}}
| {{result|none}}
|-
|-
Line 112: Line 118:
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_updates]] (notification)
| [[QA:Testcase_workstation_core_applications]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_desktop_update_graphical]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Printing_New_Printer|QA:Testcase_Printing_New_Printer (real printer)]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Printing_New_Printer|QA:Testcase_Printing_New_Printer (virtual printer)]]
| {{result|none}}
|-
| Final
| [[QA:Testcase_desktop_update_notification]]
| {{result|none}}
| {{result|none}}
|-
|-
Line 129: Line 151:
| Final
| Final
| [[QA:Testcase_desktop_keyring]]
| [[QA:Testcase_desktop_keyring]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_workstation_theming]]
| {{result|none}}
| {{result|none}}
|-
|-
Line 136: Line 162:
==== Non release-blocking desktops: '''x86 / x86_64''' ====
==== Non release-blocking desktops: '''x86 / x86_64''' ====


{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case !! [[Xfce]] !! [[LXDE]] !! MATE !! Cinnamon !! GNOME Classic
! Milestone !! Test Case !! [[Xfce]] !! [[LXQt_SIG|LXQt]] !! [[LXDE]] !! MATE !! Cinnamon !! GNOME Classic !! Silverblue
|-
|-
| Alpha
| Basic
| [[QA:Testcase_desktop_browser]]
| [[QA:Testcase_desktop_browser]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 147: Line 175:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_desktop_terminal]]
| [[QA:Testcase_desktop_terminal]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 155: Line 185:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Beta
| [[QA:Testcase_desktop_updates]] (installation)
| [[QA:Testcase_desktop_login]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 164: Line 196:
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_login]]
| [[QA:Testcase_audio_basic]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_desktop_panel_basic]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 172: Line 216:
|-
|-
| Beta
| Beta
| [[QA:Testcase_audio_basic]]
| [[QA:Testcase_desktop_automount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_workstation_core_applications]]
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
| {{result|none}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_panel_basic]]
| [[QA:Testcase_desktop_update_graphical]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 188: Line 246:
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_automount]]
| [[QA:Testcase_Printing_New_Printer|QA:Testcase_Printing_New_Printer (real printer)]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 196: Line 256:
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_updates]] (notification)
| [[QA:Testcase_Printing_New_Printer|QA:Testcase_Printing_New_Printer (virtual printer)]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_desktop_update_notification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 205: Line 277:
| Final
| Final
| [[QA:Testcase_desktop_error_checks]]
| [[QA:Testcase_desktop_error_checks]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 213: Line 287:
| Final
| Final
| [[QA:Testcase_desktop_menus]]
| [[QA:Testcase_desktop_menus]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 221: Line 297:
| Final
| Final
| [[QA:Testcase_desktop_panel_advanced]]
| [[QA:Testcase_desktop_panel_advanced]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 229: Line 307:
| Final
| Final
| [[QA:Testcase_desktop_keyring]]
| [[QA:Testcase_desktop_keyring]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_workstation_theming]]
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
| {{result|none}}
|-
|-
Line 240: Line 330:
==== Non release-blocking desktops: '''ARM''' ====
==== Non release-blocking desktops: '''ARM''' ====


{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case !! [[Workstation]] !! [[Xfce]] !! [[LXDE]] !! MATE !! Cinnamon !! GNOME Classic
! Milestone !! Test Case !! [[KDE]] !! [[Xfce]] !! [[LXQt_SIG|LXQt]] !! [[LXDE]] !! MATE !! Cinnamon !! GNOME Classic !! Silverblue
|-
|-
| Alpha
| Basic
| [[QA:Testcase_desktop_browser]]
| [[QA:Testcase_desktop_browser]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 252: Line 344:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_desktop_terminal]]
| [[QA:Testcase_desktop_terminal]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 261: Line 355:
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Beta
| [[QA:Testcase_desktop_updates]] (installation)
| [[QA:Testcase_desktop_login]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 271: Line 367:
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_login]]
| [[QA:Testcase_audio_basic]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 280: Line 378:
|-
|-
| Beta
| Beta
| [[QA:Testcase_audio_basic]]
| [[QA:Testcase_desktop_panel_basic]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 289: Line 389:
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_panel_basic]]
| [[QA:Testcase_desktop_automount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 298: Line 400:
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_automount]]
| [[QA:Testcase_workstation_core_applications]]
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
|-
| Beta
| [[QA:Testcase_desktop_update_graphical]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 307: Line 422:
|-
|-
| Beta
| Beta
| [[QA:Testcase_desktop_updates]] (notification)
| [[QA:Testcase_Printing_New_Printer|QA:Testcase_Printing_New_Printer (real printer)]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 316: Line 433:
|-
|-
| Beta
| Beta
| [[QA:Testcase_workstation_core_applications]]
| [[QA:Testcase_Printing_New_Printer|QA:Testcase_Printing_New_Printer (virtual printer)]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_desktop_update_notification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
|-
| Final
| Final
| [[QA:Testcase_desktop_error_checks]]
| [[QA:Testcase_desktop_error_checks]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 335: Line 467:
| Final
| Final
| [[QA:Testcase_desktop_menus]]
| [[QA:Testcase_desktop_menus]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 344: Line 478:
| Final
| Final
| [[QA:Testcase_desktop_panel_advanced]]
| [[QA:Testcase_desktop_panel_advanced]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 353: Line 489:
| Final
| Final
| [[QA:Testcase_desktop_keyring]]
| [[QA:Testcase_desktop_keyring]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 360: Line 498:
| {{result|none}}
| {{result|none}}
|-
|-
| Final
| Optional
| [[QA:Testcase_workstation_theming]]
| [[QA:Testcase_workstation_theming]]
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
Line 368: Line 505:
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
|-
|-
|}
|}
Line 376: Line 516:
{{admon/note|Sugar test cases|The Sugar desktop differs significantly from a typical desktop, so it gets its own test cases. At present these live [http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases on the Sugar wiki].}}
{{admon/note|Sugar test cases|The Sugar desktop differs significantly from a typical desktop, so it gets its own test cases. At present these live [http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases on the Sugar wiki].}}


{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Test Case !! x86 !! ARM
! Test Case !! x86 !! ARM
|-
|-

Revision as of 01:56, 26 February 2020

Template documentation [edit]

This documentation is transcluded from Template:Desktop test matrix/doc. It will not be transcluded on pages that use this template.
Warning.png
Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.
This template contains the Desktop 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Desktop validation test case, though, don't worry about that stuff, and put it in here.

Release-blocking desktops: x86 / x86_64

Milestone Test Case Workstation KDE
Basic QA:Testcase_desktop_browser
none
none
Basic QA:Testcase_desktop_terminal
none
none
Beta QA:Testcase_desktop_login
none
none
Beta QA:Testcase_audio_basic
none
none
Beta QA:Testcase_desktop_panel_basic
none
none
Beta QA:Testcase_desktop_automount
none
none
Beta QA:Testcase_workstation_core_applications
none
Beta QA:Testcase_desktop_update_graphical
none
none
Beta QA:Testcase_Printing_New_Printer (real printer)
none
none
Beta QA:Testcase_Printing_New_Printer (virtual printer)
none
none
Final QA:Testcase_desktop_update_notification
none
none
Final QA:Testcase_desktop_error_checks
none
none
Final QA:Testcase_desktop_menus
none
none
Final QA:Testcase_desktop_panel_advanced
none
none
Final QA:Testcase_desktop_keyring
none
none
Optional QA:Testcase_workstation_theming
none


Release-blocking desktops: ARM

Milestone Test Case Workstation
Basic QA:Testcase_desktop_browser
none
Basic QA:Testcase_desktop_terminal
none
Beta QA:Testcase_desktop_login
none
Beta QA:Testcase_audio_basic
none
Beta QA:Testcase_desktop_panel_basic
none
Beta QA:Testcase_desktop_automount
none
Beta QA:Testcase_workstation_core_applications
none
Beta QA:Testcase_desktop_update_graphical
none
Beta QA:Testcase_Printing_New_Printer (real printer)
none
Beta QA:Testcase_Printing_New_Printer (virtual printer)
none
Final QA:Testcase_desktop_update_notification
none
Final QA:Testcase_desktop_error_checks
none
Final QA:Testcase_desktop_menus
none
Final QA:Testcase_desktop_panel_advanced
none
Final QA:Testcase_desktop_keyring
none
Optional QA:Testcase_workstation_theming
none


Non release-blocking desktops: x86 / x86_64

Milestone Test Case Xfce LXQt LXDE MATE Cinnamon GNOME Classic Silverblue
Basic QA:Testcase_desktop_browser
none
none
none
none
none
none
none
Basic QA:Testcase_desktop_terminal
none
none
none
none
none
none
none
Beta QA:Testcase_desktop_login
none
none
none
none
none
none
none
Beta QA:Testcase_audio_basic
none
none
none
none
none
none
none
Beta QA:Testcase_desktop_panel_basic
none
none
none
none
none
none
none
Beta QA:Testcase_desktop_automount
none
none
none
none
none
none
none
Beta QA:Testcase_workstation_core_applications
none
Beta QA:Testcase_desktop_update_graphical
none
none
none
none
none
none
none
Beta QA:Testcase_Printing_New_Printer (real printer)
none
none
none
none
none
none
none
Beta QA:Testcase_Printing_New_Printer (virtual printer)
none
none
none
none
none
none
none
Final QA:Testcase_desktop_update_notification
none
none
none
none
none
none
none
Final QA:Testcase_desktop_error_checks
none
none
none
none
none
none
none
Final QA:Testcase_desktop_menus
none
none
none
none
none
none
none
Final QA:Testcase_desktop_panel_advanced
none
none
none
none
none
none
none
Final QA:Testcase_desktop_keyring
none
none
none
none
none
none
none
Optional QA:Testcase_workstation_theming
none


Non release-blocking desktops: ARM

Milestone Test Case KDE Xfce LXQt LXDE MATE Cinnamon GNOME Classic Silverblue
Basic QA:Testcase_desktop_browser
none
none
none
none
none
none
none
none
Basic QA:Testcase_desktop_terminal
none
none
none
none
none
none
none
none
Beta QA:Testcase_desktop_login
none
none
none
none
none
none
none
none
Beta QA:Testcase_audio_basic
none
none
none
none
none
none
none
none
Beta QA:Testcase_desktop_panel_basic
none
none
none
none
none
none
none
none
Beta QA:Testcase_desktop_automount
none
none
none
none
none
none
none
none
Beta QA:Testcase_workstation_core_applications
none
Beta QA:Testcase_desktop_update_graphical
none
none
none
none
none
none
none
none
Beta QA:Testcase_Printing_New_Printer (real printer)
none
none
none
none
none
none
none
none
Beta QA:Testcase_Printing_New_Printer (virtual printer)
none
none
none
none
none
none
none
none
Final QA:Testcase_desktop_update_notification
none
none
none
none
none
none
none
none
Final QA:Testcase_desktop_error_checks
none
none
none
none
none
none
none
none
Final QA:Testcase_desktop_menus
none
none
none
none
none
none
none
none
Final QA:Testcase_desktop_panel_advanced
none
none
none
none
none
none
none
none
Final QA:Testcase_desktop_keyring
none
none
none
none
none
none
none
none
Optional QA:Testcase_workstation_theming
none


Sugar (non-blocking, all arches)

Note.png
Sugar test cases
The Sugar desktop differs significantly from a typical desktop, so it gets its own test cases. At present these live on the Sugar wiki.
Test Case x86 ARM
QA:Testcase_SoaS boots to the (name) selection screen
none
none
QA:Testcase_SoaS installed to hard disk with liveinst from root terminal
none
none
QA:Testcase_Jabber.sugarlabs.org should connect and display XO "Buddies"
none
none
QA:Testcase_When a USB storage device is inserted, it should show up in the Frame
none
none
QA:Testcase_Functions in My Settings (Sugar control panel)
none
none
QA:Testcase_Applications in the Home Screen
none
none
QA:Testcase_Sugar-desktop installed in another Desktop
none
none