User:Ankursinha/Workstation test outline

From FedoraProject

< User:Ankursinha(Difference between revisions)
Jump to: navigation, search
(Scope)
Line 9: Line 9:
 
The [[Workstation/Workstation_PRD]] - henceforth, "PRD" - defines the high-level aims of the Workstation product, and the [[Workstation/Technical_Specification]] - henceforth, "TS" - provides technical detail on its design. Significant points include:
 
The [[Workstation/Workstation_PRD]] - henceforth, "PRD" - defines the high-level aims of the Workstation product, and the [[Workstation/Technical_Specification]] - henceforth, "TS" - provides technical detail on its design. Significant points include:
  
* The product will be delivered as "A network installation media (either a traditional netinst.iso or a boot.fedoraproject.org style)" and "A local installation media providing the default package set as well as any featured roles that are meaningfully installed without a network connection." ([[Workstation/Technical_Specification#Supported_Architectures_and_Install_Media|TS]])
+
* The product will be delivered as a local live install media, with USB sticks as the primary target. The image will also be burnable on to DVDs. Persistence is not an important requirement. gnome-disks, liveusb-creator need to be tested to check creation of EFI compatible USB sticks on both Windows and Linux ([[Workstation/Technical_Specification#Installation_Methods_and_Media|TS]])
 
* The product will use [[Anaconda]] as its deployment mechanism (implicit in the TS)
 
* The product will use [[Anaconda]] as its deployment mechanism (implicit in the TS)
* The product's default storage configuration will be XFS-on-LVM, which differs from at least the Workstation product ([[Workstation/Technical_Specification#File_system|TS]])
+
* The product's default storage configuration will be btrfs. However, until btrfs is deemed mature enough, the product will continue to use the current configuration: ext4 ([[Workstation/Technical_Specification#File_system|TS]])
 
* The product will be built on top of the [[Base]] WG's output (part of overall Fedora.next plan)
 
* The product will be built on top of the [[Base]] WG's output (part of overall Fedora.next plan)
* A concept of "featured server roles" is defined: "A Featured Workstation role is an installable component of Fedora Workstation that provides a well-integrated service on top of the Fedora Workstation platform." It is mentioned that these "featured" roles will be tested: "Initially, we will test and support only a single role per server..." A set of "Mandatory Requirements" is defined for these "featured" roles; it is reasonable to deduce that we must test the "featured" roles meet these "Mandatory" requirements. ([[Workstation/Workstation_PRD#Featured_Workstation_Roles|Workstation_PRD]])
+
* The PRD/Technical spec does not cover installation methods.
* Scripted and interactive installations are both considered supported, and in-place upgrades. ([[Workstation/Workstation_PRD#Delivery_Mechanisms|Workstation_PRD]])
+
* The product will be based on the GNOME desktop environment. ([[Workstation/Technical_Specification#Core_Services_and_Features|TS]])
* Workstation role deployment is supported both during installation and post-install. ([[Workstation/Workstation_PRD#Delivery_Mechanisms|Workstation_PRD]])
+
* A core package set will be focussed on. This includes but is not limited to gdm, gnome-initial-setup, firefox, gnome-terminal, gnome-boxes, nautilus, developer assistant ([[Workstation/Technical_Specification#Core_Package_list|TS]])
* No graphical environment is considered to be a part of the Workstation product. ([[Workstation/Technical_Specification#Graphics_and_Display_Manager|TS]])
+
 
* Various requirements for the base system are documented in the [[Workstation/Technical_Specification#Core_Services_and_Features|TS]], several of which are likely to be held in common with the other Products and current Fedora, but some of which are specific to Workstation.
 
* Various requirements for the base system are documented in the [[Workstation/Technical_Specification#Core_Services_and_Features|TS]], several of which are likely to be held in common with the other Products and current Fedora, but some of which are specific to Workstation.
  

Revision as of 13:15, 28 April 2014

Note.png
Draft only
This document is only a draft

Objective

This document aims to establish what testing is necessary to ensure the milestone releases of the Fedora Workstation product meet the desired levels of quality.

Scope

The Workstation/Workstation_PRD - henceforth, "PRD" - defines the high-level aims of the Workstation product, and the Workstation/Technical_Specification - henceforth, "TS" - provides technical detail on its design. Significant points include:

  • The product will be delivered as a local live install media, with USB sticks as the primary target. The image will also be burnable on to DVDs. Persistence is not an important requirement. gnome-disks, liveusb-creator need to be tested to check creation of EFI compatible USB sticks on both Windows and Linux (TS)
  • The product will use Anaconda as its deployment mechanism (implicit in the TS)
  • The product's default storage configuration will be btrfs. However, until btrfs is deemed mature enough, the product will continue to use the current configuration: ext4 (TS)
  • The product will be built on top of the Base WG's output (part of overall Fedora.next plan)
  • The PRD/Technical spec does not cover installation methods.
  • The product will be based on the GNOME desktop environment. (TS)
  • A core package set will be focussed on. This includes but is not limited to gdm, gnome-initial-setup, firefox, gnome-terminal, gnome-boxes, nautilus, developer assistant (TS)
  • Various requirements for the base system are documented in the TS, several of which are likely to be held in common with the other Products and current Fedora, but some of which are specific to Workstation.

Proposed test coverage

It is reasonable to assume that most of our existing Fedora_Release_Criteria, with the exception of those specifically relating to desktop functionality, will be held to apply to the Workstation product. It is therefore equally reasonable to assume that our existing QA:Installation_validation_testing and QA:Base_validation_testing processes will apply to the Workstation product, and the corresponding test plans ('test matrices') will need to be run for each milestone release of the Workstation product.

We will also require additional Workstation-specific testing to fully validate the product for release. Testing the "server roles" will form the majority of this work. The mechanisms for deploying and configuring server roles both during installation and after installation will need to be tested. All of the "featured" roles for any given release will also need to be tested to ensure they meet the "mandatory requirements" defined in the Workstation_PRD.

Beyond this, additional "Base validation" type tests are likely to be required to validate all the commitments of the TS which are not currently explicitly tested, e.g. the requirements for remote logging and remote updating, the requirements relating to firewall functionality, and so forth. Some of these tests may be shared with the other products and deliverables.