F18FinalPPC checklist

From FedoraProject

(Difference between revisions)
Jump to: navigation, search
(Final Release Requirements)
(Final Release Requirements)
 
(7 intermediate revisions by 3 users not shown)
Line 14: Line 14:
 
| 2 || All bugs blocking the [https://bugzilla.redhat.com/showdependencytree.cgi?id=f18blocker&hide_resolved=1 F18Blocker tracker] must be [[BugZappers/BugStatusWorkFlow#CLOSED|CLOSED]] || pknirsch || {{result|pass}} ||  
 
| 2 || All bugs blocking the [https://bugzilla.redhat.com/showdependencytree.cgi?id=f18blocker&hide_resolved=1 F18Blocker tracker] must be [[BugZappers/BugStatusWorkFlow#CLOSED|CLOSED]] || pknirsch || {{result|pass}} ||  
 
|-
 
|-
| 3 || If there is an embedded checksum in the image, it must match. If there is a related UI element displayed after booting the image, it must work and display the correct result || dwa || {{result|pass}}RC2.2 {{result|pass}}RC4 ||
+
| 3 || If there is an embedded checksum in the image, it must match. If there is a related UI element displayed after booting the image, it must work and display the correct result || dwa || {{result|pass}}RC2.2 {{result|pass}}RC4 {{result|pass}}RC5||
 
|-
 
|-
 
| 4 || <strike>The release live images must properly support mounting and using a persistent storage overlay for the entire system and/or one for the /home partition, if such an overlay or overlays have been correctly written to the medium from which the image is booted </strike>|| || ||
 
| 4 || <strike>The release live images must properly support mounting and using a persistent storage overlay for the entire system and/or one for the /home partition, if such an overlay or overlays have been correctly written to the medium from which the image is booted </strike>|| || ||
Line 20: Line 20:
 
| 5 || The installer must be able to use all supported local and remote package source options || brent/hamzy || {{result|pass|baude}} ||
 
| 5 || The installer must be able to use all supported local and remote package source options || brent/hamzy || {{result|pass|baude}} ||
 
|-
 
|-
| 6 || The installer must be able to complete an installation using any network-attached storage devices (e.g. iSCSI, FCoE, Fibre Channel) || brent/hamzy || ||
+
| 6 || The installer must be able to complete an installation using any network-attached storage devices (e.g. iSCSI, FCoE, Fibre Channel) || brent/hamzy || {{result|pass|baude}} ||
 
|-
 
|-
 
| 7 || The installer must be able to complete an installation using all supported interfaces || brent/hamzy || {{result|pass|baude}} ||
 
| 7 || The installer must be able to complete an installation using all supported interfaces || brent/hamzy || {{result|pass|baude}} ||
 
|-
 
|-
| 8 || The installer must be able to create and install to any workable partition layout using any file system offered in a default installer configuration, LVM, software, hardware or BIOS RAID, or combination of the above || karsten || {{result|inprogress|karsten}}|| {{result|pass|encrypted LVM}}
+
| 8 || The installer must be able to create and install to any workable partition layout using any file system offered in a default installer configuration, LVM, software, hardware or BIOS RAID, or combination of the above || karsten || {{result|pass|karsten}}|| {{result|pass|encrypted LVM}} {{result|pass|Standard Partition}} {{result|pass|BTRFS}} {{result|warn|Software RAID only available in Kickstart}}
 
|-
 
|-
 
| 9 || <strike> The installer must be able to install into free space alongside an existing clean single-partition Windows installation and either install a bootloader which can boot into the Windows installation, or leave the Windows bootloader untouched and working</strike> || || ||
 
| 9 || <strike> The installer must be able to install into free space alongside an existing clean single-partition Windows installation and either install a bootloader which can boot into the Windows installation, or leave the Windows bootloader untouched and working</strike> || || ||
Line 30: Line 30:
 
|10 || The installer must be able to use an [[Anaconda/Updates|installer update image]] retrieved from removable media, remote installation source and HTTP server || brent ||{{result|pass|baude}}  ||
 
|10 || The installer must be able to use an [[Anaconda/Updates|installer update image]] retrieved from removable media, remote installation source and HTTP server || brent ||{{result|pass|baude}}  ||
 
|-
 
|-
|11 || For each one of the release-blocking package sets ('minimal', and the package sets for each one of the release-blocking desktops), it must be possible to successfully complete an upgrade from a fully updated installation of the previous stable Fedora release with that package set installed, using all officially recommended upgrade mechanisms. The upgraded system must meet all release criteria || karsten || {{result|inprogress|karsten}} || {{result|pass|KDE}} {{result|inprogress|dwa}}minimal
+
|11 || For each one of the release-blocking package sets ('minimal', and the package sets for each one of the release-blocking desktops), it must be possible to successfully complete an upgrade from a fully updated installation of the previous stable Fedora release with that package set installed, using all officially recommended upgrade mechanisms. The upgraded system must meet all release criteria || karsten || {{result|pass|karsten}} || {{result|pass|KDE}} {{result|pass|dwa}}minimal {{result|pass|GNOME}}
 
|-
 
|-
 
|12 || <strike>The release must boot successfully as Xen DomU with releases providing a functional, supported Xen Dom0 and widely used cloud providers utilizing Xen. This does not include any issues limited to the release functioning as Xen Dom0</strike> || || ||
 
|12 || <strike>The release must boot successfully as Xen DomU with releases providing a functional, supported Xen Dom0 and widely used cloud providers utilizing Xen. This does not include any issues limited to the release functioning as Xen Dom0</strike> || || ||
 
|-
 
|-
|13 || All services in a default install must start properly || karsten || {{result|pass}} ||
+
|13 || All services in a default install must start properly || karsten || {{result|pass|karsten}} ||
 
|-
 
|-
|14 || All [[Critical_path_package#Actions|critical path actions]] on release-blocking desktop environments should correctly display all sufficiently complete translations available for use || karsten || {{result|pass}} || {{result|pass|GNOME}} {{result|pass|KDE}}
+
|14 || All [[Critical_path_package#Actions|critical path actions]] on release-blocking desktop environments should correctly display all sufficiently complete translations available for use || karsten || {{result|pass|karsten}} || {{result|pass|GNOME}} {{result|pass|KDE}}
 
|-
 
|-
 
|15 || In most cases, there must be no SELinux 'AVC: denied' messages or abrt crash notifications on initial boot and subsequent login (see [[Blocker_Bug_FAQ#Hardware_and_local_configuration_dependent_issues|Blocker_Bug_FAQ]]) || karsten || {{result|pass}} ||
 
|15 || In most cases, there must be no SELinux 'AVC: denied' messages or abrt crash notifications on initial boot and subsequent login (see [[Blocker_Bug_FAQ#Hardware_and_local_configuration_dependent_issues|Blocker_Bug_FAQ]]) || karsten || {{result|pass}} ||
Line 44: Line 44:
 
| || Menu sanity - the following criteria refer to both a live image and default installed system, and to all release-blocking desktops: || || ||
 
| || Menu sanity - the following criteria refer to both a live image and default installed system, and to all release-blocking desktops: || || ||
 
|-
 
|-
|18 || * All ''Applications'' listed in the system menus (or equivalent) must have icons which have a consistent appearance and sufficiently high resolution to avoid appearing blurry || karsten || {{result|pass}} || {{result|pass|GNOME}} {{result|pass|KDE}}
+
|18 || * All ''Applications'' listed in the system menus (or equivalent) must have icons which have a consistent appearance and sufficiently high resolution to avoid appearing blurry || karsten || {{result|pass|karsten}} || {{result|pass|GNOME}} {{result|pass|KDE}}
 
|-
 
|-
|19 || * All applications listed under the ''Applications'' menu or category must start successfully || karsten || {{result|inprogress|karsten}} || {{result|pass|GNOME}} {{result|fail|KDE: qtwebkit segfaults|893447}}
+
|19 || * All applications listed under the ''Applications'' menu or category must start successfully || karsten || {{result|pass|karsten}} || {{result|pass|GNOME}} {{result|pass|KDE}}
 
|-
 
|-
|20 || * All applications listed under the ''Applications'' menu or category must withstand a basic functionality test and not crash after a few minutes of normal use.  They must also have working ''Help'' and ''Help -> About'' menu items || karsten || {{result|pass}} || {{result|pass|GNOME}} {{result|pass|KDE|893447}}
+
|20 || * All applications listed under the ''Applications'' menu or category must withstand a basic functionality test and not crash after a few minutes of normal use.  They must also have working ''Help'' and ''Help -> About'' menu items || karsten || {{result|pass|karsten}} || {{result|pass|GNOME}} {{result|pass|KDE|893447}}  
 
|-
 
|-
|21 || * No application may unintentionally appear twice in the menus. In particular, items under ''System'' must not appear under ''Applications'' || karsten || {{result|pass}} || {{result|pass|GNOME}} {{result|pass|KDE}}
+
|21 || * No application may unintentionally appear twice in the menus. In particular, items under ''System'' must not appear under ''Applications'' || karsten || {{result|pass|karsten}} || {{result|pass|GNOME}} {{result|pass|KDE}}
 
|-
 
|-
|22 || All elements of the default panel (or equivalent) configuration in all release-blocking desktops must function correctly in common use || karsten || {{result|inprogress|karsten}} || {{result|pass|GNOME}} {{result|fail|KDE: qtwebkit segfaults|893447}}
+
|22 || All elements of the default panel (or equivalent) configuration in all release-blocking desktops must function correctly in common use || karsten || {{result|pass|karsten}} || {{result|pass|GNOME}} {{result|pass|KDE}}
 
|-
 
|-
|23 || Saving passwords in the desktop default keyring (if the desktop implements one), and retrieving passwords from the keyring, must work for all release-blocking desktops || pknirsch || || {{result|fail|gnome-keyring-daemon segfaults|893162}} {{result|pass|KDE/kwallet}}
+
|23 || Saving passwords in the desktop default keyring (if the desktop implements one), and retrieving passwords from the keyring, must work for all release-blocking desktops || pknirsch || {{result|pass|karsten}} || {{result|pass|GNOME/gnome-keyring}} {{result|pass|KDE/kwallet}}
 
|-
 
|-
 
|24 || The proposed final Fedora artwork must be included and enabled by default for all graphical bootloaders and the desktop background. All Fedora artwork must be consistent with the proposed final theme || gustavold || {{result|pass}} ||
 
|24 || The proposed final Fedora artwork must be included and enabled by default for all graphical bootloaders and the desktop background. All Fedora artwork must be consistent with the proposed final theme || gustavold || {{result|pass}} ||

Latest revision as of 14:46, 15 January 2013

Contents

[edit] Final Objectives

The objective of the Final release is to:

  1. Provide a polished final release suitable for meeting the needs of our Target Audience

[edit] Final Release Requirements

In order to be released to the general public, the Final Candidate (RC) must meet all of the following criteria. This is intended to make the decision process as clear and straightforward as possible. Mostly met items are incomplete until they are met. Optional and nice to have items should not be included in this list.

There may be times where a requirement is unmet only in a particular configuration, such as with some keyboard layouts but not others, or if a particular character is used in a username, password or passphrase. In such cases, the release team should use their judgement and refer to precedent to determine whether or not the issue should be considered to block the release. They should consider the number of users likely to be affected by the issue, the severity of the case when the issue is encountered, and the ease or otherwise with which the issue can be avoided by both informed and uninformed users.

The term 'release-blocking desktops' means all the desktop environments in which bugs are currently considered capable of blocking a Fedora release. The current set of release-blocking desktops for the x86 architectures is GNOME and KDE, and for the ARM architectures is KDE. Note that bugs in desktops that are not part of this set which would infringe these criteria automatically qualify for freeze exception status, according to the freeze exception bug process.

The term 'release-blocking images' means all the images in which bugs are currently considered capable of blocking a Fedora release. The current set of release-blocking images includes the network install image, the DVD image, and the live images for each of the release-blocking desktops.

Number Requirements Owner Status Comments
1 All Fedora 18 Beta Release Criteria must be met dwa/pknirsch
Pass pass dwa
RC4
Mainly tested releng related items, installer & system items are mostly covered by the rest of the checklist.
2 All bugs blocking the F18Blocker tracker must be CLOSED pknirsch
Pass pass
3 If there is an embedded checksum in the image, it must match. If there is a related UI element displayed after booting the image, it must work and display the correct result dwa
Pass pass
RC2.2
Pass pass
RC4
Pass pass
RC5
4 The release live images must properly support mounting and using a persistent storage overlay for the entire system and/or one for the /home partition, if such an overlay or overlays have been correctly written to the medium from which the image is booted
5 The installer must be able to use all supported local and remote package source options brent/hamzy
Pass pass baude
6 The installer must be able to complete an installation using any network-attached storage devices (e.g. iSCSI, FCoE, Fibre Channel) brent/hamzy
Pass pass baude
7 The installer must be able to complete an installation using all supported interfaces brent/hamzy
Pass pass baude
8 The installer must be able to create and install to any workable partition layout using any file system offered in a default installer configuration, LVM, software, hardware or BIOS RAID, or combination of the above karsten
Pass pass karsten
Pass pass encrypted LVM
Pass pass Standard Partition
Pass pass BTRFS
Warning warn Software RAID only available in Kickstart
9 The installer must be able to install into free space alongside an existing clean single-partition Windows installation and either install a bootloader which can boot into the Windows installation, or leave the Windows bootloader untouched and working
10 The installer must be able to use an installer update image retrieved from removable media, remote installation source and HTTP server brent
Pass pass baude
11 For each one of the release-blocking package sets ('minimal', and the package sets for each one of the release-blocking desktops), it must be possible to successfully complete an upgrade from a fully updated installation of the previous stable Fedora release with that package set installed, using all officially recommended upgrade mechanisms. The upgraded system must meet all release criteria karsten
Pass pass karsten
Pass pass KDE
Pass pass dwa
minimal
Pass pass GNOME
12 The release must boot successfully as Xen DomU with releases providing a functional, supported Xen Dom0 and widely used cloud providers utilizing Xen. This does not include any issues limited to the release functioning as Xen Dom0
13 All services in a default install must start properly karsten
Pass pass karsten
14 All critical path actions on release-blocking desktop environments should correctly display all sufficiently complete translations available for use karsten
Pass pass karsten
Pass pass GNOME
Pass pass KDE
15 In most cases, there must be no SELinux 'AVC: denied' messages or abrt crash notifications on initial boot and subsequent login (see Blocker_Bug_FAQ) karsten
Pass pass
16 All known bugs that can cause corruption of user data must be fixed or documented at Common F18 bugs pknirsch
Pass pass pknirsch
Currently no known additional data corruptors on Power SA
Menu sanity - the following criteria refer to both a live image and default installed system, and to all release-blocking desktops:
18 * All Applications listed in the system menus (or equivalent) must have icons which have a consistent appearance and sufficiently high resolution to avoid appearing blurry karsten
Pass pass karsten
Pass pass GNOME
Pass pass KDE
19 * All applications listed under the Applications menu or category must start successfully karsten
Pass pass karsten
Pass pass GNOME
Pass pass KDE
20 * All applications listed under the Applications menu or category must withstand a basic functionality test and not crash after a few minutes of normal use. They must also have working Help and Help -> About menu items karsten
Pass pass karsten
Pass pass GNOME
Pass pass KDE [1]
21 * No application may unintentionally appear twice in the menus. In particular, items under System must not appear under Applications karsten
Pass pass karsten
Pass pass GNOME
Pass pass KDE
22 All elements of the default panel (or equivalent) configuration in all release-blocking desktops must function correctly in common use karsten
Pass pass karsten
Pass pass GNOME
Pass pass KDE
23 Saving passwords in the desktop default keyring (if the desktop implements one), and retrieving passwords from the keyring, must work for all release-blocking desktops pknirsch
Pass pass karsten
Pass pass GNOME/gnome-keyring
Pass pass KDE/kwallet
24 The proposed final Fedora artwork must be included and enabled by default for all graphical bootloaders and the desktop background. All Fedora artwork must be consistent with the proposed final theme gustavold
Pass pass
25 No notices or alerts about pre-release status should be present gustavold/dwa
Pass pass
Pass pass dwa
26 The release must contain no known security bugs of 'important' or higher impact according to the Red Hat severity classification scale which cannot be satisfactorily resolved by a package update (e.g. issues during installation)" gustavold
Pass pass dwa
primary says we're good
27 A Package-x-generic-16.pngspin-kickstarts package which contains the exact kickstart files used to build the release must be present in the release repository. The included kickstarts must define the correct set of release repositories
28 The final branded release notes from the Documentation team must be present on ISO media and the appropriately versioned generic release notes must be available in the online release repository dwa / gustavold
Pass pass dwa
RC4
29 A Package-x-generic-16.pngfedora-release package containing the correct names, information and repository configuration for a final Fedora release (as opposed to a pre-release) must be present on ISO media while the appropriately versioned Package-x-generic-16.pnggeneric-release package must be available in the online release repository dwa /gustavold
Pass pass dwa
RC4
  1. RHBZ #893447

[edit] Final Blocker Bugs

A bug is considered a Final blocker bug if any of the following criteria are met:

  • A bug in a Critical Path package that:
    • Cannot be fixed with a future stable update
    • Has a severity rating of high or greater and no reasonable workaround (see definition of severity and priority)
  • Bug hinders execution of required Final test plans or dramatically reduces test coverage
  • Bug relates to an unmet Final Release Requirement

A Fedora feature being incomplete, in and of itself, does not constitute a blocker bug. The feature process is separate from this process. Features are required to meet certain standards at certain points of the release cycle, but this is part of the feature process and managed, tracked and enforced separately from this process. However, if a proposed feature being incomplete causes any of the above criteria to be met, then the bug is a release blocker.


[edit] Key

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result Explanation Code Entered
none
Untested - This test has not been run, and is available for anyone to contribute feedback. {{result|none}}
Pass pass robatino
Passed - The test has been run and the tester determine the test met the expected results {{result|pass|robatino}}
Inprogress inprogress adamwill
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. {{result|inprogress|adamwill}}
Fail fail jlaska [1] [2]
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information.
  1. RHBZ #XYZ
  2. RHBZ #ZXY
{{result|fail|jlaska|XYZ|ZXY}}
Warning warn rhe
[1]
Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention.
  1. Brief description about the warning status
{{result|warn|rhe}} <ref>Brief description about the warning status</ref>
Pass pass newgle1
Warning warn kparal
Multiple results - More people can easily provide results to a single test case. {{result|pass|newgle1}} {{result|warn|kparal}}

[edit] Contingency Plan

  • If all of the Final Release Requirements are not met by 20:00 UTC on Tuesday the week prior to release day, the release will be delayed by one week so that the Final Release Requirements can be met.
  • One week will be added to all remaining tasks in the release schedule, including the final release date.

[edit] Related Pages