Fedora 16 Final Release Criteria

From FedoraProject

(Difference between revisions)
Jump to: navigation, search
(copy 15 to 16, add a criterion previously proposed that fell through the cracks)
 
(add translations criterion as discussed at 2011-10-14 blocker review meeting and in thread "Release criteria priposal: i18n criteria")
 
(9 intermediate revisions by 2 users not shown)
Line 4: Line 4:
  
 
== Final Release Requirements ==
 
== Final Release Requirements ==
In order to be released to the general public, the Final Candidate (RC) must meet '''all''' of the following criteria.  This is intended to make the decision process as clear and straightforward as possible.  ''Mostly met'' items are ''incomplete'' until they are ''met.''  Optional and ''nice to have'' items should not be included in this list.
 
  
There may be times where a requirement is unmet only in a particular configuration, such as with some keyboard layouts but not others, or if a particular character is used in a username, password or passphrase. In such cases, the release team should use their judgment and refer to precedent to determine whether or not the issue should be considered to block the release. They should consider the number of users likely to be affected by the issue, the severity of the case when the issue is encountered, and the ease or otherwise with which the issue can be avoided by both informed and uninformed users.
+
{{Template:Release_criteria_preamble|prerelease=Final}}
  
 
Release Requirements:
 
Release Requirements:
Line 12: Line 11:
 
# All bugs blocking the [https://bugzilla.redhat.com/showdependencytree.cgi?id=f16blocker&hide_resolved=1 F16Blocker tracker] must be [[BugZappers/BugStatusWorkFlow#CLOSED|CLOSED]]
 
# All bugs blocking the [https://bugzilla.redhat.com/showdependencytree.cgi?id=f16blocker&hide_resolved=1 F16Blocker tracker] must be [[BugZappers/BugStatusWorkFlow#CLOSED|CLOSED]]
 
# The installer must be able to use all supported local and remote package source options
 
# The installer must be able to use all supported local and remote package source options
# The installer must be able to complete an installation using IDE, SATA, SCSI and iSCSI storage devices
+
# The installer must be able to complete an installation using any network-attached storage devices (e.g. iSCSI, FCoE, Fibre Channel)
 
# The installer must be able to create and install to any workable partition layout using any file system offered in a default installer configuration, LVM, software, hardware or BIOS RAID, or combination of the above
 
# The installer must be able to create and install to any workable partition layout using any file system offered in a default installer configuration, LVM, software, hardware or BIOS RAID, or combination of the above
 
# The installer must be able to install into free space alongside an existing clean single-partition Windows installation and either install a bootloader which can boot into the Windows installation, or leave the Windows bootloader untouched and working
 
# The installer must be able to install into free space alongside an existing clean single-partition Windows installation and either install a bootloader which can boot into the Windows installation, or leave the Windows bootloader untouched and working
 +
# The release must boot successfully as Xen DomU with releases providing a functional, supported Xen Dom0 and widely used cloud providers utilizing Xen. This does not include any issues limited to the release functioning as Xen Dom0
 
# All services in a default install must start properly
 
# All services in a default install must start properly
 +
# All [[Critical_path_package#Actions|critical path actions]] on release-blocking desktop environments should correctly display all sufficiently complete translations available for use
 
# In most cases, there must be no SELinux 'AVC: denied' messages or abrt crash notifications on initial boot and subsequent login (see [[Blocker_Bug_FAQ#Hardware_and_local_configuration_dependent_issues|Blocker_Bug_FAQ]])
 
# In most cases, there must be no SELinux 'AVC: denied' messages or abrt crash notifications on initial boot and subsequent login (see [[Blocker_Bug_FAQ#Hardware_and_local_configuration_dependent_issues|Blocker_Bug_FAQ]])
 
# All known bugs that can cause corruption of user data must be fixed or documented at [[Common F16 bugs]]
 
# All known bugs that can cause corruption of user data must be fixed or documented at [[Common F16 bugs]]
 
# The installed system must run normally if the user chooses to install without SELinux
 
# The installed system must run normally if the user chooses to install without SELinux
# Menu sanity - the following criteria refer to both a live image and default installed system
+
# Menu sanity - the following criteria refer to both a live image and default installed system, and to all release-blocking desktops
#* All ''Applications'' listed in the desktop menus must have icons which have a consistent appearance and sufficiently high resolution to avoid appearing blurry
+
#* All ''Applications'' listed in the system menus (or equivalent) must have icons which have a consistent appearance and sufficiently high resolution to avoid appearing blurry
 
#* All applications listed under the ''Applications'' menu or category must start successfully
 
#* All applications listed under the ''Applications'' menu or category must start successfully
 
#* All applications listed under the ''Applications'' menu or category must withstand a basic functionality test and not crash after a few minutes of normal use.  They must also have working ''Help'' and ''Help -> About'' menu items
 
#* All applications listed under the ''Applications'' menu or category must withstand a basic functionality test and not crash after a few minutes of normal use.  They must also have working ''Help'' and ''Help -> About'' menu items
 
#* No application may unintentionally appear twice in the menus. In particular, items under ''System'' must not appear under ''Applications''
 
#* No application may unintentionally appear twice in the menus. In particular, items under ''System'' must not appear under ''Applications''
# All elements of the default panel (or equivalent) configuration must function correctly in common use
+
# All elements of the default panel (or equivalent) configuration in all release-blocking desktops must function correctly in common use
# Saving passwords in the desktop default keyring (if the desktop implements one), and retrieving passwords from the keyring, must work
+
# Saving passwords in the desktop default keyring (if the desktop implements one), and retrieving passwords from the keyring, must work for all release-blocking desktops
 
# The proposed final Fedora artwork must be included and enabled by default for the installer, graphical boot, firstboot, graphical login and desktop background.  All Fedora artwork must be consistent with the proposed final theme, and if any artwork contains a graphical version number, the version number used must match the Fedora release number.  Generic release artwork (e.g. Alpha, Beta, Development) must not be used for the final release
 
# The proposed final Fedora artwork must be included and enabled by default for the installer, graphical boot, firstboot, graphical login and desktop background.  All Fedora artwork must be consistent with the proposed final theme, and if any artwork contains a graphical version number, the version number used must match the Fedora release number.  Generic release artwork (e.g. Alpha, Beta, Development) must not be used for the final release
# The final release notes from the Documentation team must be present in the release repository in packaged form
+
# A {{package|spin-kickstarts}} package which contains the exact kickstart files used to build the release must be present in the release repository. The included kickstarts must define the correct set of release repositories
 +
# The final branded release notes from the Documentation team must be present on ISO media and the appropriately versioned generic release notes must be available in the online release repository
 +
# A {{package|fedora-release}} package containing the correct names, information and repository configuration for a final Fedora release (as opposed to a pre-release) must be present on ISO media while the appropriately versioned {{package|generic-release}} package must be available in the online release repository
  
== Final Blocker Bugs ==
+
{{Template:Release_criteria_definition|prerelease=Final}}
A bug is considered a [https://bugzilla.redhat.com/showdependencytree.cgi?id=f16blocker&hide_resolved=1 Final Blocker Bug] if '''any''' of the following criteria are met:
+
* A bug in a [[Critical Path Packages|Critical Path package]] that: 
+
** Cannot be fixed with a future rawhide update
+
** Has a severity rating of ''high'' or greater and no reasonable workaround
+
* Bug hinders execution of required Final testplans or dramatically reduces test coverage
+
* Bug relates to an unmet Final Release Requirement (see above)
+
<!--
+
Specific requirements that ''must'' be present to release should be explicitly stated in the ''Release Requirements'' section
+
-->
+
  
 
== Contingency Plan ==
 
== Contingency Plan ==

Latest revision as of 21:14, 14 October 2011

Contents

[edit] Final Objectives

The objective of the Final release is to:

  1. Provide a polished final release suitable for meeting the needs of our Target Audience

[edit] Final Release Requirements

In order to be released to the general public, the Final Candidate (RC) must meet all of the following criteria. This is intended to make the decision process as clear and straightforward as possible. Mostly met items are incomplete until they are met. Optional and nice to have items should not be included in this list.

There may be times where a requirement is unmet only in a particular configuration, such as with some keyboard layouts but not others, or if a particular character is used in a username, password or passphrase. In such cases, the release team should use their judgement and refer to precedent to determine whether or not the issue should be considered to block the release. They should consider the number of users likely to be affected by the issue, the severity of the case when the issue is encountered, and the ease or otherwise with which the issue can be avoided by both informed and uninformed users.

The term 'release-blocking desktops' means all the desktop environments in which bugs are currently considered capable of blocking a Fedora release. The current set of release-blocking desktops for the x86 architectures is GNOME and KDE, and for the ARM architectures is KDE. Note that bugs in desktops that are not part of this set which would infringe these criteria automatically qualify for freeze exception status, according to the freeze exception bug process.

The term 'release-blocking images' means all the images in which bugs are currently considered capable of blocking a Fedora release. The current set of release-blocking images includes the images defined by the three primary Products - Server, Workstation and Cloud - in their product requirement documents and/or technical specifications, and the KDE live image.

Release Requirements:

  1. All Fedora 16 Beta Release Criteria must be met
  2. All bugs blocking the F16Blocker tracker must be CLOSED
  3. The installer must be able to use all supported local and remote package source options
  4. The installer must be able to complete an installation using any network-attached storage devices (e.g. iSCSI, FCoE, Fibre Channel)
  5. The installer must be able to create and install to any workable partition layout using any file system offered in a default installer configuration, LVM, software, hardware or BIOS RAID, or combination of the above
  6. The installer must be able to install into free space alongside an existing clean single-partition Windows installation and either install a bootloader which can boot into the Windows installation, or leave the Windows bootloader untouched and working
  7. The release must boot successfully as Xen DomU with releases providing a functional, supported Xen Dom0 and widely used cloud providers utilizing Xen. This does not include any issues limited to the release functioning as Xen Dom0
  8. All services in a default install must start properly
  9. All critical path actions on release-blocking desktop environments should correctly display all sufficiently complete translations available for use
  10. In most cases, there must be no SELinux 'AVC: denied' messages or abrt crash notifications on initial boot and subsequent login (see Blocker_Bug_FAQ)
  11. All known bugs that can cause corruption of user data must be fixed or documented at Common F16 bugs
  12. The installed system must run normally if the user chooses to install without SELinux
  13. Menu sanity - the following criteria refer to both a live image and default installed system, and to all release-blocking desktops
    • All Applications listed in the system menus (or equivalent) must have icons which have a consistent appearance and sufficiently high resolution to avoid appearing blurry
    • All applications listed under the Applications menu or category must start successfully
    • All applications listed under the Applications menu or category must withstand a basic functionality test and not crash after a few minutes of normal use. They must also have working Help and Help -> About menu items
    • No application may unintentionally appear twice in the menus. In particular, items under System must not appear under Applications
  14. All elements of the default panel (or equivalent) configuration in all release-blocking desktops must function correctly in common use
  15. Saving passwords in the desktop default keyring (if the desktop implements one), and retrieving passwords from the keyring, must work for all release-blocking desktops
  16. The proposed final Fedora artwork must be included and enabled by default for the installer, graphical boot, firstboot, graphical login and desktop background. All Fedora artwork must be consistent with the proposed final theme, and if any artwork contains a graphical version number, the version number used must match the Fedora release number. Generic release artwork (e.g. Alpha, Beta, Development) must not be used for the final release
  17. A Package-x-generic-16.pngspin-kickstarts package which contains the exact kickstart files used to build the release must be present in the release repository. The included kickstarts must define the correct set of release repositories
  18. The final branded release notes from the Documentation team must be present on ISO media and the appropriately versioned generic release notes must be available in the online release repository
  19. A Package-x-generic-16.pngfedora-release package containing the correct names, information and repository configuration for a final Fedora release (as opposed to a pre-release) must be present on ISO media while the appropriately versioned Package-x-generic-16.pnggeneric-release package must be available in the online release repository

[edit] Final Blocker Bugs

A bug is considered a Final blocker bug if any of the following criteria are met:

  • A bug in a Critical Path package that:
    • Cannot be fixed with a future stable update
    • Has a severity rating of high or greater and no reasonable workaround (see definition of severity and priority)
  • Bug hinders execution of required Final test plans or dramatically reduces test coverage
  • Bug relates to an unmet Final Release Requirement

A Fedora Change being incomplete, in and of itself, does not constitute a blocker bug. The Change process is separate from this process. Changes are required to meet certain standards at certain points of the release cycle, but this is part of the feature process and managed, tracked and enforced separately from this process. However, if a proposed feature being incomplete causes any of the above criteria to be met, then the bug is a release blocker.


[edit] Contingency Plan

  • If all of the Final Release Requirements are not met by 20:00 UTC on Tuesday the week prior to release day, the release will be delayed by one week so that the Final Release Requirements can be met.
  • One week will be added to all remaining tasks in the release schedule, including the final release date.
  • This decision will be made at the Go/No-Go Meeting.

[edit] Confirming Final Requirements

QA has the responsibility of determining whether the criteria for the release has been met (as outlined above) through discussion with Development and Release Engineering. QA's findings will be reviewed and discussed at the Go/No-Go Meeting.

[edit] Related Pages