From Fedora Project Wiki

(Priority)
(Priority)
Line 51: Line 51:
  
 
This is the explanation of priority for test cases.
 
This is the explanation of priority for test cases.
This test plan will use a 3 '''tier''' classification for test execution priority.
 
  
 
Tier1 is intended to verify that installation is possible on common hardware using common use cases.  Verification includes:
 
Tier1 is intended to verify that installation is possible on common hardware using common use cases.  Verification includes:

Revision as of 07:43, 15 June 2009

This page is intended to record QA/TestPlans/Fedora12Install test results for the FIXME milestone.

Instructions

What To Test

This page tracks test results against Fedora 12 Release Candidate builds. Test results against earlier Fedora 12 milestones can be found at Releases/12/Schedule.

Testing with Releases/Rawhide is recommended for tests that do not require the use of physical media (e.g. DVD or CD images).

Physical media can be found at FIXME

Post Test Results

Want to share information about something you tested?

  1. Please select and test the test cases that best matche your test environment.
  2. Edit test result page by adding your test results according to this Test Result Template.Here are some references of F11 test results
  3. If a defect occurs, add a link to the reported bug using the syntax: <ref>[[rhbug:12345]] - failure to detect foo</ref>
Note.png
One install, multiple results
One install may successfully execute multiple test cases. For example, booting a DVD to perform a DVD upgrade from the previous Fedora release actually executes 3 tests:
  1. QA/TestCases/BootMethodsDvd
  2. QA/TestCases/InstallSourceDvd
  3. QA:Testcase_Anaconda_Upgrade_New_Bootloader

Add or Remove a Test Case

  1. Please request review for your changes by publishing your test case for review to fedora-test-list.
  2. Once reviewed, make your changes to this document
  3. Finally, update QA:Fedora_12_Install_Results_Template with the same changes.

Key

Please use the following format when posting results to this page

Example Explanation
Untested
USERNAME Indicates an inprogress or test that needs further review
USERNAME Indicates a test that has passed
USERNAME Indicates a failed test ... see Notes/Bug(s) for details
Unsupported configuration

Priority

This is the explanation of priority for test cases.

Tier1 is intended to verify that installation is possible on common hardware using common use cases. Verification includes:

  • Common boot media
  • Common Installation source
  • Installation using defaults installation options
  • Default Partitioning

Tier2 takes a step further to include more use cases. Tier2 verification consists of:

  • All boot media
  • All installation sources
  • All kickstart delivery methods
  • Some architecture specific verification

Tier3 captures the remaining identified use cases:

  • More exhaustive partitioning schemes
  • More complex networking scenarios
  • More architecture specific verification
  • Network device
  • Storage device
  • Upgrade testing


Priority Explanation
1 Tier1,high priority
2 Tier2,medium priority
3 Tier3,low priority

Test Areas

Image Sanity Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
2 QA:Testcase_Mediakit_ISO_Size
1 QA:Testcase_Mediakit_ISO_Checksums
3 QA:Testcase_Mediakit_Repoclosure
3 QA:Testcase_Mediakit_FileConflicts

Boot Methods Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
3 QA/TestCases/BootMethodsBootIso
1 QA/TestCases/BootMethodsCdrom
1 QA/TestCases/BootMethodsDvd
2 QA:Testcases_Installer_Boot_Methods_Netboot_(ppc)
1 QA/TestCases/BootMethodsPxeboot
3 QA/TestCases/BootMethodsXenParaVirt
3 QA/TestCases/BootMethodsKVM
2 QA:Testcase_efidisk.img

Installation Source Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
2 QA/TestCases/InstallSourceHttp
2 QA/TestCases/InstallSourceNfs
2 QA/TestCases/InstallSourceNfsIso
1 QA/TestCases/InstallSourceCdrom
1 QA/TestCases/InstallSourceDvd
3 QA/TestCases/InstallSourceFtpAnonymous
3 QA/TestCases/InstallSourceFtpNonAnonymous
3 QA/TestCases/InstallSourceHardDrive
1 QA:TestCases/Install Source Live Image

Kickstart Delivery Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
3 QA/TestCases/KickstartKsFilePathKsCfg
3 QA/TestCases/KickstartKsHdDevicePathKsCfg
1 QA/TestCases/KickstartKsHttpServerKsCfg
2 QA/TestCases/KickstartKsNfsServerPathKsCfg

Package Sets Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
1 QA/TestCases/PackageSetsDefaultPackageInstall
2 QA/TestCases/PackageSetsMinimalPackageInstall

Partitioning Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
1 QA:Testcase_Anaconda_autopart_install
2 QA:Testcase_Anaconda_autopart_(encrypted)_install
2 QA:Testcase_Anaconda_autopart_(shrink)_install
2 QA:Testcase_Anaconda_autopart_(use_free_space)_install
1 QA/TestCases/PartitioningExt4OnNativeDevice
2 QA/TestCases/PartitioningExt3OnNativeDevice
3 QA/TestCases/PartitioningExt2OnNativeDevice
1 QA/TestCases/PartitioningRootfsOnLvmDevice
1 QA/TestCases/PartitioningRootfsOnRaid1
3 QA/TestCases/PartitioningNoSwap
2 QA/TestCases/PartitioningRaid0OnLvmDevice
2 QA/TestCases/PartitioningSwapOnLvmDevice
1 QA/TestCases/PartitioningUninitializedDisks
2 QA/TestCases/PartitioningUsrOnRaid0
2 QA/TestCases/PartitioningUsrOnRaid5
3 QA/TestCases/PartitioningUsrOnRaid6
2 QA/TestCases/PartitioningPreExistingLvm2Lvm2
2 QA/TestCases/PartitioningPreExistingRaidRaid

Recovery Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
1 QA:Testcase_Anaconda_rescue_mode
3 QA:Testcase_Anaconda_updates.img_via_URL
3 QA:Testcase_Anaconda_updates.img_via_installation_source
3 QA:Testcase_Anaconda_updates.img_via_local_media
3 QA:Testcases Anaconda save traceback to remote system
3 QA:Testcases Anaconda save traceback to bugzilla
3 QA:Testcases Anaconda save traceback to disk
2 QA:Testcases Anaconda traceback debug mode

Storage Devices Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
2 QA/TestCases/StorageDeviceSata
2 QA/TestCases/StorageDeviceScsi
2 QA:Testcase_Install_to_Pata_Device
2 QA:Testcase Anaconda iSCSI no authentication
2 QA:Testcase_Anaconda_partitioning_dmraid_rootfs

User Interface Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
1 QA/TestCases/UserInterfaceGraphical
1 QA/TestCases/UserInterfaceText
2 QA/TestCases/UserInterfaceVnc
2 QA/TestCases/UserInterfaceCmdline
2 QA/TestCases/UserInterfaceTelnet

Upgrade system Testing

Priority Test Case Architectures Bug(s)
i386 ppc x86_64
2 QA:Testcase_Anaconda_Upgrade_New_Bootloader
2 QA:Testcase_Anaconda_Upgrade_Skip_Bootloader
2 QA:Testcase_Anaconda_Upgrade_Update_Bootloader
2 QA:Testcase_Anaconda_Upgrade_Encrypted_Root
2 QA:Testcase_Preupgrade
2 QA:Testcase_Preupgrade_from_older_release