From Fedora Project Wiki
m (Updated to adjust to rhe's latest draft)
 
(10 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{admon/note|DRAFT|This page is currently a draft.  It has not been finalized yet.  Stay tuned ...}}
{{draft}}
 
This page is intended to record [[QA:Fedora_14_Install_Test_Plan]] test results for the '''FIXME''' milestone.
 
= Instructions =
 
This page tracks test results against the Fedora 14 '''FIXME''' build.  Test results against other Fedora 14 milestones can be found at [[:Category:Fedora_14_Test_Results]].
 
== What To Test ==
 
* Tests requiring ''physical media'' (e.g. DVD or CD images) -- [http://serverbeach1.fedoraproject.org/pub/alt/stage  download the required ISO images].
* Unless otherwise noted, you may use nightly Fedora 14 ''branch'' install images.  [[Releases/Branched|Review for information on downloading and installing Branched]].
* For testers with limited bandwidth, ''deltaiso'' images are available.  For more information on creating or using delta ISOs, please refer to [[Delta_ISOs]].
 
{{admon/tip|Save bandwidth|If you already downloaded previous ''physical media'' ISO images, you can save time by [http://thepiratebay.org/user/andre14965/ downloading delta ISO images].}}
 
== Who's available ==
 
The following cast of characters will be available testing, workarounds, bug fixes, general discussion ...
* IRC: [irc://irc.freenode.net/fedora-qa #fedora-qa] on irc.freenode.net
* Quality Assurance - [[User:jlaska]] , [[User:Rhe]], [[User:Liam]], [[User:Robatino]]
 
== Add or Remove a Test Case ==
 
# Please request review for your changes by publishing your test case for review to [https://admin.fedoraproject.org/mailman/listinfo/test test list].
# Once reviewed, make your changes to this document
# Finally, update [[QA:Fedora_14_Install_Results_Template]] with the same changes.
 
== Post Test Results  ==
 
Want to share information about something you tested?  Please click ''edit'' to add test results.  All test results are posted using the format specified [[Template:Result]].
 
== Key ==
 
See the table below for a sample format for test results.
 
{| class="wikitable collapsible" border="0" width="85%"
! colspan="3" style="background-color: grey;" | Test Results Format
|-
|-
! Test Result !! Explanation !! Code Entered
|-
| {{result|none}}
| ''Untested'' - This test has not been run, and is available for anyone to contribute feedback.
| <code><nowiki>{{result|none}}</nowiki></code>
|-
| {{result|pass|liam}}
| ''Passed'' - The test has been run and the tester determine the test met the ''expected results''
| <code><nowiki>{{result|pass|liam}}</nowiki></code>
|-
| {{result|inprogress|adamwill}}
| ''Inprogress'' - An inprogress result is often used for tests that take a long time to execute.  Inprogress results should be temporary and change to pass, fail or warn.
| <code><nowiki>{{result|inprogress|adamwill}}</nowiki></code>
|-
| {{result|fail|jlaska|XYZ|ZXY}}
| ''Failed'' - Indicates a failed test.  A link to a bug must be provided.  See [[Template:Result]] for details on providing bug information. <references/>
| <code><nowiki>{{result|fail|jlaska|XYZ|ZXY}}</nowiki></code>
|-
| {{result|warn|rhe}} <ref>Brief description about the warning status</ref>
| ''Warning'' - This test completed and met the ''expected results'' of the test, but other issues were encountered during testing that warrant attention.<references/>
| <code><nowiki>{{result|warn|rhe}} <ref>Brief description about the warning status</ref></nowiki></code>
|-
| {{result|pass|rhe}} {{result|warn|kparal}}
| ''Multiple results'' - More people can easily provide results to a single test case.
| <code><nowiki>{{result|pass|rhe}} {{result|warn|kparal}}</nowiki></code>
|-
| style="background:lightgrey;"| {{testresult/none}} {{result|none}}
| ''Unsupported'' - An unsupported test or configuration.  No testing is required.
|
|-
|}
 
== Priority ==
 
The explanation of test case priority is available at [[QA:Fedora_14_Install_Test_Plan#Test_Priority]].
 
= '''Test Matrix''' =
Please click ''[show]'' in each table to view the tests of each media installation, and click ''[edit]'' to post your test results using the syntax in [[#Key|Key Section]]. 
 
=== Boot Iso ===
 
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: lightgreen;" | Boot.iso/Netinst.iso installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|fail|rhe|12345}}
| {{result|fail|rhe|12345}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|fail|rhe}} <ref name="54321">{{bz|54321}} - xxxx </ref>
| {{result|fail|rhe}} <ref name="54321" />
|-
| Alpha
| Boot Methods
| [[QA/TestCases/BootMethodsBootIso]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA/TestCases/InstallSourceBootIso]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase Additional Http Repository|QA:Testcase Http Repository]]
| {{result|none}}
| {{result|none}}
|-
|}
|}


=== DVD ===
=== DVD ===


{| class="wikitable collapsible collapsed"  border="1" width="85%"
{| class="wikitable collapsible"  border="1" width="85%"
|-  
|-  
! colspan="5" style="background-color: pink;" | DVD.iso installation
! colspan="5" style="background-color: pink;" | DVD.iso installation
Line 136: Line 15:
| Image Sanity
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|pass}} {{result|pass}}
| {{result|none}}
| {{result|pass}} {{result|pass}}
|-
|-
| Alpha
| Alpha
| Image Sanity
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
|-
|-
| Alpha
| Alpha
| Image Sanity
| Image Sanity
| [[QA:Testcase_Mediakit_Repoclosure]]
| [[QA:Testcase_Mediakit_Repoclosure]]
| {{result|none}}
| {{result|pass|robatino}} {{result|pass|kparal}}
| {{result|none}}
| {{result|pass}} {{result|pass}}
|-
|-
| Alpha
| Alpha
| Image Sanity
| Image Sanity
| [[QA:Testcase_Mediakit_FileConflicts]]
| [[QA:Testcase_Mediakit_FileConflicts]]
| {{result|none}}
| {{result|pass}} {{result|warn}}
| {{result|none}}
| {{result|pass}} {{result|pass}}
|-
|-
| Alpha
| Alpha
| Boot Methods
| Boot Methods
| [[QA/TestCases/BootMethodsDvd]]
| [[QA/TestCases/BootMethodsDvd]]
| {{result|none}}
| {{result|pass}} {{result|pass}}
| {{result|none}}
| {{result|pass}} {{result|pass}}
|-
|-
| Alpha
| Alpha
| Install Source
| Install Source
| [[QA/TestCases/InstallSourceDvd]]
| [[QA/TestCases/InstallSourceDvd]]
| {{result|none}}
| {{result|pass}} {{result|pass}}
| {{result|none}}
| {{result|pass}} {{result|pass}}
|-
|-
| Alpha
| Alpha
| Repository
| Repository
| [[QA:Testcase_Additional_CDDVD_Repository|QA:Testcase_DVD_Repository]]
| [[QA:Testcase Additional Http Repository]]
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|pass|mkrizek}}
|-
|}
|}
 
=== CD ===
 
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: yellow;" | CD.iso installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_Repoclosure]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_FileConflicts]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Boot Methods
| [[QA/TestCases/BootMethodsCdrom]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Install Source
| [[QA/TestCases/InstallSourceCdrom]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase_Additional_CDDVD_Repository|QA:Testcase_CD_Repository]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== Live Image ===
 
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: orange;" | Live.iso installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_Repoclosure]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_FileConflicts]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA:TestCases/Install Source Live Image]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== PXE Images ===
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: lightblue;" | Pxeboot installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Boot Methods
| [[QA/TestCases/BootMethodsPxeboot]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA/TestCases/InstallSourceHttp]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase_Additional_Mirrorlist_Repository|QA:Testcase_Mirrorlist_Repository]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== General Tests ===
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: lightgreen;" | Install Variations & General Tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Beta
| Boot Methods
| [[QA/TestCases/BootMethodsKVM]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Boot Methods
| [[QA/TestCases/BootMethodsXenParaVirt]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Boot Methods
| [[QA:Testcase_Boot_Methods_efidisk.img]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Memory Test
| [[memtest86+]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Graphical]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Text]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_VNC]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Cmdline]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_serial_console]]
| {{result|none}}
| {{result|none}}
|-
| Final
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Telnet]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Install Source
| [[QA/TestCases/InstallSourceNfs]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Install Source
| [[QA/TestCases/InstallSourceNfsIso]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA/TestCases/InstallSourceFtpAnonymous]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Install Source
| [[QA/TestCases/InstallSourceFtpNonAnonymous]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Install Source
| [[QA/TestCases/InstallSourceHardDrive]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA/TestCases/PartitioningUninitializedDisks]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA:Testcase_Anaconda_autopart_install]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(encrypted)_install]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(shrink)_install]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(use_free_space)_install]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA/TestCases/PartitioningExt4OnNativeDevice]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Partitioning
| [[QA/TestCases/PartitioningExt3OnNativeDevice]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Partitioning
| [[QA/TestCases/PartitioningExt2OnNativeDevice]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Partitioning
| [[QA/TestCases/PartitioningNoSwap]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Partitioning
| [[QA:Testcase_Partitioning_On_Software_RAID]]
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Alpha
| Repository
| Repository
| [[QA:Testcase Additional Ftp Repository]]
| [[QA:Testcase Additional Ftp Repository]]
| {{result|none}}
| {{result|fail}}
| {{result|none}}
| {{result|warn}}
|-
|-
| Alpha
| Alpha
| Repository
| Repository
| [[QA:Testcase Additional Mirrorlist Repository]]
| [[QA:Testcase Additional Mirrorlist Repository]]
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
|-
|-
| Beta
| Beta
| Repository
| Repository
| [[QA:Testcase Additional NFS Repository]]
| [[QA:Testcase Additional NFS Repository]]
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
|-
| Alpha
| Package Set
| [[QA/TestCases/PackageSetsDefaultPackageInstall]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Package Set
| [[QA/TestCases/PackageSetsMinimalPackageInstall]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Kickstart Delivery
| [[QA/TestCases/KickstartKsHttpServerKsCfg]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Kickstart Delivery
| [[QA/TestCases/KickstartKsFilePathKsCfg]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Kickstart Delivery
| [[QA/TestCases/KickstartKsHdDevicePathKsCfg]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Kickstart Delivery
| [[QA/TestCases/KickstartKsNfsServerPathKsCfg]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase_Anaconda_rescue_mode]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_URL]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_installation_source]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_local_media]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase Anaconda save traceback to remote system]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase Anaconda save traceback to bugzilla]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase Anaconda save traceback to disk]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Recovery
| [[QA:Testcase Anaconda traceback debug mode]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Storage Devices
| [[QA:Testcase_install_to_SATA_device]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Storage Devices
| [[QA:Testcase_install_to_SCSI_device]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Storage Devices
| [[QA:Testcase_install_to_PATA_device]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Storage Devices
| [[QA:Testcase_Install_to_BIOS_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Storage Devices
| [[QA:Testcase_Install_to_Hardware_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Storage Devices
| [[QA:Testcase_Anaconda_ISCSI_No_Authentication]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Anaconda_Upgrade_New_Bootloader]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Anaconda_Upgrade_Skip_Bootloader]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Anaconda_Upgrade_Update_Bootloader]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Anaconda_Upgrade_Encrypted_Root]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Preupgrade]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Preupgrade_low_/boot_disk_space_to_install]]
| {{result|none}}
| {{result|none}}
|-
|-
|}
|}
|}
|}
== References ==
<references/>

Latest revision as of 17:09, 7 December 2010

Warning.png
This page is a draft only
It is still under construction and content may change. Do not rely on the information on this page.

DVD

DVD.iso installation
Release Level Test Area Test Case i386 x86_64
Alpha Image Sanity QA:Testcase_Mediakit_ISO_Size
Pass pass
Pass pass
Pass pass
Pass pass
Alpha Image Sanity QA:Testcase_Mediakit_ISO_Checksums
Pass pass
Pass pass
Alpha Image Sanity QA:Testcase_Mediakit_Repoclosure
Pass pass robatino
Pass pass kparal
Pass pass
Pass pass
Alpha Image Sanity QA:Testcase_Mediakit_FileConflicts
Pass pass
Warning warn
Pass pass
Pass pass
Alpha Boot Methods QA/TestCases/BootMethodsDvd
Pass pass
Pass pass
Pass pass
Pass pass
Alpha Install Source QA/TestCases/InstallSourceDvd
Pass pass
Pass pass
Pass pass
Pass pass
Alpha Repository QA:Testcase Additional Http Repository
Pass pass jlaska
Pass pass mkrizek
Alpha Repository QA:Testcase Additional Ftp Repository
Fail fail
Warning warn
Alpha Repository QA:Testcase Additional Mirrorlist Repository
Pass pass
Pass pass
Beta Repository QA:Testcase Additional NFS Repository
Pass pass
Pass pass