From Fedora Project Wiki

(redirect to the Nightly page (again, sorry for the mess))
 
(3 intermediate revisions by one other user not shown)
Line 1: Line 1:
This page is intended to record installation validation test results for f21-candidate nightly builds in the month of August 2014.
#REDIRECT [[Test_Results:Fedora_21_Nightly_2014_08_Install]]
 
{{Admon/tip|Not mandatory testing|This testing is not in any way mandatory, but rather precautionary / exploratory. No Fedora release depends on this testing being performed. Due to the longer Fedora 21 release cycle, we think it is a good idea to keep an eye on the status of the cadidates before we reach the Alpha milestone, however no-one should feel obliged in any way to participate in this testing, and certainly not to work excessively long, late or hard on it.}}
 
= Instructions =
 
This page tracks test results against August 2014 nightly f21-candidate builds.  Test results against other Fedora 21 milestones can be found at [[:Category:Fedora_21_Test_Results]].
 
== What To Test ==
 
* Tests requiring ''physical media'' (e.g. DVD or CD images) -- download the required f21-candidate nightly [http://koji.fedoraproject.org/koji/tasks?start=0&state=all&view=flat&method=createLiveCD&order=-id live image], [http://download.fedoraproject.org/pub/fedora/linux/development/21/x86_64/os/images/boot.iso x86_64] or [http://download.fedoraproject.org/pub/fedora/linux/development/21/i386/os/images/boot.iso i386] network install image, or [http://koji.fedoraproject.org/koji/tasks?method=createAppliance&state=all&view=flat&order=-id ARM] or [http://koji.fedoraproject.org/koji/tasks?method=createImage&state=all&view=flat&order=-id Cloud disk image]. If you use the network install image, enter the date on which you downloaded it as the 'build date' in your results (see [[#Key]].)
 
Note that if generation of the {{filename|boot.iso}} images fails for a given day, the file will not be present on the mirrors (the last successful compose is not retained). In this case, you just have to wait for a successful compose, or use one of the other images/methods described on this page.
 
== Add or Remove a Test Case ==
 
# Please request review for your changes by publishing your test case for review to [https://admin.fedoraproject.org/mailman/listinfo/test test list].
# Once reviewed, make your changes to this document
# Finally, update [[QA:Fedora_21_Install_Results_Template]] with the same changes.
 
== Key ==
 
See the table below for a sample format for test results. All test results are posted using the format specified [[Template:Result]].
 
{| class="wikitable collapsible" border="0" width="85%"
! colspan="3" style="background-color: grey;" | Test Results Format
|-
|-
! Test Result !! Explanation !! Code Entered
|-
| {{result|none}}
| ''Untested'' - This test has not been run, and is available for anyone to contribute feedback.
| <code><nowiki>{{result|none}}</nowiki></code>
|-
| {{result|pass|robatino}} 20140715
| ''Passed'' - The test has been run and the tester determine the test met the ''expected results''. The date of the build tested (not the date the test was run) should be included. <references/>
| <code><nowiki>{{result|pass|robatino}} 20140715</nowiki></code>
|-
| {{result|inprogress|adamwill}}
| ''Inprogress'' - An inprogress result is often used for tests that take a long time to execute.  Inprogress results should be temporary and change to pass, fail or warn.
| <code><nowiki>{{result|inprogress|adamwill}}</nowiki></code>
|-
| {{result|fail|jlaska|XYZ|ZXY}} 20140715
| ''Failed'' - Indicates a failed test.  A link to a bug must be provided.  See [[Template:Result]] for details on providing bug information. The date of the build tested (not the date the test was run) should be included.<references/>
| <code><nowiki>{{result|fail|jlaska|XYZ|ZXY}} 20140715</nowiki></code>
|-
| {{result|warn|rhe}} <ref>Brief description about the warning status</ref> 20140415
| ''Warning'' - This test completed and met the ''expected results'' of the test, but other issues were encountered during testing that warrant attention. The date of the build tested (not the date the test was run) should be included.<references/>
| <code><nowiki>{{result|warn|rhe}} <ref>Brief description about the warning status</ref> 20140715</nowiki></code>
|-
| {{result|pass|hongqing}} 20140715 {{result|warn|kparal}} 20140718
| ''Multiple results'' - More people can easily provide results to a single test case. <references/>
| <code><nowiki>{{result|pass|hongqing}} 20140715 {{result|warn|kparal}} 20140718</nowiki></code>
|-
| style="background:lightgrey;"|
| ''Unsupported'' - An unsupported test or configuration.  No testing is required.
|
|-
|}
 
= Test Matrix =
Please click ''[show]'' in each table to view the tests of each media installation, and click ''[edit]'' to post your test results using the syntax in [[#Key|Key Section]].
 
=== Image sanity ===
 
{| class="wikitable collapsible "  border="1" width="85%"
|-
! colspan="5" style="background-color: darkgreen;" | Image sanity tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! Release Level !! Test Case !! netinst x86<ref>'x86' means 'x86_64 or i386'</ref> !! Live x86 !! ARM !! Cloud
|-
| Alpha / Final
| [[QA:Testcase_Mediakit_Checksums]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
<references/>
 
=== Netinst image ===
 
{| class="wikitable collapsible "  border="1" width="85%"
|-
! colspan="5" style="background-color: yellow;" | netinst.iso (boot.iso) tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="15%"|Release Level !! width="15%"|Test Area !! width="40%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 !! width="10%"|EFI
|-
| Alpha
| Boot Methods
| [[QA:Testcase_Boot_Methods_Boot_Iso]]
| {{result|none}}{{result|pass|satellit}} 20140807 <ref>boot-f21-0807.iso (Soas) VirtualBox </ref>
| {{result|none}}
|-
|}
|}
 
<references/>
 
=== Live image ===
 
{| class="wikitable collapsible"  border="1" width="85%"
|-
! colspan="5" style="background-color: orange;" | Live.iso tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="15%"|Release Level !! width="15%"|Test Area !! width="40%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 !! width="10%"|EFI
|-
| Alpha
| Boot Methods
| [[QA:Testcase_Live_Image_Boot]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Repository
| [[QA:Testcase_install_repository_Live_Image]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
<references/>
 
=== USB stick ===
{| class="wikitable collapsible"  border="1" width="85%"
|-
! colspan="5" style="background-color: olive;" | USB stick tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="15%"|Release Level !! width="15%"|Test Area !! width="40%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 !! width="10%"|EFI
|-
| Alpha
| Boot Methods
| [[QA:Testcase_USB_stick_Live_luc|QA:Testcase_USB_stick_Live LiveUSB-creator]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Boot Methods
| [[QA:Testcase_USB_stick_Live_litd|QA:Testcase_USB_stick_Live Live-ISO-to-Disk]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Boot Methods
| [[QA:Testcase_USB_stick_Live_dd]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
<references/>
 
=== ARM disk images ===
 
In all of these tests, the test case used is [[QA:Testcase_arm_image_deployment]]. That is where the links point. The same test needs to be run for multiple images and target platforms.
 
{| class="wikitable collapsible"  border="1" width="85%"
|-
! colspan="5" style="background-color: lightyellow;" | ARM disk image functionality
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="10%"|Release Level !! width="25%"|Image !! width="10%"|Ext boot
|-
| Alpha
| [[QA:Testcase_arm_image_deployment|Minimal]]
| {{result|pass|pwhalen}}20140808
|-
| Alpha
| [[QA:Testcase_arm_image_deployment|KDE]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|Xfce]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|Desktop]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|LXDE]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|MATE]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_arm_image_deployment|SoaS]]
| {{result|none}}
|-
|}
|}
 
<references/>
 
=== Cloud images ===
 
{| class="wikitable collapsible"  border="1" width="85%"
|-
! colspan="5" style="background-color: cadetblue;" | Cloud images
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="15%"|Release Level !! width="40%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| [[QA:Testcase_EC2_AMI_Validation]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_OpenStack_Image_Validation]]
| {{result|none}}
| {{result|none}}
|}
|}
 
<references/>
 
=== PXE images ===
{| class="wikitable collapsible"  border="1" width="85%"
|-
! colspan="5" style="background-color: lightblue;" | PXE boot tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="35%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 !! width="10%"|ARM
|-
| Alpha
| Boot Methods
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
<references/>
 
=== Storage device tests ===
 
{| class="wikitable sortable" border="1"
! Release Level !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> !! ARM
|-
| Alpha
| [[QA:Testcase_install_to_SATA]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_install_to_PATA]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_install_to_SCSI]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_install_to_SAS]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_install_to_firmware_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_install_to_hardware_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_install_to_VirtIO]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_install_to_iSCSI_no_authentication]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_install_to_multipath]]
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_install_to_FCoE_target]]
| {{result|none}}
| {{result|none}}
|-
|}
 
<references/>
 
=== Storage volume type tests ===
 
==== Guided installation ====
 
{| class="wikitable sortable" border="1"
! Release Level !! Test Case !! x86 BIOS<ref>'x86' means 'x86_64 or i386'</ref> !! x86 UEFI !! ARM
|-
| Alpha
| [[QA:Testcase_partitioning_guided_empty]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_partitioning_guided_delete_all]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Alpha
| [[QA:Testcase_partitioning_guided_multi_select]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_partitioning_guided_delete_partial]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_partitioning_guided_free_space]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_partitioning_guided_encrypted]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_partitioning_guided_multi_empty_all]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
 
<references/>
 
==== Guided shrinking ====
 
For this test, the column headings refer to the storage volume type ''to be shrunk'', not the one chosen to replace it for the new installation.
 
{| class="wikitable sortable" border="1"
! Release Level !! Test Case !! LVM !! ext4 !! NTFS !! BTRFS
|-
| Final
| [[QA:Testcase_partitioning_guided_shrink]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
 
<references/>
 
=== General Tests ===
{| class="wikitable collapsible "  border="1" width="85%"
|-
! colspan="5" style="background-color: lightgreen;" | Install Variations & General Tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="15%"|Release Level !! width="15%"|Test Area !! width="30%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 !! width="10%"|EFI !! width="10%"|ARM
|-
| Alpha
| Package Set
| [[QA:Testcase_Package_Sets_Default_Package_Install]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| Package Set
| [[QA:Testcase_Package_Sets_KDE_Package_Install]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| Package Set
| [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Beta
| Partitioning
| [[QA:Testcase_Anaconda_custom_partitioning]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Beta
| Partitioning
| [[QA:Testcase_Partitioning_On_Software_RAID]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Final
| Partitioning
| [[QA:Testcase_dualboot_with_windows]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Final
| Partitioning
| [[QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Final
| Partitioning
| [[QA:Testcase_anaconda_ext3_rootfs_on_disk_partition]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Final
| Partitioning
| [[QA:Testcase_anaconda_xfs_rootfs_on_disk_partition]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Graphical]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Text]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_VNC]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_serial_console]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Alpha
| Install Repository
| [[QA:Testcase_install_repository_Mirrorlist_default]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| Install Repository
| [[QA:Testcase_install_repository_Mirrorlist_graphical]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| Install Repository
| [[QA:Testcase_install_repository_HTTP/FTP_graphical]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| Install Repository
| [[QA:Testcase_install_repository_HTTP/FTP_variation]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| Install Repository
| [[QA:Testcase_install_repository_NFS_graphical]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| Install Repository
| [[QA:Testcase_install_repository_NFS_variation]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Final
| Install Repository
| [[QA:Testcase_install_repository_NFSISO_variation]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Final
| Install Repository
| [[QA:Testcase_install_repository_Hard_drive_variation]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| Storage Devices
| [[QA:Testcase_Install_to_Previous_KVM]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| Storage Devices
| [[QA:Testcase_Install_to_Current_KVM]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Final
| Storage Devices
| [[QA:Testcase_Boot_Methods_Xen_Para_Virt]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| Recovery
| [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Alpha
| Recovery
| [[QA:Testcase_Anaconda_rescue_mode]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Alpha
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_URL]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Final
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_installation_source]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Final
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_local_media]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| Kickstart Delivery
| [[QA:Testcase_Kickstart_Http_Server_Ks_Cfg]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Beta
| Kickstart Delivery
| [[QA:Testcase_Kickstart_File_Path_Ks_Cfg]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| Kickstart Delivery
| [[QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| Kickstart Delivery
| [[QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
| Alpha
| User Creation
| [[QA:Testcase_Anaconda_user_creation]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Beta
| Upgrade system
| [[QA:Testcase_upgrade_fedup_cli_previous_desktop]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| Upgrade system
| [[QA:Testcase_upgrade_fedup_cli_previous_kde]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| Upgrade system
| [[QA:Testcase_upgrade_fedup_cli_previous_minimal]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Beta
| Upgrade system
| [[QA:Testcase_upgrade_fedup_cli_previous_desktop_encrypted]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
| Optional
| Boot Methods
| [[QA:Testcase_Install_Image_Boot_Local]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Optional
| Memory Test
| [[QA:Testcase_Memtest86]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Optional
| Recovery
| [[QA:Testcase_Anaconda_traceback_debug_mode]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
| Optional
| Partitioning
| [[QA:Testcase_Partitioning_No_Swap]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
|-
|}
|}
 
<references/>
 
[[Category:Fedora 21 candidate Test Results|I]]

Latest revision as of 16:11, 9 August 2014